Pytorch using ReduceLROnPlateau to update learning rates
Reason I wrote a Pytorch learning rate update, which feels based on whether the number of times the loss rises or falls to dynamically update the learning rate, I think it's a fun thing. I got it wrong for a long time, but I got it today! Analysis Explanation ReduceLROnPlateau(optimizer, mode='min', factor=0.1, patience=10, verbose......