In particular if
- I am training with epochs
- I am training with iterations instead
For 1 is calling the scheduler every epoch the most common?
For 2 is calling the scheduler every 150 its the most common? (to approximate every epoch).
Or is whenever the validation loss is not decreasing anymore…?