Hello, how can we configure Lightning to switch from one optimizer to the second optimizer (e.g. Adam to SGD) when the validation loss stops improving for a certain number of validation epochs?
Kind of like EarlyStopping and its patience parameter, but switches optimizer instead of stop training.
Thank you!