I have experimented with the auto_lr_find option in the trainer, and it seems that it is affected by the initial value of self.learning_rate; I was surprised as I expected the lr finder to override the initial self.learning_rate. How does auto_lr_find depends on the initial learning rate? Thank you!
This question can be ignored. There is no dependence on initial learning rate- it was simply a bug in my program. Mods welcome to delete this. Thanks!
1 Like