How to checkpoint on multiple validation sets

My model has multiple validation sets, and each of them behaves the same way. I’m currently logging using:

self.log('val_loss', loss)

However, I noticed that the validation loss from each validation set is automatically added with a name ‘val_loss/dataloader_idx_1’. How to save checkpoints based on the average validation loss of all datasets in this case?

Hello, my apology for the late reply. We are slowly converging to deprecate this forum in favor of the GH build-in version… Could we kindly ask you to recreate your question there - Lightning Discussions