How to assess mean inference time using the Trainer.test?


I am interested in assessing the mean inference time per batch on the test set using the pytorch lightening framework. Is there a handy way to do that? (Haven’t seen a solution on Google)



Hello, my apology for the late reply. We are slowly converging to deprecate this forum in favor of the GH build-in version… Could we kindly ask you to recreate your question there - Lightning Discussions