Called by Lightning to restore your model. If you saved something with
on_save_checkpoint()this is your chance to restore this.
def on_load_checkpoint(self, checkpoint): # 99% of the time you don't need to implement this method self.something_cool_i_want_to_save = checkpoint['something_cool_i_want_to_save']
Lightning auto-restores global step, epoch, and train state including amp scaling. There is no need for you to restore anything regarding training.