Best validation performance in multi-round training

[ali-akhavan89]

Hello,

I want to double-check my understanding of the best validation loss.

1. When doing multi-round SNPE training, the first validation loss is not comparable with the ones from the other rounds. Is my understanding correct?
2. Also, is there any meaningful information about the best validation loss for SNPE-C with atomic loss? For example, is 'Best validation performance: 0.02' in round 3 better than 'Best validation performance: 0.3' in round 11?
3. Finally, should I even compare the validation losses across training rounds and look for any patterns?

Update: I just learned the application of 'force_first_round_loss=True' and could see its impact on loss value (so I got my answer to my first question). But I would appreciate any feedback or comment anyone has. Thanks a lot!

Thank you,
Ali