Training student without training teacher

[thanhnt-2658]

I can see in your example that you train both teacher and student. However, is it ok to load pretrained teacher and train only student?

[Het-Shah]

Hi @thanhnt-2658! It is totally fine to pass in a pre-trained model as well. We do not initialize the teacher models internally. So it should not affect your pre-trained teacher network.