USAGE INSTRUCTIONS FOR RESEARCH
NoisyStudent.ipynb is where the majority of the training code for the noisy student training method is. HuggingFaceTransformers.ipynb is where the intial teacher model was trained using pretrained models on huggingface ModelBenchmarking.ipynb is where different pretrained model versions were trained and benchmarked. Its an automated notebook just throw in the variables and hit run all.
The rest of the notebooks are as their names describe, and are data augmentation, EDA and others.