training the teacher model

[Maaakabaka]

I am very interested in your experiment. Could you please let me which dataset was used to train your CIFAR-10 teacher model? Additionally, I would like to train a teacher model using a different dataset. Would it be possible for you to share the code for training the teacher model?

[rangwani-harsh]

Thank you @Maaakabaka for your interest.

We use the long-tailed data CIFAR-10 data itself to train the teacher, and don't use any additional data.

We use the following repository to train the LDAM teachers with SAM optimisation method:

https://github.com/val-iisc/Saddle-LongTail

The PaCo based teachers can be obtained by applying SAM on PaCo [ICCV 2021] method.

Please let me know in case you have any more questions.

Best,
Harsh