Hyperparameters for GLUE benchmark

[ghost]

Hi ! Thank you for your great work. Would you be able to share the hyper-parameters used for the GLUE benchmark tasks ?

[paischer101]

Hi @roberto545, thank you for your interest in our work!
Please have a look at Table 18 in Appendix C.3 for the hyperparameters for all the different GLUE tasks.

[ghost]

Thanks very much ! Do you have training script for the GLUE task ?

[paischer101]

For the results in the paper, we incorporated EVA into the original LoRA codebase.
However, you should be able to run it easily with this code, simply replace the dataset with the respective GLUE task and the model with your desired model.