-
Notifications
You must be signed in to change notification settings - Fork 2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add MLQA #2622
Add MLQA #2622
Conversation
I am not sure about the |
Found the error sending the updated commit as soon as possible |
Hi @KahnSvaer, this is great! small nit: the test failing as it's trying to parse Have you come across any papers which test these tasks on any transformer models? I can try to reproduce. But no worries if not. |
@baberabb The original paper for this benchmark https://arxiv.org/pdf/1910.07475 shows some tests on transformer models like M-Bert and XLM. |
LGTM! thanks for the PR! |
add mlqa_common_yaml
add 49 tests of mlqa family
update tasks/README.md
resolved: #192