Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow for training without test set #85

Open
emanjavacas opened this issue Oct 28, 2017 · 4 comments
Open

Allow for training without test set #85

emanjavacas opened this issue Oct 28, 2017 · 4 comments
Labels

Comments

@emanjavacas
Copy link

Currently, tagger.py wouldn't run unless you provide all three splits. Especially for fine-tunning is highly recommendable to not use the test set, since that would actually lead to overfitting on the test set (since you are getting feedback from your model's performance on the test set). You can of course set the test split to be the same as the dev, then you are running the same evaluation twice, which is wasteful.

@emanjavacas
Copy link
Author

I just saw there is the include_test param in the config file. I guess that's is redundant with the fact of actually providing a path for --test... we could get rid of that config param.

@Jean-Baptiste-Camps
Copy link

In that case, we should do the same with include_dev too, right ?

@emanjavacas
Copy link
Author

yes, I think so

@PonteIneptique
Copy link
Member

I think this has been fixed by setup_from_disk but I might be wrong

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants