Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation on PER, LOC, ORG tag scheme and BIOES tag sheme and how to use BERT emeddings #129

Open
alimghl opened this issue Jul 13, 2019 · 1 comment

Comments

@alimghl
Copy link

alimghl commented Jul 13, 2019

Scenario: use My own RNN model (very simple model ) on my dataset by using (ORG, PER, LOC, O)tag scheme my model gives score about (F1 = 0.775) but when i use NCRFpp to train my model and it gives me F1 score = -1
and after debugging I changed my data format according to the requirement (BIOES tag sheme used)
and then it gives my very poor results (F1 = 0.554)
Q-1 how do you compute f1-Score replacing tag with original or just weighted average?
Q-2 if I want to use bert Embedding How can I use?

@baiziyuandyufei
Copy link

The tag Schema needs to be consistent with the format in the repository. For example:
Zine B-PER
al-Abidine I-PER
Ben I-PER
Ali E-PER

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants