Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

for NAF: check that nr terms == nr of tokens #15

Open
dafnevk opened this issue Nov 4, 2020 · 0 comments
Open

for NAF: check that nr terms == nr of tokens #15

dafnevk opened this issue Nov 4, 2020 · 0 comments

Comments

@dafnevk
Copy link

dafnevk commented Nov 4, 2020

NAF has a text layer for tokens (words) and a terms layers for terms, where in principle multiple tokens (New York) could form one term (New_York). However, as e2e works on token level but should be mapped to the terms, it only gives correct output if there are no multi-token terms. This is the case if we use stanza for creating the term layer.
We should check that this is the case if we read in NAF.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant