Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Procedure for tracking annotation and adjudication #2

Open
nschneid opened this issue Jul 17, 2024 · 2 comments
Open

Procedure for tracking annotation and adjudication #2

nschneid opened this issue Jul 17, 2024 · 2 comments

Comments

@nschneid
Copy link
Contributor

I think the idea is that there will be a .cgel file for each sentence or small batch of sentences, with just the sentences initially. Individual annotators will fork and then submit PRs, and adjudication will be handled as merging the PRs.

We should have a convention for tracking annotators in the metadata too. How about using GitHub usernames and dates:

# tree_by = nschneid (2024-07-17), devika-tiwari (2024-07-19), devika-tiwari+nschneid (2024-07-22), rev. bwaldon (2024-07-25)

to show independent annotation, adjudication, and review phases

@bwaldon
Copy link
Collaborator

bwaldon commented Jul 17, 2024

I like that! Will update the example in oneoff to reflect this.

@nschneid
Copy link
Contributor Author

And maybe when we put up placeholder files we can specify the annotation plan, e.g.

# tree_by = nschneid (___), devika-tiwari (___), devika-tiwari+nschneid (___), rev. bwaldon (___)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants