Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: Add additional Glaux content #130

Draft
wants to merge 7 commits into
base: main
Choose a base branch
from
Draft

WIP: Add additional Glaux content #130

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
ea1ee2c
Refactor Glaux text extraction to use CTS resolver
jacobwegner Mar 23, 2023
a048797
Use scaife.perseus.org to resolve Glaux versions
jacobwegner Mar 23, 2023
9fe8e37
Small code cleanups
jacobwegner Mar 23, 2023
35e73f3
Load Xenophon - Apology
jacobwegner Mar 23, 2023
609b02b
Expand glaux token annotations
jacobwegner Mar 23, 2023
13eda2c
Expand glaux gloss mapping
jacobwegner Mar 23, 2023
914d456
Update ATLAS to support multi-valued TACs
jacobwegner Mar 23, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19,265 changes: 19,265 additions & 0 deletions backend/data/annotations/syntax-trees/glaux_syntax_trees_tlg0032.tlg005.perseus-grc2.json
View file
Open in desktop

Large diffs are not rendered by default.

4 changes: 3 additions & 1 deletion backend/data/annotations/token-annotations/glaux/metadata.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,4 +5,6 @@ metadata:
- name: Toon Van Hal et al.
role: Annotator
# TODO: refactor to bind to multiple files
values: tlg0032.tlg006.perseus-grc2.csv
values:
- tlg0032.tlg005.perseus-grc2.csv
- tlg0032.tlg006.perseus-grc2.csv
2,002 changes: 2,002 additions & 0 deletions backend/data/annotations/token-annotations/glaux/tlg0032.tlg005.perseus-grc2.csv
View file
Open in desktop

Large diffs are not rendered by default.

36 changes: 36 additions & 0 deletions backend/data/library/tlg0032/tlg005/metadata.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
{
"urn": "urn:cts:greekLit:tlg0032.tlg005:",
"group_urn": "urn:cts:greekLit:tlg0032:",
"node_kind": "work",
"lang": "grc",
"title": [
{
"lang": "eng",
"value": "Apology"
}
],
"versions": [
{
"urn": "urn:cts:greekLit:tlg0032.tlg005.perseus-grc2:",
"node_kind": "version",
"version_kind": "edition",
"lang": "grc",
"first_passage_urn": "urn:cts:greekLit:tlg0032.tlg005.perseus-grc2:1-5",
"citation_scheme": [
"section"
],
"label": [
{
"lang": "eng",
"value": "Apology"
}
],
"description": [
{
"lang": "eng",
"value": "Xenophon, creator; Xenophontis Opera omnia Volume II Oeconomicus, Convivium, Apologia Socratis; Marchant, E. C. (Edgar Cardew), 1864-1960, editor"
}
]
}
]
}
34 changes: 34 additions & 0 deletions backend/data/library/tlg0032/tlg005/tlg0032.tlg005.perseus-grc2.txt
View file
Open in desktop

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion backend/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,5 +12,5 @@ more_itertools==8.12.0
pandas==1.3.1
requests>=2.0.6
thefuzz==0.19.0
scaife-viewer-atlas @https://github.com/scaife-viewer/backend/archive/182743eff6f1bf58ac7f11e01496159ecce3b8e8.zip#subdirectory=atlas
scaife-viewer-atlas @https://github.com/scaife-viewer/backend/archive/389031acfb9ff993635a16b593f5519bb9be14d4.zip#subdirectory=atlas
whitenoise==4.1.4
250 changes: 0 additions & 250 deletions backend/scaife_stack_atlas/extractors/extract_glaux_text.py
View file
Open in desktop

This file was deleted.

7 changes: 5 additions & 2 deletions backend/scaife_stack_atlas/extractors/extract_glaux_token_annotations.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -227,7 +227,7 @@ def write_glaux_annotations(lookups, version_urn, tokens):

tag = data["tag"]
if tag:
# FIXME:
# FIXME: Check with Toon about b?
if tag == "b--------":
part_of_speech = ""
parse = "INDECL"
Expand All @@ -248,7 +248,10 @@ def get_lookups(version_urn):


def main():
version_urns = ["urn:cts:greekLit:tlg0032.tlg006.perseus-grc2:"]
version_urns = [
"urn:cts:greekLit:tlg0032.tlg005.perseus-grc2:",
"urn:cts:greekLit:tlg0032.tlg006.perseus-grc2:"
]
for urn_ in version_urns:
version_urn = URN(urn_)
tokens = Token.objects.filter(text_part__urn__startswith=version_urn)
Expand Down
Loading