Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Location lookup table #35

Open
skondrashov opened this issue Jan 8, 2018 · 0 comments
Open

Location lookup table #35

skondrashov opened this issue Jan 8, 2018 · 0 comments
Assignees

Comments

@skondrashov
Copy link
Owner

We should be able to perform fast lookup of tweet origin location names with a new table.

The new table should be generated in tweets.sql and filled by a manual script (or at the very least decoupled from archivist's main process) that checks for commonly duplicated lon/lat coordinates and enters metadata for those locations from a sample of tweets in that location.

This process will save space in the database (much fewer location entries than 1 per row) and be backwards-compatible with tweets we have already recorded - we can determine their location names at any time using a lookup against this new table.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants