Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Round search #26

Open
wants to merge 173 commits into
base: v3
Choose a base branch
from
Open

Round search #26

wants to merge 173 commits into from

Conversation

D0ugins
Copy link

@D0ugins D0ugins commented Jan 22, 2023

Updates pgsync and implements searching rounds by cites and round report.
Cites are searched through pgsync, round reports are through postgres using LIKE queries
Filtering could be added to improve search

More advanced search could be implemented in the future, such as parsing round reports into separate speeches or separating cites into individual cites.

D0ugins added 30 commits July 27, 2022 21:00
With the roughly 200,000 files, there is a decent chance of a collision between two file ids. Switching to 64 bit lowers the chance to around 1/1000
Currently designed for development only.
Client is generated using openapi-generator-cli, can be run with yarn run generate
Uses the request based typescript-node generator because ones like typescript-axios are missing a lot of features
Online version of the schema is outdated
D0ugins added 30 commits January 9, 2023 14:42
tryBuild would retry the same path in different orders
Keep track of states with known return values across runs
Could implement bidirectional search if needed
Also now stores card length and SubBucket id in seperate keys
Allows using mget instead of repeated hgetall
Significant performance at the cost of 80 bytes per card, around 300MB with full dataset
Field to keep track of the updated_at time the caselist has for the currently stored version of a round
Periodically checks the /recent route of caselists for new updates and downloads them
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant