Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Find a solution to database size increasing #4

Open
leo-holanda opened this issue Feb 10, 2024 · 0 comments
Open

Find a solution to database size increasing #4

leo-holanda opened this issue Feb 10, 2024 · 0 comments

Comments

@leo-holanda
Copy link
Owner

leo-holanda commented Feb 10, 2024

Until the database hits the free tier limit, its size will increase every time new jobs are inserted by the serverless functions. Then, it should stop working.

It can be said that it makes no significant difference whether saving new jobs in a database or just appending them in a compressed JSON file that is uploaded to R2 and requested by Cloudflare Workers. Because it is very unlikely that the job data will change after the job posting is closed.

To avoid exceeding the database free tier limit, there should be a solution where the jobs are automatically appended to a JSON file that is then saved in R2. There should be specific JSON files for each collection, i.e., webdev, qa, ai, etc. They should be compressed using zip and then decompressed at the client in an effort to increase download speed and, consequently, reduce page load time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant