Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace Badger with Pebble DB on execution node #6939

Open
2 tasks
j1010001 opened this issue Jan 27, 2025 · 0 comments
Open
2 tasks

Replace Badger with Pebble DB on execution node #6939

j1010001 opened this issue Jan 27, 2025 · 0 comments
Assignees
Labels
Execution Cadence Execution Team

Comments

@j1010001
Copy link
Member

j1010001 commented Jan 27, 2025

Objective

Improving stability of execution node (reducing memory spikes) reduction operational overhead (memory cost, manual interventions).

Key Results:

  1. Enable automatic data pruning. (Badger DB does not support pruning, so on long-running network removing unused data requires node downtime & manual intervention).
  2. Reduce memory requirements (Badger compaction has caused memory spikes, performance issues and outages of Execution node in the past, so far mitigated with more aggressive GC GoMemLimit setting. As the load on the DB grows these issues are likely to reoccur in the future).
  3. Reduce the risk on unsupported SW. Badger DB is a project that is not actively maintained anymore. At some point it might not be compatible with a new version of Go, which would block the upgrade of flow-go to newer versions of Go language.

DACI

Role Assigned
Driver Technical: @zhangchiqing , EM: @j1010001
Approver @Kay-Zee
Consulted @AlexHentschel, @franklywatson
Informed Flow protocol Engineering team

Tasks

Preview Give feedback
  1. 2 of 19
    Execution
    j1010001 zhangchiqing

Stretch goals

Preview Give feedback
  1. 0 of 3
    Execution
    zhangchiqing
@j1010001 j1010001 changed the title Replace Badger with Pebble DB on EN Replace Badger with Pebble DB on execution node Jan 27, 2025
@j1010001 j1010001 added the Execution Cadence Execution Team label Jan 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Execution Cadence Execution Team
Projects
None yet
Development

No branches or pull requests

2 participants