Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Persist document syncing thumbnails #290

Open
sgwilym opened this issue Dec 14, 2022 · 0 comments
Open

Persist document syncing thumbnails #290

sgwilym opened this issue Dec 14, 2022 · 0 comments

Comments

@sgwilym
Copy link
Contributor

sgwilym commented Dec 14, 2022

What's the problem you want solved?

In v10 Earthstar adopted range-based set reconciliation to make sync more efficient.

One of the steps of this methodology involves creating a large augmented red black tree which is able to produce 'fingerprints' for certain ranges of items.

Currently, this tree is created from scratch every time a replica is synced for the first time.

If a replica held a large number of documents, redoing this work every time could impact the experience of syncing.

It would be good to be able to persist these fingerprint trees between sessions in order to avoid redoing this work.

Is there a solution you'd like to recommend?

I'm not sure yet. Whatever method we'd choose would have to be careful not to let the documents on the replica and the document thumbnails on the fingerprint tree get out of sync.

@sgwilym sgwilym added enhancement New feature or request completeness help wanted Extra attention is needed figure out labels Dec 14, 2022
@sgwilym sgwilym added fixed by willow and removed help wanted Extra attention is needed figure out labels May 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant