Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

doc about download / update #118

Open
jcohenadad opened this issue Sep 17, 2021 · 1 comment
Open

doc about download / update #118

jcohenadad opened this issue Sep 17, 2021 · 1 comment

Comments

@jcohenadad
Copy link
Member

here: https://github.com/neuropoly/data-management/blob/master/internal-server.md#download, can we consider:

  • mentioning that some datasets are SUPER big and that ppl might not want to run these commands (or they should check the size before doing so-- with instruction how to do it)
  • describing procedure to only download part of the dataset (eg git annex get sub-blabla*.*)
  • adding a section "update" that explains how to update the repository, also explaining that it is possible to update only the non-imaging files, eg with: "git pull" (am i correct @kousu ?)
@kousu
Copy link
Contributor

kousu commented Sep 17, 2021

  1. git tells you how large a download will be as it goes; however git-annex doesn't have an easy way to do the same, though it does keep size information around. We would have to write and package a small script that people could run after clone but before. Alternatively, we could get an estimate by adding another custom chart to netdata, but it would only be an estimate since it would count size used across all branches. In either case, there is no workable instruction right now.

    I think if we Considering plain git #68 then we can just lean on the estimate given at clone time: to find out the size of a dataset, just start downloading it. You can stop it if it says it's going to be too many gigs.

    Otherwise, we'll need to develop a bit of software.

  2. I handled in Remove sync --content from instructions #97: 8a88b3b

    But this is an advanced use-case and I think documenting it will mislead people more than help them.

  3. Document updates #119.

    I have reservations here too though. We should not be teaching people git. This should be at best a hand-book to the parts of git customized for our use-case.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants