You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I stumbled upon a huggingface downloader written in Go which uses git LFS. It's fast. I get considerably faster transfer speeds than with aria2 or git-lfs, and it doesn't take 1,000 hours to reassemble the file like git-lfs does. The author distributes binaries for a number of platforms, as well (though IIRC they're not statically linked, not sure about that though). You may wish to switch to this from aria2 or add support for it.
Hello,
I stumbled upon a huggingface downloader written in Go which uses git LFS. It's fast. I get considerably faster transfer speeds than with aria2 or git-lfs, and it doesn't take 1,000 hours to reassemble the file like git-lfs does. The author distributes binaries for a number of platforms, as well (though IIRC they're not statically linked, not sure about that though). You may wish to switch to this from aria2 or add support for it.
https://github.com/bodaay/HuggingFaceModelDownloader
The text was updated successfully, but these errors were encountered: