Please do not include original PTH files.
#10
by
Qubitium
- opened
Having the original pth files double the bandwidth cost and time. Please move the original pth to a separate model/repo. Thank you! I can image the 405B downloaders having a tough time syncing a 2TB repo.
Qubitium
changed discussion status to
closed
Qubitium
changed discussion status to
open
Use the ignore flag on the cli.
@BarraHome You mean the --exclude flag for hugging-cli? This should work but for those that are doing a git clone or shadow clone I don't think there is a skip option.
huggingface-cli download --exclude="*original*" does the trick
People shouldn't be doing simple git clones for HuggingFace Repos. Git cloning is slower than huggingface-cli. 🤔