Wauplin HF staff commited on
Commit
f8269c9
1 Parent(s): 88bc4de

Add `hf_transfer` for faster download

Browse files

Hey there 👋
Apparently, this space takes a lot of time (~1h?) to initialize as it downloads heavy files at startup. To speed up initialization, you can try to use the new `hf_transfer` lib that should speed up downloads (up to 2x). It is a Rust-based library developed by

@Narsil

that will be integrated in next version of `huggingface_hub`. You can already get it from the `main` branch on Github. It is still experimental so feedback is very welcome here.

You must also set [HF_HUB_ENABLE_HF_TRANSFER=1](https://huggingface.co/docs/huggingface_hub/main/en/package_reference/environment_variables#hfhubenablehftransfer) as environment variable in the Space settings.

Related to [internal slack discussion](https://huggingface.slack.com/archives/C048K60MPNF/p1674067722665209).

Files changed (1) hide show
  1. requirements.txt +4 -0
requirements.txt CHANGED
@@ -1,6 +1,10 @@
1
  --extra-index-url https://download.pytorch.org/whl/cu113
2
  torch
3
  torchvision==0.13.1+cu113
 
 
 
 
4
  #diffusers
5
  git+https://github.com/huggingface/diffusers.git
6
  #transformers
 
1
  --extra-index-url https://download.pytorch.org/whl/cu113
2
  torch
3
  torchvision==0.13.1+cu113
4
+ # huggingface_hub
5
+ git+https://github.com/huggingface/huggingface_hub
6
+ # enable faster download speed in hfh
7
+ hf_transfer
8
  #diffusers
9
  git+https://github.com/huggingface/diffusers.git
10
  #transformers