Missing files

#1
by do-me - opened

Hey, great work! I love your mission of bringing LLMs to the GPU-poor but CPU-rich masses. I am on a similar mission: I would like to use your bge models in with transformers.js in SemanticFinder but I currently cannot load them due to the following missing files:

  • special_tokens_map.json
  • vocab.txt
  • tokenizer_config.json

(also missing in sparse version)
Could you please add them?

Also, would you mind tagging all your onnx models with transformers.js too? I'm periodically mining all feature-extraction models so it would be cool if your models would then land in my data dump automatically. :)

Sign up or log in to comment