Add gguf version

by rodion-m - opened Apr 30

Apr 30

Hi! It would nice to have gguf version of this embeddings to get an ability to run it from LM Studio.

izhx

Alibaba-NLP org May 6

Thanks for the suggestion, I will learn these tools and give it a shot!

Sep 1

Did you get anywhere with this @izhx ?

It would be really good to be able to use this with llama.cpp/ollama etc...

Sep 9

Needed llama.cpp NewModel implementation

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment