openchat

/

openchat-3.5-0106-gemma

like 56

Follow

OpenChat 252

lemon-mint/openchat-gemma-gguf

The provided link by boxqkrtm is down so I found two other GGUF versions, but neither work for me using either GPT4ALL or koboldcpp. I pasted them below in case they work for someone else.

https://huggingface.co/gguf/openchat-3.5-0106-gemma-GGUF

https://huggingface.co/bartowski/openchat-3.5-0106-gemma-GGUF

Have baked it today: https://huggingface.co/pi-null-mezon/openchat-3.5-0106-gemma-GGUF

Works both in llama.cpp and in ollama

Thanks @pi-null-mezon it's the first to load in GPT4ALL v2.7.3, but has a token issue (see bellow). This has happened before with GGUFs that later worked properly after GPT4ALL was updated. It takes a while for it to use the latest llama.cpp.

"Thelyricisfromthesong“ILoveIt”byMeghanTrainorfeaturingNickiMinajandCharliePuth,whichwasreleasedin2016."