Spaces:

huggingchat

/

chat-ui

like 1.06k

Running

I cant seem to add any custom models when running locally. how do you do this,

Is this section of the readme not enough ? Feel free to open a github issue and I'll see how I can help you there.

Is this section of the readme not enough ? Feel free to open a github issue and I'll see how I can help you there.

Thank you I added an Issue.

Check out my models-https://hf.co/chat/assistant/65c8539d02294f8760ccf784

Hi @victor @nsarrazin so i am trying to deploy mistral nemo on chatui in my personal huggingface space but i keep getting this error

2024-08-08T09:31:09.568296Z INFO text_generation_launcher: Download file: consolidated.safetensors
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080 after 0 ms: Connection refused
Warning: Problem : connection refused. Will retry in 10 seconds. 59 retries
Warning: left.
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080 after 0 ms: Connection refused
Warning: Problem : connection refused. Will retry in 10 seconds. 58 retries
Warning: left.
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (7) Failed to connect to 127.0.0.1 port 8080 after 0 ms: Connection refused
Warning: Problem : connection refused. Will retry in 10 seconds. 57 retries
Warning: left.

and this happening for many models it is not specific to this model, i reported this issue on github too while ago but nothing changed.
can you guys please help