model keeps timing out?

#83
by 0xHalo22 - opened

model keeps timing out; even on HF inference dashboard.

Screenshot 2024-11-07 at 12.52.16 PM.png

Same for me, please help fix the issue.

I met the same issue.

What's going wrong?

Hey guys, what's another solution to use while they don't solve it? Thanks.

Hey guys, what's another solution to use while they don't solve it? Thanks.

Run it local.

I started paying the other day just so I can use this model for creating Lyrics, as it's the best out there, now it's not working. Please fix!

Hi guys, I was building a chatbot with this API, please, do you know of another one that could replace it that is stable?

Hi guys, I was building a chatbot with this API, please, do you know of another one that could replace it that is stable?

I'm moving to bittensor MoDE API I think. this is still offline as of this posting

Same issue on my end.. 😢
Hoping that it gets resolved soon.

Hi guys, I was building a chatbot with this API, please, do you know of another one that could replace it that is stable?

Hi,

I swapped out Nemo-Instruct-2407 with mistralai/Mistral-7B-Instruct-v0.2 and this seemed to fix the problem.
No other alterations were made and my program is giving me similar performances.

Hope this helps! :)

Hi,

I tried mistralai/Mistral-7B-Instruct-v0.3 but that also went down. So, now I am also using mistralai/Mistral-7B-Instruct-v0.2 as it does not require any changes to the previous structure in my code.

any update?

Sign up or log in to comment