Mine is completely incoherent 😢
#4
by
CH1997
- opened
Downloaded una-xaberius-34b-v1beta.Q8_0.gguf from TheBloke, and installed like normal. First it just repeated the same tokens constantly, so I increased the frequency penalty. But now it just spits out word salat instead 😂
Console paste: https://justpaste.it/b38hk
I also tried different temperature settings from lowest to high
What's going wrong?
This comment has been hidden
This comment has been hidden
Your repetition penalty is crazy, set it to 1.0 - 1.05.
Your repetition penalty is crazy, set it to 1.0 - 1.05.
Here you go...
It's not the smartest, but least it's funny 😌
Use bartowski exllama2 files, im not sure what happened with thebloke quants :)
fblgit
changed discussion status to
closed