This thing just repeats endlessly? ooba interface, is there some setting I need to change?
#1
by
qq67878980
- opened
As per title, this just repeats endlessly. ooba interface, is there some setting I need to change?
Yeah set rope frequency scale to 0.25.
With llama.cpp command line you'd use these arguments:
--rope-freq-base 10000 --rope-freq-scale 0.25
I assume there's a slider or input box on text-gen-UI to set those for the llama.cpp Loader.