rep_pen_slope in koboldcpp
#11
by
lightning-missile
- opened
Hello,
I'm new at local LLMs, I appologise in advance if my question is obvious.
First, I absolutely love this model. I am using it for generating stories.
I am applying your recommended settings in koboldcpp. One of the samplers that it has is the rep_pen_slope. Now I totally have no idea what this is. But in the case of koboldcpp, do you recommend turning this on? Since you have recommended settings for rep_pen and rep_pen_range, it seems like they are connected? The default value is 0.7.
Thanks!
I have never messed with the rep_pen slope before, so the default is probably fine. I'm glad you're enjoying the model!
sophosympatheia
changed discussion status to
closed