Context length
#1
by
viren-takia
- opened
Amazing model, great work on the quantisation.
Question - What options / parameters need to be set (and how) to increase the context length.
Depending on where you're running it there'll be some value like "rope scale" or alpha, you should be able to set that to a higher number to increase context