Recent weight update
#6
by
adamo1139
- opened
Hi,
Yi-6B-200k weights and config.json were updated a few days ago, similarly to Yi-34B-200k.
In the discussion page for Yi-34B-200K, 01.ai representative confirmed that long context performance of the model has been increased. discussion link. Yi-6B-200k repo was updated to inform about updates to Yi-34B-200k model but updates to Yi-6B-200k were not mentioned.
Has the same long context performance extension happened to Yi-6B-200k? Do you have any numbers for the increase in "Needle-In-A-Haystack" test?
@adamo1139 We are yet to make any announcements specifically on Yi-6B-200k, please stay tuned :)
adamo1139
changed discussion status to
closed