context length for Yi-1.5B-chat

#14
by hbhf - opened

what is the context length for "Yi-1.5-34B-Chat"? 4k?
For "Yi-1.5-34B-Chat-16k", I guess the context length is 16k. will there be a version of chat model for 32k context length?

01-ai org

Hello @hbhf our Yi-1.5-34B-Chat model is 4k, and there is also a 16k version: https://huggingface.co/collections/01-ai/yi-15-2024-05-663f3ecab5f815a3eaca7ca8 . However, our base model has a 32k version: https://huggingface.co/01-ai/Yi-1.5-34B-32K

01-ai org

Yes, Yi-1.5 in this repository has context length of 4096, as indicated in config.json -> max_position_embeddings.

what is the context length for "Yi-1.5-34B-Chat"? 4k?
For "Yi-1.5-34B-Chat-16k", I guess the context length is 16k. will there be a version of chat model for 32k context length?

lorinma changed discussion status to closed

Sign up or log in to comment