Instruct Meaning
What does Instruct mean? How is this different from a model without Instruct in the title?
Thanks!
Instruct models are base models with additional tuning to understand how to follow instructions
Base models (often just not tagged at all, sometimes called -base) are just basic text completion models, so if you want something coherent you have to really prime its context for it to just continue writing, and it won't be good at user/assistant back and forth without a bunch of in-context learning
Instruct models take the base model and tune it with the understanding of what it means to receive an instruction, and how to go back and forth with a user
Generally speaking, you'll almost never want to use a base model, and always use an instruct. Base may have some edge use cases but are mostly released with the intention of continuing the training and introducing your own data and your own chat/instruction following
Thanks. This helped me too. 🙏👍💥