Discord Server

#1
by Josephgflowers - opened

Cool, check in on your discord server once and a while, we would have been excited to know about the continued work.

What is the prompt format to be used for finetuning with custom Question answer dataset? Can someone share an example?

@vijaydeshpande Tinyllama generally uses the zephyr chat format. I say generally because the user, system, and assistant portions are not specific tokens (like llama3). So Tinyllama adapts well to other chat formats with training. The discord for tinyllama is moderately active https://discord.gg/mPpsevg9.

TinyLlama org

@Josephgflowers Thank you for your interest in TinyLlama! However, we currently have no plans for its continued development.

chaoscodes changed discussion status to closed

Sign up or log in to comment