Can you guys do distill LLaMa-3.1-70B-Instruct into LLaMa-3.1-8B-Instruct, or even better: LLaMa-3.1-405B-Instruct into LLaMa-3.1-8B-Instruct
#1
by
Joseph717171
- opened
Great model guys! I don't know if this is even feasible, but, if you guys could do a distillation of LLaMa-3.1-70B-Instruct into LLaMa-3.1-8B-Instruct, and/or LLaMa-3.1-405B-Instruct into LLaMa-3.1-8B-Instruct that would be amazing. 🤩
Coming today :)
Crystalcareai
changed discussion status to
closed
@Crystalcareai llama 3.1 1.5B Instruct would be awesome, too
@Crystalcareai llama 3.1 1.5B Instruct would be awesome, too
Yeah, I would love a Llama-3.1 model with that size!