Training Task Experts through Retrieval Based Distillation
Paper
•
2407.05463
•
Published
•
6
Transfer Learning - FineTuning SFT - Instruction
-
-
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper • 2406.14491 • Published • 85 -
Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization
Paper • 2409.12903 • Published • 21 -
A Unified View of Delta Parameter Editing in Post-Trained Large-Scale Models
Paper • 2410.13841 • Published • 14