Tracking Universal Features Through Fine-Tuning and Model Merging Paper • 2410.12391 • Published Oct 16 • 5
WebInstruct 🌐 Embeddings 🧱 Models Collection A collection of SoTA embeddings model fine-tuned on WebInstruct dataset to learn to pair instructions with its responses • 3 items • Updated Sep 4 • 11
Improving Text Embeddings for Smaller Language Models Using Contrastive Fine-tuning Paper • 2408.00690 • Published Aug 1 • 22
Emergent Linear Representations in World Models of Self-Supervised Sequence Models Paper • 2309.00941 • Published Sep 2, 2023 • 1
Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs Paper • 2309.07311 • Published Sep 13, 2023 • 2