Instruction Tuning Datasets - a skymizer Collection

skymizer 's Collections

Instruction Tuning Datasets

Pre-Training Datasets

Domain-Specific Datasets

Alignment Algorithm Papers

Other Awesome datasets

Instruction Tuning Datasets

updated 4 days ago

For both SFT and DPO

tatsu-lab/alpaca

Viewer • Updated May 22, 2023 • 52k • 26k • 704

Note SFT
elichen3051/alpaca52k-alignment-handbook

Viewer • Updated Jun 7 • 52k • 46 • 1
yahma/alpaca-cleaned

Viewer • Updated Apr 10, 2023 • 51.8k • 22.7k • 593

Note SFT
HuggingFaceH4/ultrachat_200k

Viewer • Updated Oct 16 • 515k • 12.6k • 477

Note SFT
openbmb/UltraFeedback

Viewer • Updated Dec 29, 2023 • 64k • 1.67k • 337

Note SFT
HuggingFaceH4/ultrafeedback_binarized

Viewer • Updated Oct 16 • 187k • 6.29k • 244

Note SFT; DPO
HuggingFaceH4/deita-10k-v0-sft

Viewer • Updated Mar 1 • 20k • 183 • 31

Note SFT
HuggingFaceH4/orca_dpo_pairs

Viewer • Updated Apr 14 • 12.9k • 174 • 25

Note DPO
HuggingFaceH4/cai-conversation-harmless

Viewer • Updated Feb 2 • 44.8k • 183 • 14

Note SFT; DPO
shahules786/orca-chat

Viewer • Updated Jul 25, 2023 • 198k • 162 • 110

Note SFT
lmsys/lmsys-chat-1m

Viewer • Updated Jul 27 • 1M • 36.1k • 602

Note SFT; DPO
What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning

Paper • 2312.15685 • Published Dec 25, 2023 • 17
HuggingFaceH4/no_robots

Viewer • Updated Apr 18 • 10k • 1.54k • 451

Note SFT
HuggingFaceH4/SystemChat

Viewer • Updated Mar 12 • 7.02k • 60 • 9
HuggingFaceH4/deita-6k-v0-sft

Viewer • Updated Jan 9 • 12k • 39
Open-Orca/OpenOrca

Viewer • Updated Oct 21, 2023 • 2.91M • 10.9k • 1.34k
Open-Orca/slimorca-deduped-cleaned-corrected

Viewer • Updated May 9 • 182k • 720 • 15
allenai/WildChat-1M

Viewer • Updated Oct 17 • 838k • 3.2k • 285
mlabonne/orpo-dpo-mix-40k

Viewer • Updated Oct 17 • 44.2k • 1.62k • 248
argilla/ultrafeedback-binarized-preferences-cleaned

Viewer • Updated Dec 11, 2023 • 60.9k • 8.31k • 125
argilla/distilabel-capybara-dpo-7k-binarized

Viewer • Updated Jul 16 • 7.56k • 961 • 175
argilla/OpenHermesPreferences

Viewer • Updated Mar 1 • 989k • 2.14k • 199

Note DPO
OpenAssistant/oasst2

Viewer • Updated Jan 11 • 135k • 1.44k • 215