Anthropic/hh-rlhf
Viewer
•
Updated
•
169k
•
8.44k
•
1.19k
Awesome feedback datasets
A curated list of datasets with human or AI feedback. Useful for training reward models or applying techniques like DPO.
Note The OG of open preference data. Not super great quality
berkeley-nest/Nectar
Viewer • Updated • 183k • 575 • 276Note NC
-
openbmb/UltraFeedback
Viewer • Updated • 64k • 1.59k • 330
Intel/orca_dpo_pairs
Viewer • Updated • 12.9k • 1.28k • 287Note A simple idea to just generate GPT-4 responses and treat them as preferred response.
Hello-SimpleAI/HC3
Viewer • Updated • 48.6k • 1.14k • 181Note Some parts are NC
-
lvwerra/stack-exchange-paired
Viewer • Updated • 31.3M • 3.08k • 140
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 6.51k • 124Note Computes the mean preference score instead of relying on the overall score from GPT-4. Also removes contamination from TruthfulQA prompts
nvidia/HelpSteer
Viewer • Updated • 37.1k • 2.7k • 216Note The dataset behind NVIDIA's SteerLM alignment method
-
jondurbin/truthy-dpo-v0.1
Viewer • Updated • 1.02k • 1.1k • 128 -
lmsys/chatbot_arena_conversations
Viewer • Updated • 33k • 570 • 336 -
hbXNov/sparse_feedback
Updated • 47 • 5 -
Unified-Language-Model-Alignment/Anthropic_HH_Golden
Viewer • Updated • 44.8k • 1.07k • 29 -
neovalle/H4rmony
Viewer • Updated • 2.02k • 113 • 15 -
PKU-Alignment/PKU-SafeRLHF
Viewer • Updated • 164k • 3.3k • 114 -
peiyi9979/Math-Shepherd
Viewer • Updated • 445k • 1.09k • 65 -
m-a-p/Code-Feedback
Viewer • Updated • 66.4k • 293 • 196 -
introspector/unimath
Updated • 6.76k • 6 -
abacusai/MetaMath_DPO_FewShot
Viewer • Updated • 395k • 121 • 25 -
interstellarninja/tool-calls-dpo
Viewer • Updated • 235 • 47 • 6