Sleeping
1
💻
Direct Preference Optimization Datasets
Datasets suitable for DPO based on having 'chosen', 'rejected', and 'prompt' columns. Created using librarian-bots/dataset-column-search-api
Note This Space allows you to navigate through all the datasets in this collection and view their datasets viewer preview.
-
HuggingFaceH4/ultrafeedback_binarized
Viewer • Updated • 187k • 6.16k • 234 -
argilla/distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 875 • 173 -
allenai/reward-bench
Viewer • Updated • 8.11k • 7.1k • 73 -
Dahoas/rm-static
Viewer • Updated • 81.4k • 7.9k • 109 -
princeton-nlp/llama3-ultrafeedback
Viewer • Updated • 61.8k • 442 • 14 -
Dahoas/full-hh-rlhf
Viewer • Updated • 125k • 1.33k • 72 -
trl-internal-testing/hh-rlhf-helpful-base-trl-style
Viewer • Updated • 46.2k • 7.08k • 9 -
tasksource/oasst1_pairwise_rlhf_reward
Viewer • Updated • 18.9k • 96 • 42 -
mlabonne/orpo-dpo-mix-40k
Viewer • Updated • 44.2k • 1.36k • 242 -
trl-internal-testing/descriptiveness-sentiment-trl-style
Viewer • Updated • 10.9k • 4.79k • 1 -
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 6.51k • 124 -
princeton-nlp/mistral-instruct-ultrafeedback
Viewer • Updated • 62.7k • 180 • 2 -
allenai/ultrafeedback_binarized_cleaned
Viewer • Updated • 186k • 687 • 67 -
csarron/argilla-ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 62.9k • 45 • 1 -
princeton-nlp/llama3-ultrafeedback-armorm
Viewer • Updated • 61.8k • 700 • 13 -
yitingxie/rlhf-reward-datasets
Viewer • Updated • 81.4k • 552 • 60 -
HuggingFaceH4/testing_h4
Viewer • Updated • 70 • 92 -
CarperAI/openai_summarize_comparisons
Viewer • Updated • 260k • 3.05k • 38 -
sfanm/ultrafeedback_llama3_label
Viewer • Updated • 60k • 41 -
HuggingFaceH4/summarize_from_feedback
Viewer • Updated • 353k • 72 • 2 -
HuggingFaceH4/rlaif-v_formatted
Viewer • Updated • 83.1k • 276 • 2 -
zhengr/ultrafeedback_binarized
Viewer • Updated • 190k • 109 • 2 -
HuggingFaceH4/orca_dpo_pairs
Viewer • Updated • 12.9k • 148 • 24 -
Baidicoot/augmented_advbench_v4
Viewer • Updated • 4.95k • 38 -
xinlai/Math-Step-DPO-10K
Viewer • Updated • 10.8k • 650 • 27 -
arcee-ai/distilabel-intel-orca-dpo-pairs-binarized
Viewer • Updated • 12.9k • 691 • 1 -
nz/anthropic_hh_rlhf
Viewer • Updated • 169k • 55 -
trl-internal-testing/hh-rlhf-trl-style
Viewer • Updated • 169k • 399 • 10 -
ContextualAI/ultrabin_clean_max_chosen_rand_rejected
Viewer • Updated • 60.9k • 41 -
trl-internal-testing/sentiment-trl-style
Viewer • Updated • 5.48k • 369 -
trl-internal-testing/tldr-preference-trl-style
Viewer • Updated • 179k • 268 • 3 -
Syed-Hasan-8503/orpo-40k-train-test
Viewer • Updated • 44.2k • 49 -
allenai/preference-test-sets
Viewer • Updated • 43.2k • 977 • 18 -
maywell/ko_Ultrafeedback_binarized
Viewer • Updated • 62k • 63 • 28 -
SAGI-1/Greetings_DPO_dataset_V1
Viewer • Updated • 891 • 49 • 3 -
ContextualAI/ultrafeedback_binarized_1percent
Viewer • Updated • 200 • 300 -
HuggingFaceH4/cai-conversation-harmless
Viewer • Updated • 44.8k • 217 • 13 -
HuggingFaceH4/h4-tests-format-dpo-dataset
Viewer • Updated • 1 • 46 -
when2rl/tldr-summarisation-preferences_reformatted
Viewer • Updated • 177k • 63 -
Xalphinions/llama3_ultrafeedback_with_tie_armorm
Viewer • Updated • 61.8k • 38 -
mnoukhov/openai_summarize_comparisons_tldrprompt_relabel1b
Viewer • Updated • 97.5k • 58 -
alvarobartt/dpo-mix-7k-simplified
Viewer • Updated • 7.5k • 65 • 11 -
Magpie-Align/Magpie-Pro-DPO-200K
Viewer • Updated • 207k • 41 • 5 -
pharaouk/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 50 -
Xalphinions/UltraFeedback_with_tie_strict
Viewer • Updated • 65.1k • 40 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected
Viewer • Updated • 60.9k • 45 -
beyond/rlhf-reward-single-round-trans_chinese
Viewer • Updated • 24.9k • 114 • 37 -
mlabonne/orpo-dpo-mix-40k-flat
Viewer • Updated • 44.2k • 349 • 9 -
valerielucro/gsm8k_preference_dataset
Viewer • Updated • 895 • 44 -
Katayoon/SELM-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 63 -
trl-internal-testing/mlabonne-chatml-dpo-pairs-copy
Viewer • Updated • 12.9k • 68 -
yuasosnin/imdb-dpo
Viewer • Updated • 10k • 70 -
Xalphinions/UltraFeedback_with_tie
Viewer • Updated • 133k • 38 -
gx-ai-architect/HelpSteer2_DPO
Viewer • Updated • 7.59k • 56 • 1 -
yaswanthchittepu/ultrafeedback-binarized-standard-margin-data-full
Viewer • Updated • 63.7k • 44 -
smangrul/ultrachat-feedback-10k-chatml
Viewer • Updated • 12k • 54 -
Synadapt/Orpo_Split_Turns_v1_clean_ready
Viewer • Updated • 8.1k • 41 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part0
Viewer • Updated • 20k • 42 -
youjunhyeok/ko-orca-pair-and-ultrafeedback-dpo
Viewer • Updated • 72.5k • 93 • 2 -
xiaodongguaAIGC/awesome-dpo
Viewer • Updated • 302k • 65 • 2 -
Xalphinions/llama3_ultrafeedback_with_tie
Viewer • Updated • 61.8k • 39 -
pythainlp/oasst2_dpo_pairs_enth
Viewer • Updated • 5.28k • 48 • 1 -
banghua/tldr_reward_model_labeled
Viewer • Updated • 176k • 50 -
abhayesian/augmented_advbench_v5
Viewer • Updated • 4.95k • 46 -
cyberagent/chatbot-arena-ja-calm2-7b-chat-experimental
Viewer • Updated • 29.2k • 44 • 16 -
argilla/OpenHermesPreferences
Viewer • Updated • 989k • 4.85k • 198 -
snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset
Viewer • Updated • 62.7k • 130 • 42 -
Windy/4rewriter_simpo_distrib4_onraw
Viewer • Updated • 8.77k • 40 -
dinaaaaaa/lima_rand_sel_50_preference
Viewer • Updated • 500 • 41 -
yaswanthchittepu/ultrafeedback-binarized-pop-margin-data-full
Viewer • Updated • 63.7k • 42 -
kira/math-dpo
Viewer • Updated • 2.42k • 121 • 5 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part1
Viewer • Updated • 20k • 40 -
Columbia-NLP/DPO-HelpSteer
Viewer • Updated • 9.17k • 41 -
Windy/test_simpo_distrib4_onraw
Viewer • Updated • 14k • 36 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_pythia6.9b
Viewer • Updated • 177k • 61 -
nebchi/kor-orpo
Viewer • Updated • 98.1k • 48 • 1 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part2
Viewer • Updated • 21.1k • 40 -
Windy/ultr4_v3_t1_trlsft_mv1_ranksim_top1
Viewer • Updated • 15k • 40 -
aklein4/tldr-feedback
Viewer • Updated • 179k • 38 -
wenbopan/Chinese-dpo-pairs
Viewer • Updated • 10.7k • 101 • 37 -
HuggingFaceH4/grok-conversation-harmless
Viewer • Updated • 44.8k • 101 • 21 -
BramVanroy/ultra_feedback_dutch
Viewer • Updated • 53.6k • 112 • 2 -
ZHLiu627/ultrafeedback_binarized_with_response_full
Viewer • Updated • 61.1k • 64 -
RAY2L/llama3-ultrafeedback-mini
Viewer • Updated • 1.2k • 40 -
kaist-ai/Multifaceted-Collection-DPO
Viewer • Updated • 65.1k • 64 • 7 -
David-Xu/astronomy-stack-dpo-text
Viewer • Updated • 19.9k • 49 • 1 -
GitBag/multiturn-hh-turn-1-5
Viewer • Updated • 162k • 62 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_pythia1b
Viewer • Updated • 177k • 48 -
yhavinga/orpo-dpo-mix-dutch-40k
Viewer • Updated • 43.1k • 66 • 1 -
zekeZZ/hh-rlhf-dpo
Viewer • Updated • 51.9k • 59 -
Windy/test_simpo_distrib4
Viewer • Updated • 14k • 39 -
Windy/4rewriter_simpo_distrib4
Viewer • Updated • 8.77k • 38 -
Windy/4rewriter_simpo_distrib4_rankthresh4
Viewer • Updated • 3.21k • 37 -
argilla/ultrafeedback-multi-binarized-preferences-cleaned
Viewer • Updated • 158k • 204 • 6 -
GitBag/multiturn-512-hh-turn-1-5
Viewer • Updated • 165k • 61 • 1 -
trl-internal-testing/descriptiveness-trl-style
Viewer • Updated • 5.42k • 67 • 1 -
GrowingApple/orpo_kor_translated_medical
Viewer • Updated • 10.4k • 44 • 3 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144
Viewer • Updated • 179k • 58 -
minkyungpark/UFB_test_500
Viewer • Updated • 500 • 54 -
tasksource/tasksource_dpo_pairs
Viewer • Updated • 5.13M • 400 • 21 -
when2rl/SHP_reformatted
Viewer • Updated • 386k • 62 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_instruction_following
Viewer • Updated • 60.9k • 42 • 3 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1
Viewer • Updated • 20k • 41 -
tasksource/oasst2_pairwise_rlhf_reward
Viewer • Updated • 28.4k • 54 • 2 -
allenai/coconot
Viewer • Updated • 13.8k • 282 • 4 -
VictorDCh/spider-dpo-dataset
Viewer • Updated • 901 • 45 -
joshuasundance/mypo-4k-rfc
Viewer • Updated • 6.36k • 64 • 2 -
ZHLiu627/ultrafeedback_binarized_with_response_full_part0
Viewer • Updated • 20k • 35 -
Baidicoot/anthropic-harmless-rlhf
Viewer • Updated • 42.5k • 89 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_helpfulness
Viewer • Updated • 60.9k • 48 -
Windy/ultr4_v3_t1_trlsft_mv1_ranksim
Viewer • Updated • 7.11k • 37 -
nz/ulma_anthropic_hh_golden
Viewer • Updated • 44.8k • 49 -
ThWu/dpo_openhermes
Viewer • Updated • 183k • 45 • 6 -
droussis/UltraSafety_binarized-orpo-dpo
Viewer • Updated • 2.26k • 48 • 2 -
Baidicoot/anthropic-hh-rlhf
Viewer • Updated • 169k • 78 -
abacusai/MetaMath_DPO_FewShot
Viewer • Updated • 395k • 121 • 25 -
reciprocate/ultrafeedback_orca_math_dpo
Viewer • Updated • 73.8k • 42 • 1 -
trl-internal-testing/Anthropic-hh-rlhf-processed
Viewer • Updated • 3k • 44 -
stojchet/dpo-base_py_java
Viewer • Updated • 17.5k • 38 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_0
Viewer • Updated • 5.08k • 36 -
arcee-ai/general-dpo-datasets
Viewer • Updated • 91.6k • 115 -
zaddyzaddy/randomcrawl
Viewer • Updated • 100k • 38 -
lca0503/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 63 -
Windy/ultr4_v3_t1_ont0data
Viewer • Updated • 44.9k • 39 -
abhayesian/circuit-breakers-dataset
Viewer • Updated • 4.48k • 37 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1
Viewer • Updated • 19.6k • 37 -
JamesSpray/dpo_dataset_hh
Viewer • Updated • 24.2k • 46 -
iamnguyen/orpo-dpo-mix-translated
Viewer • Updated • 44.2k • 74 -
We-Want-GPU/Yi-Ko-DPO-dataset
Viewer • Updated • 4k • 37 • 4 -
lamhieu/itorca_dpo_vi
Viewer • Updated • 12.9k • 69 -
lamhieu/beyond_dpo_vi
Viewer • Updated • 25k • 72 -
arham6/dataset3
Viewer • Updated • 258 • 44 -
gabjp/PKU-safe-dpo
Viewer • Updated • 75.1k • 43 -
Windy/tmp_output
Viewer • Updated • 60 • 49 -
abacusai/ARC_DPO_FewShot
Viewer • Updated • 4.25k • 75 • 17 -
alexredna/oasst2_dpo_pairs
Viewer • Updated • 10k • 50 • 6 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2
Viewer • Updated • 20k • 43 -
2A2I/Aya-Command.R-DPO
Viewer • Updated • 14.2k • 65 • 7 -
kaist-ai/Multifaceted-Collection-ORPO
Viewer • Updated • 64.6k • 65 • 9 -
mii-community/ultrafeedback-preferences-translated-ita
Viewer • Updated • 60.9k • 66 • 3 -
orpo-explorers/OpenHermesPreferences-10k
Viewer • Updated • 10k • 35 • 2 -
BarraHome/ultrafeedback_binarized
Viewer • Updated • 187k • 214 -
when2rl/py-dpo-v0.1_reformatted
Viewer • Updated • 9.47k • 38 -
when2rl/Nectar_reformatted
Viewer • Updated • 183k • 42 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_truthfulness
Viewer • Updated • 60.9k • 46 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_minpi_part_3
Viewer • Updated • 21.1k • 40 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2
Viewer • Updated • 20k • 46 -
efederici/alpaca-vs-alpaca-orpo-dpo
Viewer • Updated • 49.2k • 92 • 6 -
IlyaGusev/saiga_preferences
Viewer • Updated • 30.6k • 211 • 4 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 568k • 126 -
lightblue/mitsu_top75_borda
Viewer • Updated • 2.02k • 45 -
thesven/pihkal-tihkal-orpo-dpo-dataset
Viewer • Updated • 3.46k • 44 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_honesty
Viewer • Updated • 60.9k • 39 -
mintaeng/dpo_ko_mj
Viewer • Updated • 3k • 54 -
AlexHung29629/stack-exchange-paired-128K
Viewer • Updated • 128k • 46 • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2
Viewer • Updated • 568k • 133 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_2
Viewer • Updated • 5.08k • 44 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_3
Viewer • Updated • 5.09k • 38 -
when2rl/UltraInteract_pair_reformatted_filtered
Viewer • Updated • 166k • 40 -
ineskoder/KIBRAM_dataset
Viewer • Updated • 72.2k • 37 -
wisenut-nlp-team/dpo_test2
Viewer • Updated • 100 • 43 -
YYYYYYibo/full_simple_online_train_part_2
Viewer • Updated • 19k • 40 -
YYYYYYibo/full_simple_online_train_part_3
Viewer • Updated • 19.3k • 37 -
YYYYYYibo/gshf_vllm_1_part_2
Viewer • Updated • 20k • 42 -
YYYYYYibo/gshf_vllm_2_part_2
Viewer • Updated • 20k • 37 -
YYYYYYibo/gshf_train_part_2
Viewer • Updated • 20k • 40 -
YYYYYYibo/gshf_vllm_2_part_3
Viewer • Updated • 21.1k • 37 -
RedaAlami/PKU-SafeRLHF-Processed-Modified
Viewer • Updated • 47.1k • 39 -
lightblue/mitsu_tophalf_borda
Viewer • Updated • 1.42k • 70 • 5 -
2A2I/Aya-SambaLingo.Arabic.Chat-DPO
Viewer • Updated • 14.2k • 75 • 3 -
Deojoandco/reward_model_anthropic
Viewer • Updated • 169k • 48 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706887192
Viewer • Updated • 405 • 41 -
ShenaoZhang/0.0_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 24k • 43 -
YYYYYYibo/eval-dataset-nash
Viewer • Updated • 1k • 51 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0
Viewer • Updated • 19.6k • 35 -
ShenaoZhang/0.0_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 2k • 44 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_3
Viewer • Updated • 5k • 42 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 36 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3
Viewer • Updated • 21.1k • 47 -
justinphan3110/toxic-dpo-v0.2-sft
Viewer • Updated • 540 • 47 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_0
Viewer • Updated • 5k • 43 -
We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs
Viewer • Updated • 12.7k • 61 • 5 -
ibivibiv/cleaned_orca_math_dpo_pairs
Viewer • Updated • 200k • 46 • 1 -
alvarobartt/ultrafeedback-multi-binarized-quality-preferences-cleaned
Viewer • Updated • 155k • 45 -
jan-hq/ultrafeedback_quality_binarized
Viewer • Updated • 155k • 61 -
Asap7772/ultrafeedback_binarized_relabelled_ultrarm
Viewer • Updated • 63.1k • 48 -
weijie210/UFB_prefs_iter_0
Viewer • Updated • 24.9k • 42 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 568k • 86 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_1
Viewer • Updated • 189k • 63 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_3
Viewer • Updated • 5k • 42 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 39 -
ShenaoZ/0.0005_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 37 -
Baidicoot/hh-rlhf-harmful-responses
Viewer • Updated • 14.9k • 48 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_1
Viewer • Updated • 5.18k • 36 -
YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_3
Viewer • Updated • 21.1k • 41 -
ibivibiv/cleaned_math_dpo_pairs
Viewer • Updated • 760k • 38 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3
Viewer • Updated • 21.1k • 39 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_3
Viewer • Updated • 5k • 36 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_3
Viewer • Updated • 5k • 38 -
wenzhy7/llama2_orpo_ei
Viewer • Updated • 2.05k • 38 -
abacusai/HellaSwag_DPO_FewShot
Viewer • Updated • 150k • 62 • 8 -
reshinthadith/pairwise-code-review-instruct-critique-revision-python
Viewer • Updated • 5.24k • 152 • 7 -
argilla/ultrafeedback-multi-binarized-quality-preferences-cleaned
Viewer • Updated • 155k • 51 • 4 -
orpo-explorers/ultrafeedback_binarized_15k
Viewer • Updated • 15.4k • 43 • 4 -
ThWu/dpo_highest_n_random
Viewer • Updated • 182k • 49 • 2 -
agicorp/MetaMath_DPO_FewShot
Viewer • Updated • 395k • 75 • 2 -
2A2I/Aya-AceGPT.13B.Chat-DPO
Viewer • Updated • 13k • 76 • 2 -
Trelis/orpo-dpo-mix-40k-SHORT
Viewer • Updated • 7.19k • 45 • 2 -
AlekseyKorshuk/cup-it-ds-pairwise
Viewer • Updated • 352k • 39 -
Code-Refinement/utf_20_refs_pairs
Viewer • Updated • 3.68k • 47 -
when2rl/distilabel-intel-orca-dpo-pairs_cleaned_reformatted
Viewer • Updated • 12.8k • 51 -
reciprocate/dpo_ultra-capybara_filtered-best
Viewer • Updated • 25.6k • 37 -
reciprocate/dpo_ultra-capybara-code_filtered-best
Viewer • Updated • 35.2k • 43 -
ShenaoZ/0.0_dataup_4iters_dataset
Viewer • Updated • 51.8k • 49 -
YYYYYYibo/ultrafeedback_binarized_phase_2_ranked
Viewer • Updated • 9.28k • 42 -
YYYYYYibo/eval-dataset-vanilla
Viewer • Updated • 200 • 43 -
YYYYYYibo/ultrafeedback_binarized_plus_vllm_part_3
Viewer • Updated • 5k • 37 -
vipinkatara/dataset_complete_12
Viewer • Updated • 220k • 40 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_1
Viewer • Updated • 5k • 43 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_0
Viewer • Updated • 4.8k • 38 -
ShenaoZ/0.00001_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 40 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_part1
Viewer • Updated • 19.6k • 38 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2
Viewer • Updated • 20.7k • 41 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_minpi_part_2
Viewer • Updated • 19.1k • 41 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_minpi_part_2
Viewer • Updated • 19.4k • 37 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_3
Viewer • Updated • 4.85k • 41 -
when2rl/PKU-SafeRLHF_reformatted_filtered
Viewer • Updated • 136k • 41 -
nhyha/ORPO-DPO
Viewer • Updated • 1.68k • 54 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_0
Viewer • Updated • 5k • 36 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_3
Viewer • Updated • 5k • 38 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_0
Viewer • Updated • 5k • 40 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_0
Viewer • Updated • 5.28k • 38 -
cmcmaster/clinical_cases_preferences
Viewer • Updated • 7.94k • 38 -
valerielucro/gsm8k_preference_dataset_2.1
Viewer • Updated • 1.21k • 37 -
quyanh/lexglue-cot-dpo
Viewer • Updated • 4k • 45 -
NickyNicky/function_call_orpo_sft_phi3_chatML_only
Viewer • Updated • 66k • 46 • 2 -
2A2I/Aya-Aya.23.8B-DPO
Viewer • Updated • 14k • 48 • 2 -
d0rj/oasst1_pairwise_rlhf_reward-ru
Viewer • Updated • 18.9k • 94 • 1 -
SUSTech/bagel-dpo
Viewer • Updated • 192k • 48 • 1 -
giux78/20000-50000-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 30k • 44 -
Astris/Nectar-Ranked-DPO
Viewer • Updated • 503k • 52 -
ShenaoZhang/0.0005_idpo_same_nodpo_replace_dataset
Viewer • Updated • 67.1k • 78 -
ShenaoZ/0.0001_idpo_same_6iters_dataset
Viewer • Updated • 48.8k • 51 -
trl-lib/capybara-preferencces-7k
Viewer • Updated • 7.56k • 44 -
ShenaoZ/0.001_ablation_5iters_bs256_dataset
Viewer • Updated • 56.9k • 52 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_0
Viewer • Updated • 1k • 39 -
YYYYYYibo/first-eval-dataset-no-score
Viewer • Updated • 1k • 37 -
YYYYYYibo/ultrafeedback_binarized_vllm_part_3
Viewer • Updated • 5k • 46 -
YYYYYYibo/ultrafeedback_binarized_train_part_3
Viewer • Updated • 26.1k • 38 -
four-two-labs/orpo-test
Viewer • Updated • 60.9k • 42 -
YYYYYYibo/ultrafeedback_binarized_plus_train_part_3
Viewer • Updated • 5k • 44 -
vipinkatara/dataset_complete_1
Viewer • Updated • 63.1k • 44 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_1
Viewer • Updated • 5k • 40 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_1
Viewer • Updated • 25k • 35 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_3
Viewer • Updated • 5k • 39 -
ShenaoZ/0.0001_withdpo_4iters_bs256_4444lr_dataset
Viewer • Updated • 51.8k • 38 -
YYYYYYibo/ultrafeedback_binarized_new_gen_part_3
Viewer • Updated • 5k • 36 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_3
Viewer • Updated • 5.19k • 40 -
ShenaoZ/0.0001_sft_nodpo_3iters_bs256_531lr_dataset
Viewer • Updated • 67.1k • 45 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_0
Viewer • Updated • 4.78k • 37 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_minpi_part_3
Viewer • Updated • 20.7k • 35 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_0
Viewer • Updated • 5.16k • 38 -
arcee-ai/ultrafeedback-binarized
Viewer • Updated • 60.9k • 51 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_3
Viewer • Updated • 5k • 39 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2
Viewer • Updated • 20k • 40 -
2A2I/NoRobots-Command.R-DPO
Viewer • Updated • 9.5k • 52 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 36 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_0
Viewer • Updated • 5.28k • 43 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 37 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_part_2
Viewer • Updated • 19.1k • 38 -
kaitchup/UltraFeedback-prompt-chosen-rejected
Viewer • Updated • 18k • 55 • 6 -
reciprocate/math_dpo_pairs
Viewer • Updated • 4.38k • 53 • 5 -
HuggingFaceH4/cai-conversation
Viewer • Updated • 169k • 54 • 3 -
We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs-lora
Viewer • Updated • 6k • 43 • 2 -
vicgalle/OpenHermesPreferences-roleplay
Viewer • Updated • 3.06k • 49 • 3 -
ZHLiu627/ultrafeedback_binarized_with_response_full_part1
Viewer • Updated • 20k • 40 • 1 -
Baidicoot/hh-rlhf-golden-harmful
Viewer • Updated • 7.64k • 59 • 1 -
ummagumm-a/cup-it-ds-classification-pairwise
Viewer • Updated • 282k • 99 -
pszemraj/SHP-2-dpo-100k_sample
Viewer • Updated • 200k • 135 • 1 -
floleuerer/distilabel-intel-orca-dpo-pairs-binarized
Viewer • Updated • 5.92k • 58 -
giux78/0-10000-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 10k • 40 -
weijie210/UFB_preference_iter_0_all
Viewer • Updated • 56.6k • 43 -
celinelee/thestack_py312_fstrings_dpo
Viewer • Updated • 100k • 45 -
manishiitg/aditi-dpo-prompts
Viewer • Updated • 48.7k • 40 • 1 -
mesolitica/DPO-translated-CodeUltraFeedback
Viewer • Updated • 7.17k • 60 -
ShenaoZ/0.001_ablation_4iters_bs256_decalpha_dataset
Viewer • Updated • 51.8k • 60 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_2
Viewer • Updated • 10k • 37 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_zephyrbeta_userresponse_dataset
Viewer • Updated • 67.1k • 38 -
ShenaoZ/0.001_ablation_4iters_bs256_only2third_dataset
Viewer • Updated • 2k • 40 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_part0
Viewer • Updated • 5k • 35 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_minpi
Viewer • Updated • 10k • 37 -
YYYYYYibo/ultrafeedback_binarized_phase_2
Viewer • Updated • 20k • 41 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_2
Viewer • Updated • 1k • 40 -
YYYYYYibo/ultrafeedback_binarized_phase_2_unranked
Viewer • Updated • 9.28k • 38 -
YYYYYYibo/ultrafeedback_binarized_phase_2_minpi
Viewer • Updated • 9.28k • 40 -
YYYYYYibo/ultrafeedback_binarized_train_part_2
Viewer • Updated • 25k • 37 -
GENIAC-Team-Ozaki/chatbot-arena-ja-calm2-7b-chat-experimental_deduped
Viewer • Updated • 23.3k • 48 -
YYYYYYibo/eval-dataset-rank4
Viewer • Updated • 200 • 40 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_3
Viewer • Updated • 26.1k • 39 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_train_part_2
Viewer • Updated • 18.6k • 41 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_minpi_part_3
Viewer • Updated • 20.5k • 37 -
ShenaoZ/0.00005_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 44 -
YYYYYYibo/ultrafeedback_binarized_new_train_part_2
Viewer • Updated • 15k • 36 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_0
Viewer • Updated • 5.18k • 41 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_3
Viewer • Updated • 5k • 39 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_0
Viewer • Updated • 5k • 40 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 36 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_0
Viewer • Updated • 5.18k • 41 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_0
Viewer • Updated • 5k • 39 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2
Viewer • Updated • 19.4k • 44 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 40 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_minpi_part_3
Viewer • Updated • 20.6k • 45 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3
Viewer • Updated • 20.6k • 41 -
ibivibiv/nectar_dpo_cleaned
Viewer • Updated • 3.84M • 122 -
euiyulsong/sci_train_ds
Viewer • Updated • 11.7k • 37 -
ibivibiv/cleaned_math_dpo_pairs_eval
Viewer • Updated • 40k • 42 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_0
Viewer • Updated • 5.28k • 37 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_1
Viewer • Updated • 5.28k • 37 -
mnlp-nsoai/dpo-student-preference-pairs
Viewer • Updated • 18.4k • 44 -
arham6/dataset2
Viewer • Updated • 258 • 38 -
aklein4/tldr-feedback-shuffled
Viewer • Updated • 179k • 66 -
fblgit/simple-math-DPO
Viewer • Updated • 800k • 137 • 16 -
malhajar/orca_dpo_pairs-tr
Viewer • Updated • 10.8k • 128 • 6 -
PawanKrd/dpo-gpt-4o
Viewer • Updated • 12.4k • 46 • 10 -
NickyNicky/oasst2_orpo_mix_function_call_phi_3_v1
Viewer • Updated • 120k • 46 • 2 -
d0rj/full-hh-rlhf-ru
Viewer • Updated • 125k • 78 • 2 -
lightblue/mitsu_full_borda
Viewer • Updated • 2.85k • 62 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1707245027
Viewer • Updated • 1M • 127 -
when2rl/distilabel-capybara-dpo-7k-binarized_reformatted
Viewer • Updated • 7.56k • 62 -
0-hero/distilabel-math-preference-dpo
Viewer • Updated • 2.42k • 50 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 189k • 49 -
Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 94.6k • 44 -
ShenaoZhang/0.001_idpo_ref_response
Viewer • Updated • 44.8k • 37 -
ShenaoZhang/0.001_idpo_same_replacechosen_only_dataset
Viewer • Updated • 44.8k • 40 -
when2rl/prm_dpo_pairs_cleaned_reformatted
Viewer • Updated • 7.99k • 39 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_4
Viewer • Updated • 10k • 36 -
cornfieldrm/prm800k-phase2
Viewer • Updated • 81.6k • 37 -
YYYYYYibo/ultrafeedback_binarized_phase_3
Viewer • Updated • 21.1k • 43 -
YYYYYYibo/ultrafeedback_binarized_minpi_part_3
Viewer • Updated • 5k • 48 -
ShenaoZ/0.00001_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 63 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_lora-sft-finetuned-stage4-iter86000
Viewer • Updated • 20.8k • 37 -
2A2I/NoRobots-Aya.23.8B-DPO
Viewer • Updated • 9.5k • 56 -
y1xing/orpo_llama3_concatenated_data_with_chris_examples_orpo_instruct_dataset
Viewer • Updated • 2.64k • 40 -
mlabonne/arena-preferences
Viewer • Updated • 2.69k • 54 • 9 -
reciprocate/ultrafeedback_orca_math_cleaned_high_dpo
Viewer • Updated • 48.3k • 45 • 1 -
SUSTech/bagel-sft
Viewer • Updated • 727k • 61 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1706885528
Viewer • Updated • 24 • 47 -
Sharathhebbar24/orca_dpo_pairs
Viewer • Updated • 12.9k • 49 -
quirky-lats-at-mats/NORMAL_BACKDOOR_alpaca_sleeper_agents_toy_safety_NOT_TRUNCATED_v4
Viewer • Updated • 2.83k • 36 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_2
Viewer • Updated • 568k • 104 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_1
Viewer • Updated • 189k • 56 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 568k • 161 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 189k • 43 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_3
Viewer • Updated • 189k • 69 -
pgurazada1/ultrafeedback-sample
Viewer • Updated • 315 • 60 -
UCLAML/data-RPO-Iter1-New-309_generated
Viewer • Updated • 20k • 46 -
NobodyExistsOnTheInternet/ToxicDPOqa
Viewer • Updated • 6.87k • 43 • 14 -
d0rj/rlhf-reward-datasets-ru
Viewer • Updated • 81.4k • 67 • 4 -
HuggingFaceH4/cai-conversation-harmless-old
Viewer • Updated • 44.8k • 102 • 3 -
allenai/reward-bench-results
Updated • 18k • 2 -
d0rj/synthetic-instruct-gptj-pairwise-ru
Viewer • Updated • 33.1k • 272 • 1 -
banghua/hh_reward_model_labeled
Viewer • Updated • 125k • 45 -
vwxyzjn/ultrafeedback_binarized_1707921333
Viewer • Updated • 2k • 59 -
vwxyzjn/ultrafeedback_binarized_1708458397
Viewer • Updated • 25.3k • 42 -
David-Xu/astronomy-stack-dpo-text-20-percent
Viewer • Updated • 3.99k • 40 • 1 -
abhinand/argilla-dpo-mix-7k-singleturn
Viewer • Updated • 4.9k • 46 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 568k • 195 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_2
Viewer • Updated • 568k • 192 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 568k • 187 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_3
Viewer • Updated • 568k • 181 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3
Viewer • Updated • 568k • 88 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 189k • 41 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 511k • 130 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 189k • 60 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_2
Viewer • Updated • 189k • 56 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_3
Viewer • Updated • 189k • 42 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 95 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.5
Viewer • Updated • 568k • 102 -
ShenaoZ/0.001_ablation_4iters_bs256_useresponse_dataset
Viewer • Updated • 17.3k • 40 -
ShenaoZhang/0.0001_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 62k • 41 -
ShenaoZ/0.0001_withdpo_4iters_bs256_511lr_dataset
Viewer • Updated • 51.8k • 41 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_2
Viewer • Updated • 5k • 37 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_1
Viewer • Updated • 5.16k • 37 -
euiyulsong/generated_data
Viewer • Updated • 452 • 41 -
arcee-ai/truthy-dpo-v0.1-binarized
Viewer • Updated • 1.02k • 45 -
arcee-ai/OpenHermesPreferences-binarized
Viewer • Updated • 989k • 59 • 1 -
arcee-ai/multiturn-capybara-preferences-filtered-binarized
Viewer • Updated • 14.8k • 58 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_2
Viewer • Updated • 5k • 42 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_1
Viewer • Updated • 5k • 37 -
when2rl/HelpSteer_reformatted
Viewer • Updated • 9.17k • 45 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 39 -
YYYYYYibo/full_simple_online_vllm_part_2
Viewer • Updated • 19k • 40 -
YYYYYYibo/full_simple_online_vllm_part_3
Viewer • Updated • 19.3k • 37 -
YYYYYYibo/gshf_vllm_1_part_3
Viewer • Updated • 21.1k • 36 -
YYYYYYibo/gshf_train_part_3
Viewer • Updated • 21.1k • 36 -
BramVanroy/orca_dpo_pairs_dutch
Viewer • Updated • 11k • 72 • 5 -
erhwenkuo/rlhf_reward_single_round-chinese-zhtw
Viewer • Updated • 24.9k • 45 • 3 -
alielfilali01/ultrafeedback-arabic
Viewer • Updated • 63.1k • 42 • 2 -
Palash123/dpo_anthropic_hh_rlhf
Viewer • Updated • 168k • 70 • 1 -
ayoubkirouane/Orca-Direct-Preference-Optimization
Viewer • Updated • 12.9k • 42 • 1 -
winglian/cortex-0_1-loss
Viewer • Updated • 402 • 47 • 1 -
vtiyyal1/AskDocsEmpathy_4k_dpo
Viewer • Updated • 4.12k • 42 • 1 -
ummagumm-a/cup-it-ds-classification-pairwise-test
Viewer • Updated • 56k • 59 -
AlekseyKorshuk/lmeh-hh
Viewer • Updated • 12.5k • 46 -
genta-tech/rlhf-id-30
Viewer • Updated • 125k • 53 -
vwxyzjn/cai-conversation-prod-h4-harmless
Viewer • Updated • 44.9k • 56 -
giux78/10000-20000-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 10k • 50 -
giux78/50000-60900-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 10.9k • 39 -
vwxyzjn/cai-conversation-dev1705951688
Viewer • Updated • 256 • 58 -
manishiitg/unalignment-toxic-dpo-v0.2
Viewer • Updated • 1.08k • 48 -
remyxai/ffmperative_dpo_test
Viewer • Updated • 1.47k • 49 -
weijie210/UFB_prefs_nosub_iter_0
Viewer • Updated • 14.7k • 44 -
when2rl/UltraFeedback_binarized_cleaned_annotated
Viewer • Updated • 62.7k • 59 -
roleplay4fun/chai-valid-pairs-ss5-v1.0
Viewer • Updated • 12.2k • 37 -
Baidicoot/anthropic_hh_golden_mistral
Viewer • Updated • 42.1k • 38 -
psyche/anthropic-hh-rlhf
Viewer • Updated • 169k • 48 -
aengusl/noise5_alpaca_sleeper_agents_toy_safety_v4
Viewer • Updated • 2.83k • 37 -
vtiyyal1/AskDocsEmpathy_2k_llama_dpo
Viewer • Updated • 2.12k • 47 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_2
Viewer • Updated • 568k • 89 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 189k • 45 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 189k • 73 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 189k • 52 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_3
Viewer • Updated • 189k • 46 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1_t_1.0
Viewer • Updated • 568k • 82 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_3_t_1.0
Viewer • Updated • 568k • 81 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3_t_1.0
Viewer • Updated • 568k • 115 -
Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 94.6k • 47 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.5
Viewer • Updated • 568k • 66 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.25
Viewer • Updated • 568k • 84 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.7
Viewer • Updated • 568k • 109 -
ShenaoZ/0.0001_idpo_same_3iters_dataset
Viewer • Updated • 44.8k • 39 -
ShenaoZ/0.0001_idpo_same_3itersn_dataset
Viewer • Updated • 44.8k • 45 -
ShenaoZ/0.001_ablation_4iters_dataset
Viewer • Updated • 17.3k • 40 -
ShenaoZ/0.001_ablation_dataset
Viewer • Updated • 44.8k • 51 -
orpo-explorers/OHP-15k-Stratified-3
Viewer • Updated • 15k • 44 -
distilabel-internal-testing/ultrafeedback-mini-dpo
Viewer • Updated • 10 • 45 -
ShenaoZ/0.001_ablation_3iters_bs256_nodpo_dataset
Viewer • Updated • 67.1k • 58 -
ShenaoZhang/0.0_ablation_4iters_bs128_nodpo_dataset
Viewer • Updated • 53.8k • 55 -
ShenaoZ/0.001_4iters_bs128_declr_nodpo_useresponse_dataset
Viewer • Updated • 69.1k • 53 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_dataset
Viewer • Updated • 24.4k • 36 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_4
Viewer • Updated • 303k • 64 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_4
Viewer • Updated • 303k • 92 -
ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_zephyr_dataset
Viewer • Updated • 48k • 44 -
theGhoul21/dpo-dataset-v2
Viewer • Updated • 4.83k • 40 -
ShenaoZ/0.0_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 40 -
theGhoul21/irpo-dataset-v1
Viewer • Updated • 11k • 51 -
YYYYYYibo/eval-dataset-with-score-nash
Viewer • Updated • 200 • 36 -
YYYYYYibo/eval-dataset-with-score-rank4
Viewer • Updated • 200 • 46 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_1
Viewer • Updated • 5k • 37 -
ShenaoZ/0.0_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 90 -
ShenaoZ/0.0001_withdpo_4iters_bs256_3333lr_dataset
Viewer • Updated • 51.8k • 43 -
ShenaoZ/0.0001_zephyrdpoinit_nodpo_3iters_bs256_555lr_dataset
Viewer • Updated • 67.1k • 36 -
ashishkgpian/kaggle_comp_dpo
Viewer • Updated • 39.7k • 40 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_3
Viewer • Updated • 4.9k • 41 -
Baidicoot/helpful-harmful-rlhf
Viewer • Updated • 161k • 43 -
massimilianowosz/japanese_food
Viewer • Updated • 4.69k • 41 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_3
Viewer • Updated • 5.09k • 40 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 37 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_2
Viewer • Updated • 4.4k • 39 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_2
Viewer • Updated • 4.85k • 38 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_1
Viewer • Updated • 4.85k • 45 -
when2rl/hh-rlhf_reformatted
Viewer • Updated • 169k • 39 -
ShenaoZ/0.001_withdpo_4iters_bs256_5551lr_dataset
Viewer • Updated • 51.8k • 64 -
Baidicoot/anthropic-rlhf-eval
Viewer • Updated • 2.31k • 46 -
euiyulsong/arc_easy
Viewer • Updated • 2.25k • 43 -
Aditya685/dpo_data
Viewer • Updated • 3.15k • 54 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_2
Viewer • Updated • 5k • 36 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 48 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v3_full-sft-finetuned-stage4-iter86000-v3
Viewer • Updated • 19.3k • 40 -
2A2I/NoRobots-SambaLingo.Arabic.Chat-DPO
Viewer • Updated • 9.5k • 61 -
WKLI22/orpo-dpo-mix-zh-40k
Viewer • Updated • 44.2k • 42 -
d-llm/hh-rlhf
Viewer • Updated • 160k • 39 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_2
Viewer • Updated • 5k • 38 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_1
Viewer • Updated • 5.28k • 41 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_2
Viewer • Updated • 5.28k • 42 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_minpi_part_2
Viewer • Updated • 20k • 44 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3
Viewer • Updated • 21.1k • 40 -
vicgalle/configurable-system-prompt-multitask
Viewer • Updated • 1.95k • 159 • 19 -
Dahoas/rm_instruct_helpful_preferences
Viewer • Updated • 90.7k • 49 • 4 -
Dahoas/instruct_helpful_preferences
Viewer • Updated • 111k • 90 • 1 -
eryk-mazus/polka-dpo-v1
Viewer • Updated • 7.06k • 59 • 1 -
Baidicoot/harmful-rlhf
Viewer • Updated • 42.5k • 40 • 1 -
AlekseyKorshuk/davinci-pairwise-medium
Viewer • Updated • 72k • 72 -
AlekseyKorshuk/cup-it-ds-pairwise-small
Viewer • Updated • 17.6k • 105 -
TaylorAI/rlcd
Viewer • Updated • 168k • 39 -
abhishek/dpo-sample
Viewer • Updated • 7 • 42 -
orendar/ultrafeedback_binarized_filtered
Viewer • Updated • 27.2k • 42 -
varun-v-rao/mimic_cxr_dpo
Viewer • Updated • 125k • 43 -
dvilasuero/ultrafeedback-followup
Viewer • Updated • 6k • 41 • 1 -
dvilasuero/multiturn_with_generations
Viewer • Updated • 100 • 41 -
reciprocate/pku_safer_dpo_pairs
Viewer • Updated • 51.8k • 42 -
vwxyzjn/cai-conversation-dev1705525723
Viewer • Updated • 256 • 48 -
CognitiveLab/hh-rlhf-formatted-60000
Viewer • Updated • 60k • 49 -
vwxyzjn/cai-conversation-dev1705633234
Viewer • Updated • 256 • 66 -
vwxyzjn/self-reward-dev1706043619
Viewer • Updated • 16 • 70 -
vwxyzjn/self-reward-dev1706112590
Viewer • Updated • 16 • 52 -
SUSTech/bagel-clean
Viewer • Updated • 799k • 52 -
Asap7772/ultrafeedback_binarized_narrow
Viewer • Updated • 60.7k • 49 -
dkshjn/processed_truthy-v2
Viewer • Updated • 1.02k • 42 -
weijie210/UC_prefs_nosub_iter_0
Viewer • Updated • 14.4k • 45 -
nz/highest-number-rlhf
Viewer • Updated • 84k • 50 -
weijie210/gsm8k_dpo
Viewer • Updated • 5.48k • 56 -
nz/100_rlhf
Viewer • Updated • 107k • 42 -
vwxyzjn/ultrafeedback_binarized_1707920039
Viewer • Updated • 2k • 47 -
macadeliccc/distilabel-neurology-preferences-2k-cleaner
Viewer • Updated • 1.99k • 54 -
cassanof/python_pass_fail_sample
Viewer • Updated • 100 • 46 -
NickyNicky/distilabel-intel-orca-dpo-pairs_gemma_chatml
Viewer • Updated • 12.9k • 40 -
jikaixuan/mistral02_generated
Viewer • Updated • 61.1k • 62 -
Baidicoot/anthropic_hh_golden_llama
Viewer • Updated • 42.1k • 40 -
arianhosseini/summ_dpo1b1_ngen10_minmax
Viewer • Updated • 20k • 37 -
nz/closest_to_7000_range_1000_to_9000
Viewer • Updated • 11k • 58 -
David-Xu/astronomy-stack-cira
Viewer • Updated • 19.9k • 45 -
boopysaur/user2-dpo-small
Updated • 37 -
David-Xu/astronomy-stack-dpo-20-percent
Viewer • Updated • 3.99k • 44 -
aengusl/test_hp_dpo_unlrn_ds
Viewer • Updated • 312 • 43 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.2_self_70m
Viewer • Updated • 37.9k • 41 -
valerielucro/Preference-Dataset-sample
Viewer • Updated • 525 • 35 -
mesolitica/DPO-malaysian-questions
Viewer • Updated • 32.5k • 62 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_1
Viewer • Updated • 568k • 101 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 568k • 123 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 568k • 124 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_2
Viewer • Updated • 189k • 48 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3_t_1.0
Viewer • Updated • 568k • 90 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.25
Viewer • Updated • 568k • 77 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.9
Viewer • Updated • 568k • 79 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.9
Viewer • Updated • 568k • 76 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 156 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.3
Viewer • Updated • 568k • 144 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.5
Viewer • Updated • 568k • 68 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1_t_1.0_eval
Viewer • Updated • 568k • 116 -
ShenaoZ/0.0_dataup_dataset
Viewer • Updated • 44.8k • 41 -
Gopal2002/zephyr-gemma-finetune-dpo
Viewer • Updated • 69 • 40 -
AnushaKulkarni/preferred_dataset
Viewer • Updated • 50 • 40 -
thavens/ufb_mini
Viewer • Updated • 160 • 39 -
guoyu-zhang/hh_llama2
Viewer • Updated • 125k • 40 -
guoyu-zhang/usp_1
Viewer • Updated • 1k • 40 -
ShenaoZ/0.0_ablation_4iters_dataset
Viewer • Updated • 17.3k • 39 -
ShenaoZ/0.000001_ablation_dataset
Viewer • Updated • 44.8k • 44 -
ShenaoZ/0.0001_ablation_4iters_bs256_dataset
Viewer • Updated • 51.8k • 37 -
YYYYYYibo/ultrafeedback_binarized_with_response_full
Viewer • Updated • 61.1k • 40 -
UCLAML/RPO-Iter2-New-312_generated
Viewer • Updated • 20k • 40 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_0
Viewer • Updated • 10k • 40 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_1
Viewer • Updated • 10k • 39 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_3
Viewer • Updated • 10k • 38 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_5
Viewer • Updated • 10k • 35 -
YYYYYYibo/ultrafeedback_binarized_without_ranked
Viewer • Updated • 10k • 38 -
ShenaoZ/0.001_3iters_bs256_declr_nodpo_userresponse_dataset
Viewer • Updated • 67.1k • 45 -
NickyNicky/mlabonne_orpo-dpo-mix-40k
Viewer • Updated • 44.2k • 39 -
lightblue/mitsu_top25_borda
Viewer • Updated • 674 • 42 -
theGhoul21/dpo-dataset
Viewer • Updated • 4.82k • 41 -
communityai/system_identity_remove_preference_microsoft
Viewer • Updated • 93 • 39 -
ShenaoZhang/0.001_2iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 65.1k • 44 -
YYYYYYibo/first-dpo-eval-dataset-no-score
Viewer • Updated • 1k • 37 -
ShenaoZhang/0.0_3iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 44.8k • 56 -
nnheui/stablelm-2-1_6b-sft-full-ultrafeedback_generated
Viewer • Updated • 61.1k • 39 -
YYYYYYibo/eval-dataset-merge
Viewer • Updated • 1k • 40 -
YYYYYYibo/eval-dataset-with-score-vanilla
Viewer • Updated • 200 • 43 -
YYYYYYibo/ultrafeedback_binarized_plus_left_part_3
Viewer • Updated • 16.1k • 38 -
ShenaoZ/0.0001_withdpo_3iters_bs256_551lr_dataset
Viewer • Updated • 44.8k • 53 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_1
Viewer • Updated • 16.1k • 37 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_3
Viewer • Updated • 15k • 37 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_2
Viewer • Updated • 3.8k • 37 -
AmberYifan/safetyQA_DPO
Viewer • Updated • 55k • 41 -
ShenaoZ/0.0001_zephyrgemmadpo_nodpo_3iters_bs256_555lr_dataset
Viewer • Updated • 22.4k • 42 -
YYYYYYibo/ultrafeedback_binarized_new_gen_part_1
Viewer • Updated • 5k • 39 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_1
Viewer • Updated • 4.9k • 39 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_1
Viewer • Updated • 4.9k • 40 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_1
Viewer • Updated • 4.78k • 35 -
ShenaoZ/0.0001_sft_nodpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 69.1k • 46 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_3
Viewer • Updated • 5.19k • 41 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 41 -
ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5311lr_dataset
Viewer • Updated • 51.8k • 70 -
ShenaoZhang/0.01_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 51.8k • 52 -
euiyulsong/threedata
Viewer • Updated • 5.7k • 36 -
euiyulsong/arc_all
Viewer • Updated • 3.36k • 38 -
DuongTrongChi/detoxic
Viewer • Updated • 5.69k • 41 -
euiyulsong/generated_data_all_cos
Viewer • Updated • 3.32k • 41 -
euiyulsong/generated_data_all_cos_1000
Viewer • Updated • 1k • 37 -
arcee-ai/OpenHermes2.5-dpo-binarized-alpha
Viewer • Updated • 9.79k • 50 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1
Viewer • Updated • 20k • 42 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2
Viewer • Updated • 20k • 40 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_3
Viewer • Updated • 5.29k • 39 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_2
Viewer • Updated • 5.28k • 41 -
mnlp-nsoai/hf-dpo-pairs-collection
Viewer • Updated • 10.5k • 38 -
2A2I/NoRobots-AceGPT.13B.Chat-DPO
Viewer • Updated • 9.5k • 46 -
berquetR/dpo_preference_dataset_EPFL_shp
Viewer • Updated • 69.1k • 38 -
AlpacaAAR/epfl-synthetic-dpo
Viewer • Updated • 19.6k • 145 -
ShenaoZ/SELM-Zephyr-7B-dataset
Viewer • Updated • 17.3k • 45 -
TTTXXX01/My-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 66 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_0
Viewer • Updated • 5k • 36 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_1
Viewer • Updated • 5k • 46 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_minpi_part_2
Viewer • Updated • 20k • 37 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_1
Viewer • Updated • 5k • 35 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3
Viewer • Updated • 21.1k • 39 -
SiMajid/Dahoad
Viewer • Updated • 2.96k • 39 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_minpi_part_3
Viewer • Updated • 21.1k • 45 -
valerielucro/gsm8k_preference_dataset_2
Viewer • Updated • 379 • 39 -
Dahoas/static-hh
Viewer • Updated • 101k • 86 • 20 -
M4-ai/prm_dpo_pairs
Viewer • Updated • 93.9k • 66 • 7 -
NickyNicky/neovalle_H4rmony_dpo_translated_English_to_Spanish
Viewer • Updated • 2.02k • 45 • 4 -
Starlento/DPO-En-Zh-20k-handbook
Viewer • Updated • 20k • 55 • 3 -
orpo-explorers/OpenHermesPreferences-500k
Viewer • Updated • 500k • 48 • 2 -
vwxyzjn/cai-conversation-dev1704836562
Viewer • Updated • 128 • 47 -
pvduy/dpo_data
Viewer • Updated • 197k • 48 -
vwxyzjn/cai-conversation-dev1705363150
Viewer • Updated • 128 • 43 -
vwxyzjn/cai-conversation-dev1705620998
Viewer • Updated • 256 • 57 -
vwxyzjn/cai-conversation-dev1705631776
Viewer • Updated • 256 • 49 -
lamhieu/beyond_dpo_en
Viewer • Updated • 25k • 70 -
CognitiveLab/hh-rlhf-json
Viewer • Updated • 161k • 43 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330973
Viewer • Updated • 167 • 43 -
sanduntg/test_vsort_classification
Viewer • Updated • 99 • 48 -
mnoukhov/openai_comparisons_20k_regen_and_relabelled
Viewer • Updated • 20k • 37 -
vwxyzjn/ultrafeedback_binarized_1708454270
Viewer • Updated • 25.3k • 66 -
sanduntg/cpcdata_ppo
Viewer • Updated • 24 • 43 -
hon9kon9ize/yue-truthy
Viewer • Updated • 2.03k • 41 -
aengusl/train_hp_dpo_unlrn_ds
Viewer • Updated • 927 • 38 -
vwxyzjn/hh-rlhf
Viewer • Updated • 100 • 51 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.2_self_160m
Viewer • Updated • 37.9k • 42 -
boopysaur/user3-dpo-small
Updated • 35 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_0.1_self_160m
Viewer • Updated • 37.9k • 47 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_1
Viewer • Updated • 568k • 146 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_3
Viewer • Updated • 568k • 121 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 568k • 115 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1
Viewer • Updated • 568k • 190 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 568k • 134 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 568k • 143 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3
Viewer • Updated • 568k • 88 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 568k • 104 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_2
Viewer • Updated • 189k • 59 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 189k • 58 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 568k • 156 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_2
Viewer • Updated • 189k • 62 -
Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 94.6k • 37 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 78 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.9
Viewer • Updated • 568k • 217 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.9
Viewer • Updated • 568k • 122 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_3_t_1.0_eval
Viewer • Updated • 568k • 83 -
dinaaaaaa/lima_rand_sel_50_preference_self_reward
Viewer • Updated • 223 • 50 -
Jessiecs/7374-assignment4-question2_dataset_for_DPO
Viewer • Updated • 50 • 38 -
ShenaoZ/0.0_idpo_same_3iters_debug_dataset
Viewer • Updated • 22.4k • 38 -
guoyu-zhang/shp_1
Viewer • Updated • 1k • 36 -
guoyu-zhang/shp_2
Viewer • Updated • 1k • 37 -
guoyu-zhang/shp_3
Viewer • Updated • 1k • 37 -
ShenaoZ/0.001_ablation_4iters_bs256_nodpo_dataset
Viewer • Updated • 69.1k • 50 -
NickyNicky/DPO_tokenizer_phi_3_test
Viewer • Updated • 10 • 35 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3
Viewer • Updated • 303k • 101 -
YYYYYYibo/ultrafeedback_binarized_phase_0_part_0
Viewer • Updated • 100 • 37 -
ShenaoZhang/0.0001_3iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 67.1k • 61 -
communityai/system_identity_remove_preference_google
Viewer • Updated • 93 • 39 -
communityai/system_identity_remove_preference_alibaba_cloud
Viewer • Updated • 93 • 37 -
communityai/system_identity_remove_preference_gpt
Viewer • Updated • 93 • 35 -
communityai/system_identity_remove_preference_gpt_4
Viewer • Updated • 93 • 41 -
nbalepur/Mnemonic_Chosen_Rejected
Viewer • Updated • 472 • 45 -
C-Stuti/llama3-8b-orpo-con
Viewer • Updated • 3.36k • 56 -
Ksgk-fy/alignment-dpo-test2-mode-4
Viewer • Updated • 720 • 38 -
ShenaoZ/0.0001_withdpo_3iters_bs256_531lr_dataset
Viewer • Updated • 44.8k • 49 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_train_part_3
Viewer • Updated • 20.5k • 37 -
StrangeSX/SGXT1
Viewer • Updated • 99 • 40 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_2
Viewer • Updated • 4.9k • 36 -
theGhoul21/irpo-dataset-v2
Viewer • Updated • 17.9k • 48 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_2
Viewer • Updated • 4.78k • 36 -
ShenaoZ/0.0001_sft_nodpo_5iters_bs256_5102lr_dataset
Viewer • Updated • 71.1k • 76 -
ShenaoZ/0.0005_mistral_withdpo_4iters_bs256_5551lr_dataset
Viewer • Updated • 51.8k • 59 -
euiyulsong/arc_train_ds
Viewer • Updated • 1.12k • 47 -
reciprocate/dpo-objective
Viewer • Updated • 512 • 46 -
DuongTrongChi/detoxic-dpo-format
Viewer • Updated • 46.6k • 44 -
euiyulsong/generated_data_all_cos_3000
Viewer • Updated • 3k • 41 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.20
Updated • 36 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.00
Updated • 42 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.00
Updated • 36 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.00
Updated • 35 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_1
Viewer • Updated • 5k • 42 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.50
Updated • 39 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.50
Updated • 36 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_2
Viewer • Updated • 5.28k • 37 -
yasirchemmakh/dpo_llama3
Viewer • Updated • 43 • 37 -
mcding-org/CorrectDPO-Eval-DPO_Pm3B_U0_beta0.10
Updated • 40 -
mcding-org/CorrectDPO-Eval-DPO_L8B_U0_beta0.10
Updated • 42 -
Piteryo/hf-trl-1024
Viewer • Updated • 1.28k • 46 -
jayhii/orpo_2sep_data_font
Viewer • Updated • 10k • 38 -
sfanm/ultrafeedback_llama3
Viewer • Updated • 60.2k • 45 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized
Viewer • Updated • 60.9k • 41 -
nhyha/DPO
Viewer • Updated • 1 • 51 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_2
Viewer • Updated • 5.28k • 41 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_3
Viewer • Updated • 5.29k • 40 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_3
Viewer • Updated • 5.29k • 37 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_3
Viewer • Updated • 5.29k • 41 -
Columbia-NLP/DPO-distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 39 -
beom115/test2
Viewer • Updated • 72.5k • 35 -
maywell/ko_Ultrafeedback_binarized_10k
Viewer • Updated • 10k • 48 • 5 -
vicgalle/OpenHermesPreferences-1k
Viewer • Updated • 1.11k • 44 • 3 -
mlabonne/oasst-preferences
Viewer • Updated • 22.3k • 52 • 3 -
beyond/rlhf-reward-single-round
Viewer • Updated • 25k • 143 • 2 -
alvarobartt/Anthropic_HH_Golden_Formatted
Viewer • Updated • 44.8k • 42 • 2 -
distilabel-internal-testing/ohp-writing
Viewer • Updated • 1.53k • 41 • 2 -
sablo/HelpSteer_binarized
Viewer • Updated • 8.55k • 66 • 1 -
Suraponn/iapp_for_orpo
Viewer • Updated • 121k • 37 • 1 -
umarigan/openhermespreference_tr
Viewer • Updated • 989k • 58 • 2 -
orpo-explorers/OHP-15k
Viewer • Updated • 15.4k • 41 • 1 -
NickyNicky/oasst2_orpo_mix_tokenizer_phi_3_v1
Viewer • Updated • 54.3k • 47 • 1 -
NickyNicky/Colossal_Translation_EN_ES_ORPO_DPO_Gemma
Viewer • Updated • 1.7M • 56 • 2 -
NickyNicky/DIBT_prompts_ranked_En_Es_orpo_dpo_chatML_gemma_V3
Viewer • Updated • 20.4k • 36 • 1 -
NickyNicky/nano_finance_200k_en_es_chatML_gemma_orpo_dpo
Viewer • Updated • 201k • 52 • 1 -
AlekseyKorshuk/chai-real-and-synthetic
Viewer • Updated • 154k • 78 -
ummagumm-a/cup-it-ds-classification-pairwise-train-val
Viewer • Updated • 352k • 96 -
samxm111/rlhf-reward-single-round
Viewer • Updated • 25k • 46 -
vwxyzjn/cai-conversation-dev1-h4
Viewer • Updated • 16.4k • 66 -
alvarobartt/Anthropic_HH_Golden_Extended
Viewer • Updated • 89.7k • 41 -
mnoukhov/openai_summarize_generated_20k_relabel_410m_dpo1
Viewer • Updated • 20k • 36 -
mnoukhov/openai_summarize_generated_20k_relabel_1b
Viewer • Updated • 20k • 39 -
GokhanAI/INST_Synthetic_LLAMA
Viewer • Updated • 26.3k • 48 -
0x7o/oasst-ru-dpo-v1
Viewer • Updated • 1.32k • 42 -
Jaredquek/dpoedtech
Viewer • Updated • 3.25k • 37 -
CognitiveLab/hh-rlhf-formatted
Viewer • Updated • 161k • 40 -
CognitiveLab/hh-rlhf-formatted-10000
Viewer • Updated • 10k • 40 -
arianhosseini/openai_comparisons_20k_regen_and_relabelled
Viewer • Updated • 25k • 44 -
Saugatkafley/okapi-ranking
Viewer • Updated • 126k • 57 -
vwxyzjn/self-reward-dev1706109551
Viewer • Updated • 16 • 51 -
manishiitg/jondurbin-gutenberg-dpo-v0.1
Viewer • Updated • 1.8k • 51 -
argilla/ultrafeedback-capybara-mix-5k
Viewer • Updated • 5k • 44 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1706885434
Viewer • Updated • 24 • 45 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706903049
Viewer • Updated • 167 • 42 -
pvduy/dpo_data_capy
Viewer • Updated • 47.6k • 47 -
dkshjn/processed_distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 44 -
weijie210/UC_prefs_iter_0_pairwise
Viewer • Updated • 14.4k • 50 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707331096
Viewer • Updated • 87 • 60 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707331527
Viewer • Updated • 462 • 53 -
vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707332943
Viewer • Updated • 167 • 47 -
nz/100_v2_rlhf
Viewer • Updated • 122k • 40 -
vwxyzjn/ultrafeedback_binarized_1708035667
Viewer • Updated • 63.1k • 48 -
vwxyzjn/ultrafeedback_binarized_1708702930
Viewer • Updated • 27k • 52 -
jikaixuan/mistral_generated
Viewer • Updated • 61.1k • 44 -
arianhosseini/summ_dpo1b1_ngen10_max_2ndmax
Viewer • Updated • 20k • 36 -
nz/closest_to_3000_range_1000_to_9000
Viewer • Updated • 11k • 42 -
nz/closest_to_5000_range_1000_to_9000
Viewer • Updated • 11k • 44 -
hon9kon9ize/yue-toxic-dpo
Viewer • Updated • 1.07k • 35 -
vwxyzjn/hh-rlhf-trl-style
Viewer • Updated • 100 • 60 -
Mitsuki-Sakamoto/filter_dataset_test
Viewer • Updated • 73 • 65 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.5_self_160m
Viewer • Updated • 37.9k • 53 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_0.3_self_160m
Viewer • Updated • 37.9k • 38 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_1.0_self_160m
Viewer • Updated • 18.9k • 37 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_1
Viewer • Updated • 568k • 111 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 568k • 121 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 568k • 143 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 568k • 130 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 568k • 77 -
when2rl/dpo-mix-7k-rescaled_reformatted
Viewer • Updated • 7.5k • 48 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 568k • 153 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1
Viewer • Updated • 568k • 80 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1
Viewer • Updated • 568k • 77 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2
Viewer • Updated • 568k • 98 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 568k • 136 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3
Viewer • Updated • 568k • 110 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3
Viewer • Updated • 568k • 114 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_2
Viewer • Updated • 189k • 51 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_3
Viewer • Updated • 189k • 74 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_3
Viewer • Updated • 189k • 47 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_3
Viewer • Updated • 189k • 53 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_1
Viewer • Updated • 189k • 53 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 189k • 50 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 88 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_2_t_1.0
Viewer • Updated • 568k • 88 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2_t_1.0
Viewer • Updated • 568k • 83 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3_t_1.0
Viewer • Updated • 568k • 82 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 152 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.75
Viewer • Updated • 568k • 138 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0_eval
Viewer • Updated • 568k • 178 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1_t_1.0_eval
Viewer • Updated • 568k • 83 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2_t_1.0_eval
Viewer • Updated • 568k • 207 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2_t_1.0_eval
Viewer • Updated • 568k • 213 -
orpo-explorers/OpenHermesPreferences-250k
Viewer • Updated • 250k • 39 -
sazirarrwth99/kangoroo_dpo_trainer_final
Viewer • Updated • 23.3k • 40 -
wenbopan/cmmlu_dpo_pairs
Viewer • Updated • 5.04k • 44 -
ShenaoZhang/0.001_idpo_dataset
Viewer • Updated • 44.8k • 44 -
AnushaKulkarni/preferred_dataset2
Viewer • Updated • 50 • 35 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo_temp0.7
Viewer • Updated • 20k • 42 -
arianhosseini/ultrafeedback_binarized_relabel1b
Viewer • Updated • 63.1k • 37 -
ShenaoZ/0.001_idpo_same_scratch_dataset
Viewer • Updated • 106k • 45 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo_temp0.7_length128
Viewer • Updated • 20k • 41 -
guoyu-zhang/usp_2
Viewer • Updated • 1k • 37 -
guoyu-zhang/usp_4
Viewer • Updated • 1k • 43 -
DuongTrongChi/hh-rlhf
Viewer • Updated • 161k • 37 -
when2rl/gutenberg-dpo-v0.1_reformatted
Viewer • Updated • 918 • 39 -
ShenaoZ/0.0001_ablation_dataset
Viewer • Updated • 44.8k • 46 -
mnoukhov/summarize_from_feedback_tldr3_labelled_vllm_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 9.5k • 40 -
ShenaoZ/0.01_ablation_4iters_bs256_dataset
Viewer • Updated • 51.8k • 44 -
orpo-explorers/OHP-15k-Stratified-1
Viewer • Updated • 15k • 40 -
orpo-explorers/OHP-15k-Stratified-2
Viewer • Updated • 15k • 42 -
ShenaoZhang/0.001_ablation_5iters_bs128_dataset
Viewer • Updated • 12.2k • 41 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_useresponse_dataset
Viewer • Updated • 67.1k • 40 -
NickyNicky/alexredna_oasst2_dpo_pairs
Viewer • Updated • 10k • 37 -
ShenaoZ/0.001_4iters_bs256_nodpo_only2third_dataset
Viewer • Updated • 12.2k • 37 -
ShenaoZhang/0.001_4iters_bs128_nodpo_only4w_userresponse_dataset
Viewer • Updated • 48k • 51 -
ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_userresponse_dataset
Viewer • Updated • 48k • 48 -
ShenaoZhang/0.001_4iters_bs128_nodpo_only4w_dataset
Viewer • Updated • 48k • 43 -
ShenaoZhang/0.01_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 48k • 39 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_ranked
Viewer • Updated • 10k • 39 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_2
Viewer • Updated • 5.28k • 43 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_3
Viewer • Updated • 1k • 37 -
communityai/system_identity_remove_preference_openai
Viewer • Updated • 93 • 41 -
ShenaoZhang/0.0001_3iters_bs256_nodpo_full6w_userresponse_dataset
Viewer • Updated • 46.8k • 45 -
YYYYYYibo/ultrafeedback_binarized_left_part_2
Viewer • Updated • 15k • 39 -
when2rl/mt_bench_human_judgments_reformatted
Viewer • Updated • 8.96k • 46 -
iamnguyen/ultrafeedback_translated
Viewer • Updated • 999 • 40 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_2
Viewer • Updated • 25k • 37 -
ShenaoZ/0.0001_withdpo_4iters_bs256_5102lr_misit_correct_dataset
Viewer • Updated • 51.8k • 46 -
ShenaoZ/0.0005_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 44 -
YYYYYYibo/ultrafeedback_binarized_real_rank4_all_minpi_part_3
Viewer • Updated • 20.5k • 41 -
ShenaoZ/0.0001_sft_nodpo_3iters_bs256_555lr_dataset
Viewer • Updated • 67.1k • 44 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo_costa_2.8b_bf16.yml_6e799_new
Viewer • Updated • 20k • 40 -
YYYYYYibo/ultrafeedback_binarized_new_gen_part_2
Viewer • Updated • 5k • 39 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_part0
Viewer • Updated • 19.6k • 39 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_2
Viewer • Updated • 4.9k • 47 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_2
Viewer • Updated • 4.1k • 44 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_1
Viewer • Updated • 5k • 39 -
ShenaoZ/0.0001_withdpo_3iters_bs256_5102lr_dataset
Viewer • Updated • 44.8k • 45 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_1
Viewer • Updated • 5k • 37 -
ShenaoZ/0.001_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 75 -
uine/single-dpo-practice-dataset
Viewer • Updated • 2.11k • 40 -
ShenaoZ/0.0001_withdpo_4iters_bs256_5551lr_dataset
Viewer • Updated • 51.8k • 60 -
ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5551lr_dataset
Viewer • Updated • 51.8k • 49 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr
Viewer • Updated • 107k • 47 -
ContextualAI/tiny_train_test_ultrafeedback_binarized
Viewer • Updated • 20 • 42 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr-step873
Viewer • Updated • 20k • 43 -
ShenaoZhang/0.0001_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 51.8k • 41 -
DuongTrongChi/dpo-detoxic
Viewer • Updated • 46.6k • 35 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_0
Viewer • Updated • 5k • 40 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_2
Viewer • Updated • 5k • 42 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.00
Updated • 38 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.00
Updated • 35 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.10
Updated • 36 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.00
Updated • 38 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.20
Updated • 42 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.00
Updated • 39 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.30
Updated • 41 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.00
Updated • 41 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.00
Updated • 36 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.30
Updated • 39 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.10
Updated • 41 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.50
Updated • 42 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.30
Updated • 38 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.10
Updated • 44 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.10
Updated • 37 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.20
Updated • 39 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_3
Viewer • Updated • 5k • 37 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.40
Updated • 39 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.40
Updated • 37 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.40
Updated • 41 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.50
Updated • 36 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.50
Updated • 36 -
mcding-org/CorrectDPO-Dataset-U10
Updated • 35 -
mcding-org/CorrectDPO-Dataset-U30
Updated • 38 -
mcding-org/CorrectDPO-Eval-DDP_Pm3B_U0_beta0.10r0.30rho0.20
Updated • 39 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v2_full-sft-finetuned-stage4-iter86000-v2
Viewer • Updated • 18.8k • 40 -
berquetR/dpo_preference_dataset
Preview • Updated • 40 -
patruff/chuckles_dpo_pairsA
Viewer • Updated • 106 • 40 -
ihughes15234/tictactoe_DPO
Viewer • Updated • 765 • 41 -
rajj0/god_sent_data_v2
Viewer • Updated • 2.84k • 36 -
nhyha/DPO_2
Viewer • Updated • 5 • 46 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_2
Viewer • Updated • 5k • 38 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_3
Viewer • Updated • 5.29k • 36 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_2
Viewer • Updated • 5k • 37 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_1
Viewer • Updated • 5k • 41 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_2
Viewer • Updated • 5k • 40 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_2
Viewer • Updated • 5.28k • 35 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_1
Viewer • Updated • 5.28k • 40 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_2
Viewer • Updated • 5.28k • 41 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel2_llama8b
Viewer • Updated • 92.1k • 41 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_train_part_2
Viewer • Updated • 19.1k • 35 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_part_3
Viewer • Updated • 19.6k • 35 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_train_part_3
Viewer • Updated • 19.6k • 39 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_part_2
Viewer • Updated • 19.1k • 36 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_train_part_2
Viewer • Updated • 19.1k • 40 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_part_3
Viewer • Updated • 19.8k • 35 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_train_part_3
Viewer • Updated • 19.8k • 36 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_vllm_1_part_2
Viewer • Updated • 20k • 38 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_vllm_2_part_2
Viewer • Updated • 20k • 36 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_vllm_1_part_3
Viewer • Updated • 21.1k • 40 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_vllm_2_part_3
Viewer • Updated • 21.1k • 36 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_train_part_3
Viewer • Updated • 21.1k • 36 -
joshuasundance/mypo-4k-rfc-val-phi3test
Viewer • Updated • 100 • 49 -
davanstrien/dataset-tldr-preference-dpo
Viewer • Updated • 522 • 56 • 11 -
declare-lab/audio-alpaca
Viewer • Updated • 15k • 178 • 10 -
HuggingFaceH4/grok-conversation-harmless2
Viewer • Updated • 44.8k • 155 • 6 -
monology/oasst2_dpo
Viewer • Updated • 28.4k • 44 • 3 -
HuggingFaceH4/orca_dpo_pairs_no_system_prompt
Viewer • Updated • 12.9k • 47 • 3 -
udkai/klexikon_dpo
Viewer • Updated • 2.89k • 51 • 3 -
Dahoas/rl-prompt-dataset
Viewer • Updated • 207k • 86 • 2 -
reciprocate/ultrafeedback_cleaned_high_dpo
Viewer • Updated • 40k • 38 • 2 -
giux78/ultrafeedback-binarized-preferences-cleaned-ita-ready
Viewer • Updated • 60.9k • 42 • 2 -
AlekseyKorshuk/synthetic-instruct-gptj-pairwise
Viewer • Updated • 33.1k • 43 • 1 -
Deojoandco/reward_model_anthropic_88
Viewer • Updated • 8.55k • 41 • 1 -
SAGI-1/ultrafeedback_binarized_dpo
Viewer • Updated • 64k • 45 • 1 -
ThWu/dpo_prompt_r
Viewer • Updated • 183k • 44 • 1 -
0x7o/fialka-v2-dpo
Viewer • Updated • 2.47k • 44 • 1 -
reciprocate/ultrafeedback_cleaned_v2_dpo
Viewer • Updated • 58.6k • 53 • 1 -
nutorbit/news-headline-dpo
Viewer • Updated • 2.37k • 41 • 1 -
giux78/ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 60.9k • 49 • 1 -
NickyNicky/Colossal_Translation_Spanish_to_English_AND_English_to_Spanish_ORPO_DPO_Gemma
Viewer • Updated • 3.4M • 128 • 3 -
thepowerfuldeez/Qwen-summarize-dataset-train
Viewer • Updated • 20.4k • 41 • 1 -
AlekseyKorshuk/davinci-pairwise
Viewer • Updated • 144k • 144 -
AlekseyKorshuk/davinci-pairwise-all
Viewer • Updated • 48k • 79 -
AlekseyKorshuk/davinci-pairwise-tokenized
Viewer • Updated • 72k • 70 -
AlekseyKorshuk/davinci-pairwise-filtered
Viewer • Updated • 108k • 44 -
AlekseyKorshuk/chai-synthetic-pairwise
Viewer • Updated • 45.7k • 82 -
HuggingFaceH4/test-dataset-all-splits
Viewer • Updated • 600 • 43 -
AlekseyKorshuk/lmeh-chai-davinci
Viewer • Updated • 14.4k • 59 -
AlekseyKorshuk/lmeh-chai-synthetic
Viewer • Updated • 4.57k • 39 -
PanoEvJ/GPT3.5_summarization_preference_RLAIF
Viewer • Updated • 100 • 41 -
JuanKO/RLAIF_summarization_preference_gpt35
Viewer • Updated • 1k • 43 -
victorialee/openai_summarize_comparisons_relabel_GPTJ
Updated • 39 -
sayan1101/reward_test_custom_dataset_RLHF
Viewer • Updated • 164 • 51 -
SebastianSchramm/ultrafeedback_binarized_prefs_filtered
Viewer • Updated • 58.1k • 35 -
remyxai/ffmperative_dpo
Viewer • Updated • 1.48k • 44 -
rajammanabrolu/ultrafeedback_binarized
Viewer • Updated • 190k • 61 -
kfkas/test_DPO_dataset
Viewer • Updated • 3.83k • 39 -
varun-v-rao/mimic-cxr-dpo-with-metrics
Viewer • Updated • 125k • 42 • 1 -
mnoukhov/openai_summarize_generated_10k
Viewer • Updated • 10k • 37 -
mnoukhov/openai_summarize_generated_10-20k
Viewer • Updated • 10k • 37 -
mnoukhov/openai_summarize_generated_20k
Viewer • Updated • 20k • 42 -
GokhanAI/INST_Synthetic_MISTRAL
Viewer • Updated • 26.3k • 79 -
dvilasuero/multiturner
Viewer • Updated • 3.43k • 35 -
arianhosseini/openai_summarize_comparisons_relabel_pythia1b_iter1_temp0.7
Viewer • Updated • 20k • 45 -
mnoukhov/compare_results
Viewer • Updated • 100 • 42 -
mnoukhov/openai_summarize_vllm_generated_20k_label410m
Viewer • Updated • 19.9k • 49 -
reciprocate/orca_dpo_pairs
Viewer • Updated • 14.8k • 40 -
reciprocate/pku_better_dpo_pairs
Viewer • Updated • 330k • 40 -
manishiitg/jondurbin-truthy-dpo-v0.1
Viewer • Updated • 2.03k • 41 -
manishiitg/unalignment-toxic-dpo-v0.1
Viewer • Updated • 604 • 44 -
mii-llm/oasst2-dpo-it
Viewer • Updated • 210 • 42 -
UnderstandLing/oasst1_nl_threads_dpo
Viewer • Updated • 25.1k • 39 -
vwxyzjn/cai-conversation-dev1705423021
Viewer • Updated • 2.31k • 42 -
vwxyzjn/cai-conversation-dev1705526305
Viewer • Updated • 256 • 63 -
vwxyzjn/cai-conversation-dev1705676837
Viewer • Updated • 256 • 47 -
arianhosseini/trl_data
Viewer • Updated • 20k • 37 -
weijie210/UC_preference_iter_0
Viewer • Updated • 39.1k • 43 -
weijie210/UC_preference_iter_0_all
Viewer • Updated • 93.2k • 36 -
pvduy/dpo_data_ultra
Viewer • Updated • 80k • 43 -
ogbrandt/gpt35_preference_rlaif
Viewer • Updated • 520 • 37 -
ogbrandt/gpt4_preference_rlaif
Viewer • Updated • 520 • 38 -
Asap7772/ultrafeedback_binarized_narrow_unlabeled
Viewer • Updated • 60.7k • 48 -
weijie210/UFB_reference_rejected
Viewer • Updated • 57.6k • 82 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706886961
Viewer • Updated • 24 • 47 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706887930
Viewer • Updated • 30 • 46 -
nz/anthropic-hh-golden-rlhf
Viewer • Updated • 44.8k • 66 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706893611
Viewer • Updated • 84 • 44 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706896441
Viewer • Updated • 5 • 43 -
arianhosseini/summarize_dpo1b1_ngen10_20k
Viewer • Updated • 20k • 58 -
weijie210/UFB_prefs_iter_0_4_bestn
Viewer • Updated • 55.5k • 44 -
weijie210/UC_prefs_iter_0
Viewer • Updated • 31 • 49 -
weijie210/UFB_maximal_prefs
Viewer • Updated • 63.1k • 46 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330518
Viewer • Updated • 167 • 52 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330742
Viewer • Updated • 167 • 42 -
vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707333633
Viewer • Updated • 167 • 48 -
vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707337384
Viewer • Updated • 167 • 54 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707405480
Viewer • Updated • 167 • 49 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707406141
Viewer • Updated • 167 • 49 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707408224
Viewer • Updated • 167 • 50 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707422187
Viewer • Updated • 48.3k • 51 -
shidowake/UFeedback_without_gpt_output
Viewer • Updated • 7.68k • 42 -
ibndias/distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 41 -
dlibf/ultra_feedback_zephyr-dpo
Viewer • Updated • 125k • 57 -
dlibf/ultra_feedback_zephyr-sft
Viewer • Updated • 125k • 56 -
vwxyzjn/ultrafeedback_binarized_1707945637
Viewer • Updated • 63.1k • 70 -
vwxyzjn/ultrafeedback_binarized_1707947544
Viewer • Updated • 63.1k • 70 -
arianhosseini/comparisons_20k_regen_labeled_dpo1b1
Viewer • Updated • 20k • 37 -
male-2/0.2.0-public
Viewer • Updated • 1 • 39 -
mnoukhov/openai_summarize_comparisons_tldprompt_relabel_pythia410m-dpo1
Viewer • Updated • 92.5k • 38 -
vwxyzjn/ultrafeedback_binarized_1708381525
Viewer • Updated • 1.9k • 50 -
Radiantloom/distilabel-intel-orca-dpo-pairs-chatml
Viewer • Updated • 12.9k • 39 -
cmcmaster/OpenHermes2.5-dpo-binarized-alpha-trl
Viewer • Updated • 9.79k • 41 -
mnoukhov/openai_summarize_generated_20k_relabel_1b_margin
Viewer • Updated • 20k • 40 -
mnoukhov/openai_summarize_comparisons_tldrprompt_relabel1b_margin
Viewer • Updated • 97.5k • 42 -
mnoukhov/compare_test
Viewer • Updated • 20k • 40 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo
Viewer • Updated • 20k • 42 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo
Viewer • Updated • 20k • 45 -
mnoukhov/openai_summarize_generated_20k_relabel_1b_predict_410m-dpo1
Viewer • Updated • 20k • 37 -
cnbeining/sentence-segmentation-dpo-raw
Viewer • Updated • 9.18k • 56 -
aengusl/llama_dpo_hhh
Viewer • Updated • 161k • 50 -
aengusl/mistral_dpo_hhh
Viewer • Updated • 161k • 45 -
Baidicoot/dpo_safety_ihy_openhermes
Viewer • Updated • 5k • 39 -
celinelee/thestack_npzeros_dpo
Viewer • Updated • 100k • 47 -
nz/closest_to_5000_range_1000_to_9000_55k
Viewer • Updated • 55.7k • 43 -
ZHLiu627/ultrafeedback_binarized_with_response_full_part2
Viewer • Updated • 21.1k • 40 -
aengusl/noise0_alpaca_sleeper_agents_toy_test_preference_v4
Viewer • Updated • 15.7k • 40 -
vwxyzjn/ultrafeedback_binarized_1710165338
Viewer • Updated • 25k • 39 -
vtiyyal1/AskDocsEmpathy_2k_dpo
Viewer • Updated • 2.12k • 51 -
davidberenstein1957/ultrafeedback-binarized-cleaned-and-filtered-random-split
Viewer • Updated • 6.69k • 73 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.1_self_70m
Viewer • Updated • 37.9k • 48 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.1_self_160m
Viewer • Updated • 37.9k • 42 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_3
Viewer • Updated • 568k • 143 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1
Viewer • Updated • 568k • 114 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1
Viewer • Updated • 568k • 139 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2
Viewer • Updated • 568k • 82 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3
Viewer • Updated • 568k • 139 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 568k • 84 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 568k • 157 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_1
Viewer • Updated • 189k • 47 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_1
Viewer • Updated • 189k • 58 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_1
Viewer • Updated • 189k • 43 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_2
Viewer • Updated • 189k • 72 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 90 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 114 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1_t_1.0
Viewer • Updated • 568k • 120 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2_t_1.0
Viewer • Updated • 568k • 99 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2_t_1.0
Viewer • Updated • 568k • 143 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.9
Viewer • Updated • 568k • 62 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.5
Viewer • Updated • 568k • 194 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.5
Viewer • Updated • 568k • 196 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 57 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.1
Viewer • Updated • 568k • 129 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.3
Viewer • Updated • 568k • 143 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.1
Viewer • Updated • 568k • 135 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.7
Viewer • Updated • 568k • 188 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.9
Viewer • Updated • 568k • 114 -
Nbardy/prompt_variance_reward_complete
Viewer • Updated • 412 • 48 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0_eval
Viewer • Updated • 568k • 152 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_1_t_1.0_eval
Viewer • Updated • 568k • 143 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2_t_1.0_eval
Viewer • Updated • 568k • 136 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3_t_1.0_eval
Viewer • Updated • 568k • 153 -
orpo-explorers/OpenHermesPreferences-25k
Viewer • Updated • 25k • 39 -
orpo-explorers/OpenHermesPreferences-50k
Viewer • Updated • 50k • 39 -
orpo-explorers/OpenHermesPreferences-100k
Viewer • Updated • 100k • 43 -
ShenaoZ/ultrafeedback_subset
Viewer • Updated • 22k • 38 -
ShenaoZhang/0.001_idpo_same_nodpo_dataset
Viewer • Updated • 67.1k • 58 -
ShenaoZhang/0.001_idpo_same_replacechosen_dataset
Viewer • Updated • 44.8k • 38 -
ShenaoZhang/0.001_idpo_noreplacerej_ref_response
Viewer • Updated • 44.8k • 42 -
ShenaoZhang/0.001_idpo_noreplacerej_dataset
Viewer • Updated • 44.8k • 47 -
jinlibao/lima_preference_dataset
Viewer • Updated • 50 • 38 -
hsikchi/tldr-preference-trl-style
Viewer • Updated • 179k • 55 -
gx-ai-architect/helpsteer_preference
Viewer • Updated • 35.6k • 42 -
sophiex/hh-rlhf
Viewer • Updated • 169k • 38 -
when2rl/OpenHermesPreferences_reformatted
Viewer • Updated • 985k • 91 -
mnoukhov/summarize_from_feedback_tldr3_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b35a8
Viewer • Updated • 20k • 40 -
ShenaoZ/0.0_ablation_6iters_dataset
Viewer • Updated • 48.8k • 53 -
ShenaoZ/0.0_ablation_dataset
Viewer • Updated • 44.8k • 40 -
UCLAML/snorkel_prompt3
Viewer • Updated • 21k • 39 -
mnoukhov/summarize_from_feedback_tldr3_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 20k • 36 -
arianhosseini/hh_with_prompt
Viewer • Updated • 169k • 40 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 107k • 40 -
when2rl/OpenHermesPreferences_CamelAI
Viewer • Updated • 78.4k • 46 -
Louieworth/hh-rlhf-trl-style
Viewer • Updated • 100 • 37 -
rippertnt/OpenOrca-dpo-ko-en
Viewer • Updated • 25.6k • 47 -
dmvaldman/showerthought_preferences2
Viewer • Updated • 34k • 48 -
Astris/toxic-dpo-v0.2-embedded
Updated • 40 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo_costa_2.8b_bf16.yml_6e799
Viewer • Updated • 107k • 36 -
orpo-explorers/OHP-Stratified-1
Viewer • Updated • 327k • 42 -
ShenaoZ/0.001_ablation_4iters_bs512_dataset
Viewer • Updated • 2k • 41 -
ShenaoZ/0.001_ablation_4iters_bs256_declr_dataset
Viewer • Updated • 51.8k • 50 -
ShenaoZ/0.01_ablation_5iters_bs256_nodpo_dataset
Viewer • Updated • 71.1k • 54 -
ShenaoZ/0.01_ablation_4iters_bs256_nodpo_dataset
Viewer • Updated • 69.1k • 68 -
ShenaoZ/0.001_ablation_4iters_bs256_nodpo_sample2_dataset
Viewer • Updated • 69.1k • 45 -
orpo-explorers/OHP-15k-mathcode
Viewer • Updated • 15k • 44 -
ShenaoZ/0.001_ablation_5iters_bs256_nodpo_dataset
Viewer • Updated • 71.1k • 35 -
ShenaoZhang/0.001_ablation_4iters_bs128_nodpo_dataset
Viewer • Updated • 69.1k • 35 -
ShenaoZhang/0.01_ablation_4iters_bs128_nodpo_dataset
Viewer • Updated • 53.8k • 44 -
ShenaoZ/0.01_ablation_3iters_bs256_nodpo_dataset
Viewer • Updated • 42.8k • 35 -
ShenaoZ/0.001_ablation_4iters_bs256_nodpo_useresponse_dataset
Viewer • Updated • 69.1k • 41 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1
Viewer • Updated • 303k • 104 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_zephyrbeta_dataset
Viewer • Updated • 46.8k • 39 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_5
Viewer • Updated • 303k • 85 -
ShenaoZhang/0.001_5iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 70k • 63 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_part1
Viewer • Updated • 5k • 41 -
ShenaoZhang/0.1_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 48k • 39 -
ShenaoZhang/0.001_3iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 46k • 62 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_1
Viewer • Updated • 1k • 42 -
ShenaoZhang/0.001_6iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 2k • 37 -
ShenaoZhang/0.01_3iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 67.1k • 59 -
communityai/system_identity_remove_preference_meta_ai
Viewer • Updated • 93 • 41 -
communityai/system_identity_remove_preference_facebook
Viewer • Updated • 93 • 37 -
communityai/system_identity_remove_preference_alibaba
Viewer • Updated • 93 • 38 -
communityai/system_identity_remove_preference_mistral
Viewer • Updated • 93 • 36 -
communityai/system_identity_remove_preference_cohere
Viewer • Updated • 93 • 39 -
communityai/system_identity_remove_preference_chatgpt
Viewer • Updated • 93 • 40 -
communityai/system_identity_remove_preference_gpt_3
Viewer • Updated • 93 • 37 -
ShenaoZhang/0.01_4iters_bs256_nodpo_full6w_userresponse_dataset
Viewer • Updated • 34.6k • 36 -
Ksgk-fy/alignment-dpo-test2-mode-3
Viewer • Updated • 720 • 48 -
YYYYYYibo/ultrafeedback_binarized_vllm_part_2
Viewer • Updated • 5k • 40 -
YYYYYYibo/ultrafeedback_binarized_minpi_part_2
Viewer • Updated • 5k • 49 -
ReBatch/ultrafeedback_binarized_nl
Viewer • Updated • 61.7k • 51 -
nbalepur/Mnemonic_Preferences_direct_comparison_fixed
Preview • Updated • 37 -
jhmejia/classifai
Viewer • Updated • 99 • 63 -
YYYYYYibo/whatever
Viewer • Updated • 40 • 43 -
YYYYYYibo/eval-dataset-with-score-original
Viewer • Updated • 200 • 36 -
ShenaoZ/0.0001_withdpo_3iters_bs256_511lr_dataset
Viewer • Updated • 44.8k • 41 -
hanyinwang/layer-project-reward-training
Viewer • Updated • 101 • 46 -
vipinkatara/dataset_complete_new
Viewer • Updated • 89.5k • 35 -
YYYYYYibo/eval-dataset-with-score-rank4_plus
Viewer • Updated • 200 • 36 -
vipinkatara/dataset_complete_final
Viewer • Updated • 89.5k • 39 -
ShenaoZ/0.01_withdpo_4iters_bs256_5102lr_misit_dataset
Viewer • Updated • 51.8k • 41 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_2
Viewer • Updated • 15k • 43 -
ShenaoZ/0.001_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 41 -
ShenaoZ/0.00005_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 41 -
KaggleMasterX/DPO_Test_ORPO
Viewer • Updated • 500 • 40 -
KaggleMasterX/ORPO_5K
Viewer • Updated • 15k • 35 -
ShenaoZ/0.0001_zephyrgemmasft_withdpo_3iters_bs256_555lr_dataset
Viewer • Updated • 24.4k • 41 -
YYYYYYibo/ultrafeedback_binarized_new_train_part_1
Viewer • Updated • 15k • 39 -
YYYYYYibo/ultrafeedback_binarized_new_train_part_3
Viewer • Updated • 15k • 36 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_0
Viewer • Updated • 4.9k • 41 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_2
Viewer • Updated • 5.18k • 38 -
ShenaoZ/0.0001_sft_nodpo_4iters_bs256_555lr_dataset
Viewer • Updated • 69.1k • 49 -
ShenaoZ/0.0001_sft_nodpo_5iters_bs256_555lr_dataset
Viewer • Updated • 71.1k • 60 -
ShenaoZ/0.001_sft_nodpo_3iters_bs256_531lr_dataset
Viewer • Updated • 67.1k • 42 -
ShenaoZ/0.001_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 45 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_3
Viewer • Updated • 4.78k • 41 -
ShenaoZ/0.0001_sft_nodpo_3iters_bs256_5102lr_dataset
Viewer • Updated • 67.1k • 53 -
ShenaoZ/0.0001_withdpo_5iters_bs256_5102lr_dataset
Viewer • Updated • 56.9k • 51 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_2
Viewer • Updated • 5.18k • 38 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3
Viewer • Updated • 20.7k • 37 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_2
Viewer • Updated • 4.98k • 40 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_3
Viewer • Updated • 5.09k • 38 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_3
Viewer • Updated • 5.16k • 38 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_2
Viewer • Updated • 5.16k • 39 -
GENIAC-Team-Ozaki/chatbot-arena-ja-calm2-7b-chat-experimental_deduped_add_generated_text
Viewer • Updated • 12k • 96 -
ShenaoZhang/0.001_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 51.8k • 46 -
Code-Refinement/dpo-sample-perfect-less
Viewer • Updated • 128 • 42 -
Code-Refinement/dpo-sample-perfect-more
Viewer • Updated • 128 • 46 -
euiyulsong/sciqa_train_ds_random_rejected
Viewer • Updated • 12.7k • 39 -
GENIAC-Team-Ozaki/chatbot-arena-ja-karakuri-lm-8x7b-chat-v0.1-awq
Viewer • Updated • 12.5k • 42 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr_relabel_pythia1b
Viewer • Updated • 107k • 45 -
theGhoul21/irpo-dataset-v3-iteration2
Viewer • Updated • 5.01k • 42 -
JiazhenLiu01/dpo_llama3_362_threeturn
Viewer • Updated • 1.46k • 38 -
JiazhenLiu01/dpo_llama3_362_threeturn_empty_neg
Viewer • Updated • 1.46k • 53 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.20
Updated • 42 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.10
Updated • 39 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.00
Updated • 41 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.00
Updated • 37 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.20
Updated • 35 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.20
Updated • 40 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.30
Updated • 36 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.10
Updated • 37 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.00
Updated • 39 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.10
Updated • 39 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.20
Updated • 39 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.20
Updated • 38 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.30
Updated • 36 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.20
Updated • 37 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.30
Updated • 44 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.00
Updated • 35 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.10
Updated • 37 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.20
Updated • 38 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.20
Updated • 38 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.40
Updated • 38 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.20
Updated • 39 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.10
Updated • 39 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.50
Updated • 38 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.40
Updated • 37 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.30
Updated • 44 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_1
Viewer • Updated • 5k • 36 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.50
Updated • 36 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.40
Updated • 40 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.30
Updated • 38 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.30
Updated • 36 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.30
Updated • 41 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.40
Updated • 37 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.50
Updated • 44 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.50
Updated • 39 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.40
Updated • 39 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.40
Updated • 40 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.50
Updated • 38 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_2
Viewer • Updated • 5k • 37 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_0
Viewer • Updated • 5k • 36 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_3
Viewer • Updated • 5k • 41 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_3
Viewer • Updated • 5.29k • 39 -
mcding-org/CorrectDPO-Dataset-U0
Updated • 38 -
mcding-org/CorrectDPO-Eval-DDP_L8B_U0_beta0.10r0.30rho0.20
Updated • 39 -
Piteryo/count_letters
Viewer • Updated • 1.28k • 45 • 1 -
rafaelsandroni/ultrafeedback_binarized_translated
Viewer • Updated • 1 • 51 -
elfonthefly/STEM_DPO
Viewer • Updated • 1.45M • 60 • 1 -
Piteryo/exact_number_of_sentences
Viewer • Updated • 1.28k • 44 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v4_full-sft-finetuned-stage4-iter86000-v4
Viewer • Updated • 19.5k • 43 -
ReBatch/ultrafeedback_nl
Viewer • Updated • 71.4k • 55 -
rajj0/god_sent_datav1
Viewer • Updated • 2.84k • 39 -
sfanm/ultrafeedback_llama3_pad_rm
Viewer • Updated • 56.4k • 53 -
nhyha/ORPO_2
Viewer • Updated • 4 • 55 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_3
Viewer • Updated • 5k • 41 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_1
Viewer • Updated • 5k • 37 -
minkyungpark/UFB_test
Viewer • Updated • 2k • 42 -
kpriyanshu256/v0-hh-rlhf-train-Hindi-0-20000
Viewer • Updated • 20k • 46 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_llama8b
Viewer • Updated • 176k • 37 -
vwxyzjn/sentiment-trl-style
Viewer • Updated • 100 • 60 -
heegyu/Magpie-Pro-DPO-200K-Filtered
Viewer • Updated • 57.1k • 49 -
kashif/nectar_dpo_pairs
Viewer • Updated • 3.84M • 450 • 4 -
We-Want-GPU/yi-ko-DPO-noprompt-dataset
Viewer • Updated • 3.83k • 43 • 2 -
sablo/oasst2_dpo_pairs_en
Viewer • Updated • 5.12k • 89 • 2 -
Deojoandco/reward_model_anthropic_8
Viewer • Updated • 8.55k • 43 • 1 -
FredrikBL/Legal-Snigel-DPO
Viewer • Updated • 2k • 46 • 1 -
nayohan/SentimentSynth-ko
Viewer • Updated • 5.3k • 43 • 1 -
LawChat-tw/RLHF_data
Viewer • Updated • 23.6k • 68 -
cryptom/rm-static
Updated • 45 -
mnoukhov/openai_summarize_vllm_generated_20k
Viewer • Updated • 19.9k • 100 -
dvilasuero/multiturner-for-generation
Viewer • Updated • 3.43k • 45 -
Jaredquek/DpoOlier
Viewer • Updated • 315 • 46 -
vwxyzjn/cai-conversation-dev1705622085
Viewer • Updated • 44.8k • 62 -
vwxyzjn/cai-conversation-dev1705634160
Viewer • Updated • 256 • 58 -
vwxyzjn/cai-conversation-dev1705674984
Viewer • Updated • 256 • 51 -
vwxyzjn/cai-conversation-dev1705675844
Viewer • Updated • 256 • 43 -
weijie210/UFB_preference_iter_0
Viewer • Updated • 15.4k • 44 -
manishiitg/HuggingFaceH4-orca_dpo_pairs
Viewer • Updated • 22.7k • 43 -
pvduy/dpo_data_baai_50k
Viewer • Updated • 54.4k • 41 -
NobodyExistsOnTheInternet/FilteredTruthyDPO
Viewer • Updated • 477 • 40 -
lmg-anon/VNTL-v2.5-1.6k-dpo-pairs
Viewer • Updated • 8.99k • 46 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706888126
Viewer • Updated • 84 • 36 -
alvarobartt/orca_dpo_pairs_openai
Viewer • Updated • 12.9k • 41 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__temp
Viewer • Updated • 600k • 55 -
mesolitica/DPO-filtered-aya_dataset-zsm
Viewer • Updated • 10.1k • 39 -
nz/losest_to_3000_range_1000_to_9000
Viewer • Updated • 11k • 40 -
Baidicoot/dpo_safety_ihy_llama
Viewer • Updated • 5k • 41 -
kyujinpy/Mistral-EN-DPO-9K
Viewer • Updated • 9.18k • 68 -
vwxyzjn/ultrafeedback_binarized_1710204240
Viewer • Updated • 24.9k • 49 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.5_self_70m
Viewer • Updated • 37.9k • 39 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 568k • 104 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 568k • 131 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 568k • 97 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2
Viewer • Updated • 568k • 67 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2
Viewer • Updated • 568k • 195 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 568k • 109 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 189k • 65 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 189k • 45 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 155 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1_t_1.0
Viewer • Updated • 568k • 145 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 99 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_1_t_1.0
Viewer • Updated • 568k • 108 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.75
Viewer • Updated • 568k • 87 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.3
Viewer • Updated • 568k • 132 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.5
Viewer • Updated • 568k • 150 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1_t_1.0_eval
Viewer • Updated • 568k • 122 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_2_t_1.0_eval
Viewer • Updated • 568k • 90 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3_t_1.0_eval
Viewer • Updated • 568k • 259 -
ShenaoZhang/0.001_idpo_4iters_dataset
Viewer • Updated • 51.8k • 38 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo_temp0.7
Viewer • Updated • 20k • 38 -
Joyqiuyue/lima-preference_dataset-2
Viewer • Updated • 1 • 40 -
ShenaoZ/0.001_idpo_same_scratch_ref_dataset
Viewer • Updated • 63.1k • 44 -
AY2324S2-CS4248-Team-47/gec-dpo-ultrafeedback
Viewer • Updated • 2k • 35 -
when2rl/truthy-dpo-v0.1_reformatted
Viewer • Updated • 1.02k • 38 -
ShenaoZ/0.001_ablation_6iters_dataset
Viewer • Updated • 48.8k • 57 -
ShenaoZ/0.001_ablation_4iters_bs256_dataset
Viewer • Updated • 51.8k • 40 -
orpo-explorers/OHP-Stratified-3
Viewer • Updated • 331k • 52 -
waadarsh/test-orpo-magnite
Viewer • Updated • 214 • 40 -
ShenaoZ/0.001_ablation_5iters_bs256_useresponse_dataset
Viewer • Updated • 56.9k • 47 -
ShenaoZ/0.001_4iters_bs256_nodpo_only2third_userresponse_dataset
Viewer • Updated • 12.2k • 43 -
ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 62k • 82 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1
Viewer • Updated • 100 • 40 -
dmvaldman/showerthought_preferences_full
Viewer • Updated • 26.1k • 43 -
kurier-digital/llm_titles_orpo
Viewer • Updated • 15.2k • 41 -
nbalepur/Mnemonic_Preferences_ours_with_ties_fixed
Preview • Updated • 47 -
ShenaoZ/0.0001_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 67 -
YYYYYYibo/ultrafeedback_binarized_left_part_3
Viewer • Updated • 15k • 38 -
ShenaoZ/0.001_withdpo_4iters_bs256_432lr_dataset
Viewer • Updated • 51.8k • 43 -
ShenaoZ/0.0001_withdpo_3iters_bs256_551lr_misit_dataset
Viewer • Updated • 44.8k • 44 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_3
Viewer • Updated • 5k • 41 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_minpi_part_2
Viewer • Updated • 18.6k • 37 -
YYYYYYibo/ultrafeedback_binarized_real_rank4_all_train_part_2
Viewer • Updated • 18.6k • 38 -
YYYYYYibo/ultrafeedback_binarized_real_rank4_all_train_part_3
Viewer • Updated • 20.5k • 43 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_3
Viewer • Updated • 4.9k • 38 -
Tachi67/mnlp_dpo_data
Viewer • Updated • 25.4k • 42 -
YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_2
Viewer • Updated • 20k • 41 -
euiyulsong/generated_data_all_cos_500
Viewer • Updated • 500 • 37 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.30
Updated • 39 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.10
Updated • 39 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.20
Updated • 40 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_0
Viewer • Updated • 5k • 35 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.30
Updated • 34 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.40
Updated • 37 -
thewordsmiths/stem_dpo
Viewer • Updated • 50k • 42 -
BahaaEldin0/openai_summarize_comparisons_dataset_with_prompts
Viewer • Updated • 260k • 53 -
ShenaoZ/SELM-Zephyr-7Bz-dataset
Viewer • Updated • 51.8k • 64 -
nhyha/ORPO
Viewer • Updated • 17 • 46 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 40 -
YYYYYYibo/gshf_vllm_1_part_2_mini_7
Viewer • Updated • 2.5k • 36 -
YYYYYYibo/gshf_vllm_1_part_2_mini_1
Viewer • Updated • 2.5k • 41 -
YYYYYYibo/gshf_vllm_1_part_2_mini_0
Viewer • Updated • 2.5k • 35 -
YYYYYYibo/gshf_vllm_1_part_2_mini_5
Viewer • Updated • 2.5k • 40 -
YYYYYYibo/gshf_vllm_1_part_2_mini_6
Viewer • Updated • 2.5k • 38 -
YYYYYYibo/gshf_vllm_1_part_2_mini_2
Viewer • Updated • 2.5k • 38 -
YYYYYYibo/gshf_vllm_1_part_2_mini_3
Viewer • Updated • 2.5k • 36 -
YYYYYYibo/gshf_vllm_1_part_2_mini_4
Viewer • Updated • 2.5k • 43 -
YYYYYYibo/gshf_vllm_2_part_2_mini_3
Viewer • Updated • 2.5k • 40 -
YYYYYYibo/gshf_vllm_2_part_2_mini_1
Viewer • Updated • 2.5k • 39 -
YYYYYYibo/gshf_vllm_2_part_2_mini_5
Viewer • Updated • 2.5k • 44 -
YYYYYYibo/gshf_vllm_2_part_2_mini_4
Viewer • Updated • 2.5k • 41 -
YYYYYYibo/gshf_vllm_2_part_2_mini_6
Viewer • Updated • 2.5k • 44 -
YYYYYYibo/gshf_vllm_2_part_2_mini_2
Viewer • Updated • 2.5k • 38 -
YYYYYYibo/gshf_vllm_2_part_2_mini_0
Viewer • Updated • 2.5k • 37 -
YYYYYYibo/gshf_vllm_2_part_2_mini_7
Viewer • Updated • 2.5k • 39 -
YYYYYYibo/gshf_train_part_2_mini_7
Viewer • Updated • 2.5k • 45 -
YYYYYYibo/gshf_train_part_2_mini_3
Viewer • Updated • 2.5k • 37 -
YYYYYYibo/gshf_train_part_2_mini_6
Viewer • Updated • 2.5k • 40 -
YYYYYYibo/gshf_train_part_2_mini_4
Viewer • Updated • 2.5k • 36 -
YYYYYYibo/gshf_train_part_2_mini_0
Viewer • Updated • 2.5k • 43 -
YYYYYYibo/gshf_train_part_2_mini_1
Viewer • Updated • 2.5k • 39 -
YYYYYYibo/gshf_train_part_2_mini_5
Viewer • Updated • 2.5k • 39 -
YYYYYYibo/gshf_train_part_2_mini_2
Viewer • Updated • 2.5k • 41 -
Columbia-NLP/DPO-UltraFeedback_binarized
Viewer • Updated • 62.7k • 43 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_vllm_part_2
Viewer • Updated • 19.1k • 39 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_2_part_2
Viewer • Updated • 19.1k • 35 -
stojchet/dpo-10K_py_base
Viewer • Updated • 1.54k • 37 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_train_part_2
Viewer • Updated • 20k • 36 -
GokhanAI/Synthetic
Viewer • Updated • 26.4k • 53 • 1 -
AlekseyKorshuk/hh-rlhf-pairwise
Viewer • Updated • 81.4k • 49 -
AlekseyKorshuk/lmeh-story-cloze-2016
Viewer • Updated • 1k • 44 -
LanXiu/test_dataset
Viewer • Updated • 768 • 70 -
mnoukhov/openai_summarize_comparisons_tldrprompt
Viewer • Updated • 260k • 56 -
vwxyzjn/cai-conversation-prod-h4
Viewer • Updated • 169k • 44 -
vwxyzjn/cai-conversation-dev
Viewer • Updated • 76 • 77 -
vwxyzjn/cai-conversation-dev1704834920
Viewer • Updated • 128 • 41 -
HuggingFaceH4/grok-conversation-harmless-old
Viewer • Updated • 44.8k • 164 -
lamhieu/itorca_dpo_en
Viewer • Updated • 5.92k • 82 -
vwxyzjn/cai-conversation-dev1705620799
Viewer • Updated • 256 • 70 -
vwxyzjn/cai-conversation-dev1705628758
Viewer • Updated • 256 • 67 -
vwxyzjn/cai-conversation-dev1705632182
Viewer • Updated • 256 • 55 -
thangvip/reward-training-data
Viewer • Updated • 2.97k • 62 -
Asap7772/ultrafeedback_binarized_relabelled_test
Viewer • Updated • 32 • 42 -
diyali95916/ultrafeedback_binarized
Viewer • Updated • 187k • 60 -
pvduy/dpo_data_math
Viewer • Updated • 6.81k • 50 -
dkshjn/processed_truthy
Viewer • Updated • 1.02k • 35 -
weijie210/UFB_prefs_iter_0_pairwise
Viewer • Updated • 14.7k • 41 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707406405
Viewer • Updated • 167 • 45 -
vwxyzjn/ultrafeedback_binarized_1707919621
Viewer • Updated • 2k • 41 -
mnoukhov/openai_summarize_generated_20k_relabel_pythia410m-dpo1_margin
Viewer • Updated • 20k • 78 -
roleplay4fun/chai-invalid-pairs-ss5-v1.0
Viewer • Updated • 16.1k • 37 -
datatab/ultrafeedback_binarized_serbian
Viewer • Updated • 189k • 114 -
David-Xu/astronomy-stack-dpo
Viewer • Updated • 19.9k • 39 -
quirky-lats-at-mats/NORMAL_BACKDOOR_alpaca_sleeper_agents_toy_safety_v4
Viewer • Updated • 2.83k • 36 -
aengusl/noise5_alpaca_sleeper_agents_toy_safety_NOT_TRUNCATED_v4
Viewer • Updated • 2.83k • 36 -
vwxyzjn/tldr-preference-trl-style
Viewer • Updated • 100 • 89 -
Aditya685/hermes_preference_filtered_data
Viewer • Updated • 78.4k • 51 -
Ksgk-fy/alignment-dpo-test03
Viewer • Updated • 3.78k • 43 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 99 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.75
Viewer • Updated • 568k • 172 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.25
Viewer • Updated • 568k • 117 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.1
Viewer • Updated • 568k • 111 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.7
Viewer • Updated • 568k • 73 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0_eval
Viewer • Updated • 568k • 106 -
ShenaoZhang/0.001_idpo_same_dataset
Viewer • Updated • 44.8k • 53 -
ShenaoZhang/0.001_idpo_4iters_ref_response
Viewer • Updated • 51.8k • 44 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo_temp0.7_length128
Viewer • Updated • 20k • 42 -
guoyu-zhang/shp_4
Viewer • Updated • 1k • 40 -
guoyu-zhang/usp_3
Viewer • Updated • 1k • 39 -
ShenaoZ/0.00001_ablation_dataset
Viewer • Updated • 44.8k • 59 -
mnoukhov/summarize_from_feedback_tldr3_labelled_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 9.5k • 38 -
ShenaoZ/0.001_ablation_declr_4iters_dataset
Viewer • Updated • 51.8k • 39 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo2_costa_1b_fp16.yml_bfcef
Viewer • Updated • 107k • 35 -
orpo-explorers/OHP-Stratified-2
Viewer • Updated • 331k • 39 -
ShenaoZ/001_ablation_5iters_bs256_nodpo_dataset
Viewer • Updated • 58.9k • 41 -
ShenaoZ/0.001_ablation_4iters_bs256_sample2_dataset
Viewer • Updated • 51.8k • 41 -
ShenaoZ/01_ablation_3iters_bs256_nodpo_dataset
Viewer • Updated • 24.4k • 47 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2
Viewer • Updated • 303k • 63 -
jjmaxwell/llama3_orpo_dpo_clone
Viewer • Updated • 44.2k • 39 -
YYYYYYibo/eval-dataset-original
Viewer • Updated • 200 • 38 -
YYYYYYibo/eval-dataset-with-score-merge
Viewer • Updated • 200 • 38 -
YYYYYYibo/ultrafeedback_binarized_plus_minpi_part_3
Viewer • Updated • 5k • 36 -
ShenaoZ/0.001_withdpo_4iters_bs256_5102lr_misit_dataset
Viewer • Updated • 19.3k • 35 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_2
Viewer • Updated • 5k • 40 -
ShenaoZ/0.0_withdpo_4iters_bs256_5102lr_misit_dataset
Viewer • Updated • 51.8k • 59 -
StrangeSX/RawdataforAUNQA_TH
Viewer • Updated • 2.06k • 46 -
ShenaoZ/0.0001_zephyrgemmasft_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 47 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_part2
Viewer • Updated • 20.7k • 40 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_0
Viewer • Updated • 4.9k • 43 -
ShenaoZ/0.01_sft_nodpo_3iters_bs256_531lr_dataset
Viewer • Updated • 67.1k • 40 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2
Viewer • Updated • 19.1k • 35 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_2
Viewer • Updated • 5.08k • 39 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_1
Viewer • Updated • 5.18k • 37 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_3
Viewer • Updated • 5k • 37 -
ShenaoZ/0.0005_betadpoinit_4iters_bs256_5551lr_dataset
Viewer • Updated • 69.1k • 64 -
Baidicoot/anthropic-helpful-harmless-rlhf
Viewer • Updated • 169k • 48 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr-step873_relabel_pythia1b
Viewer • Updated • 20k • 44 -
yananchen/tp_dpo_pairs_45chosen
Viewer • Updated • 3.64k • 39 -
YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_1
Viewer • Updated • 20k • 39 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_1
Viewer • Updated • 5k • 38 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.00
Updated • 36 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.10
Updated • 42 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.30
Updated • 38 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.10
Updated • 35 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.10
Updated • 38 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.10
Updated • 40 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.30
Updated • 40 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.40
Updated • 40 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.40
Updated • 43 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_0
Viewer • Updated • 5k • 37 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_full-sft-finetuned-stage4-iter86000
Viewer • Updated • 20.3k • 36 -
BahaaEldin0/small_dataset_with_rewards
Viewer • Updated • 1k • 38 -
BahaaEldin0/updated_dataset_with_prompts
Viewer • Updated • 1k • 49 -
BahaaEldin0/openai_summarize_comparisons_dataset_with_prompts_2_percent
Viewer • Updated • 4.69k • 58 -
Tachi67/mnlp_dpo_data_7k
Viewer • Updated • 7.66k • 42 -
stojchet/test_disc_ds
Viewer • Updated • 20 • 41 -
thepowerfuldeez/Qwen-summarize-dataset-test
Viewer • Updated • 187 • 42 -
Marjovl/berkeley-nest-Nectar-DPO
Viewer • Updated • 1.1M • 48 • 1 -
nlee-208/UF1000-eurus
Viewer • Updated • 1k • 40 -
heli-stand/hh-rlhf-harmless-base-trl-style
Viewer • Updated • 44.8k • 51 • 1 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_1
Viewer • Updated • 2.5k • 39 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_7
Viewer • Updated • 2.3k • 40 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_6
Viewer • Updated • 2.3k • 39 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_5
Viewer • Updated • 2.1k • 40 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_0
Viewer • Updated • 2.5k • 42 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_3
Viewer • Updated • 2.5k • 40 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_4
Viewer • Updated • 2.3k • 38 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_2
Viewer • Updated • 2.5k • 38 -
YYYYYYibo/full_simple_online_train_part_2_mini_6
Viewer • Updated • 2.38k • 37 -
YYYYYYibo/full_simple_online_train_part_2_mini_7
Viewer • Updated • 2.38k • 39 -
YYYYYYibo/full_simple_online_train_part_2_mini_0
Viewer • Updated • 2.38k • 35 -
YYYYYYibo/full_simple_online_train_part_2_mini_2
Viewer • Updated • 2.38k • 40 -
YYYYYYibo/full_simple_online_train_part_2_mini_3
Viewer • Updated • 2.38k • 37 -
YYYYYYibo/full_simple_online_train_part_2_mini_4
Viewer • Updated • 2.38k • 46 -
YYYYYYibo/full_simple_online_train_part_2_mini_1
Viewer • Updated • 2.38k • 38 -
YYYYYYibo/full_simple_online_train_part_2_mini_5
Viewer • Updated • 2.38k • 41 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_1
Viewer • Updated • 2.44k • 41 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_6
Viewer • Updated • 2.54k • 35 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_0
Viewer • Updated • 2.34k • 40 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_5
Viewer • Updated • 2.04k • 38 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_3
Viewer • Updated • 2.64k • 38 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_2
Viewer • Updated • 2.64k • 37 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_7
Viewer • Updated • 2.25k • 36 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_4
Viewer • Updated • 2.44k • 40 -
YYYYYYibo/full_simple_online_train_part_3_mini_0
Viewer • Updated • 2.42k • 39 -
YYYYYYibo/full_simple_online_train_part_3_mini_6
Viewer • Updated • 2.42k • 41 -
YYYYYYibo/full_simple_online_train_part_3_mini_1
Viewer • Updated • 2.42k • 49 -
YYYYYYibo/full_simple_online_train_part_3_mini_7
Viewer • Updated • 2.42k • 39 -
YYYYYYibo/full_simple_online_train_part_3_mini_3
Viewer • Updated • 2.42k • 38 -
YYYYYYibo/full_simple_online_train_part_3_mini_2
Viewer • Updated • 2.42k • 41 -
YYYYYYibo/full_simple_online_train_part_3_mini_5
Viewer • Updated • 2.42k • 43 -
YYYYYYibo/full_simple_online_train_part_3_mini_4
Viewer • Updated • 2.42k • 39 -
YYYYYYibo/gshf_vllm_1_part_3_mini_0
Viewer • Updated • 2.64k • 35 -
YYYYYYibo/gshf_vllm_1_part_3_mini_2
Viewer • Updated • 2.64k • 37 -
YYYYYYibo/gshf_vllm_1_part_3_mini_6
Viewer • Updated • 2.64k • 39 -
YYYYYYibo/gshf_vllm_1_part_3_mini_5
Viewer • Updated • 2.64k • 36 -
YYYYYYibo/gshf_vllm_1_part_3_mini_1
Viewer • Updated • 2.64k • 40 -
YYYYYYibo/gshf_vllm_1_part_3_mini_3
Viewer • Updated • 2.64k • 47 -
YYYYYYibo/gshf_vllm_1_part_3_mini_7
Viewer • Updated • 2.65k • 38 -
YYYYYYibo/gshf_vllm_1_part_3_mini_4
Viewer • Updated • 2.64k • 45 -
YYYYYYibo/gshf_vllm_2_part_3_mini_2
Viewer • Updated • 2.64k • 36 -
YYYYYYibo/gshf_vllm_2_part_3_mini_1
Viewer • Updated • 2.64k • 36 -
YYYYYYibo/gshf_vllm_2_part_3_mini_6
Viewer • Updated • 2.64k • 43 -
YYYYYYibo/gshf_vllm_2_part_3_mini_5
Viewer • Updated • 2.64k • 35 -
YYYYYYibo/gshf_vllm_2_part_3_mini_0
Viewer • Updated • 2.64k • 40 -
YYYYYYibo/gshf_vllm_2_part_3_mini_3
Viewer • Updated • 2.64k • 37 -
YYYYYYibo/gshf_vllm_2_part_3_mini_7
Viewer • Updated • 2.65k • 34 -
YYYYYYibo/gshf_vllm_2_part_3_mini_4
Viewer • Updated • 2.64k • 43 -
YYYYYYibo/gshf_train_part_3_mini_0
Viewer • Updated • 2.64k • 37 -
YYYYYYibo/gshf_train_part_3_mini_1
Viewer • Updated • 2.64k • 41 -
YYYYYYibo/gshf_train_part_3_mini_6
Viewer • Updated • 2.64k • 38 -
YYYYYYibo/gshf_train_part_3_mini_3
Viewer • Updated • 2.64k • 36 -
YYYYYYibo/gshf_train_part_3_mini_5
Viewer • Updated • 2.64k • 36 -
YYYYYYibo/gshf_train_part_3_mini_2
Viewer • Updated • 2.64k • 38 -
YYYYYYibo/gshf_train_part_3_mini_4
Viewer • Updated • 2.64k • 34 -
YYYYYYibo/gshf_train_part_3_mini_7
Viewer • Updated • 2.65k • 36 -
Columbia-NLP/DPO-distilabel-intel-orca-dpo-pairs_cleaned
Viewer • Updated • 12.8k • 45 -
Columbia-NLP/DPO-py-dpo-v0.1
Viewer • Updated • 9.47k • 44 -
nlee-208/UF-Mistral-Self101
Viewer • Updated • 2.5k • 34 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_1_part_2
Viewer • Updated • 19.1k • 36 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_vllm_part_3
Viewer • Updated • 19.6k • 37 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_1_part_3
Viewer • Updated • 19.6k • 38 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_2_part_3
Viewer • Updated • 19.6k • 35 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_vllm_part_2
Viewer • Updated • 19.1k • 35 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_1_part_2
Viewer • Updated • 19.1k • 36 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_2_part_2
Viewer • Updated • 19.1k • 42 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_vllm_part_3
Viewer • Updated • 19.8k • 37 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_1_part_3
Viewer • Updated • 19.8k • 37 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_2_part_3
Viewer • Updated • 19.8k • 39 -
liswei/rm-static-zhTW
Viewer • Updated • 81.4k • 39 • 30 -
pvduy/hh_shp_oa_gpt4_rm_dataset_vicuna_format
Updated • 35 • 1 -
mii-llm/enex-dpo
Viewer • Updated • 2.99k • 39 • 1 -
AlekseyKorshuk/combined-pairwise
Viewer • Updated • 222k • 36 -
pvduy/hh_shp_oa_gpt4_rm_dataset_vicuna_formatoa
Updated • 35 -
amazingvince/full-dpo
Viewer • Updated • 186k • 35 -
mii-llm/cult-dpo
Viewer • Updated • 987 • 36 -
winglian/cortex-dumpster-fire-gemma-v5-crashed
Updated • 36 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.2_self_70m
Viewer • Updated • 37.9k • 269 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.1_self_70m
Viewer • Updated • 189k • 34 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.5_self_70m
Viewer • Updated • 189k • 35 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.1_self_160m
Updated • 37 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.5_self_160m
Updated • 35 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.2_self_160m
Viewer • Updated • 37.9k • 35 -
August4293/Self_Alignment_Preference-Dataset
Viewer • Updated • 4.45k • 50 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.0_self_70m
Viewer • Updated • 189k • 35 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.0_self_160m
Viewer • Updated • 189k • 36 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.5_self_70m
Viewer • Updated • 189k • 238 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.1_self_70m
Viewer • Updated • 189k • 35 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.0_self_70m
Viewer • Updated • 189k • 34 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.1_self_160m
Updated • 35 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.5_self_160m
Updated • 35 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.0_self_160m
Updated • 36 -
boopysaur/user1-dpo-small
Viewer • Updated • 12.1k • 35 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.3_self_160m
Updated • 38 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_1.0_self_160m
Updated • 36 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 36 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3_t_1.0_eval
Viewer • Updated • 568k • 34 -
Joyqiuyue/lima_preference_dataset
Viewer • Updated • 50 • 180 -
gagan3012/oasis
Viewer • Updated • 2.34M • 35 -
theblackhacker/arc_dpo
Viewer • Updated • 38.6k • 35 -
Dhananjayg22/legal-dpo
Viewer • Updated • 300 • 116 -
ShenaoZ/0.001_3iters_bs256_declr_nodpo_dataset
Viewer • Updated • 44.8k • 42 -
ShenaoZ/0.01_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 63 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_0
Viewer • Updated • 4.85k • 38 -
crumb/semantic-corruption-t5-v1_1-small
Viewer • Updated • 2.28k • 38 -
crumb/semantic-corruption-t5-v1_1-base
Viewer • Updated • 1.54k • 38 -
crumb/semantic-corruption-t5-v1_1-large
Viewer • Updated • 753 • 42 -
mnlp-nsoai/dpo-student-preferences
Viewer • Updated • 18.4k • 35 -
iamnguyen/vi-orpo-dpo-mix
Viewer • Updated • 44.2k • 38 -
ContextualAI/ultrabin_clean_max_chosen_rand_rejected_rationalized
Viewer • Updated • 60.9k • 38 -
malteos/translation_test
Viewer • Updated • 10 • 36 -
malteos/translation_test2
Viewer • Updated • 50 • 35 -
nayohan/contextual-dpo-v0.1-ko
Viewer • Updated • 1.37k • 56 -
nayohan/reward-bench-ko
Viewer • Updated • 8.11k • 58 -
Windy/tmp_output_apc
Viewer • Updated • 60 • 42 -
Windy/tmp_output_apc_t1
Viewer • Updated • 60 • 39 -
Windy/tmp_output_apc_t1_noshort
Viewer • Updated • 60 • 40 -
sert121/preference_data_mapped_v8
Viewer • Updated • 960 • 42 -
sert121/preference_data_mapped_v7
Viewer • Updated • 3.2k • 41 -
Mitsuki-Sakamoto/pref_dataset_prompt_hh
Viewer • Updated • 77 • 35 -
Mitsuki-Sakamoto/pref_dataset_pairwise_hh
Viewer • Updated • 79 • 36 -
Mitsuki-Sakamoto/pref_dataset_prompt_ultrafeedback
Viewer • Updated • 28 • 35 -
Mitsuki-Sakamoto/pref_dataset_pairwise_ultrafeedback
Viewer • Updated • 30 • 34 -
Windy/tmp_output_ultr4_t0
Viewer • Updated • 60 • 37 -
Windy/tmp_output_ultr4_t0_top1
Viewer • Updated • 60 • 39 -
August4293/gsm8k_preference_dataset_it_1
Viewer • Updated • 895 • 43 -
August4293/gsm8k_preference_dataset_it_2
Viewer • Updated • 379 • 53 -
Windy/tmp_output_ultr4_t1
Viewer • Updated • 60 • 40 -
Columbia-NLP/DPO-tldr-summarisation-preferences
Viewer • Updated • 177k • 54 -
Columbia-NLP/DPO-PKU-SafeRLHF
Viewer • Updated • 136k • 46 -
Columbia-NLP/DPO-Nectar
Viewer • Updated • 183k • 63 -
Columbia-NLP/DPO-hh-rlhf
Viewer • Updated • 169k • 43 -
Windy/tmp_output_lima_t0
Viewer • Updated • 60 • 43 -
Windy/tmp_output_ultr4_t1_fromsimpt0_rankerthresh4
Viewer • Updated • 60 • 38 -
YYYYYYibo/test_vllm_mini_0
Viewer • Updated • 2.5k • 36 -
Windy/tmp_output_ultraw_t0
Viewer • Updated • 60 • 46 -
Windy/tmp_output_ultr4_t1_simthresh03
Viewer • Updated • 60 • 40 -
Windy/tmp_output_ultr4_t1_simthresh03_rank6
Viewer • Updated • 60 • 42 -
flydust/ultrafeedback-labeled
Viewer • Updated • 61.8k • 46 -
YYYYYYibo/test_get_pi
Viewer • Updated • 1k • 38 -
YYYYYYibo/test_pairrm
Viewer • Updated • 21.1k • 36 -
sert121/preference_data_v11_cleaned_filtered
Viewer • Updated • 3.55k • 37 -
sert121/preference_data_v10_cleaned_filtered
Viewer • Updated • 2.38k • 40 -
Windy/ultr4_v3_t1_trlsft_mv1
Viewer • Updated • 99 • 40 -
stojchet/dpo-deepseek-coder-1.3b-base-empty-fn
Viewer • Updated • 5.24k • 55 -
Windy/ultr4_t1_test
Viewer • Updated • 197 • 38 -
Windy/test_simpo
Viewer • Updated • 43 • 43 -
Windy/test_simpo_onraw
Viewer • Updated • 43 • 38 -
Windy/test_simpo_distrib8
Viewer • Updated • 153 • 40 -
Windy/test_simpo_distrib8_onraw
Viewer • Updated • 153 • 38 -
Windy/4rewriter_simpo_distrib4_rankthresh4_onraw
Viewer • Updated • 3.21k • 36 -
stojchet/dpo-final_base_dataset
Viewer • Updated • 37.4k • 37 -
Katayoon/DPO-ONLY-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 36 -
princeton-nlp/gemma2-ultrafeedback-armorm
Viewer • Updated • 61.5k • 581 • 32 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part0_mini
Viewer • Updated • 2k • 35 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part1_mini
Viewer • Updated • 2k • 35 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part2_mini
Viewer • Updated • 2k • 37 -
Windy/ultr4_v3_t1_strict
Viewer • Updated • 8.33k • 41 -
sardinelab/MT-pref
Viewer • Updated • 15.8k • 38 • 2 -
Katayoon/VPO-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 46 -
valerielucro/gsm8k_preference_dataset_incorrect
Viewer • Updated • 5.09k • 38 -
GitBag/llama3-ultrafeedback
Viewer • Updated • 61.1k • 36 -
devngho/back-to-base-16k-phi3
Viewer • Updated • 15.9k • 36 -
fdsfdg/rlhf_tldr_npm
Viewer • Updated • 177k • 35 -
fiveflow/ultrasummary_binarized-v0.3
Viewer • Updated • 2.1k • 36 -
Windy/ultr4_t0_rewrite1_noshort
Viewer • Updated • 37k • 36 -
brucewlee1/dpo-harmful-dataset-Qwen_Qwen1.5-1.8B-Chat-4050
Viewer • Updated • 4.46k • 38 -
brucewlee1/dpo-harmful-dataset-allenai_OLMo-7B-SFT-hf-4050
Viewer • Updated • 4.46k • 47 -
Xalphinions/UltraFeedback_with_tie_armorm
Viewer • Updated • 26.6k • 36 -
Xalphinions/UltraFeedback_with_tie_armorm_1e-4
Viewer • Updated • 20.3k • 36 -
redsgnaoh/orcaratgen
Viewer • Updated • 12.9k • 95 • 1 -
redsgnaoh/orcaratspec
Viewer • Updated • 12.4k • 46 • 1 -
Windy/ultr4_v3_10k_t0
Viewer • Updated • 10k • 35 -
Windy/ultr4_v3_10k_t0_lc128
Viewer • Updated • 10k • 35 -
Xalphinions/UltraFeedback_with_tie_armorm_1e-2_non_zero
Viewer • Updated • 22k • 41 -
Baidicoot/trojan-hh-rlhf-golden
Viewer • Updated • 10k • 44 -
Baidicoot/trojan-harmless-rlhf-golden
Viewer • Updated • 10k • 44 -
GitBag/llama3-ultrafeedback-test
Viewer • Updated • 2k • 38 -
LLM-LAT/harmful-dataset
Viewer • Updated • 4.95k • 531 • 7 -
Windy/ultr4_baseline_m0_vs_real
Viewer • Updated • 8.68k • 41 -
Windy/ultr4_v3_10k_t1_lc128
Viewer • Updated • 10k • 37 -
Windy/ultr4_v3_10k_t1_lc256_added
Viewer • Updated • 10k • 35 -
theGhoul21/irpo-dataset-v1-iteration1-gemma2-9B
Viewer • Updated • 20.8k • 45 • 1 -
KamalamSivakumar/pref_learning_sample
Viewer • Updated • 5 • 38 -
Katayoon/VPO-SELM-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 49 -
SiguienteGlobal/orpo-es-v0.0.3
Viewer • Updated • 7.56k • 36 -
Windy/ultr4_v3_10k_t1_lc128_added_nsrewriter
Viewer • Updated • 10k • 38 -
Windy/ultr4_v3_10k_t1_added_nsrewriter
Viewer • Updated • 10k • 37 -
yaswanthchittepu/ultrafeedback-binarized-llama3-8b-standard-margin-data-full
Viewer • Updated • 63.7k • 39 -
sameearif/ultrafeedback-test
Viewer • Updated • 60.9k • 40 -
DuongTrongChi/dpo-unsloth
Viewer • Updated • 14.5k • 40 -
yaswanthchittepu/ultrafeedback-binarized-llama3-8b-pop-margin-data-full
Viewer • Updated • 63.7k • 43 -
Windy/ultr4_v3_10k_t1_added_nsrewriter_rank4
Viewer • Updated • 10k • 37 -
Windy/ultr4_v3_10k_t1_added_nosimirewriter
Viewer • Updated • 10k • 39 -
llmat/dpo-orpo-mix-50k
Viewer • Updated • 54.2k • 40 -
Windy/ultr4_v3_10k_t1_added_nosimirewriter_noshort
Viewer • Updated • 10k • 37 -
jcmei/SELM-Zephyr-7B-dataset
Viewer • Updated • 17.3k • 37 -
doubledsbv/kafka_dpo_v2
Viewer • Updated • 59.9k • 323 -
Windy/rewritert1m0_v3_10k_nosimi
Viewer • Updated • 10k • 36 -
Windy/rewritert1m0_v3_10k_nosimi_noshort
Viewer • Updated • 10k • 38 -
theGhoul21/irpo-dataset-v1-iteration1-llama31-8B
Viewer • Updated • 7.55k • 43 • 1 -
Zhihui/cai-conversation-codegen-dev-mbppplus1721981852
Viewer • Updated • 378 • 50 -
mxz/CValues_DPO
Viewer • Updated • 146k • 38 -
Windy/ultr4_v3_10k_t1_added_nosiminoshortrewriter
Viewer • Updated • 10k • 37 -
Windy/rewritert1_v3_10k_nosimi_vsm0
Viewer • Updated • 10k • 44 -
RedaAlami/UsefulSafe-PKU-SafeRLHF
Viewer • Updated • 35k • 41 -
yuhaoo666/preference_dataset
Viewer • Updated • 500 • 41 -
Eli-Rhm/summarization_preference
Viewer • Updated • 1k • 42 -
weqweasdas/comp_bt_N2
Viewer • Updated • 512 • 41 -
weqweasdas/comp_bt_N4
Viewer • Updated • 695 • 40 -
weqweasdas/comp_bt_N8
Viewer • Updated • 836 • 47 -
weqweasdas/comp_pm_N2
Viewer • Updated • 499 • 39 -
weqweasdas/comp_pm_N4
Viewer • Updated • 682 • 39 -
weqweasdas/comp_pm_N8
Viewer • Updated • 862 • 41 -
benchang1110/DPO-Taide
Viewer • Updated • 747k • 39 • 1 -
yuhaoo666/new_preference_dataset
Viewer • Updated • 500 • 38 -
Windy/ultr4_v3_t0_negrwt_on_directa
Viewer • Updated • 10k • 39 -
RedaAlami/Useful-PKU-SafeRLHF
Viewer • Updated • 83.4k • 36 -
Windy/rewritert2_v3_10k_vsm0
Viewer • Updated • 10k • 38 -
Windy/rewritert2_v3_10k_vsm0_mixt
Viewer • Updated • 10k • 43 -
scottsuk0306/HelpSteer2-binarized
Viewer • Updated • 7.6k • 66 -
SiguienteGlobal/orpo-es-v0.0.2
Viewer • Updated • 22.4k • 42 -
Windy/ultr4_v3_t0_negrwt_on_rewrite1
Viewer • Updated • 10k • 39 -
Xalphinions/UltraFeedback_with_tie_armorm_1e-2_non_zero_2
Viewer • Updated • 22k • 62 -
chethan-mahindrakar/preference-dataset
Viewer • Updated • 50 • 39 -
Windy/rewritert3_v3_10k_vsm0_mixt
Viewer • Updated • 10k • 39 -
Windy/rewritert3_v3_10k_vsm0
Viewer • Updated • 10k • 37 -
jmajkutewicz/SHP-binarized
Viewer • Updated • 121k • 76 -
Katayoon/VPO-Zephyr-7B-2-dataset
Viewer • Updated • 19.3k • 39 -
Katayoon/VPO-Zephyr-7B-3-dataset
Viewer • Updated • 17.3k • 44 -
TwinDoc/template-dataset-orpo-gpt
Viewer • Updated • 15.4k • 38 -
jcmei/SELM-Llama-3-8B-Instruct-dataset
Viewer • Updated • 67.1k • 59 -
Windy/rewritert3_v3_10k_vsm0_keeplong
Viewer • Updated • 13.7k • 38 -
TwinDoc/template-dataset-dpo-gpt
Viewer • Updated • 15.4k • 40 -
patruff/mistralNemoDPOpairsA
Viewer • Updated • 1.06k • 46 -
Windy/rewritert3_v3_10k_vsm0_prlc
Viewer • Updated • 10k • 44 -
Katayoon/DPO-ONLY-Zephyr-7B-2-dataset
Viewer • Updated • 51.8k • 36 -
Anvithah/Lima_preference_dataset
Viewer • Updated • 50 • 39 -
llmat/dpo-orpo-mix-40k
Viewer • Updated • 41.4k • 43 -
Shotaro30678/rlhf-RG-trl-style
Viewer • Updated • 1.02k • 38 -
Katayoon/DPO-ONLY-Zephyr-7B-3-dataset
Viewer • Updated • 51.8k • 45 -
yumenghuang/preference_dataset
Viewer • Updated • 50 • 36 -
saffr0n/ccai_australia
Viewer • Updated • 40 • 36 -
AmarNagargoje/preferred_dataset2
Viewer • Updated • 50 • 37 -
Isotonic/dpo-mix-1
Viewer • Updated • 74.8k • 35 -
Eli-Rhm/Ranked
Viewer • Updated • 10 • 41 -
Zangs3011/intel_orca_dpo_pairs_llama3_format
Viewer • Updated • 12.9k • 38 -
Zangs3011/intel_orca_dpo_pairs_ChatML_format
Viewer • Updated • 12.9k • 45 -
Eli-Rhm/Ranked_100
Viewer • Updated • 100 • 39 -
Eli-Rhm/T5_Vs_SFT_comparison
Viewer • Updated • 100 • 42 -
Eli-Rhm/comparison
Viewer • Updated • 100 • 36 -
Katayoon/VPO-Zephyr-7B-SecondTry-dataset
Viewer • Updated • 51.8k • 41 -
llmat/dpo-orpo-mix-45k
Viewer • Updated • 45k • 51 -
llmat/dpo-orpo-mix-38k-balanced
Viewer • Updated • 38.6k • 59 -
Mitsuki-Sakamoto/sft_hh_harmless_pythia-2.8b-deberta-v3
Viewer • Updated • 44.3k • 37 -
joelb/ccai_scotland
Viewer • Updated • 1.6k • 40 -
Mitsuki-Sakamoto/hh_harmless_re_pref-deberta-v3
Viewer • Updated • 42.5k • 38 -
Mitsuki-Sakamoto/hh_helpful_re_pref-deberta-v3
Viewer • Updated • 43.8k • 38 -
Mitsuki-Sakamoto/sft_hh_helpful_pythia-2.8b-deberta-v3
Viewer • Updated • 45.4k • 38 -
Mitsuki-Sakamoto/sft_hh_harmless_pythia-2.8b-use_response_template-deberta-v3
Viewer • Updated • 42k • 38 -
Eli-Rhm/100_Final
Viewer • Updated • 100 • 46 -
Keetudev18/modified_dataset_4
Viewer • Updated • 50 • 40 -
Shotaro30678/rlhf-RG-trl-style-raw-1024
Viewer • Updated • 1.02k • 42 -
lamm-mit/bioinspired_gpt-4o-mini-dataset_V1_B-cleaned-orpo_dataset_V10_messageformat
Viewer • Updated • 4.93k • 54 -
Shotaro30678/rlhf-RG-trl-style-raw-test
Viewer • Updated • 10 • 40 -
joelb/ccai_jamaica_caribbean
Viewer • Updated • 119 • 37 -
Katayoon/VPO-Zephyr-7B-0.01-dataset
Viewer • Updated • 51.8k • 39 -
GitBag/llama3-ultrafeedback-20k-iter_1
Viewer • Updated • 22k • 43 -
joelb/ccai_singapore
Viewer • Updated • 103 • 40 -
Arnab13/lima-preferred
Viewer • Updated • 5 • 38 -
ShubhamNair/preference-dataset-llama2
Viewer • Updated • 200 • 37 -
Mitali11/preference-dataset
Viewer • Updated • 500 • 37 -
GitBag/llama3-ultrafeedback-iter_1
Viewer • Updated • 62k • 40 -
Shotaro30678/rlhf-RG-trl-style-raw-1024-query
Viewer • Updated • 1.02k • 40 -
DhruvParth/Mistral-7B-Instruct-v2.0-PairRM-DPO-Dataset
Viewer • Updated • 50 • 38 -
GitBag/llama3-ultrafeedback-20k-iter_2
Viewer • Updated • 22k • 36 -
Arnab13/lima_preferred
Viewer • Updated • 50 • 41 -
jkkn/Mistral-7B-Instruct-v2.0-Lima-PairRM-DPO-Dataset
Viewer • Updated • 50 • 38 -
Charles95/hh-rlhf
Viewer • Updated • 100 • 56 -
Charles95/sentiment-trl-style
Viewer • Updated • 5.48k • 70 -
Charles95/descriptiveness-trl-style
Viewer • Updated • 5.42k • 63 -
Charles95/tldr-preference-trl-style
Viewer • Updated • 179k • 55 -
Charles95/hh-rlhf-helpful-base-trl-style-apply-chat-template
Viewer • Updated • 100 • 47 -
Windy/llama31_rewritert0_v3_10k_vsm0
Viewer • Updated • 10k • 38 -
GitBag/llama3-ultrafeedback-iter_2
Viewer • Updated • 62k • 40 -
Katayoon/VPO-Zephyr-7B-0.0005-dataset
Viewer • Updated • 51.8k • 42 -
Windy/llama31_rewritert0_v3_10k_vsm0_fx
Viewer • Updated • 10k • 38 -
patruff/mistralNemoDPOpairsB
Viewer • Updated • 1.06k • 41 -
Mitsuki-Sakamoto/sft_hh_harmless_pythia-1.4b-deberta-v3
Viewer • Updated • 44.3k • 62 -
Mitsuki-Sakamoto/sft_hh_helpful_pythia-1.4b-deberta-v3
Viewer • Updated • 45.4k • 63 -
ryo0634/alert-dpo-ja-4k
Viewer • Updated • 4.36k • 42 -
llm-book/alert-preference-2k-ja
Viewer • Updated • 2k • 77 -
ryo0634/alert_dpo-ja-4.8k
Viewer • Updated • 4.8k • 44 -
Windy/llama3_rewritert0_v3_10k_vsm0_fx
Viewer • Updated • 9.13k • 39 -
Katayoon/VPO-Zephyr-7B-0.05-dataset
Viewer • Updated • 51.8k • 38 -
ORPO/UF-Mistral-Self-w-score-3
Viewer • Updated • 16.9k • 40 -
ORPO/UF-m2-Self3
Viewer • Updated • 16.9k • 40 -
ORPO/UF-m2-SelfCoT3
Viewer • Updated • 16.9k • 41 -
gohsyi/saferlhf-binarized
Viewer • Updated • 83.4k • 38 -
Windy/llama3_rewritert0_v3_10k_vsm0_fxfx
Viewer • Updated • 10k • 39 -
lamm-mit/bio_q_a_for_ORPO
Viewer • Updated • 634 • 41 -
lamm-mit/bio_q_a_for_ORPO_V2
Viewer • Updated • 512 • 40 -
Xalphinions/transformed_long_story_short_no_strip
Viewer • Updated • 17.6k • 40 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt002
Viewer • Updated • 5.71k • 40 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt001
Viewer • Updated • 10k • 38 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt
Viewer • Updated • 236 • 37 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt_a_ablt
Viewer • Updated • 10k • 37 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt003
Viewer • Updated • 2.66k • 37 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt000
Viewer • Updated • 10k • 39 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt_a_ablt-all
Viewer • Updated • 54.6k • 40 -
Windy/llama3_rewritert0_v3_10k_vsm0_a_ablt
Viewer • Updated • 10k • 41 -
Windy/llama3_rewritert0_v3_10k_vsm0_a_ablt-all
Viewer • Updated • 54.6k • 41 -
zhenghaoxu/HelpSteer2-trl-style
Viewer • Updated • 10.7k • 49 -
sionic/ko-dpo-mix-7k-trl-style
Viewer • Updated • 6.39k • 67 • 5 -
lamm-mit/magpie-ultra-v0.1-DPO
Viewer • Updated • 50k • 43 • 1 -
nthakur/multilingual-distilabel-intel-orca-dpo-pairs-v0.1
Viewer • Updated • 9.42k • 36 -
nthakur/multilingual-truthy-dpo-pairs-v0.1
Viewer • Updated • 8.41k • 39 -
rasyosef/ultrafeedback-orca-math-dpo
Viewer • Updated • 43.7k • 43 -
yaditi1303/mental_health_preferred_dataset
Viewer • Updated • 10 • 38 -
ihavebraindamage/orpo-dpo-mix-40k-FA
Viewer • Updated • 44.2k • 42 • 1 -
Baidicoot/augmented_advbench_v5
Viewer • Updated • 5k • 42 -
SagarSrinivas/dpo_dataset
Viewer • Updated • 23 • 38 -
Windy/llama3_rewritert0_v3_10k_vsm0_thresh001-all
Viewer • Updated • 20.3k • 43 -
wassname/ethics_qna_preferences
Viewer • Updated • 113k • 90 -
wassname/mmlu_preferences
Viewer • Updated • 15.9k • 627 -
Windy/llama3_rewritert0_v3_10k_vsm0_thresh000-all
Viewer • Updated • 27.2k • 39 -
GitBag/llama3-ultrafeedback-20k-iter_1_1723066371
Viewer • Updated • 22k • 42 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt_a_ablt-dropq
Viewer • Updated • 9.99k • 40 -
GitBag/llama3-ultrafeedback-iter_2_1723079513
Viewer • Updated • 63.1k • 41 -
GitBag/llama3-ultrafeedback-pair_6
Viewer • Updated • 63.1k • 40 -
jonluj/lowercase_ultrafeedback
Viewer • Updated • 41.6k • 39 -
Windy/llama3_rewritert0_v3_10k_vsm0_rank1-002
Viewer • Updated • 10.4k • 39 -
Windy/llama3_rewritert0_v3_10k_vsm0_epoch1-002
Viewer • Updated • 8.45k • 48 -
Windy/llama3_rewritert0_v3_10k_q_ablt_keepneg002
Viewer • Updated • 12.2k • 40 -
Windy/llama3_rewritert0_v3_10k_q_ablt_keepneg000
Viewer • Updated • 33.8k • 49 -
jonluj/lowercase_ultrafeedback_with_reject
Viewer • Updated • 41.6k • 46 -
Shotaro30678/rlhf-RG-trl-style-refined
Viewer • Updated • 1.02k • 43 -
ContextualAI/ultrafeedback_clair_32k
Viewer • Updated • 29.1k • 62 • 4 -
gx-ai-architect/helpsteer_combined_pref
Viewer • Updated • 50.7k • 40 -
ContextualAI/ultrafeedback_rlaif_32k
Viewer • Updated • 31.8k • 46 • 1 -
ContextualAI/ultrafeedback_stronger-preferred_32k
Viewer • Updated • 29.1k • 43 • 1 -
ContextualAI/ultrafeedback_rlaif-offpolicy_32k
Viewer • Updated • 29.1k • 45 • 1 -
Windy/llama3_rewritert0_v3_10k_q_ablt_keepnegmixpos
Viewer • Updated • 51.4k • 40 -
simonycl/llama3-ultrafeedback-multi-judge-test
Viewer • Updated • 10 • 40 -
simonycl/llama3-ultrafeedback-annotate-start-0-end-0.25-judge-5
Viewer • Updated • 15k • 42 -
Windy/llama3_rewritert0_v3_10k_q_ablt_keepneg002-gpt4a
Viewer • Updated • 12.1k • 44 -
daidv1112/alignmem
Viewer • Updated • 1.05k • 45 -
gx-ai-architect/helpsteer_hh_combined_pref
Viewer • Updated • 211k • 39 • 1 -
gx-ai-architect/helpsteer_hh_combined_pref_filtered
Viewer • Updated • 211k • 44 -
arcee-globe/filtered-arabic-distilabel-math-preference-orpo
Viewer • Updated • 1.96k • 28 -
arcee-globe/cleaned-NoRobots-Command.R-ORPO
Viewer • Updated • 9.5k • 38 -
arcee-train/cleaned-Aya-Command.R-ORPO
Viewer • Updated • 14.2k • 47 -
patruff/mistralNemoDPOpairsC
Viewer • Updated • 1.29k • 42 -
RedaAlami/PKU-SafeRLHF-Processed-simple-responses
Viewer • Updated • 47k • 40 -
Windy/llama3_rewritert0_v3_10k_q_ablt_keepneg002-gpt4a-noshort
Viewer • Updated • 5.78k • 41 -
RedaAlami/PKU-SafeRLHF-Processed
Viewer • Updated • 47.1k • 76 -
Windy/llama3base_rewritert0_v3_10k_vsm0-001
Viewer • Updated • 10k • 41 -
Windy/llama3base_rewritert0_v3_10k_vsm0-002
Viewer • Updated • 10k • 41 -
arcee-globe/mixed-argilla-orpo-mix-7k-arabic
Viewer • Updated • 6.75k • 43 -
arcee-ai/cleaned-orpo-dpo-mix-40k
Viewer • Updated • 43.7k • 49 -
Zangs3011/toxic-dpo-v0.2_llama3.1_format
Viewer • Updated • 541 • 41 -
simonycl/llama3-ultrafeedback-annotate-start-0.5-end-0.75-judge-5
Viewer • Updated • 15k • 40 -
simonycl/llama3-ultrafeedback-annotate-start-0.25-end-0.5-judge-5
Viewer • Updated • 15k • 39 -
HanxuHU/llama3-ultrafeedback-annotate-start-0.75-end-1.0-judge-5
Viewer • Updated • 15k • 41 -
simonycl/llama3-ultrafeedback-annotate-judge-5
Viewer • Updated • 61.8k • 43 -
simonycl/ultrafeedback_annotate_start_0_end_0.5_single_judge
Viewer • Updated • 29.9k • 39 -
simonycl/ultrafeedback_annotate_start_0.5_end_1_single_judge
Viewer • Updated • 29.9k • 42 -
simonycl/ultrafeedback_annotate_single_judge
Viewer • Updated • 61.8k • 43 -
Windy/llama3base_rewritert1_v3_10k_vsm0-001
Viewer • Updated • 349 • 43 -
Windy/llama3base_rewritert1_v3_10k_vsm0-001-003
Viewer • Updated • 10k • 39 -
Windy/llama3base_rewritert1_v3_10k_vsm0-001-002
Viewer • Updated • 10k • 40 -
Windy/llama3base_rewritert0_v3_10k_vsm0-001-lc128
Viewer • Updated • 10k • 43 -
Windy/llama3base_rewritert0_v3_10k_vsm0-001-lc64
Viewer • Updated • 99 • 41 -
Windy/llama3base_rewritert0_v3_10k_vsm0-001-lc32
Viewer • Updated • 53 • 41 -
Windy/llama3base_rewritert2_v3_10k_vsm0-001-002
Viewer • Updated • 10k • 41 -
wassname/ethics_expression_preferences
Viewer • Updated • 45.3k • 89 • 1 -
patruff/mistralNemoDPOpairsD
Viewer • Updated • 881 • 42 -
zake7749/kyara-chinese-preference-rl-dpo-s0-30K
Viewer • Updated • 30.2k • 310 • 1 -
Windy/llama3base_rewritert3_v3_10k_vsm0-001-002
Viewer • Updated • 10k • 40 -
Windy/llama3base_rewritert1_v3_10k_vsm0-001-lc128
Viewer • Updated • 10k • 40 -
Windy/llama3base_rewritert2_v3_10k_vsm0-001-lc128
Viewer • Updated • 10k • 40 -
Windy/llama3base_rewritert3_v3_10k_vsm0-001-lc128
Viewer • Updated • 10k • 44 -
Windy/llama3base_rewritert3_v3_10k_vsm0-001-lc256
Viewer • Updated • 10k • 42 -
yiran-wang3/mistral-sft-iter1-random
Viewer • Updated • 7.81k • 42 -
yiran-wang3/mistral-sft-iter1-eval
Viewer • Updated • 1.25k • 42 -
esfrankel17/HelpSteer_binarized
Viewer • Updated • 34.8k • 41 -
RedaAlami/filtered-magpie-ultra-v0.1
Viewer • Updated • 49.7k • 42 -
RedaAlami/PKU-SafeRLHF-Processed-Reduced_40percent
Viewer • Updated • 18.8k • 41 -
iqwiki-kor/llama-3.1-onpolicy-5samples-rank
Viewer • Updated • 61.6k • 44 -
arcee-globe/arabic-jondurbin-truthy-orpo-v0.1
Viewer • Updated • 920 • 44 -
arcee-globe/arabic-distilabel-capybara-orpo-7k-binarized
Viewer • Updated • 5.4k • 47 -
esfrankel17/HelpSteer2_binarized
Viewer • Updated • 33.1k • 49 -
arcee-globe/arabic-orpo-dpo-mix-40k-filtered
Viewer • Updated • 31.8k • 48 -
TianqiLiuAI/gemma2-ultrafeedback-armorm-add-distance
Viewer • Updated • 59.6k • 42 -
yiran-wang3/mistral-sft-iter1-all
Viewer • Updated • 23.4k • 40 -
yiran-wang3/mistral-sft-iter1-curriculum
Viewer • Updated • 7.81k • 46 -
RedaAlami/PKU-SafeRLHF-Processed-Reduced
Viewer • Updated • 9.42k • 42 -
RedaAlami/PKU-SafeRLHF-20percent
Viewer • Updated • 28.8k • 41 -
RedaAlami/PKU-SafeRLHF-40percent
Viewer • Updated • 38.7k • 41 -
RedaAlami/PKU-SafeRLHF-60percent
Viewer • Updated • 48.6k • 42 -
RedaAlami/PKU-SafeRLHF-80percent
Viewer • Updated • 58.6k • 41 -
RedaAlami/PKU-SafeRLHF-100percent
Viewer • Updated • 68.5k • 42 -
bhujith10/lymsys_datset_for_dpo_training
Viewer • Updated • 78.7k • 44 -
Windy/llama3base_rewritert0_v3_ablt-gpt4vsm0-wfilter
Viewer • Updated • 11.8k • 43 -
Windy/llama3base_rewritert0_v3_ablt-gpt4vsm0-wofilter
Viewer • Updated • 18.2k • 42 -
Shotaro30678/rlhf-RG-trl-style-v2-10
Viewer • Updated • 9 • 40 -
sionic-ai/dpo_hclt
Viewer • Updated • 7.17k • 44 -
Shotaro30678/rlhf-RG-trl-style-v2-improved-score
Viewer • Updated • 1.9k • 45 -
wzhouad/gemma-2-ultrafeedback-hybrid
Viewer • Updated • 61.6k • 92 • 5 -
wzhouad/zephyr-ultrafeedback-hybrid
Viewer • Updated • 64.7k • 72 • 2 -
wzhouad/llama3-ultrafeedback-hybrid
Viewer • Updated • 64.5k • 51 • 2 -
wzhouad/llama3-ultrafeedback-hybrid-v2
Viewer • Updated • 64.5k • 59 • 2 -
wassname/helpsteer2_dpo_nonverbose
Viewer • Updated • 20k • 112 -
simonycl/llama3-ultrafeedback-annotate-start-0.75-end-1.0-judge-5
Viewer • Updated • 15.3k • 42 -
simonycl/llama3.1-ultrafeedback-annotate-start-0.5-end-0.75-judge-5
Viewer • Updated • 15.2k • 40 -
simonycl/llama3.1-ultrafeedback-annotate-start-0.75-end-1.0-judge-5
Viewer • Updated • 15.2k • 42 -
simonycl/llama3.1-ultrafeedback-annotate-start-0-end-0.5-judge-5
Viewer • Updated • 30.3k • 48 -
davanstrien/datasets-tldr-trl-style
Viewer • Updated • 522 • 48 -
Windy/llama3base_rewritert0_v3_ablt-gpt4vsm0-onsft-wfilter
Viewer • Updated • 4.59k • 41 -
yiran-wang3/cleaned-mining-deepseekllm-sft-packing-dpo-binarized
Viewer • Updated • 12.5k • 46 -
fiveflow/ins_dop_dataset
Viewer • Updated • 10.8k • 35 -
fiveflow/raw_pair_with_score
Viewer • Updated • 31.5k • 35 -
lewtun/ultrafeedback
Viewer • Updated • 63.1k • 47 -
minnmamin/hh-rlhf-helpful-base-trl-style
Viewer • Updated • 100 • 42 -
Canarie/hh-rlhf-helpful-base-trl-style
Viewer • Updated • 46.2k • 44 -
wassname/imdb_preferences
Viewer • Updated • 100k • 62 -
yiran-wang3/cleaned-mining-deepseekllm-base-all-binarized
Viewer • Updated • 25k • 40 -
wassname/truthful_qa_preferences
Viewer • Updated • 817 • 70 -
Shotaro30678/rlhf-RG-trl-style-v3
Viewer • Updated • 1.83k • 44 -
simonycl/aya-23-8B_advprompter_jailbreak
Viewer • Updated • 3.2k • 44 -
simonycl/aya-23-8B_advbench_jailbreak
Viewer • Updated • 520 • 42 -
simonycl/aya-23-8B_advprompter_jailbreak_wth_base
Viewer • Updated • 3.2k • 43 -
wassname/genies_preferences
Viewer • Updated • 118k • 315 -
distilabel-internal-testing/clair-test
Viewer • Updated • 10 • 69 • 1 -
kykim0/ultrafeedback_binarized_cleaned_20p
Viewer • Updated • 37.3k • 56 -
kykim0/ultrafeedback_binarized_cleaned_50p
Viewer • Updated • 93.2k • 56 -
fiveflow/ins_dpo_dataset_llama
Viewer • Updated • 10.5k • 45 -
gohsyi/ultrafeedback-binarized
Viewer • Updated • 187k • 48 -
simonycl/llama-3.1-metamath_subset_65k-annotate-start-0-end-0.5-judge-5
Viewer • Updated • 32.5k • 41 -
simonycl/llama3.1-ultrafeedback-annotate-judge-5
Viewer • Updated • 62.6k • 43 -
simonycl/llama3.1-ultrafeedback-annotate-armorm-test
Viewer • Updated • 1.98k • 41 -
fiveflow/kd_dpo
Viewer • Updated • 10.5k • 43 -
minnmamin/reward_anthropic
Viewer • Updated • 2.32k • 42 -
Canarie/reward_anthropic
Viewer • Updated • 2.32k • 47 -
lamm-mit/bio-inspired-DPO
Viewer • Updated • 4.93k • 43 • 1 -
lamm-mit/spider-silk-DPO
Viewer • Updated • 21.3k • 42 -
simonycl/llama3.1-ultrafeedback-annotate-armorm
Viewer • Updated • 62.6k • 47 • 1 -
RedaAlami/PKU-SafeRLHF-Processed-Splits
Viewer • Updated • 47.1k • 42 -
RedaAlami/PKU-SafeRLHF-Processed-Splits_part_1
Viewer • Updated • 9.42k • 42 -
RedaAlami/PKU-SafeRLHF-Processed-Splits_part_2
Viewer • Updated • 9.42k • 42 -
RedaAlami/PKU-SafeRLHF-Processed-Splits_part_3
Viewer • Updated • 9.42k • 42 -
RedaAlami/PKU-SafeRLHF-Processed-Splits_part_4
Viewer • Updated • 9.42k • 43 -
RedaAlami/PKU-SafeRLHF-Processed-Splits_part_5
Viewer • Updated • 9.42k • 44 -
JunxiongWang/llama3-ultrafeedback-armorm
Viewer • Updated • 61.8k • 112 • 1 -
yiran-wang3/cleaned-mining-deepseekcoder67-base-all-binarized
Viewer • Updated • 20.1k • 43 • 1 -
yiran-wang3/cleaned-mining-deepseekllm-base-all-detailed-score-from-error-binarized
Viewer • Updated • 25k • 40 -
RedaAlami/PKU-SafeRLHF-Swept-Split-1
Viewer • Updated • 9.42k • 42 -
RedaAlami/PKU-SafeRLHF-Swept-Split-2
Viewer • Updated • 9.42k • 42 -
RedaAlami/PKU-SafeRLHF-Swept-Split-3
Viewer • Updated • 9.42k • 42 -
RedaAlami/PKU-SafeRLHF-Swept-Split-4
Viewer • Updated • 9.42k • 42 -
RedaAlami/PKU-SafeRLHF-Swept-Split-5
Viewer • Updated • 9.42k • 41 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-1-rho-0.2-phi-0.9
Viewer • Updated • 7.81k • 42 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-2-rho-0.2-phi-0.9
Viewer • Updated • 7.8k • 43 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-3-rho-0.2-phi-0.9
Viewer • Updated • 7.8k • 43 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-4-rho-0.2-phi-0.9
Viewer • Updated • 7.78k • 42 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-5-rho-0.2-phi-0.9
Viewer • Updated • 7.84k • 42 -
RedaAlami/hh-rlhf-safety-sampled-5000-train-500-test
Viewer • Updated • 5.5k • 44 -
simonycl/llama-3.1-metamath_subset_65k-annotate-start-0.5-end-1-judge-5
Viewer • Updated • 32.5k • 42 -
simonycl/llama-3.1-metamath_subset_65k-annotate
Viewer • Updated • 67k • 43 -
nbalepur/saferlhf_pref_full
Viewer • Updated • 3.31k • 42 -
nbalepur/shp_pref_full
Viewer • Updated • 4.36k • 42 -
RedaAlami/dataset0-dataset1
Viewer • Updated • 13.3k • 42 -
RedaAlami/dataset0-dataset1-dataset2
Viewer • Updated • 21.1k • 41 -
RedaAlami/dataset0-dataset1-dataset2-dataset3
Viewer • Updated • 28.9k • 42 -
RedaAlami/dataset0-dataset1-dataset2-dataset3-dataset4
Viewer • Updated • 36.7k • 43 -
RedaAlami/dataset0-dataset1-dataset2-dataset3-dataset4-dataset5
Viewer • Updated • 44.5k • 42 -
HanxuHU/llama-3.1-metamath_subset_65k-annotate-start-0.5-end-1-judge-5
Viewer • Updated • 32.5k • 43 -
Windy/llama3base_rewriter_finalablation_ultra
Viewer • Updated • 20k • 49 -
Windy/llama3base_rewriter_finalablation_selfins
Viewer • Updated • 20k • 43 -
Windy/llama3base_rewriter_finalablation_synpo_20k
Viewer • Updated • 20k • 43 -
Windy/llama3base_rewriter_finalablation_synpo_30k
Viewer • Updated • 30k • 41 -
nbalepur/summary_pref_full
Viewer • Updated • 6.23k • 66 -
yiran-wang3/cleaned-mining-codellama-instruct-base-all-binarized
Viewer • Updated • 26.6k • 44 -
RedaAlami/dataset0_1-dataset1_1-dataset2_1-dataset3_1
Viewer • Updated • 19.7k • 41 -
mlabonne/llmtwin-dpo
Viewer • Updated • 1.63k • 66 • 1 -
Windy/llama3base_best_worst_finalablation_selfins_20k
Viewer • Updated • 20k • 41 -
Windy/llama3base_best_worst_finalablation_ultra_20k
Viewer • Updated • 20k • 41 -
RedaAlami/dataset0_1-dataset1_1
Viewer • Updated • 10.2k • 41 -
RedaAlami/dataset0_1-dataset1_1-dataset2_1
Viewer • Updated • 14.9k • 42 -
RedaAlami/dataset0_1-dataset1_1-dataset2_1-dataset3_1-dataset4_1
Viewer • Updated • 24.4k • 42 -
RedaAlami/dataset0_1-dataset1_1-dataset2_1-dataset3_1-dataset4_1-dataset5_1
Viewer • Updated • 29.1k • 42 -
Windy/llama3base_best_worst_finalablation_synpo_20k
Viewer • Updated • 20k • 44 -
ai2-adapt-dev/ultrafeedback-small
Viewer • Updated • 1k • 219 -
simonycl/llama3.1-ultrafeedback-annotate-single-judge
Viewer • Updated • 62.6k • 41 -
allenai/ultrafeedback_binarized_cleaned_train
Viewer • Updated • 61.8k • 84 -
ai2-adapt-dev/webgpt-binarized
Viewer • Updated • 14.3k • 56 -
ai2-adapt-dev/summarize_from_feedback_small
Viewer • Updated • 1k • 220 -
ai2-adapt-dev/summarize_from_feedback
Viewer • Updated • 177k • 43 -
HanxuHU/llama3.1-ultrafeedback-annotate-single-judge
Viewer • Updated • 60.6k • 41 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-1-rho-0.5-phi-0.5
Viewer • Updated • 4.67k • 46 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-2-rho-0.5-phi-0.5
Viewer • Updated • 4.75k • 44 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-3-rho-0.5-phi-0.5
Viewer • Updated • 4.76k • 41 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-4-rho-0.5-phi-0.5
Viewer • Updated • 4.72k • 41 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-5-rho-0.5-phi-0.5
Viewer • Updated • 4.7k • 42 -
Windy/testdata
Viewer • Updated • 25 • 41 -
Windy/llama3base_best_worst_finalablation_selfins_50k
Viewer • Updated • 50k • 42 -
yiran-wang3/cleaned-mining-codellama-python-base-all-binarized
Viewer • Updated • 26.6k • 42 -
Windy/llama3base_rewriter_finalablation_synpo_50k
Viewer • Updated • 50k • 45 -
Windy/llama3base_best_worst_finalablation_ultra_50k
Viewer • Updated • 50k • 41 -
Windy/llama3base_best_worst_finalablation_synpo_50k
Viewer • Updated • 50k • 43 -
nbalepur/mnemonic_pref_full
Viewer • Updated • 358 • 42 -
CoolSpring/morse-code-mistral-dpo
Viewer • Updated • 12.7k • 44 -
RedaAlami/dataset0_2-dataset1_2
Viewer • Updated • 10.7k • 45 -
RedaAlami/dataset0_2-dataset1_2-dataset2_2
Viewer • Updated • 15.8k • 47 -
simonycl/llama-3.1-metamath-annotate-armorm
Viewer • Updated • 67k • 44 -
nbalepur/oasst_pref_full
Viewer • Updated • 1.16k • 43 -
nbalepur/anthropic_pref_full
Viewer • Updated • 1.58k • 54 -
nbalepur/prism_pref_full
Viewer • Updated • 7.79k • 44 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.5-Split-1
Viewer • Updated • 9.42k • 44 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.5-Split-2
Viewer • Updated • 9.42k • 44 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.5-Split-3
Viewer • Updated • 9.42k • 44 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.5-Split-4
Viewer • Updated • 9.42k • 44 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.5-Split-5
Viewer • Updated • 9.42k • 45 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-1-rho-0.2-phi-0.9
Viewer • Updated • 5.16k • 46 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-2-rho-0.2-phi-0.9
Viewer • Updated • 5.17k • 45 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-3-rho-0.2-phi-0.9
Viewer • Updated • 5.2k • 45 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-4-rho-0.2-phi-0.9
Viewer • Updated • 5.2k • 46 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-5-rho-0.2-phi-0.9
Viewer • Updated • 5.12k • 45 -
nbalepur/defeasible-alignment
Viewer • Updated • 24.8k • 67 -
RedaAlami/dataset0_2-dataset1_2-dataset2_2-dataset3_2
Viewer • Updated • 21k • 47 -
RedaAlami/dataset0_2-dataset1_2-dataset2_2-dataset3_2-dataset4_2
Viewer • Updated • 26.2k • 45 -
RedaAlami/dataset0_2-dataset1_2-dataset2_2-dataset3_2-dataset4_2-dataset5_2
Viewer • Updated • 31.4k • 45 -
Aliproject2024/dataset_testing_2206
Viewer • Updated • 11 • 35 -
HanxuHU/Meta-Llama-3.1-70B-Instruct_ultrafeedback_annotate_single_judge_gen.jsonl
Viewer • Updated • 60.6k • 40 -
simonycl/gemma2-9B-it-ultrafeedback-armorm-judge
Viewer • Updated • 61.5k • 34 -
RyanYr/hendrydong_preference_700K
Viewer • Updated • 700k • 37 -
RyanYr/hendrydong_preference_700K_shuffled
Viewer • Updated • 700k • 36 -
mlrun/banking-orpo-new
Viewer • Updated • 42 • 40 -
hatoum/orca_dpo_pairs
Viewer • Updated • 12.9k • 37 -
Gunulhona/open_dpo_merged
Viewer • Updated • 632k • 52 -
ohsuz/dpo-v1
Viewer • Updated • 117k • 34 -
simonycl/Llama-3.1-8B-Instruct-ultrafeedback-rm-annotate
Viewer • Updated • 62.6k • 36 -
Locutusque/ApolloRP-DPO-v2.0
Viewer • Updated • 10.5k • 34 -
HanxuHU/gemma-2-9b-it_ultrafeedback_annotate_single_judge
Viewer • Updated • 5k • 34 -
HanxuHU/gemma-2-9b-it_ultrafeedback_annotate_start_0.25_end_0.5_single_judge
Viewer • Updated • 5k • 35 -
HanxuHU/gemma-2-9b-it_ultrafeedback_annotate_start_0_end_0.25_single_judge
Viewer • Updated • 5k • 35 -
HanxuHU/llama3.1-ultrafeedback-annotate-start-0.25-end-0.5-judge-5
Viewer • Updated • 5k • 34 -
HanxuHU/gemma-2-9b-it_ultrafeedback_annotate_start_0.5_end_1_single_judge
Viewer • Updated • 10k • 34 -
qgallouedec/hh-rlhf-helpful-base-trl-style
Viewer • Updated • 46.2k • 53 -
yiran-wang3/cleaned-mining-deepseek-llm-python-binarized-gt-replace
Viewer • Updated • 24.6k • 34 -
RedaAlami/dataset0_3-dataset1_3
Viewer • Updated • 14.9k • 34 -
RedaAlami/dataset0_3-dataset1_3-dataset2_3
Viewer • Updated • 24.3k • 34 -
RedaAlami/dataset0_3-dataset1_3-dataset2_3-dataset3_3
Viewer • Updated • 33.7k • 34 -
RedaAlami/dataset0_3-dataset1_3-dataset2_3-dataset3_3-dataset4_3
Viewer • Updated • 43.2k • 33 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-1-rho-1-phi-1
Viewer • Updated • 9.42k • 34 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-2-rho-1-phi-1
Viewer • Updated • 9.42k • 34 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-3-rho-1-phi-1
Viewer • Updated • 9.42k • 34 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-4-rho-1-phi-1
Viewer • Updated • 9.42k • 99 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-5-rho-1-phi-1
Viewer • Updated • 9.42k • 33 -
simonycl/gemma2-9B-it-ultrafeedback-single-judge
Viewer • Updated • 21.9k • 34 -
qgallouedec/hh-rlhf-helpful-base
Viewer • Updated • 46.2k • 37 -
HanxuHU/llama3.1-ultrafeedback-annotate-start-0-end-0.25-judge-5
Viewer • Updated • 5k • 36 -
RedaAlami/dataset0_3-dataset1_3-dataset2_3-dataset3_3-dataset4_3-dataset5_3
Viewer • Updated • 52.6k • 34 -
scottsuk0306/pairwise-preference-sample
Viewer • Updated • 3 • 34 -
scottsuk0306/alpaca_farm_gpt4-pairwise-preference
Viewer • Updated • 19.5k • 39 -
scottsuk0306/alpaca_farm_human-pairwise-preference
Viewer • Updated • 9.69k • 36 -
scottsuk0306/nectar-pairwise-preference
Viewer • Updated • 1.83M • 34 -
scottsuk0306/distilabel_math_dpo-pairwise-preference
Viewer • Updated • 2.42k • 35 -
scottsuk0306/chatbot_arena_2023-pairwise-preference
Viewer • Updated • 33k • 35 -
scottsuk0306/helpsteer2-pairwise-preference
Viewer • Updated • 10.7k • 40 -
scottsuk0306/summarize_from_feedback-pairwise-preference
Viewer • Updated • 91.9k • 35 -
scottsuk0306/webgpt-pairwise-preference
Viewer • Updated • 18.6k • 37 -
scottsuk0306/ultrafeedback-pairwise-preference
Viewer • Updated • 158k • 38 -
scottsuk0306/ultrainteract-pairwise-preference
Viewer • Updated • 220k • 41 -
nbalepur/defeasible-alignment-subset
Viewer • Updated • 26.9k • 131 -
HanxuHU/gemma-2-9b-it-ultrafeedback-annotate-start-0.5-end-1.0-judge-5
Viewer • Updated • 10k • 38 -
simonycl/Llama-3-8B-Instruct-ultrafeedback-armorm-annotate
Viewer • Updated • 62k • 42 -
simonycl/gemma2-9B-it-ultrafeedback-judge-5
Viewer • Updated • 21.9k • 36 -
simonycl/Llama-3-8B-Instruct-ultrafeedback-judge-5-annotate
Viewer • Updated • 62k • 36 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-Meta-Llama-3-8B-Instruct-annotate-start-0-end-0.5-judge-5
Viewer • Updated • 30k • 33 -
HanxuHU/Meta-Llama-3-8B-Instruct_metamath-Meta-Llama-3-8B-Instruct-annotate-start-0-end-0.5-judge-5
Viewer • Updated • 32.5k • 36 -
HanxuHU/Meta-Llama-3-8B-Instruct_metamath-Meta-Llama-3-8B-Instruct-single-judge-0.5-1-judge
Viewer • Updated • 10k • 34 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback_single_judge_0_0.25_gen
Viewer • Updated • 15k • 34 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback_single_judge_0.25_0.5_gen
Viewer • Updated • 15k • 35 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback_single_judge_0.5_1_gen
Viewer • Updated • 30k • 34 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback_single_judge
Viewer • Updated • 62k • 36 -
simonycl/Meta-Llama-3-8B-Instruct-metamath-rm-annotate
Viewer • Updated • 67k • 36 -
simonycl/Meta-Llama-3-8B-Instruct_metamath_single_judge
Viewer • Updated • 67k • 33 -
simonycl/Meta-Llama-3.1-8B-Instruct_ultrafeedback_iter_0_rm_annotate
Viewer • Updated • 16.9k • 34 -
RedaAlami/dataset0_4-dataset1_4
Viewer • Updated • 10.1k • 34 -
RedaAlami/dataset0_4-dataset1_4-dataset2_4
Viewer • Updated • 14.8k • 34 -
RedaAlami/dataset0_4-dataset1_4-dataset2_4-dataset3_4
Viewer • Updated • 19.5k • 36 -
RedaAlami/dataset0_4-dataset1_4-dataset2_4-dataset3_4-dataset4_4
Viewer • Updated • 24.2k • 34 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.1-Split-1
Viewer • Updated • 9.42k • 34 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.1-Split-2
Viewer • Updated • 9.42k • 34 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.1-Split-3
Viewer • Updated • 9.42k • 34 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.1-Split-4
Viewer • Updated • 9.42k • 34 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.1-Split-5
Viewer • Updated • 9.42k • 34 -
simonycl/Meta-Llama-3-8B-Instruct_metamath_single_judge_0_0.5
Viewer • Updated • 32.5k • 34 -
simonycl/Meta-Llama-3-8B-Instruct_metamath_single_judge_0.5_1.0
Viewer • Updated • 32.5k • 35 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-1-rho-0.5-phi-0.5
Viewer • Updated • 4.62k • 34 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-2-rho-0.5-phi-0.5
Viewer • Updated • 4.65k • 37 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-3-rho-0.5-phi-0.5
Viewer • Updated • 4.72k • 34 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-4-rho-0.5-phi-0.5
Viewer • Updated • 4.67k • 34 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-5-rho-0.5-phi-0.5
Viewer • Updated • 4.73k • 34 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.1-Split-1-rho-1-phi-1
Viewer • Updated • 9.42k • 34 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.1-Split-2-rho-1-phi-1
Viewer • Updated • 9.42k • 39 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.1-Split-3-rho-1-phi-1
Viewer • Updated • 9.42k • 36 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.1-Split-4-rho-1-phi-1
Viewer • Updated • 9.42k • 34 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.1-Split-5-rho-1-phi-1
Viewer • Updated • 9.42k • 42 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-Meta-Llama-3-8B-Instruct-annotate-start-0.75-end-1.0-judge-5
Viewer • Updated • 16.2k • 36 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-Meta-Llama-3-8B-Instruct-annotate-start-0.5-end-0.75-judge-5
Viewer • Updated • 16.2k • 36 -
RedaAlami/dataset0_4-dataset1_4-dataset2_4-dataset3_4-dataset4_4-dataset5_4
Viewer • Updated • 28.9k • 35 -
RedaAlami/dataset0_5-dataset1_5
Viewer • Updated • 14.9k • 35 -
RedaAlami/dataset0_5-dataset1_5-dataset2_5
Viewer • Updated • 24.3k • 37 -
RedaAlami/dataset0_5-dataset1_5-dataset2_5-dataset3_5
Viewer • Updated • 33.7k • 34 -
RedaAlami/dataset0_5-dataset1_5-dataset2_5-dataset3_5-dataset4_5
Viewer • Updated • 43.2k • 44 -
RedaAlami/dataset0_5-dataset1_5-dataset2_5-dataset3_5-dataset4_5-dataset5_5
Viewer • Updated • 52.6k • 42 -
ummagumm-a/ultrafeedback_binarized_all_pairs
Viewer • Updated • 929k • 36 -
qgallouedec/tldr-preference
Viewer • Updated • 179k • 37 -
qgallouedec/lm-human-preferences-sentiment
Viewer • Updated • 6.26k • 35 -
qgallouedec/lm-human-preferences-descriptiveness
Viewer • Updated • 6.26k • 37 -
allenai/reward-bench-cleaned-preview
Viewer • Updated • 2.9k • 37 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-Meta-Llama-3-8B-Instruct-annotate-judge-5
Viewer • Updated • 67k • 36 -
simonycl/Meta-Llama-3.1-8B-Instruct_ultrafeedback_iter_1_rm_annotate
Viewer • Updated • 16.8k • 34 -
ucsahin/TR-VLM-DPO-Dataset
Viewer • Updated • 10k • 40 • 1 -
simonycl/Meta-Llama-3.1-8B-Instruct_ultrafeedback_iter_2_rm_annotate
Viewer • Updated • 16.8k • 35 -
yjwon/ub_custommix_mistral7b_dpo_onpolicy
Viewer • Updated • 60.9k • 36 -
yjwon/ub_mistral7b_dpo_onpolicy
Viewer • Updated • 60.8k • 38 -
HanxuHU/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0-end-0.5-judge-5-mtbench-cot-truth
Viewer • Updated • 32.5k • 40 -
simonycl/Meta-Llama-3.1-8B-Instruct_ultrafeedback_iter_3_rm_annotate
Viewer • Updated • 16.8k • 34 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_truth
Viewer • Updated • 16.2k • 38 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_truth
Viewer • Updated • 16.2k • 35 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_reason
Viewer • Updated • 16.2k • 39 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_reason
Viewer • Updated • 16.2k • 38 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_safe
Viewer • Updated • 16.2k • 38 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_safe
Viewer • Updated • 16.2k • 35 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_chathard
Viewer • Updated • 16.2k • 36 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_chathard
Viewer • Updated • 16.2k • 38 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_hon
Viewer • Updated • 16.2k • 37 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_hon
Viewer • Updated • 16.2k • 35 -
yjwon/custommix_gemma9b_chat_dpo_beta5e-2_onpolicy
Viewer • Updated • 26.2k • 35 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_truth
Viewer • Updated • 15k • 36 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_truth
Viewer • Updated • 15k • 35 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_reason
Viewer • Updated • 15k • 36 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_reason
Viewer • Updated • 15k • 37 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_safe
Viewer • Updated • 15k • 35 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_safe
Viewer • Updated • 15k • 35 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_chathard
Viewer • Updated • 15k • 38 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-mebench_cot_truth
Viewer • Updated • 62k • 44 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_hon
Viewer • Updated • 15k • 35 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_chathard
Viewer • Updated • 15k • 33 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-judge-5-mtbench_cot_truth
Viewer • Updated • 67k • 37 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_hon
Viewer • Updated • 15k • 36 -
simonycl/gemma2-9B-it-ultrafeedback-gemma-2-9b-it-annotate-start-0-end-0.5-judge-5
Viewer • Updated • 29.4k • 38 -
trl-lib/tldr-preference
Viewer • Updated • 179k • 81 -
trl-lib/lm-human-preferences-descriptiveness
Viewer • Updated • 6.26k • 40 -
trl-lib/lm-human-preferences-sentiment
Viewer • Updated • 6.26k • 67 -
amphora/test-mrb-v01
Viewer • Updated • 63 • 36 -
amphora/test-mrb-v02
Viewer • Updated • 63 • 33 -
amphora/test-mrb-v03
Viewer • Updated • 42 • 34 -
amphora/test-mrb-v04
Viewer • Updated • 42 • 34 -
amphora/test-mrb-v05
Viewer • Updated • 63 • 34 -
amphora/test-mrb-v06
Viewer • Updated • 42 • 33 -
amphora/test-mrb-v07
Viewer • Updated • 42 • 34 -
amphora/test-mrb-v08
Viewer • Updated • 42 • 34 -
amphora/test-mrb-ko-v0
Viewer • Updated • 140 • 36 -
amphora/test-mrb-ko-v1
Viewer • Updated • 14 • 35 -
ohsuz/dpo-koen
Viewer • Updated • 54.5k • 34 -
alckasoc/smollm_dpo_examples_19k
Viewer • Updated • 19.8k • 35 • 1 -
RyanYr/reward-judge_reward-judge-trainset-gen_judgements-preference-filtered-gen_pilot-exp
Viewer • Updated • 50k • 34 -
yiran-wang3/original_cn_rl_oj_debug_iter0-binarized
Viewer • Updated • 2 • 34 -
self-generate/ds_chat_original_cn_rl_oj_debug_iter0-binarized
Viewer • Updated • 5 • 33 -
yjwon/custommix_gemma9b_ogd_onpolicy
Viewer • Updated • 26.3k • 34 -
self-generate/ds_chat_original_cn_mining_sandbox_debug_iter0-binarized
Viewer • Updated • 2 • 33 -
sirsam01/codeit_gec
Viewer • Updated • 20.3k • 36 -
self-generate/ds_chat_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 5.73k • 36 -
minhquy1624/rlhf_summarization
Viewer • Updated • 5k • 34 -
Dayyyan/test
Viewer • Updated • 1 • 34 -
self-generate/ds_chat_original_cn_mining_sandbox_iter0-binarized
Viewer • Updated • 7.75k • 36 -
self-generate/ds_chat_original_cn_rl_oj_iter0-binarized
Viewer • Updated • 4.75k • 35 -
SongTonyLi/merged_ultrafeedback_binarized_argilla_orca
Viewer • Updated • 74k • 38 -
SongTonyLi/merged_ultrafeedback_binarized_argilla_orca_skywork_preference
Viewer • Updated • 156k • 37 • 1 -
lewtun/ultrafeedback_binarized
Viewer • Updated • 62.1k • 36 -
self-generate/ds_chat_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 5.73k • 35 -
coscotuff/SLFT_Trials
Viewer • Updated • 19.8k • 34 -
acforvs/dpo-edit-v1
Viewer • Updated • 19.7k • 34 -
self-generate/ds_chat_original_cn_rl_oj_iter0-full_response_traceback
Viewer • Updated • 4.75k • 35 -
self-generate/ds_chat_original_cn_mining_sandbox_iter0-full_response_traceback
Viewer • Updated • 7.75k • 35 -
NobleMathews/GrammarSFT-DPO
Viewer • Updated • 19.9k • 42 -
prasanthyss/dpo_train_ds_focused_1
Viewer • Updated • 14.7k • 34 -
prasanthyss/dpo_test_ds_focused_1
Viewer • Updated • 455 • 33 -
Avinaash/dpo_edit_distance_test
Viewer • Updated • 7.71k • 35 -
Avinaash/CleanDPODataset
Viewer • Updated • 11.2k • 36 -
sarthakrw/smollm-dpo-preference-dataset
Viewer • Updated • 20.2k • 38 -
ravithejads/test_dataset_dpo
Viewer • Updated • 375 • 41 -
ammarnasr/SmolLM-135M-GEC-preference-dataset
Viewer • Updated • 19.8k • 39 -
SongTonyLi/merged_orca_skywork_capybara_preference
Viewer • Updated • 110k • 36 -
SongTonyLi/merged_orca_skywork_preference
Viewer • Updated • 94.8k • 36 -
SongTonyLi/merged_orca_skywork_capybara_infinity_mid_preference
Viewer • Updated • 71.5k • 35 -
SongTonyLi/merged_orca_skywork_capybara_infinity_small_preference
Viewer • Updated • 40.9k • 37 -
RyanYr/reward-judge_sft-genRM_inf-scaling-law_pilot-exp_rewards
Viewer • Updated • 456 • 36 -
RyanYr/reward-judge_iterBoN2-genRM_inf-scaling-law_pilot-exp_rewards
Viewer • Updated • 456 • 34 -
alckasoc/smollm_dpo_examples_19k_1
Viewer • Updated • 19.8k • 33 • 1 -
alckasoc/smollm_dpo_examples_19k_2
Viewer • Updated • 19.8k • 39 • 1 -
alckasoc/smollm_dpo_examples_19k_3
Viewer • Updated • 19.8k • 37 -
ravithejads/test_cpo_bleu
Viewer • Updated • 374 • 33 -
RyanYr/reward-bench_filtered_chat-hard
Viewer • Updated • 456 • 34 -
SongTonyLi/capybara_preference
Viewer • Updated • 14.8k • 34 -
AugustasM/C4AI-preference-dataset-original
Viewer • Updated • 19.8k • 37 -
AugustasM/C4AI-preference-dataset-cleaned
Viewer • Updated • 19.8k • 36 -
not-lain/gec-preference-data
Viewer • Updated • 200 • 37 -
kenza-ily/c4ai-csp-kb-dpo-dataset-train_mini
Viewer • Updated • 19 • 34 -
kenza-ily/c4ai-csp-kb-dpo-dataset-val_mini
Viewer • Updated • 24 • 36 -
RyanYr/reward-judge_sft-genRM_inf-scaling-law_pilot-exp
Viewer • Updated • 4 • 34 -
alisa-yingjia-wan/gec_SmolLM_DPO
Viewer • Updated • 25.6k • 34 -
blesspearl/grammar_dpo
Viewer • Updated • 19.8k • 37 -
coscotuff/SLFT_Trials_ORPO
Viewer • Updated • 19.8k • 36 -
RedaAlami/PKU-SafeRLHF_ultrafeedback
Viewer • Updated • 110k • 37 -
kenza-ily/c4ai_csp-dop_preference
Viewer • Updated • 6.61k • 36 -
nlee-208/Qwen2-7B-Instruct-Self-teacher-w-armo
Viewer • Updated • 60.9k • 33 -
meaningalignment/wise-data
Viewer • Updated • 3.45k • 47 -
ai2-adapt-dev/math_numina_balanced_none_mc_prefs_minerva_format
Viewer • Updated • 41.6k • 34 -
SongTonyLi/dpo-mix-shuffled
Viewer • Updated • 44.2k • 34 -
SongTonyLi/dpo-mix_skywork_infinity
Viewer • Updated • 131k • 37 • 1 -
ai2-adapt-dev/numina_math_gsm8k_prefs_balance_minerva_format_v2
Viewer • Updated • 22.8k • 35 -
Abduulllaah/orca_dpo_pairs-2k
Viewer • Updated • 2k • 35 -
prasanthyss/dpop_submitted_train
Viewer • Updated • 19.8k • 34 -
prasanthyss/dpop_submitted_test
Viewer • Updated • 485 • 35 -
Windy/llama3base_bsln_sppo_t0_10k
Viewer • Updated • 10k • 34 -
Windy/mistralbase_bsln_sppo_t0_10k
Viewer • Updated • 10k • 34 -
Windy/mistralbase_bsln_sppo_t1_10k
Viewer • Updated • 10k • 34 -
Windy/llama3base_bsln_sppo_t1_10k
Viewer • Updated • 10k • 34 -
Windy/llama3base_bsln_sppo_t2_10k
Viewer • Updated • 10k • 34 -
Windy/mistralbase_bsln_sppo_t2_10k
Viewer • Updated • 10k • 34 -
RyanYr/reward-judge_sft_t0.5-genRM_inf-scaling-law_pilot-exp_rewards
Viewer • Updated • 456 • 34 -
simonycl/helpsteer2_preference_data
Viewer • Updated • 413 • 36 -
nbalepur/personas
Viewer • Updated • 37.8k • 34 -
self-generate/cl_python_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 3 • 38 -
self-generate/cl_python_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 3 • 36 -
amphora/reasoning-rm-test
Viewer • Updated • 199 • 34 -
self-generate/topp09_temp07_ds_chat_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 4.76k • 61 -
self-generate/topp09_temp07_ds_chat_original_cn_rl_oj_iter0-binarized
Viewer • Updated • 4.72k • 52 -
self-generate/topp09_temp07_ds_chat_original_cn_mining_sandbox_iter0-binarized
Viewer • Updated • 7.99k • 36 -
flozi00/Infini-Reflect
Viewer • Updated • 46.2k • 75 • 3 -
Windy/llama3base_bsln_sppo_t3_10k
Viewer • Updated • 10k • 37 • 1 -
self-generate/topp09_temp07_ds_chat_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 4.76k • 44 -
self-generate/topp09_temp07_ds_chat_original_cn_rl_oj_iter0-full_response_traceback
Viewer • Updated • 4.72k • 41 -
prasanthyss/dpo_submitted_train
Viewer • Updated • 19.8k • 34 -
prasanthyss/dpo_submitted_test
Viewer • Updated • 485 • 38 -
self-generate/topp09_temp07_ds_chat_original_cn_mining_sandbox_iter0-full_response_traceback
Viewer • Updated • 7.99k • 37 -
Windy/mistralbase_bsln_sppo_t3_10k
Viewer • Updated • 10k • 36 -
meaningalignment/wise-data-preferences
Viewer • Updated • 5.31k • 38 -
Katayoon/VPO-Pess-SELM-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 34 -
CharlesLi/ultrafeedback_self_improve_llama3_1_8b
Viewer • Updated • 61.1k • 34 -
CharlesLi/ultrafeedback_max_14_reward_llama3_1_8b
Viewer • Updated • 61.1k • 36 -
CharlesLi/ultrafeedback_max_second_reward_llama3_1_8b
Viewer • Updated • 61.1k • 34 -
CharlesLi/ultrafeedback_most_similar_pair_llama3_1_8b
Viewer • Updated • 61.1k • 45 -
CharlesLi/ultrafeedback_llama_3_1_8B_improve_openelm_1B.json
Viewer • Updated • 10 • 38 -
CharlesLi/ultrafeedback_max_reward_most_similar_llama3_1_8b
Viewer • Updated • 61.1k • 39 -
CharlesLi/ultrafeedback_max_min_reward_llama3_1_8b
Viewer • Updated • 61.1k • 42 -
CharlesLi/ultrafeedback_max_8_reward_llama3_1_8b
Viewer • Updated • 61.1k • 41 -
CharlesLi/ultrafeedback_max_reward_least_similar_llama3_1_8b
Viewer • Updated • 61.1k • 45 -
CharlesLi/ultrafeedback_random_pair_llama3_1_8b
Viewer • Updated • 61.1k • 43 -
CharlesLi/ultrafeedback_max_4_reward_llama3_1_8b
Viewer • Updated • 61.1k • 38 -
CharlesLi/ultrafeedback_max_10_reward_llama3_1_8b
Viewer • Updated • 61.1k • 42 -
CharlesLi/ultrafeedback_least_similar_pair_llama3_1_8b
Viewer • Updated • 61.1k • 44 -
Katayoon/VPO-Pess-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 35 -
Windy/llama3base_bsln_sppo_t4_10k
Viewer • Updated • 10k • 35 -
Windy/mistralbase_bsln_sppo_t4_10k
Viewer • Updated • 10k • 33 -
amphora/mgsm-rb
Viewer • Updated • 1.97k • 77 -
amphora/lmentry-ko-rb
Viewer • Updated • 102 • 36 -
silviasapora/low_quality_dpo7k
Viewer • Updated • 7.5k • 34 -
amphora/hall-m-test
Viewer • Updated • 794 • 34 -
amphora/oasst-m-test
Viewer • Updated • 824 • 34 -
Cagatayd/orca_dpo_pairs_cleaned_DPO
Viewer • Updated • 12.9k • 35 -
Katayoon/CDPO-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 35 -
LxzGordon/Skywork-Preference-v0.1-prompt
Viewer • Updated • 82k • 34 -
i2354yc/SELM-TinyLlama_v1.1-dataset
Viewer • Updated • 8.11k • 37 -
amphora/mgsm-pair-2
Viewer • Updated • 1.33k • 47 -
amphora/toxicity-rb
Viewer • Updated • 350 • 37 -
nlee-208/Qwen2-7B-Instruct-Self-seed178
Viewer • Updated • 60.9k • 35 -
simonycl/reward_bench
Viewer • Updated • 2.99k • 36 -
Cagatayd/hh-rlhf-for-DPO
Viewer • Updated • 169k • 42 -
Translation-EnKo/nlp-arxiv-translation-dpo-chat-gemma
Viewer • Updated • 6.65k • 36 -
amphora/ling-rb
Viewer • Updated • 450 • 38 -
amphora/safety-rb
Viewer • Updated • 797 • 38 -
amphora/adv-rb
Viewer • Updated • 1.25k • 65 -
gagan3012/multi-reward-bench
Viewer • Updated • 2.99k • 34 -
amphora/blend-rb
Viewer • Updated • 54 • 40 -
pbevan11/ultrafeedback_binarized_multilingual
Viewer • Updated • 80k • 63 -
coscotuff/DPO-Chat
Viewer • Updated • 150k • 41 -
rica40325/iter1_66
Viewer • Updated • 49.6k • 41 -
theGhoul21/irpo-dataset-v1-iteration1-llama32-1B
Viewer • Updated • 5.4k • 101 -
pbevan11/multilingual-constitutional-preference-pairs
Viewer • Updated • 6.07k • 55 -
g0kul6/train_apo_oxford_flowers
Viewer • Updated • 2.09k • 37 -
trl-lib/rlaif-v
Viewer • Updated • 83.1k • 42 -
Katayoon/CDPO-Zephyr-7B-0.0001-dataset
Viewer • Updated • 34.6k • 40 -
typorch/orpo_test2
Viewer • Updated • 12.1k • 42 -
g0kul6/apo_oxford_flowers
Viewer • Updated • 5.55k • 34 -
archit11/worldbuilding_dpo
Viewer • Updated • 26.7k • 34 -
scottsuk0306/Massive-Preferences-10K
Viewer • Updated • 10.1k • 34 -
scottsuk0306/8b-CLoud-10k-offpolicy-rb-results
Viewer • Updated • 2.99k • 43 -
gagan3012/dpo-fix
Viewer • Updated • 3.4k • 92 -
Translation-EnKo/nlp-arxiv-translation-dpo-with-math-10k-chat-gemma
Viewer • Updated • 13.3k • 42 -
Cagatayd/Magpie-Pro-DPO-formatted
Viewer • Updated • 100k • 36 -
SongTonyLi/llama-1b-preference-merge-mix
Viewer • Updated • 142k • 41 • 1 -
nlee-208/Qwen2-7B-Instruct-Self-w-armo
Viewer • Updated • 60.9k • 34 -
SongTonyLi/merged_orca_skywork_capybara_infinity_midL2_preference
Viewer • Updated • 88k • 34 -
HAERAE-HUB/KHJ-RB-Format
Viewer • Updated • 524 • 44 • 5 -
Ahjeong/Ultrafeedback_cleaned_MMPO
Viewer • Updated • 155k • 35 -
ITFacto/callrentin_dpo2
Viewer • Updated • 99 • 36 -
amphora/kudge-challenge
Viewer • Updated • 746 • 61 -
Yuriy81/example-preference-dataset
Viewer • Updated • 20 • 34 -
nbalepur/persona_alignment_full
Viewer • Updated • 24.2k • 40 -
rica40325/9_25_dpo_fd_mistral
Viewer • Updated • 34.4k • 46 -
nbalepur/persona_alignment_split
Updated • 42 -
ddyuudd/chatbot-arena-ja-calm3-22b-chat-experimental
Viewer • Updated • 19.7k • 36 -
NinaCalvi/ultra-dpo-with-critique
Viewer • Updated • 9.19k • 133 -
HennersBro98/hackathon-preference-collection-no-cot
Viewer • Updated • 11.3k • 150 -
NinaCalvi/ultra-dpo-no-critique
Viewer • Updated • 9.19k • 137 -
HennersBro98/hackathon-reward-bench
Viewer • Updated • 2.99k • 103 -
qklent/gusev-gutenburg-preprocessed
Viewer • Updated • 1.42k • 34 -
DatPySci/HH-RLHF-preprocessed
Viewer • Updated • 119k • 61 -
g0kul6/gpt4o_po_oxford_flowers
Viewer • Updated • 6.56k • 71 -
HennersBro98/hackathon-preference-collection-cot
Viewer • Updated • 11.3k • 53 -
pbevan11/multilingual-constitutional-preference-pairs-revision-only
Viewer • Updated • 6.83k • 52 -
ai2-adapt-dev/ultrafeedback-pairs
Viewer • Updated • 1.05M • 73 • 1 -
qklent/gutenpromax-preprocessed-llama-70b
Viewer • Updated • 50k • 41 -
Cornell-AGI/REFUEL-hh-setting-two
Viewer • Updated • 165k • 54 -
nbalepur/persona_alignment_test
Updated • 52 -
nbalepur/persona_alignment_test_clean
Updated • 381 -
self-generate/topp09_temp07_ds_chat_original_cn_rl_oj_iter0-binarized_all_pairs
Viewer • Updated • 53.8k • 56 -
self-generate/topp09_temp07_ds_chat_original_cn_mining_oj_iter0-binarized_all_pairs
Viewer • Updated • 53.8k • 58 -
arthrod/all_outputs_bin
Viewer • Updated • 254k • 70 • 1 -
multilingual-reward-bench/open-assistant-sampled-new
Viewer • Updated • 444 • 42 -
RedaAlami/UltraInteract_pair_dpo
Viewer • Updated • 220k • 54 -
ai2-adapt-dev/DaringAnteater-prefs
Viewer • Updated • 2.9k • 38 -
alexchen4ai/vlm-dpo-example
Viewer • Updated • 5.73k • 82 -
g0kul6/dummy_debug_data
Viewer • Updated • 20 • 58 -
g0kul6/po_CLAIR_llava_next_7b_oxford_flowers
Viewer • Updated • 6.49k • 61 -
ihughes15234/ttt_dpo_3779_2
Viewer • Updated • 3.78k • 47 -
ChaiML/workshop_dpo_data
Viewer • Updated • 20.1k • 53 -
ihughes15234/ttt_dpo_3779_phi3_5
Viewer • Updated • 3.78k • 42 -
scottsuk0306/UltraFeedback-edited
Viewer • Updated • 154k • 52 -
g0kul6/po_CLAIR_more_info_llava_next_7b_oxford_flowers
Viewer • Updated • 6.55k • 36 -
g0kul6/po_CLAIR_filter_llava_next_7b_oxford_flowers
Viewer • Updated • 5.56k • 39 -
aidar-myrzakhan/wo_principle_human_pref_prompting
Viewer • Updated • 26.8k • 44 -
iqwiki-kor/rm-training-data-40k-translated-it
Viewer • Updated • 40.9k • 35 -
HennersBro98/preferenceCollectionTest
Viewer • Updated • 11.3k • 46 -
HennersBro98/preferenceCollection-2024-10-11
Viewer • Updated • 11.3k • 43 -
NinaCalvi/preferenceCollection-2024-10-11-only-cot
Viewer • Updated • 8.47k • 37 -
jkazdan/synthetic_rlhf_dataset_test
Viewer • Updated • 2k • 61 -
g0kul6/gpt4o_po_filter_oxford_flowers
Viewer • Updated • 4.24k • 36 -
multilingual-reward-bench/code-en
Viewer • Updated • 80 • 35 -
multilingual-reward-bench/code-python
Viewer • Updated • 1.84k • 49 -
quangduc1112001/python-code-DPO-fine-tune
Viewer • Updated • 2k • 65 • 1 -
multilingual-reward-bench/MRB-Preview-1013
Viewer • Updated • 5.09k • 42 -
weqweasdas/filtered_reward_bench
Viewer • Updated • 2.85k • 42 -
amphora/math-rb
Viewer • Updated • 602 • 35 -
jkazdan/synthetic_rlhf_dataset_helpsteer2
Viewer • Updated • 16 • 33 -
jkazdan/synthetic_rlhf_dataset_helpsteer2_debug
Viewer • Updated • 2.05k • 52 -
g0kul6/po_CLAIR_filter_more_info_llava_next_7b_oxford_flowers
Viewer • Updated • 5.61k • 32 -
neeljaycs/pku-rlhf-safe
Viewer • Updated • 82.1k • 43 -
RyanYr/self-correct_math-data-collect_binlabel_dpo
Viewer • Updated • 17.1k • 39 -
self-generate/debug_ds_chat_original_cn_rl_oj_debug_iter0-reflection
Viewer • Updated • 49 • 34 -
NinaCalvi/test_ultrafeeback_rpo_schema
Viewer • Updated • 70 • 37 -
dogtooth/llama31-8b-inst-uf-CHES-scored
Viewer • Updated • 61.1k • 41 -
self-generate/topp09_temp07_reflection_scored_ds_chat_original_cn_rl_oj_iter0-binarized-reflection-scored
Viewer • Updated • 4.05k • 57 -
HennersBro98/feedbackCollection_SFRFormat_prelim
Viewer • Updated • 100 • 44 -
HennersBro98/preferenceCollection_SFRFormatTest_prelim
Viewer • Updated • 50 • 38 -
HennersBro98/preferenceCollection_SFRFormat_prelim
Viewer • Updated • 100 • 36 -
self-generate/topp09_temp07_reflection_scored_ds_chat_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 4.63k • 35 -
self-generate/topp09_temp07_reflection_scored_ds_chat_original_cn_mining_oj_iter0-binarized_all_pairs
Viewer • Updated • 52.6k • 30 -
pauliusztin/llmtwin-dpo
Viewer • Updated • 402 • 38 -
NinaCalvi/test_helpsteer2_prefrence_sfr
Viewer • Updated • 190 • 39 -
NinaCalvi/test_helpsteer2_prefrence_sfr_llama31_repsonse_deduction
Viewer • Updated • 7 • 28 -
NinaCalvi/ultrafeedback_sfr_test_v2
Viewer • Updated • 161 • 36 -
RyanYr/self-correct_Llama-3.2-3B-Instruct_metaMathQA_binlabel_dpo
Viewer • Updated • 120k • 49 -
self-generate/topp09_temp07_reflection_scored_ds_chat_original_cn_mining_oj_iter0-binarized-reflection-scored
Viewer • Updated • 4k • 71 -
RyanYr/self-correct_Llama-3.2-3B-Instruct_metaMathQA_dpo_iter1_metaMathQA_binlabel_dpo
Viewer • Updated • 127k • 33 -
kuotient/HelpSteer2-preference-pairs
Viewer • Updated • 7.12k • 81 -
ringos/bio-brief-Llama-3.1-8B-gemma2-rm
Viewer • Updated • 371 • 27 -
RyanYr/self-correct_Llama-3.2-3B-Instruct_metaMathQA_dpo_iter2_metaMathQA_binlabel_dpo
Viewer • Updated • 130k • 22 -
jkazdan/self-improving-preferences-sftsd0
Viewer • Updated • 10 • 25 -
jkazdan/self-improving-preferences-sftsd1
Viewer • Updated • 10 • 26 -
jkazdan/self-improving-preferences-sftsd2
Viewer • Updated • 10 • 25 -
jkazdan/self-improving-preferences-sftsdt
Viewer • Updated • 10 • 35 -
ZixuanKe/financial_reward_dpo_binarized
Viewer • Updated • 6.9k • 93 -
ringos/raw_ultrafeedback_binarized-Mistral-7B-v0.1-gemma2-rm
Viewer • Updated • 58.2k • 15 -
wklyb/oasst2_processed
Viewer • Updated • 18.9k • 87 -
valerielucro/Anthropic-hh-rlhf-sample
Viewer • Updated • 250 • 87 -
QomSSLab/Rhino_SFT
Viewer • Updated • 1.91k • 71 -
RyanYr/self-correct_Llama-3.2-3B-Instruct_metaMathQA_dpo_iter3_metaMathQA_binlabel_dpo
Viewer • Updated • 115k • 26 -
tzwilliam0/Intel_orca_dpo_majority
Viewer • Updated • 9k • 38 -
tzwilliam0/Intel_orca_dpo_minority
Viewer • Updated • 3.86k • 36 -
RyanYr/self-correct_Llama-3.2-3B-Instruct_metaMathQA_dpo_iter4_metaMathQA_binlabel_dpo
Viewer • Updated • 141k • 27 -
neeljaycs/circuit-breakers-harmful-llama-2
Viewer • Updated • 4.99k • 42 -
RyanYr/self-correct_Llama-3.2-3B-Instruct_metaMathQA_dpo_iter5_metaMathQA_binlabel_dpo
Viewer • Updated • 129k • 24 -
ringos/bio-brief-Mistral-7B-v0.1-gemma2-rm
Viewer • Updated • 371 • 36 -
ringos/bio-detailed-Mistral-7B-v0.1-gemma2-rm
Viewer • Updated • 371 • 31 -
micost/simple_calculation_orpo
Viewer • Updated • 50k • 55 -
ringos/raw_ultrafeedback_binarized-Llama-3.1-8B-gemma2-rm
Viewer • Updated • 58.2k • 17 -
sam-paech/gutenberg3-generalfiction-scifi-fantasy-romance-adventure-dpo
Viewer • Updated • 5.65k • 272 • 10 -
ringos/ultrafeedback_binarized-Llama-3.1-8B-gemma2-rm
Viewer • Updated • 58.2k • 32 -
ringos/ultrafeedback_binarized-Mistral-7B-v0.1-gemma2-rm
Viewer • Updated • 58.2k • 26 -
RyanYr/self-correct_Llama-3.2-3B-Instruct_OpenMathInstruct-2_binlabel_dpo
Viewer • Updated • 112k • 23 -
ringos/bio-detailed-Llama-3.1-8B-gemma2-rm
Viewer • Updated • 371 • 28 -
Smudge-81/XSmicro_ultrafeedback
Viewer • Updated • 60 • 27 -
Smudge-81/small_ultrafeedback
Viewer • Updated • 6.09k • 23 -
Smudge-81/micro_ultrafeedback
Viewer • Updated • 609 • 26 -
Knifecat/DFPO-MFPEA
Viewer • Updated • 37.2k • 29 • 1 -
nayohan/Magpie-Pro-DPO-200K-ko-e3
Viewer • Updated • 200k • 23 -
RyanYr/self-correct_Llama-3.2-3B-Instruct_metaMathQA_dpo_iter6_metaMathQA_binlabel_dpo
Viewer • Updated • 128k • 22 -
sam-paech/gutenbergs_1_2_3_antislop-dpo
Viewer • Updated • 4.62k • 36 • 2 -
ai2-adapt-dev/tulu3.4-sft-replica-50k-gpt4-prefs-on-policy
Viewer • Updated • 52.7k • 71 -
Mitsuki-Sakamoto/hh-rlhf-formatted-one-to-one
Viewer • Updated • 51.9k • 15 -
jonluj/sys_contradict_dpo
Viewer • Updated • 45.1k • 16 -
iqwiki-kor/MP-86k
Viewer • Updated • 86.4k • 25 -
RyanYr/self-correct_Ministral-8B-Instruct-2410_metaMathQA_binlabel_dpo
Viewer • Updated • 35.1k • 26 -
nbalepur/persona_alignment_test_clean_vague_mnemonic
Viewer • Updated • 833 • 41 -
nbalepur/persona_alignment_test_clean_vague_mnemonic2
Viewer • Updated • 833 • 37 -
minchyeom/Thinker-XML-DPO
Viewer • Updated • 2.49k • 17 -
ashercn97/example-preference-dataset
Viewer • Updated • 20 • 22 -
ashercn97/example-preference-dataset2
Viewer • Updated • 20 • 24 -
ashercn97/example-preference-dataset2_work
Viewer • Updated • 2 • 21 -
ashercn97/example-preference-dataset2_work3
Viewer • Updated • 2 • 22 -
ashercn97/example-preference-dataset2_work4
Viewer • Updated • 2 • 20 -
ashercn97/example-preference-dataset2_work5
Viewer • Updated • 2 • 21 -
ashercn97/example-preference-dataset2_work6
Viewer • Updated • 2 • 20 -
RyanYr/self-correct_Ministral-8B-Instruct-2410_metaMathQA-txie-dsigpu4000-1729721083_binlabel_dpo
Viewer • Updated • 53.9k • 20 -
hahmadraz/orpo-dpo-mix-40k-test
Viewer • Updated • 8.85k • 38 -
ashercn97/example-preference-dataset2_work2
Viewer • Updated • 2 • 14 -
ashercn97/example-preference-dataset2_work7
Viewer • Updated • 600 • 13 -
ashercn97/preferences_data_oct_23
Viewer • Updated • 600 • 29 -
ddyuudd/chatbot-arena-ja-calm3-selfpref
Viewer • Updated • 29k • 41 -
HanxuHU/Meta-Llama-3-8B-Instruct_metamath-google-gemma-2-9b-it-single-all-judge
Viewer • Updated • 65k • 13 -
andthattoo/router-dpo
Viewer • Updated • 1.92k • 37 -
nbalepur/persona_alignment_test_clean_vague
Viewer • Updated • 5.35k • 75 -
RyanYr/self-correct_Ministral8Bit_mMQA_dpo_iter1_mMQA-1729775027_binlabel_dpo
Viewer • Updated • 30.6k • 18 -
RyanYr/self-correct_Ministral8Bit_mMQA_dpo_iter2_mMQA-1729803191_binlabel_dpo
Viewer • Updated • 29.7k • 21 -
Karan/rlaif-v_formatted_mini
Viewer • Updated • 1.1k • 17 -
prometheus-eval/MM-Eval
Viewer • Updated • 11.1k • 140 • 5 -
mazzaqq/playpen_dpo_chat_old
Viewer • Updated • 1.9k • 15 -
mazzaqq/playpen_dpo_chat_new
Viewer • Updated • 15.6k • 18 -
RyanYr/self-correct_Ministral8Bit_mMQA_dpo_iter3_mMQA_binlabel_dpo
Viewer • Updated • 28.9k • 18 -
C4AI-Community/multilingual-reward-bench
Viewer • Updated • 66.8k • 138 • 14 -
Svngoku/french-multilingual-reward-bench-dpo
Viewer • Updated • 8.11k • 32 -
RyanYr/self-correct_Ministral8Bit_mMQA_dpo_iter4_mMQA_binlabel_dpo
Viewer • Updated • 29.3k • 20 -
ashish23/granite38bit_armorm
Viewer • Updated • 63.1k • 20 -
ashish23/granite38bit_woalign_armorm
Viewer • Updated • 63.1k • 17 -
RyanYr/self-correct_Ministral8Bit_mMQA_dpo_iter5_mMQA-1729922004_binlabel_dpo
Viewer • Updated • 28.2k • 16 -
ashish23/granite38bit_pairrm
Viewer • Updated • 63.1k • 21 -
ashish23/granite38bit_woalign_pairrm
Viewer • Updated • 63.1k • 18 -
self-generate/iter_exp_ds_chat_regular_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 4.63k • 152 -
self-generate/iter_exp_no_mask_ds_chat_regular_adamw_iter1_sppo_hard_new_cn_mining_oj_iter1-binarized
Viewer • Updated • 3.32k • 70 -
self-generate/iter_exp_no_mask_ds_chat_regular_adamw_iter3_sppo_hard_new_cn_mining_oj_iter3-binarized
Viewer • Updated • 3.7k • 67 -
self-generate/iter_exp_no_mask_ds_chat_regular_adamw_iter2_sppo_hard_new_cn_mining_oj_iter2-binarized
Viewer • Updated • 3.04k • 66 -
self-generate/iter_exp_ds_chat_regular_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 4.63k • 27 -
self-generate/iter_exp_ds_chat_regular_original_cn_mining_oj_iter0-binarized_all_pairs
Viewer • Updated • 52.6k • 25 -
RyanYr/self-correct_Ministral8Bit_mMQA_dpo_iter6_mMQA_binlabel_dpo
Viewer • Updated • 28.4k • 14 -
self-generate/iter_exp_no_mask_ds_chat_regular_adamw_iter4_sppo_hard_new_cn_mining_oj_iter4-binarized
Viewer • Updated • 4.5k • 28 -
self-generate/iter_exp_reflct_ds_chat_regular_original_cn_mining_oj_iter0-binarized_all_pairs
Viewer • Updated • 52.6k • 17 -
self-generate/iter_exp_reflct_ds_chat_regular_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 4.63k • 16 -
self-generate/iter_exp_reflct_ds_chat_regular_original_cn_mining_oj_iter0-binarized-reflection-scored
Viewer • Updated • 4k • 26 -
tororoin/preprocessed-rlaif-v
Viewer • Updated • 83.1k • 15 -
RyanYr/self-correct_Ministral8Bit_iter1_mix_mMQA_binlabel_dpo
Viewer • Updated • 46.5k • 8 -
Smudge-81/micro_ultrafeedback_modified_full_chat_2
Viewer • Updated • 609 • 9 -
Smudge-81/micro_ultrafeedback_modified_full_chat_3way
Viewer • Updated • 609 • 8 -
Smudge-81/micro_ultrafeedback_modified_full_chat_3way_climax
Preview • Updated • 9 -
Smudge-81/micro_ultrafeedback_modified_full_chat_3way_climax2
Viewer • Updated • 609 • 10 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter1-binarized-reflection-scored
Viewer • Updated • 3.09k • 43 -
RyanYr/self-correct_Ministral8Bit_iter2_mix_mMQA_binlabel_dpo
Viewer • Updated • 45.9k • 20 -
micost/user_crud_orpo
Viewer • Updated • 1k • 14 -
IlyaGusev/saiga_scored_orig_vs_nemo
Viewer • Updated • 5.06k • 10 -
weqweasdas/hn_mistral_prm_pairwise
Viewer • Updated • 447k • 12 -
weqweasdas/hn_mistral_prm_pairwise_only_step2
Viewer • Updated • 138k • 9 -
self-generate/reflct_no_mask_ds_chat_reflection_adamw_iter1_sppo_hard_new_cn_mining_oj_iter1-binarized
Viewer • Updated • 3.31k • 9 -
self-generate/reflct_ds_chat_reflection_adamw_iter1_sppo_hard_new_cn_mining_oj_iter1-binarized
Viewer • Updated • 3.31k • 9 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter1-binarized
Viewer • Updated • 3.31k • 8 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter1-full_response_traceback
Viewer • Updated • 3.31k • 8 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter1-binarized_all_pairs
Viewer • Updated • 13.2k • 8 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter2-binarized
Viewer • Updated • 3.08k • 8 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter2-full_response_traceback
Viewer • Updated • 3.08k • 8 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter2-binarized_all_pairs
Viewer • Updated • 12k • 8 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter2-binarized-reflection-scored
Viewer • Updated • 2.89k • 24 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter3-binarized
Viewer • Updated • 3.02k • 8 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter3-full_response_traceback
Viewer • Updated • 3.02k • 8 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter3-binarized_all_pairs
Viewer • Updated • 11.5k • 8 -
RyanYr/self-correct_Ministral8Bit_mMQA-mix_iter3_binlabel_dpo
Viewer • Updated • 45.7k • 11 -
self-generate/reflct_sppo_hard_new_cn_mining_oj_iter3-binarized-reflection-scored
Viewer • Updated • 2.86k • 28 -
ENERGY-DRINK-LOVE/dpo_sample_240809
Viewer • Updated • 10k • 6 -
Backup6/6xcq161
Viewer • Updated • 3.55k • 29 -
NinaCalvi/ultrafeedback-migration
Viewer • Updated • 164 • 13 -
dogtooth/helpsteer2_binarized_comprehensive
Viewer • Updated • 10.2k • 12 -
NinaCalvi/migrate-helpsteer2pref
Viewer • Updated • 45 • 11 -
dogtooth/ultrafeedback_binarized
Viewer • Updated • 61.1k • 10 -
marcus2000/rlhf_timelist_keymoments
Viewer • Updated • 42 • 7 -
marcus2000/rlhf_timelist_tasks
Viewer • Updated • 42 • 6 -
HennersBro98/feedbackCollection_good_2024-11-01
Viewer • Updated • 1.03k • 4 -
HennersBro98/preferenceCollection_good_2024-11-01
Viewer • Updated • 12k • 8 -
mazzaqq/playpen_dpo_chat_old_2
Viewer • Updated • 1.9k • 10 -
yjwon/mp_gemma9b_sft_iter0
Viewer • Updated • 19.6k • 19 -
RyanYr/self-correct_mistral-small-it_mMQA_binlabel_dpo
Viewer • Updated • 44.9k • 15 -
nbalepur/personas_for_prometheus
Viewer • Updated • 151k • 17 -
self-generate/qw1_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 5.71k • 305 -
self-generate/qw2_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 4.76k • 64 -
self-generate/qwcoder2_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 3.22k • 84 -
self-generate/qw1_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 5.71k • 19 -
self-generate/qw1_original_cn_mining_oj_iter0-binarized_all_pairs
Viewer • Updated • 22.7k • 19 -
tzwilliam0/imdb_majority
Viewer • Updated • 6k • 44 -
self-generate/qwcoder2_original_cn_mining_oj_iter0-binarized_all_pairs
Viewer • Updated • 16.8k • 13 -
tzwilliam0/imdb_minority
Viewer • Updated • 4k • 39 -
RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter1_binlabel_dpo
Viewer • Updated • 23.7k • 10 -
self-generate/qwcoder2_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 3.22k • 12 -
self-generate/qw2_original_cn_mining_oj_iter0-binarized_all_pairs
Viewer • Updated • 16.9k • 10 -
RLHFlow/Mistral-PRM-Data
Viewer • Updated • 273k • 9 -
self-generate/qw2_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 4.76k • 9 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter1-binarized
Viewer • Updated • 4.18k • 46 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter1-full_response_traceback
Viewer • Updated • 4.18k • 12 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter1-binarized_all_pairs
Viewer • Updated • 20.8k • 12 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter3-binarized
Viewer • Updated • 2.69k • 45 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter3-full_response_traceback
Viewer • Updated • 2.69k • 12 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter3-binarized_all_pairs
Viewer • Updated • 10.5k • 12 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter2-binarized
Viewer • Updated • 2.86k • 48 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter2-full_response_traceback
Viewer • Updated • 2.86k • 11 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter2-binarized_all_pairs
Viewer • Updated • 10.7k • 11 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter4-binarized
Viewer • Updated • 2.62k • 45 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter4-full_response_traceback
Viewer • Updated • 2.62k • 11 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter4-binarized_all_pairs
Viewer • Updated • 10.3k • 11 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter1-binarized
Viewer • Updated • 4.07k • 99 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter1-full_response_traceback
Viewer • Updated • 4.07k • 16 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter1-binarized_all_pairs
Viewer • Updated • 15.2k • 16 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter1-binarized
Viewer • Updated • 3.05k • 45 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter1-full_response_traceback
Viewer • Updated • 3.05k • 12 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter1-binarized_all_pairs
Viewer • Updated • 11.5k • 12 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter2-binarized
Viewer • Updated • 2.97k • 81 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter2-full_response_traceback
Viewer • Updated • 2.97k • 11 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter2-binarized_all_pairs
Viewer • Updated • 11.7k • 11 -
tzwilliam0/imdb_large_majority
Updated • 6 -
tzwilliam0/imdb_large_minority
Viewer • Updated • 20k • 9 -
kaiwenw/old_aft_data
Viewer • Updated • 3k • 3 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter3-binarized
Viewer • Updated • 2.73k • 28 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter3-binarized
Viewer • Updated • 2.64k • 27 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter4-binarized
Viewer • Updated • 2.65k • 26 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter2-binarized
Viewer • Updated • 3.08k • 27 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter5-binarized
Viewer • Updated • 2.52k • 22 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter4-binarized
Viewer • Updated • 2.35k • 62 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter6-binarized
Viewer • Updated • 2.45k • 24 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter8-binarized
Viewer • Updated • 2.48k • 24 -
kaiwenw/nov2_aft_llama70b_1.0
Viewer • Updated • 3.5k • 52 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter7-binarized
Viewer • Updated • 2.36k • 22 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter6-binarized
Viewer • Updated • 2.41k • 20 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter5-binarized
Viewer • Updated • 2.58k • 20 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter7-binarized
Viewer • Updated • 2.46k • 20 -
kaiwenw/nov2_aft_llama70b_0.9
Viewer • Updated • 3.37k • 42 -
RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter2_binlabel_dpo
Viewer • Updated • 17.5k • 11 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter3-full_response_traceback
Viewer • Updated • 2.64k • 10 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter2-full_response_traceback
Viewer • Updated • 3.08k • 9 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter2-binarized_all_pairs
Viewer • Updated • 11k • 9 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter3-full_response_traceback
Viewer • Updated • 2.73k • 9 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter3-binarized_all_pairs
Viewer • Updated • 10.4k • 9 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter3-binarized_all_pairs
Viewer • Updated • 9.41k • 9 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter4-full_response_traceback
Viewer • Updated • 2.65k • 9 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter4-binarized_all_pairs
Viewer • Updated • 10.1k • 9 -
kaiwenw/nov2_aft_llama70b_1.1
Viewer • Updated • 3.63k • 7 -
kaiwenw/nov2_aft_gpt4o_0.9
Viewer • Updated • 3.05k • 6 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter5-full_response_traceback
Viewer • Updated • 2.52k • 5 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter5-binarized_all_pairs
Viewer • Updated • 9.71k • 5 -
lahirum/DPO_test
Viewer • Updated • 450 • 25 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter6-binarized_all_pairs
Viewer • Updated • 9.36k • 7 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter5-binarized_all_pairs
Viewer • Updated • 9.79k • 7 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter4-binarized_all_pairs
Viewer • Updated • 8.63k • 6 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter7-full_response_traceback
Viewer • Updated • 2.36k • 7 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter7-binarized_all_pairs
Viewer • Updated • 8.98k • 6 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter6-full_response_traceback
Viewer • Updated • 2.45k • 7 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter6-binarized_all_pairs
Viewer • Updated • 9.36k • 5 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter8-full_response_traceback
Viewer • Updated • 2.48k • 6 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter8-binarized_all_pairs
Viewer • Updated • 9.23k • 6 -
kaiwenw/nov2_aft_gpt4o_1.1
Viewer • Updated • 3.59k • 7 -
kaiwenw/nov2_aft_gpt4o_1.0
Viewer • Updated • 3.38k • 2 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter7-full_response_traceback
Viewer • Updated • 2.46k • 5 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter7-binarized_all_pairs
Viewer • Updated • 9.26k • 7 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter9-binarized
Viewer • Updated • 2.47k • 23 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter9-full_response_traceback
Viewer • Updated • 2.47k • 7 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter9-binarized_all_pairs
Viewer • Updated • 9.44k • 6 -
RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter3_binlabel_dpo
Viewer • Updated • 16.8k • 10 -
qklent/ficbook_dpo_postprocessed
Viewer • Updated • 9.33k • 7 -
arthrod/binarized_trimmed_60percent
Viewer • Updated • 89.4k • 72 -
100suping/KMMLU-DPO
Viewer • Updated • 10.6k • 14 -
yjwon/mp_gemma9b_sft_ogd_iter0
Viewer • Updated • 19.6k • 15 -
yjwon/mp_gemma9b_sft_dpo_beta1e-1_iter0
Viewer • Updated • 19.6k • 14 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter8-binarized
Viewer • Updated • 2.41k • 38 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter8-binarized_all_pairs
Viewer • Updated • 9.18k • 2 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter10-binarized
Viewer • Updated • 2.56k • 23 -
self-generate/qw1_sppo_hard_new_cn_mining_oj_iter10-binarized_all_pairs
Viewer • Updated • 9.42k • 6 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter5-binarized
Viewer • Updated • 2.24k • 23 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter5-binarized_all_pairs
Viewer • Updated • 8.24k • 7 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter9-binarized
Viewer • Updated • 2.41k • 22 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter9-full_response_traceback
Viewer • Updated • 2.41k • 6 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter9-binarized_all_pairs
Viewer • Updated • 9.14k • 6 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter6-binarized
Viewer • Updated • 2.17k • 24 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter6-full_response_traceback
Viewer • Updated • 2.17k • 7 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter6-binarized_all_pairs
Viewer • Updated • 7.82k • 7 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter10-binarized
Viewer • Updated • 2.41k • 25 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter10-full_response_traceback
Viewer • Updated • 2.41k • 6 -
self-generate/qw2_sppo_hard_new_cn_mining_oj_iter10-binarized_all_pairs
Viewer • Updated • 9.15k • 7 -
self-generate/qw1_reflct_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 5.71k • 13 -
self-generate/qw1_reflct_original_cn_mining_oj_iter0-binarized_all_pairs
Viewer • Updated • 22.7k • 13 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter7-binarized
Viewer • Updated • 2.04k • 20 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter7-full_response_traceback
Viewer • Updated • 2.04k • 2 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter7-binarized_all_pairs
Viewer • Updated • 7.44k • 2 -
mlfoundations-dev/oh_preferences
Viewer • Updated • 989k • 6 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter8-binarized
Viewer • Updated • 2.01k • 23 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter8-full_response_traceback
Viewer • Updated • 2.01k • 5 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter8-binarized_all_pairs
Viewer • Updated • 7.29k • 5 -
self-generate/qw1_reflct_original_cn_mining_oj_iter0-binarized-reflection-scored
Viewer • Updated • 4.97k • 22 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter9-binarized
Viewer • Updated • 1.92k • 24 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter9-binarized_all_pairs
Viewer • Updated • 7.01k • 5 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter1-binarized
Viewer • Updated • 3.9k • 4 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter1-full_response_traceback
Viewer • Updated • 3.9k • 5 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter1-binarized_all_pairs
Viewer • Updated • 15.1k • 5 -
self-generate/qw2_reflct_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 4.76k • 7 -
self-generate/qw2_reflct_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 4.76k • 8 -
self-generate/qw2_reflct_original_cn_mining_oj_iter0-binarized_all_pairs
Viewer • Updated • 17k • 7 -
ihughes15234/kp_cfr_drpo_12000
Viewer • Updated • 12k • 9 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter10-binarized
Viewer • Updated • 1.88k • 19 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter10-full_response_traceback
Viewer • Updated • 1.88k • 6 -
self-generate/qwcoder2_sppo_hard_new_cn_mining_oj_iter10-binarized_all_pairs
Viewer • Updated • 6.92k • 4 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter1-binarized-reflection-scored
Viewer • Updated • 3.51k • 16 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter2-binarized
Viewer • Updated • 3.11k • 9 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter2-full_response_traceback
Viewer • Updated • 3.11k • 10 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter2-binarized_all_pairs
Viewer • Updated • 12.4k • 9 -
self-generate/qwcoder2_reflct_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 3.22k • 5 -
self-generate/qwcoder2_reflct_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 3.22k • 5 -
self-generate/qwcoder2_reflct_original_cn_mining_oj_iter0-binarized_all_pairs
Viewer • Updated • 16.8k • 5 -
self-generate/qwcoder2_reflct_original_cn_mining_oj_iter0-binarized-reflection-scored
Viewer • Updated • 2.8k • 21 -
RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter4_binlabel_dpo
Viewer • Updated • 17.4k • 5 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter1-binarized
Viewer • Updated • 6.1k • 5 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter1-full_response_traceback
Viewer • Updated • 6.1k • 6 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter1-binarized_all_pairs
Viewer • Updated • 24.5k • 6 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter1-binarized-reflection-scored
Viewer • Updated • 5.33k • 20 -
yjwon/mp_gemma9b_sft_ogd_iter1
Viewer • Updated • 19.6k • 6 -
ai2-adapt-dev/persona_math-uf-regen-unused-online-dpo
Viewer • Updated • 48k • 2 -
dogtooth/helpsteer2_rej_sampling_pairwise_data_llm_judge_filtered_binarized_full
Viewer • Updated • 3.25k • 11 -
Abdulmohsena/Pairs_DPO
Viewer • Updated • 2.96k • 23 -
nbalepur/persona_qual
Viewer • Updated • 30 • 7 -
self-generate/qw1_reflct_sppo_hard_new_cn_rl_oj_debug_iter2-binarized
Viewer • Updated • 5 • 6 -
self-generate/qw1_reflct_sppo_hard_new_cn_rl_oj_debug_iter2-full_response_traceback
Viewer • Updated • 5 • 5 -
self-generate/qw1_reflct_sppo_hard_new_cn_rl_oj_debug_iter2-binarized_all_pairs
Viewer • Updated • 21 • 5 -
self-generate/qw2_reflct_original_cn_mining_oj_iter0-binarized-reflection-scored
Viewer • Updated • 4.2k • 24 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter2-binarized-reflection-scored
Viewer • Updated • 2.81k • 24 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter2-binarized
Viewer • Updated • 3.68k • 5 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter2-full_response_traceback
Viewer • Updated • 3.68k • 6 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter2-binarized_all_pairs
Viewer • Updated • 11.4k • 5 -
self-generate/qw2_reflct_sppo_hard_new_cn_mining_oj_iter1-binarized
Viewer • Updated • 3.03k • 1 -
self-generate/qw2_reflct_sppo_hard_new_cn_mining_oj_iter1-full_response_traceback
Viewer • Updated • 3.03k • 1 -
self-generate/qw2_reflct_sppo_hard_new_cn_mining_oj_iter1-binarized_all_pairs
Viewer • Updated • 11.7k • 1 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter2-binarized-reflection-scored
Viewer • Updated • 3.31k • 19 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter3-binarized
Viewer • Updated • 3.57k • 4 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter3-full_response_traceback
Viewer • Updated • 3.57k • 5 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter3-binarized_all_pairs
Viewer • Updated • 13.2k • 5 -
self-generate/qw2_reflct_sppo_hard_new_cn_mining_oj_iter1-binarized-reflection-scored
Viewer • Updated • 2.78k • 23 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter3-binarized
Viewer • Updated • 2.6k • 1 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter3-full_response_traceback
Viewer • Updated • 2.6k • 1 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter3-binarized_all_pairs
Viewer • Updated • 9.2k • 1 -
self-generate/qw2_reflct_sppo_hard_new_cn_mining_oj_iter2-binarized
Viewer • Updated • 3.05k • 5 -
self-generate/qw2_reflct_sppo_hard_new_cn_mining_oj_iter2-full_response_traceback
Viewer • Updated • 3.05k • 5 -
self-generate/qw2_reflct_sppo_hard_new_cn_mining_oj_iter2-binarized_all_pairs
Viewer • Updated • 11.5k • 5 -
self-generate/qw1_reflct_sppo_hard_new_cn_mining_oj_iter3-binarized-reflection-scored
Viewer • Updated • 3.24k • 22 -
self-generate/qwcoder2_reflct_sppo_hard_new_cn_mining_oj_iter3-binarized-reflection-scored
Viewer • Updated • 2.43k • 22