argilla/distilabel-capybara-dpo-7k-binarized
Viewer
•
Updated
•
7.56k
•
1.06k
•
170
Direct Preference Optimization Datasets
Datasets suitable for Direct Preference Optimization based on their colum names
-
-
HuggingFaceH4/ultrafeedback_binarized
Viewer • Updated • 187k • 53k • 215 -
allenai/reward-bench
Viewer • Updated • 8.11k • 56.4k • 67 -
Dahoas/rm-static
Viewer • Updated • 81.4k • 7.56k • 106 -
princeton-nlp/llama3-ultrafeedback
Viewer • Updated • 61.8k • 6.02k • 14 -
Dahoas/full-hh-rlhf
Viewer • Updated • 125k • 4.44k • 69 -
trl-internal-testing/hh-rlhf-helpful-base-trl-style
Viewer • Updated • 46.2k • 14.3k • 6 -
tasksource/oasst1_pairwise_rlhf_reward
Viewer • Updated • 18.9k • 258 • 38 -
mlabonne/orpo-dpo-mix-40k
Viewer • Updated • 44.2k • 1.26k • 221 -
trl-internal-testing/descriptiveness-sentiment-trl-style
Viewer • Updated • 10.9k • 7.01k • 1 -
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 7.79k • 116 -
allenai/ultrafeedback_binarized_cleaned
Viewer • Updated • 186k • 4.58k • 63 -
ContextualAI/ultrabin_clean_max_chosen_rand_rejected
Viewer • Updated • 60.9k • 2 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected
Viewer • Updated • 60.9k • 146 -
princeton-nlp/mistral-instruct-ultrafeedback
Viewer • Updated • 62.7k • 5.77k • 1 -
CarperAI/openai_summarize_comparisons
Viewer • Updated • 260k • 845 • 36 -
csarron/argilla-ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 62.9k • 398 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_helpfulness
Viewer • Updated • 60.9k • 2 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_truthfulness
Viewer • Updated • 60.9k • 2 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_instruction_following
Viewer • Updated • 60.9k • 2 • 3 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_honesty
Viewer • Updated • 60.9k • 2 -
HuggingFaceH4/testing_h4
Viewer • Updated • 70 • 164 -
yitingxie/rlhf-reward-datasets
Viewer • Updated • 81.4k • 858 • 59 -
Baidicoot/augmented_advbench_v4
Viewer • Updated • 4.95k • 63 -
sfanm/ultrafeedback_llama3_label
Viewer • Updated • 60k • 2 -
HuggingFaceH4/summarize_from_feedback
Viewer • Updated • 353k • 199 • 2 -
HuggingFaceH4/orca_dpo_pairs
Viewer • Updated • 12.9k • 97 • 22 -
zhengr/ultrafeedback_binarized
Viewer • Updated • 190k • 4 • 2 -
trl-internal-testing/hh-rlhf-trl-style
Viewer • Updated • 169k • 1.08k • 9 -
HuggingFaceH4/cai-conversation-harmless
Viewer • Updated • 44.8k • 120 • 13 -
HuggingFaceH4/rlaif-v_formatted
Viewer • Updated • 83.1k • 784 • 1 -
nz/anthropic_hh_rlhf
Viewer • Updated • 169k • 42 -
trl-internal-testing/sentiment-trl-style
Viewer • Updated • 5.48k • 258 -
SAGI-1/Greetings_DPO_dataset_V1
Viewer • Updated • 891 • 34 • 3 -
trl-internal-testing/tldr-preference-trl-style
Viewer • Updated • 179k • 771 • 2 -
xinlai/Math-Step-DPO-10K
Viewer • Updated • 10.8k • 1.67k • 19 -
ContextualAI/ultrafeedback_binarized_1percent
Viewer • Updated • 200 • 648 -
arcee-ai/distilabel-intel-orca-dpo-pairs-binarized
Viewer • Updated • 12.9k • 1.12k • 1 -
Syed-Hasan-8503/orpo-40k-train-test
Viewer • Updated • 44.2k • 2 -
maywell/ko_Ultrafeedback_binarized
Viewer • Updated • 62k • 171 • 28 -
sfanm/ultrafeedback_llama3_pad_rm
Viewer • Updated • 56.4k • 2 -
mnoukhov/openai_summarize_comparisons_tldrprompt_relabel1b
Viewer • Updated • 97.5k • 4 -
ZhangShenao/gc_ultrafeedback
Viewer • Updated • 97.1k • 2 -
Synadapt/Orpo_Split_Turns_v1_clean_ready
Viewer • Updated • 8.1k • 2 -
HuggingFaceH4/h4-tests-format-dpo-dataset
Viewer • Updated • 1 • 56 -
when2rl/tldr-summarisation-preferences_reformatted
Viewer • Updated • 177k • 2 -
alvarobartt/dpo-mix-7k-simplified
Viewer • Updated • 7.5k • 2 • 11 -
mlabonne/orpo-dpo-mix-40k-flat
Viewer • Updated • 44.2k • 209 • 5 -
valerielucro/gsm8k_preference_dataset
Viewer • Updated • 895 • 2 -
cyberagent/chatbot-arena-ja-calm2-7b-chat-experimental
Viewer • Updated • 29.2k • 4 • 16 -
allenai/preference-test-sets
Viewer • Updated • 43.2k • 462 • 17 -
pharaouk/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 3 -
smangrul/ultrachat-feedback-10k-chatml
Viewer • Updated • 12k • 105 -
yuasosnin/imdb-dpo
Viewer • Updated • 10k • 668 -
beyond/rlhf-reward-single-round-trans_chinese
Viewer • Updated • 24.9k • 9 • 36 -
ZhangShenao/gc_fine_ultrafeedback
Viewer • Updated • 97.1k • 2 • 1 -
Katayoon/SELM-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 2 -
Magpie-Align/Magpie-Pro-DPO-200K
Viewer • Updated • 207k • 8 • 5 -
trl-internal-testing/mlabonne-chatml-dpo-pairs-copy
Viewer • Updated • 12.9k • 9.32k -
gx-ai-architect/HelpSteer2_DPO
Viewer • Updated • 7.59k • 4 • 1 -
when2rl/UltraFeedback_binarized_cleaned_annotated
Viewer • Updated • 62.7k • 2 -
youjunhyeok/ko-orca-pair-and-ultrafeedback-dpo
Viewer • Updated • 72.5k • 41 • 1 -
xiaodongguaAIGC/awesome-dpo
Viewer • Updated • 302k • 2 • 2 -
banghua/tldr_reward_model_labeled
Viewer • Updated • 176k • 240 -
pythainlp/oasst2_dpo_pairs_enth
Viewer • Updated • 5.28k • 3 • 1 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part0
Viewer • Updated • 20k • 6 -
ZhangShenao/gc_binarized_ultrafeedback
Viewer • Updated • 109k • 2 -
dinaaaaaa/lima_rand_sel_50_preference
Viewer • Updated • 500 • 2 -
argilla/OpenHermesPreferences
Viewer • Updated • 989k • 523 • 188 -
kira/math-dpo
Viewer • Updated • 2.42k • 5 • 5 -
kaist-ai/Multifaceted-Collection-DPO
Viewer • Updated • 65.1k • 15 • 7 -
communityai/mlabonne___orpo-dpo-mix-40k-alignment
Viewer • Updated • 42.7k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part1
Viewer • Updated • 20k • 16 -
princeton-nlp/llama3-ultrafeedback-armorm
Viewer • Updated • 61.8k • 8.48k • 13 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_pythia6.9b
Viewer • Updated • 177k • 2 -
yaswanthchittepu/ultrafeedback-binarized-standard-margin-data-full
Viewer • Updated • 63.7k • 2 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_pythia1b
Viewer • Updated • 177k • 2 -
nebchi/kor-orpo
Viewer • Updated • 98.1k • 2 -
wenbopan/Chinese-dpo-pairs
Viewer • Updated • 10.7k • 146 • 35 -
ZhangShenao/gc_posonly_fine_ultrafeedback
Viewer • Updated • 49.6k • 2 -
abhayesian/augmented_advbench_v5
Viewer • Updated • 4.95k • 36 -
aklein4/tldr-feedback
Viewer • Updated • 179k • 2 -
BramVanroy/ultra_feedback_dutch
Viewer • Updated • 53.6k • 102 • 2 -
yaswanthchittepu/ultrafeedback-binarized-pop-margin-data-full
Viewer • Updated • 63.7k • 2 -
RAY2L/llama3-ultrafeedback-mini
Viewer • Updated • 1.2k • 2 -
David-Xu/astronomy-stack-dpo-text
Viewer • Updated • 19.9k • 2 • 1 -
GitBag/multiturn-hh-turn-1-5
Viewer • Updated • 162k • 2 -
yhavinga/orpo-dpo-mix-dutch-40k
Viewer • Updated • 43.1k • 2 • 1 -
HuggingFaceH4/grok-conversation-harmless
Viewer • Updated • 44.8k • 49 • 21 -
ZhangShenao/gc_binarized_noscore_ultrafeedback
Viewer • Updated • 109k • 2 -
rajj0/god_sent_datav1
Viewer • Updated • 2.84k • 2 -
GrowingApple/orpo_kor_translated_medical
Viewer • Updated • 10.4k • 9 • 3 -
trl-internal-testing/Anthropic-hh-rlhf-processed
Viewer • Updated • 3k • 46 -
GitBag/multiturn-512-hh-turn-1-5
Viewer • Updated • 165k • 40 • 1 -
snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset
Viewer • Updated • 62.7k • 13 • 42 -
maywell/ko_Ultrafeedback_binarized_10k
Viewer • Updated • 10k • 4 • 5 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part2
Viewer • Updated • 21.1k • 14 -
trl-internal-testing/descriptiveness-trl-style
Viewer • Updated • 5.42k • 2 • 1 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144
Viewer • Updated • 179k • 2 -
AlpacaAAR/epfl-synthetic-dpo
Viewer • Updated • 19.6k • 2 -
justinphan3110/toxic-dpo-v0.2-sft
Viewer • Updated • 540 • 2 -
minkyungpark/UFB_test_500
Viewer • Updated • 500 • 2 -
kaist-ai/Multifaceted-Collection-ORPO
Viewer • Updated • 64.6k • 2 • 8 -
orpo-explorers/OpenHermesPreferences-10k
Viewer • Updated • 10k • 90 • 2 -
when2rl/SHP_reformatted
Viewer • Updated • 386k • 2 -
saulgarciahuertes/orpo_ie_dataset
Viewer • Updated • 16.4k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1
Viewer • Updated • 20k • 2 -
VictorDCh/spider-dpo-dataset
Viewer • Updated • 901 • 2 -
ZhangShenao/gc_binarized_posonly_ultrafeedback
Viewer • Updated • 63.1k • 2 -
ZhangShenao/gc_mode_posonly_fine_ultrafeedback
Viewer • Updated • 49.6k • 2 -
when2rl/Nectar_reformatted
Viewer • Updated • 183k • 2 -
lightblue/mitsu_full_borda
Viewer • Updated • 2.85k • 29 • 2 -
ibivibiv/cleaned_orca_math_dpo_pairs
Viewer • Updated • 200k • 2 • 1 -
when2rl/PKU-SafeRLHF_reformatted_filtered
Viewer • Updated • 136k • 2 -
IlyaGusev/saiga_preferences
Viewer • Updated • 18.9k • 35 • 3 -
Baidicoot/anthropic-harmless-rlhf
Viewer • Updated • 42.5k • 2 -
tasksource/tasksource_dpo_pairs
Viewer • Updated • 5.13M • 446 • 20 -
reciprocate/ultrafeedback_orca_math_dpo
Viewer • Updated • 73.8k • 4 • 1 -
zaddyzaddy/randomcrawl
Viewer • Updated • 100k • 2 -
abacusai/MetaMath_DPO_FewShot
Viewer • Updated • 395k • 140 • 22 -
Baidicoot/hh-rlhf-golden-harmful
Viewer • Updated • 7.64k • 2 • 1 -
We-Want-GPU/Yi-Ko-DPO-dataset
Viewer • Updated • 4k • 8 • 4 -
wisenut-nlp-team/dpo_test2
Viewer • Updated • 100 • 5 -
tasksource/oasst2_pairwise_rlhf_reward
Viewer • Updated • 28.4k • 11 • 2 -
reciprocate/dpo_ultra-capybara-code_filtered-best
Viewer • Updated • 35.2k • 2 -
Baidicoot/anthropic-hh-rlhf
Viewer • Updated • 169k • 4 -
when2rl/distilabel-intel-orca-dpo-pairs_cleaned_reformatted
Viewer • Updated • 12.8k • 2 -
JamesSpray/dpo_dataset_hh
Viewer • Updated • 24.2k • 2 -
kaitchup/UltraFeedback-prompt-chosen-rejected
Viewer • Updated • 18k • 5 • 6 -
rajj0/god_sent_data_v2
Viewer • Updated • 2.84k • 2 -
arham6/dataset3
Viewer • Updated • 258 • 2 -
gabjp/PKU-safe-dpo
Viewer • Updated • 75.1k • 159 -
Windy/tmp_output
Viewer • Updated • 60 -
Columbia-NLP/DPO-HelpSteer
Viewer • Updated • 9.17k • 2 -
NobodyExistsOnTheInternet/ToxicDPOqa
Viewer • Updated • 6.87k • 14 • 14 -
sfanm/ultrafeedback_llama3
Viewer • Updated • 60.2k • 2 -
when2rl/distilabel-capybara-dpo-7k-binarized_reformatted
Viewer • Updated • 7.56k • 2 -
when2rl/py-dpo-v0.1_reformatted
Viewer • Updated • 9.47k • 2 -
ineskoder/KIBRAM_dataset
Viewer • Updated • 72.2k • 2 -
alexredna/oasst2_dpo_pairs
Viewer • Updated • 10k • 4 • 6 -
mintaeng/dpo_ko_mj
Viewer • Updated • 3k • 2 -
abacusai/ARC_DPO_FewShot
Viewer • Updated • 4.25k • 7 • 17 -
2A2I/Aya-Command.R-DPO
Viewer • Updated • 14.2k • 11 • 7 -
pgurazada1/ultrafeedback-sample
Viewer • Updated • 315 • 35 -
when2rl/HelpSteer_reformatted
Viewer • Updated • 9.17k • 2 -
YYYYYYibo/full_simple_online_train_part_2
Viewer • Updated • 19k • 2 -
YYYYYYibo/full_simple_online_train_part_3
Viewer • Updated • 19.3k • 2 -
YYYYYYibo/gshf_vllm_1_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/gshf_vllm_2_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/gshf_train_part_2
Viewer • Updated • 20k • 10 -
YYYYYYibo/gshf_vllm_2_part_3
Viewer • Updated • 21.1k • 2 -
lca0503/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 2 -
We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs
Viewer • Updated • 12.7k • 6 • 5 -
lightblue/mitsu_tophalf_borda
Viewer • Updated • 1.42k • 2 • 5 -
2A2I/Aya-SambaLingo.Arabic.Chat-DPO
Viewer • Updated • 14.2k • 2 • 3 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706887192
Viewer • Updated • 405 • 2 -
ShenaoZhang/0.0_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 24k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_0
Viewer • Updated • 5.08k • 2 -
aidoko/binarized-nectar
Viewer • Updated • 183k • 2 -
arcee-ai/general-dpo-datasets
Viewer • Updated • 91.6k • 7 -
argilla/ultrafeedback-multi-binarized-preferences-cleaned
Viewer • Updated • 158k • 508 • 6 -
Asap7772/ultrafeedback_binarized_relabelled_ultrarm
Viewer • Updated • 63.1k • 4 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 568k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
ibivibiv/cleaned_math_dpo_pairs
Viewer • Updated • 760k • 2 -
wenzhy7/llama2_orpo_ei
Viewer • Updated • 2.05k • 2 -
orpo-explorers/ultrafeedback_binarized_15k
Viewer • Updated • 15.4k • 2 • 4 -
ThWu/dpo_highest_n_random
Viewer • Updated • 182k • 4 • 2 -
agicorp/MetaMath_DPO_FewShot
Viewer • Updated • 395k • 2 • 2 -
2A2I/Aya-AceGPT.13B.Chat-DPO
Viewer • Updated • 13k • 2 • 2 -
Trelis/orpo-dpo-mix-40k-SHORT
Viewer • Updated • 7.19k • 2 • 2 -
Code-Refinement/utf_20_refs_pairs
Viewer • Updated • 3.68k • 2 -
ShenaoZ/0.0_dataup_4iters_dataset
Viewer • Updated • 51.8k • 2 -
lightblue/mitsu_top75_borda
Viewer • Updated • 2.02k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_2
Viewer • Updated • 5.08k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_3
Viewer • Updated • 5.09k • 2 -
ShenaoZ/0.00001_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1
Viewer • Updated • 19.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2
Viewer • Updated • 20.7k • 2 -
nhyha/ORPO-DPO
Viewer • Updated • 1.68k • 2 -
cmcmaster/clinical_cases_preferences
Viewer • Updated • 7.94k • 2 -
valerielucro/gsm8k_preference_dataset_2.1
Viewer • Updated • 1.21k • 2 -
malhajar/orca_dpo_pairs-tr
Viewer • Updated • 10.8k • 4 • 5 -
Deojoandco/reward_model_anthropic
Viewer • Updated • 169k • 2 -
Astris/Nectar-Ranked-DPO
Viewer • Updated • 503k • 2 -
ShenaoZ/0.001_ablation_5iters_bs256_dataset
Viewer • Updated • 56.9k • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_4444lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0
Viewer • Updated • 19.6k • 4 -
ShenaoZ/0.0001_sft_nodpo_3iters_bs256_531lr_dataset
Viewer • Updated • 67.1k • 2 -
2A2I/NoRobots-Command.R-DPO
Viewer • Updated • 9.5k • 2 -
Tachi67/mnlp_dpo_data_7k
Viewer • Updated • 7.66k • 2 -
d-llm/hh-rlhf
Viewer • Updated • 160k • 2 -
allenai/coconot
Viewer • Updated • 13.8k • 53 • 4 -
vicgalle/configurable-system-prompt-multitask
Viewer • Updated • 1.95k • 31 • 19 -
reciprocate/math_dpo_pairs
Viewer • Updated • 4.38k • 9 • 5 -
vicgalle/OpenHermesPreferences-roleplay
Viewer • Updated • 3.06k • 2 • 3 -
orpo-explorers/OpenHermesPreferences-500k
Viewer • Updated • 500k • 2 • 2 -
d0rj/full-hh-rlhf-ru
Viewer • Updated • 125k • 107 • 2 -
ummagumm-a/cup-it-ds-classification-pairwise
Viewer • Updated • 282k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_decalpha_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_zephyrbeta_userresponse_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_only2third_dataset
Viewer • Updated • 2k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_2
Viewer • Updated • 1k • 2 -
ShenaoZ/0.00005_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 2 -
ibivibiv/nectar_dpo_cleaned
Viewer • Updated • 3.84M • 2 -
ibivibiv/cleaned_math_dpo_pairs_eval
Viewer • Updated • 40k • 2 -
mnlp-nsoai/dpo-student-preference-pairs
Viewer • Updated • 18.4k • 2 -
arham6/dataset2
Viewer • Updated • 258 • 2 -
aklein4/tldr-feedback-shuffled
Viewer • Updated • 179k • 2 -
fblgit/simple-math-DPO
Viewer • Updated • 800k • 31 • 13 -
abacusai/HellaSwag_DPO_FewShot
Viewer • Updated • 150k • 5 • 8 -
lamhieu/beyond_dpo_vi
Viewer • Updated • 25k • 4 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1707245027
Viewer • Updated • 1M • 2 -
0-hero/distilabel-math-preference-dpo
Viewer • Updated • 2.42k • 6 -
ShenaoZhang/0.001_idpo_ref_response
Viewer • Updated • 44.8k • 2 -
ShenaoZhang/0.001_idpo_same_replacechosen_only_dataset
Viewer • Updated • 44.8k • 2 -
when2rl/prm_dpo_pairs_cleaned_reformatted
Viewer • Updated • 7.99k • 2 -
thesven/pihkal-tihkal-orpo-dpo-dataset
Viewer • Updated • 3.46k • 2 -
cornfieldrm/prm800k-phase2
Viewer • Updated • 81.6k • 2 -
ShenaoZ/0.00001_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 2 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_lora-sft-finetuned-stage4-iter86000
Viewer • Updated • 20.8k • 2 -
2A2I/NoRobots-Aya.23.8B-DPO
Viewer • Updated • 9.5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2
Viewer • Updated • 20k • 2 -
mlabonne/arena-preferences
Viewer • Updated • 2.69k • 3 • 9 -
d0rj/rlhf-reward-datasets-ru
Viewer • Updated • 81.4k • 90 • 4 -
2A2I/Aya-Aya.23.8B-DPO
Viewer • Updated • 14k • 2 • 2 -
d0rj/synthetic-instruct-gptj-pairwise-ru
Viewer • Updated • 33.1k • 26 • 1 -
reciprocate/ultrafeedback_orca_math_cleaned_high_dpo
Viewer • Updated • 48.3k • 4 • 1 -
lamhieu/itorca_dpo_vi
Viewer • Updated • 12.9k • 4 -
SUSTech/bagel-sft
Viewer • Updated • 727k • 2 -
elfonthefly/STEM_DPO
Viewer • Updated • 1.45M • 9 • 1 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_minpi_part_3
Viewer • Updated • 21.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2
Viewer • Updated • 20k • 2 -
quyanh/lexglue-cot-dpo
Viewer • Updated • 4k • 2 -
efederici/alpaca-vs-alpaca-orpo-dpo
Viewer • Updated • 49.2k • 8 • 6 -
pszemraj/SHP-2-dpo-100k_sample
Viewer • Updated • 200k • 6 • 1 -
floleuerer/distilabel-intel-orca-dpo-pairs-binarized
Viewer • Updated • 5.92k • 41 -
arcee-ai/OpenHermesPreferences-binarized
Viewer • Updated • 989k • 2 • 1 -
YYYYYYibo/full_simple_online_vllm_part_2
Viewer • Updated • 19k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3
Viewer • Updated • 19.3k • 2 -
YYYYYYibo/gshf_vllm_1_part_3
Viewer • Updated • 21.1k • 2 -
YYYYYYibo/gshf_train_part_3
Viewer • Updated • 21.1k • 2 -
BramVanroy/orca_dpo_pairs_dutch
Viewer • Updated • 11k • 4 • 5 -
erhwenkuo/rlhf_reward_single_round-chinese-zhtw
Viewer • Updated • 24.9k • 7 • 3 -
HuggingFaceH4/cai-conversation
Viewer • Updated • 169k • 4 • 3 -
We-Want-GPU/yi-ko-DPO-noprompt-dataset
Viewer • Updated • 3.83k • 4 • 2 -
allenai/reward-bench-results
Updated • 4 • 2 -
droussis/UltraSafety_binarized-orpo-dpo
Viewer • Updated • 2.26k • 25 • 2 -
AlexHung29629/stack-exchange-paired-128K
Viewer • Updated • 128k • 4 • 1 -
giux78/50000-60900-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 10.9k • 4 -
roleplay4fun/chai-valid-pairs-ss5-v1.0
Viewer • Updated • 12.2k • 2 -
orpo-explorers/OpenHermesPreferences-50k
Viewer • Updated • 50k • 2 -
Tachi67/mnlp_dpo_data
Viewer • Updated • 25.4k • 2 -
euiyulsong/sci_train_ds
Viewer • Updated • 11.7k • 2 -
arcee-ai/truthy-dpo-v0.1-binarized
Viewer • Updated • 1.02k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_3
Viewer • Updated • 5k • 2 -
2A2I/NoRobots-SambaLingo.Arabic.Chat-DPO
Viewer • Updated • 9.5k • 2 -
patruff/chuckles_dpo_pairsA
Viewer • Updated • 106 • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_minpi_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3
Viewer • Updated • 21.1k • 2 -
varun-v-rao/mimic_cxr_dpo
Viewer • Updated • 125k • 4 -
alvarobartt/ultrafeedback-multi-binarized-quality-preferences-cleaned
Viewer • Updated • 155k • 4 -
Sharathhebbar24/orca_dpo_pairs
Viewer • Updated • 12.9k • 3 -
jikaixuan/mistral02_generated
Viewer • Updated • 61.1k • 2 -
boopysaur/user2-dpo-small
Updated • 1 -
quirky-lats-at-mats/NORMAL_BACKDOOR_alpaca_sleeper_agents_toy_safety_NOT_TRUNCATED_v4
Viewer • Updated • 2.83k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 94.6k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.9
Viewer • Updated • 568k • 2 -
ShenaoZ/0.0_dataup_dataset
Viewer • Updated • 44.8k • 2 -
communityai/system_identity_remove_preference_qwen-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_chatgpt-v2
Viewer • Updated • 93 • 2 -
YYYYYYibo/eval-dataset-nash
Viewer • Updated • 1k • 2 -
ShenaoZ/0.0005_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZhang/0.0_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 2k • 2 -
euiyulsong/generated_data
Viewer • Updated • 452 • 2 -
arcee-ai/OpenHermes2.5-dpo-binarized-alpha
Viewer • Updated • 9.79k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3
Viewer • Updated • 21.1k • 2 -
2A2I/NoRobots-AceGPT.13B.Chat-DPO
Viewer • Updated • 9.5k • 2 -
jayhii/orpo_2sep_data_font
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_minpi_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3
Viewer • Updated • 21.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_minpi_part_3
Viewer • Updated • 21.1k • 2 -
valerielucro/gsm8k_preference_dataset_2
Viewer • Updated • 379 • 2 -
reshinthadith/pairwise-code-review-instruct-critique-revision-python
Viewer • Updated • 5.24k • 2 • 6 -
NickyNicky/neovalle_H4rmony_dpo_translated_English_to_Spanish
Viewer • Updated • 2.02k • 2 • 4 -
HuggingFaceH4/cai-conversation-harmless-old
Viewer • Updated • 44.8k • 4 • 3 -
Starlento/DPO-En-Zh-20k-handbook
Viewer • Updated • 20k • 2 • 3 -
AlekseyKorshuk/davinci-pairwise-medium
Viewer • Updated • 72k • 2 -
AlekseyKorshuk/cup-it-ds-pairwise
Viewer • Updated • 352k • 2 -
banghua/hh_reward_model_labeled
Viewer • Updated • 125k • 2 -
pvduy/dpo_data
Viewer • Updated • 197k • 4 -
vwxyzjn/cai-conversation-dev1705951688
Viewer • Updated • 256 • 4 -
lamhieu/beyond_dpo_en
Viewer • Updated • 25k • 4 -
CognitiveLab/hh-rlhf-json
Viewer • Updated • 161k • 4 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330973
Viewer • Updated • 167 • 2 -
sanduntg/test_vsort_classification
Viewer • Updated • 99 • 2 -
vwxyzjn/ultrafeedback_binarized_1707921333
Viewer • Updated • 2k • 2 -
mnoukhov/openai_comparisons_20k_regen_and_relabelled
Viewer • Updated • 20k • 2 -
vwxyzjn/ultrafeedback_binarized_1708454270
Viewer • Updated • 25.3k • 2 -
vwxyzjn/ultrafeedback_binarized_1708458397
Viewer • Updated • 25.3k • 2 -
Baidicoot/anthropic_hh_golden_mistral
Viewer • Updated • 42.1k • 2 -
hon9kon9ize/yue-truthy
Viewer • Updated • 2.03k • 3 -
vwxyzjn/hh-rlhf
Viewer • Updated • 100 • 3 -
reciprocate/dpo_ultra-capybara_filtered-best
Viewer • Updated • 25.6k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.2_self_160m
Viewer • Updated • 37.9k • 2 -
boopysaur/user3-dpo-small
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_0.1_self_160m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1
Viewer • Updated • 568k • 4 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.25
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.9
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.9
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_3_t_1.0_eval
Viewer • Updated • 568k • 2 -
UCLAML/data-RPO-Iter1-New-309_generated
Viewer • Updated • 20k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_nodpo_dataset
Viewer • Updated • 69.1k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_useresponse_dataset
Viewer • Updated • 17.3k • 2 -
ShenaoZhang/0.0001_3iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 67.1k • 2 -
communityai/system_identity_remove_preference_qwen_1.5-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_adept_preference_v2-corrected
Viewer • Updated • 202 • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_ranked
Viewer • Updated • 9.28k • 2 -
nbalepur/Mnemonic_Chosen_Rejected
Viewer • Updated • 472 • 2 -
YYYYYYibo/eval-dataset-with-score-rank4
Viewer • Updated • 200 • 2 -
ShenaoZ/0.0001_withdpo_3iters_bs256_531lr_dataset
Viewer • Updated • 44.8k • 2 -
vipinkatara/dataset_complete_12
Viewer • Updated • 220k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_train_part_3
Viewer • Updated • 20.5k • 2 -
StrangeSX/SGXT1
Viewer • Updated • 99 • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_part1
Viewer • Updated • 19.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_minpi_part_2
Viewer • Updated • 19.1k • 2 -
ShenaoZ/0.0001_sft_nodpo_5iters_bs256_5102lr_dataset
Viewer • Updated • 71.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_3
Viewer • Updated • 4.85k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_3
Viewer • Updated • 21.1k • 2 -
DuongTrongChi/detoxic-dpo-format
Viewer • Updated • 46.6k • 2 -
arcee-ai/multiturn-capybara-preferences-filtered-binarized
Viewer • Updated • 14.8k • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.50
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3
Viewer • Updated • 21.1k • 2 -
mcding-org/CorrectDPO-Eval-DPO_Pm3B_U0_beta0.10
Updated • 3 -
mcding-org/CorrectDPO-Eval-DPO_L8B_U0_beta0.10
Updated • 3 -
Piteryo/hf-trl-1024
Viewer • Updated • 1.28k • 2 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized
Viewer • Updated • 60.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
y1xing/orpo_llama3_concatenated_data_with_chris_examples_orpo_instruct_dataset
Viewer • Updated • 2.64k • 2 -
argilla/ultrafeedback-multi-binarized-quality-preferences-cleaned
Viewer • Updated • 155k • 36 • 4 -
IlyaGusev/saiga_reward
Viewer • Updated • 27k • 13 • 4 -
mii-community/ultrafeedback-preferences-translated-ita
Viewer • Updated • 60.9k • 2 • 3 -
vicgalle/OpenHermesPreferences-1k
Viewer • Updated • 1.11k • 2 • 3 -
mlabonne/oasst-preferences
Viewer • Updated • 22.3k • 2 • 3 -
beyond/rlhf-reward-single-round
Viewer • Updated • 25k • 2 • 2 -
alvarobartt/Anthropic_HH_Golden_Formatted
Viewer • Updated • 44.8k • 4 • 2 -
distilabel-internal-testing/ohp-writing
Viewer • Updated • 1.53k • 2 • 2 -
NickyNicky/function_call_orpo_sft_phi3_chatML_only
Viewer • Updated • 66k • 2 • 2 -
PawanKrd/dpo-gpt-4o
Viewer • Updated • 12.4k • 13 • 10 -
d0rj/oasst1_pairwise_rlhf_reward-ru
Viewer • Updated • 18.9k • 2 • 1 -
Palash123/dpo_anthropic_hh_rlhf
Viewer • Updated • 168k • 91 • 1 -
sablo/HelpSteer_binarized
Viewer • Updated • 8.55k • 4 • 1 -
SUSTech/bagel-dpo
Viewer • Updated • 192k • 2 • 1 -
winglian/cortex-0_1-loss
Viewer • Updated • 402 • 2 • 1 -
vtiyyal1/AskDocsEmpathy_4k_dpo
Viewer • Updated • 4.12k • 2 • 1 -
Suraponn/iapp_for_orpo
Viewer • Updated • 121k • 2 • 1 -
umarigan/openhermespreference_tr
Viewer • Updated • 989k • 2 • 2 -
orpo-explorers/OHP-15k
Viewer • Updated • 15.4k • 2 • 1 -
NickyNicky/oasst2_orpo_mix_tokenizer_phi_3_v1
Viewer • Updated • 54.3k • 2 • 1 -
NickyNicky/Colossal_Translation_EN_ES_ORPO_DPO_Gemma
Viewer • Updated • 1.7M • 2 • 2 -
NickyNicky/DIBT_prompts_ranked_En_Es_orpo_dpo_chatML_gemma_V3
Viewer • Updated • 20.4k • 2 • 1 -
NickyNicky/nano_finance_200k_en_es_chatML_gemma_orpo_dpo
Viewer • Updated • 201k • 3 • 1 -
AlekseyKorshuk/chai-real-and-synthetic
Viewer • Updated • 154k • 2 -
ummagumm-a/cup-it-ds-classification-pairwise-train-val
Viewer • Updated • 352k • 2 -
AlekseyKorshuk/lmeh-hh
Viewer • Updated • 12.5k • 2 -
samxm111/rlhf-reward-single-round
Viewer • Updated • 25k • 2 -
abhishek/dpo-sample
Viewer • Updated • 7 • 8 -
alvarobartt/Anthropic_HH_Golden_Extended
Viewer • Updated • 89.7k • 4 -
mnoukhov/openai_summarize_generated_20k_relabel_410m_dpo1
Viewer • Updated • 20k • 4 -
mnoukhov/openai_summarize_generated_20k_relabel_1b
Viewer • Updated • 20k • 4 -
dvilasuero/multiturn_with_generations
Viewer • Updated • 100 • 4 -
GokhanAI/INST_Synthetic_LLAMA
Viewer • Updated • 26.3k • 4 -
0x7o/oasst-ru-dpo-v1
Viewer • Updated • 1.32k • 4 -
Jaredquek/dpoedtech
Viewer • Updated • 3.25k • 4 -
jan-hq/ultrafeedback_quality_binarized
Viewer • Updated • 155k • 4 -
giux78/10000-20000-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 10k • 4 -
giux78/20000-50000-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 30k • 4 -
vwxyzjn/cai-conversation-dev1705525723
Viewer • Updated • 256 • 4 -
CognitiveLab/hh-rlhf-formatted
Viewer • Updated • 161k • 4 -
CognitiveLab/hh-rlhf-formatted-10000
Viewer • Updated • 10k • 4 -
vwxyzjn/cai-conversation-dev1705633234
Viewer • Updated • 256 • 4 -
arianhosseini/openai_comparisons_20k_regen_and_relabelled
Viewer • Updated • 25k • 4 -
Saugatkafley/okapi-ranking
Viewer • Updated • 126k • 4 -
vwxyzjn/self-reward-dev1706043619
Viewer • Updated • 16 • 4 -
vwxyzjn/self-reward-dev1706109551
Viewer • Updated • 16 • 4 -
vwxyzjn/self-reward-dev1706112590
Viewer • Updated • 16 • 4 -
manishiitg/unalignment-toxic-dpo-v0.2
Viewer • Updated • 1.08k • 2 -
manishiitg/jondurbin-gutenberg-dpo-v0.1
Viewer • Updated • 1.8k • 2 -
argilla/ultrafeedback-capybara-mix-5k
Viewer • Updated • 5k • 2 -
BarraHome/ultrafeedback_binarized
Viewer • Updated • 187k • 16 -
remyxai/ffmperative_dpo_test
Viewer • Updated • 1.47k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1706885434
Viewer • Updated • 24 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706903049
Viewer • Updated • 167 • 2 -
weijie210/UFB_prefs_iter_0
Viewer • Updated • 24.9k • 2 -
weijie210/UFB_prefs_nosub_iter_0
Viewer • Updated • 14.7k • 2 -
pvduy/dpo_data_capy
Viewer • Updated • 47.6k • 2 -
dkshjn/processed_distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 2 -
weijie210/UC_prefs_nosub_iter_0
Viewer • Updated • 14.4k • 2 -
weijie210/UC_prefs_iter_0_pairwise
Viewer • Updated • 14.4k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707331096
Viewer • Updated • 87 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707331527
Viewer • Updated • 462 • 2 -
vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707332943
Viewer • Updated • 167 • 2 -
nz/100_v2_rlhf
Viewer • Updated • 122k • 2 -
vwxyzjn/ultrafeedback_binarized_1708035667
Viewer • Updated • 63.1k • 2 -
zekeZZ/hh-rlhf-dpo
Viewer • Updated • 51.9k • 2 -
vwxyzjn/ultrafeedback_binarized_1708702930
Viewer • Updated • 27k • 2 -
jikaixuan/mistral_generated
Viewer • Updated • 61.1k • 2 -
arianhosseini/summ_dpo1b1_ngen10_max_2ndmax
Viewer • Updated • 20k • 2 -
nz/closest_to_3000_range_1000_to_9000
Viewer • Updated • 11k • 2 -
nz/closest_to_5000_range_1000_to_9000
Viewer • Updated • 11k • 2 -
nz/closest_to_7000_range_1000_to_9000
Viewer • Updated • 11k • 2 -
hon9kon9ize/yue-toxic-dpo
Viewer • Updated • 1.07k • 5 -
David-Xu/astronomy-stack-dpo-text-20-percent
Viewer • Updated • 3.99k • 3 • 1 -
psyche/anthropic-hh-rlhf
Viewer • Updated • 169k • 2 -
aengusl/noise5_alpaca_sleeper_agents_toy_safety_v4
Viewer • Updated • 2.83k • 2 -
aengusl/test_hp_dpo_unlrn_ds
Viewer • Updated • 312 • 2 -
vwxyzjn/hh-rlhf-trl-style
Viewer • Updated • 100 • 2 -
Mitsuki-Sakamoto/filter_dataset_test
Viewer • Updated • 73 • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.2_self_70m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.5_self_160m
Viewer • Updated • 37.9k • 2 -
valerielucro/Preference-Dataset-sample
Viewer • Updated • 525 • 2 -
abhinand/argilla-dpo-mix-7k-singleturn
Viewer • Updated • 4.9k • 2 -
nz/ulma_anthropic_hh_golden
Viewer • Updated • 44.8k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_0.3_self_160m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_1.0_self_160m
Viewer • Updated • 18.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_2
Viewer • Updated • 568k • 2 -
when2rl/dpo-mix-7k-rescaled_reformatted
Viewer • Updated • 7.5k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 511k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_3
Viewer • Updated • 189k • 3 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.25
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.75
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.9
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.7
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2_t_1.0_eval
Viewer • Updated • 568k • 2 -
orpo-explorers/OpenHermesPreferences-25k
Viewer • Updated • 25k • 2 -
orpo-explorers/OpenHermesPreferences-250k
Viewer • Updated • 250k • 2 -
sazirarrwth99/kangoroo_dpo_trainer_final
Viewer • Updated • 23.3k • 2 -
wenbopan/cmmlu_dpo_pairs
Viewer • Updated • 5.04k • 4 -
ShenaoZhang/0.001_idpo_dataset
Viewer • Updated • 44.8k • 2 -
Gopal2002/zephyr-gemma-finetune-dpo
Viewer • Updated • 69 • 2 -
AnushaKulkarni/preferred_dataset2
Viewer • Updated • 50 • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo_temp0.7
Viewer • Updated • 20k • 2 -
arianhosseini/ultrafeedback_binarized_relabel1b
Viewer • Updated • 63.1k • 2 -
ShenaoZ/0.0001_idpo_same_6iters_dataset
Viewer • Updated • 48.8k • 2 -
ShenaoZ/0.001_idpo_same_scratch_dataset
Viewer • Updated • 106k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo_temp0.7_length128
Viewer • Updated • 20k • 2 -
ShenaoZ/0.0001_idpo_same_3itersn_dataset
Viewer • Updated • 44.8k • 2 -
trl-lib/capybara-preferencces-7k
Viewer • Updated • 7.56k • 2 -
guoyu-zhang/usp_1
Viewer • Updated • 1k • 2 -
guoyu-zhang/usp_2
Viewer • Updated • 1k • 2 -
guoyu-zhang/usp_4
Viewer • Updated • 1k • 2 -
DuongTrongChi/hh-rlhf
Viewer • Updated • 161k • 2 -
when2rl/gutenberg-dpo-v0.1_reformatted
Viewer • Updated • 918 • 3 -
ShenaoZ/0.001_ablation_dataset
Viewer • Updated • 44.8k • 2 -
ShenaoZ/0.0001_ablation_dataset
Viewer • Updated • 44.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_labelled_vllm_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 9.5k • 2 -
ShenaoZ/0.0001_ablation_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.01_ablation_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
UCLAML/RPO-Iter2-New-312_generated
Viewer • Updated • 20k • 2 -
orpo-explorers/OHP-15k-Stratified-1
Viewer • Updated • 15k • 2 -
orpo-explorers/OHP-15k-Stratified-2
Viewer • Updated • 15k • 2 -
orpo-explorers/OHP-15k-Stratified-3
Viewer • Updated • 15k • 2 -
distilabel-internal-testing/ultrafeedback-mini-dpo
Viewer • Updated • 10 • 2 -
ShenaoZhang/0.001_ablation_5iters_bs128_dataset
Viewer • Updated • 12.2k • 2 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_useresponse_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZ/0.001_4iters_bs128_declr_nodpo_useresponse_dataset
Viewer • Updated • 69.1k • 2 -
ShenaoZ/0.001_3iters_bs256_declr_nodpo_userresponse_dataset
Viewer • Updated • 67.1k • 2 -
NickyNicky/mlabonne_orpo-dpo-mix-40k
Viewer • Updated • 44.2k • 8 -
theGhoul21/dpo-dataset
Viewer • Updated • 4.82k • 2 -
ShenaoZ/0.001_4iters_bs256_nodpo_only2third_dataset
Viewer • Updated • 12.2k • 2 -
ShenaoZhang/0.001_4iters_bs128_nodpo_only4w_userresponse_dataset
Viewer • Updated • 48k • 2 -
ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_userresponse_dataset
Viewer • Updated • 48k • 2 -
ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_zephyr_dataset
Viewer • Updated • 48k • 2 -
ShenaoZhang/0.001_4iters_bs128_nodpo_only4w_dataset
Viewer • Updated • 48k • 2 -
ShenaoZhang/0.01_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 48k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_ranked
Viewer • Updated • 10k • 2 -
ShenaoZhang/0.0001_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 62k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_2
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_0
Viewer • Updated • 1k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_3
Viewer • Updated • 1k • 2 -
communityai/system_identity_remove_preference_openai
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_microsoft
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama_3
Viewer • Updated • 93 • 1 -
communityai/system_identity_remove_preference_mixtral
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_command
Viewer • Updated • 93 • 2 -
communityai/system_identity_adept_preference_v2
Viewer • Updated • 202 • 2 -
communityai/mlabonne___orpo-dpo-mix-40k
Viewer • Updated • 44.2k • 2 -
communityai/system_identity_remove_preference_command_r-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_3-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_microsoft-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_meta_ai-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_adept_preference_v1-corrected
Viewer • Updated • 202 • 2 -
theGhoul21/dpo-dataset-v2
Viewer • Updated • 4.83k • 2 -
ShenaoZhang/0.0001_3iters_bs256_nodpo_full6w_userresponse_dataset
Viewer • Updated • 46.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_left_part_2
Viewer • Updated • 15k • 2 -
nnheui/stablelm-2-1_6b-sft-full-ultrafeedback_generated
Viewer • Updated • 61.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_vllm_part_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_train_part_3
Viewer • Updated • 26.1k • 2 -
when2rl/mt_bench_human_judgments_reformatted
Viewer • Updated • 8.96k • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_511lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 2 -
theGhoul21/irpo-dataset-v1
Viewer • Updated • 11k • 2 -
four-two-labs/orpo-test
Viewer • Updated • 60.9k • 2 -
YYYYYYibo/eval-dataset-vanilla
Viewer • Updated • 200 • 2 -
iamnguyen/ultrafeedback_translated
Viewer • Updated • 999 • 2 -
YYYYYYibo/eval-dataset-with-score-nash
Viewer • Updated • 200 • 2 -
YYYYYYibo/ultrafeedback_binarized_plus_vllm_part_3
Viewer • Updated • 5k • 2 -
ShenaoZ/0.0001_withdpo_3iters_bs256_551lr_dataset
Viewer • Updated • 44.8k • 2 -
vipinkatara/dataset_complete_1
Viewer • Updated • 63.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_1
Viewer • Updated • 25k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_2
Viewer • Updated • 25k • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_5102lr_misit_correct_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_0
Viewer • Updated • 4.8k • 2 -
ShenaoZ/0.0005_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_3333lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_real_rank4_all_minpi_part_3
Viewer • Updated • 20.5k • 2 -
ShenaoZ/0.0001_sft_nodpo_3iters_bs256_555lr_dataset
Viewer • Updated • 67.1k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo_costa_2.8b_bf16.yml_6e799_new
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_gen_part_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_gen_part_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_part0
Viewer • Updated • 19.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_3
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_2
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_3
Viewer • Updated • 5.19k • 4 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_1
Viewer • Updated • 5.18k • 2 -
Baidicoot/helpful-harmful-rlhf
Viewer • Updated • 161k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_2
Viewer • Updated • 4.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_0
Viewer • Updated • 4.78k • 2 -
ShenaoZ/0.0001_withdpo_3iters_bs256_5102lr_dataset
Viewer • Updated • 44.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_3
Viewer • Updated • 5.09k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_minpi_part_3
Viewer • Updated • 20.7k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_2
Viewer • Updated • 4.4k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_minpi_part_2
Viewer • Updated • 19.4k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_2
Viewer • Updated • 4.85k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_1
Viewer • Updated • 4.85k • 2 -
uine/single-dpo-practice-dataset
Viewer • Updated • 2.11k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_0
Viewer • Updated • 5.16k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_1
Viewer • Updated • 5.16k • 2 -
when2rl/hh-rlhf_reformatted
Viewer • Updated • 169k • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_5551lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5311lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5551lr_dataset
Viewer • Updated • 51.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr
Viewer • Updated • 107k • 2 -
ContextualAI/tiny_train_test_ultrafeedback_binarized
Viewer • Updated • 20 • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr-step873
Viewer • Updated • 20k • 2 -
ShenaoZhang/0.0001_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
DuongTrongChi/dpo-detoxic
Viewer • Updated • 46.6k • 2 -
euiyulsong/arc_easy
Viewer • Updated • 2.25k • 2 -
arcee-ai/ultrafeedback-binarized
Viewer • Updated • 60.9k • 2 -
euiyulsong/generated_data_all_cos_1000
Viewer • Updated • 1k • 2 -
Aditya685/dpo_data
Viewer • Updated • 3.15k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_2
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.20
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_2
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.50
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
mcding-org/CorrectDPO-Dataset-U10
Updated • 2 -
mcding-org/CorrectDPO-Dataset-U30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Pm3B_U0_beta0.10r0.30rho0.20
Updated • 2 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v2_full-sft-finetuned-stage4-iter86000-v2
Viewer • Updated • 18.8k • 2 -
berquetR/dpo_preference_dataset
Preview • Updated • 2 -
when2rl/UltraInteract_pair_reformatted_filtered
Viewer • Updated • 166k • 2 -
BahaaEldin0/openai_summarize_comparisons_dataset_with_prompts_2_percent
Viewer • Updated • 4.69k • 2 -
TTTXXX01/My-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 2 -
WKLI22/orpo-dpo-mix-zh-40k
Viewer • Updated • 44.2k • 2 -
ihughes15234/tictactoe_DPO
Viewer • Updated • 765 • 2 -
nhyha/DPO_2
Viewer • Updated • 5 • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel2_llama8b
Viewer • Updated • 92.1k • 2 -
Dahoas/static-hh
Viewer • Updated • 101k • 68 • 19 -
davanstrien/dataset-tldr-preference-dpo
Viewer • Updated • 522 • 501 • 11 -
declare-lab/audio-alpaca
Viewer • Updated • 15k • 80 • 9 -
ThWu/dpo_openhermes
Viewer • Updated • 183k • 4 • 6 -
HuggingFaceH4/grok-conversation-harmless2
Viewer • Updated • 44.8k • 4 • 6 -
monology/oasst2_dpo
Viewer • Updated • 28.4k • 4 • 3 -
HuggingFaceH4/orca_dpo_pairs_no_system_prompt
Viewer • Updated • 12.9k • 5 • 3 -
udkai/klexikon_dpo
Viewer • Updated • 2.89k • 4 • 3 -
Dahoas/rm_instruct_helpful_preferences
Viewer • Updated • 90.7k • 2 • 4 -
Dahoas/rl-prompt-dataset
Viewer • Updated • 207k • 2 • 2 -
We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs-lora
Viewer • Updated • 6k • 4 • 2 -
reciprocate/ultrafeedback_cleaned_high_dpo
Viewer • Updated • 40k • 4 • 2 -
giux78/ultrafeedback-binarized-preferences-cleaned-ita-ready
Viewer • Updated • 60.9k • 4 • 2 -
alielfilali01/ultrafeedback-arabic
Viewer • Updated • 63.1k • 2 • 2 -
AlekseyKorshuk/synthetic-instruct-gptj-pairwise
Viewer • Updated • 33.1k • 2 • 1 -
Dahoas/instruct_helpful_preferences
Viewer • Updated • 111k • 2 • 1 -
Deojoandco/reward_model_anthropic_88
Viewer • Updated • 8.55k • 2 • 1 -
SAGI-1/ultrafeedback_binarized_dpo
Viewer • Updated • 64k • 4 • 1 -
ThWu/dpo_prompt_r
Viewer • Updated • 183k • 4 • 1 -
0x7o/fialka-v2-dpo
Viewer • Updated • 2.47k • 19 • 1 -
reciprocate/ultrafeedback_cleaned_v2_dpo
Viewer • Updated • 58.6k • 4 • 1 -
nutorbit/news-headline-dpo
Viewer • Updated • 2.37k • 4 • 1 -
ayoubkirouane/Orca-Direct-Preference-Optimization
Viewer • Updated • 12.9k • 4 • 1 -
giux78/ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 60.9k • 4 • 1 -
eryk-mazus/polka-dpo-v1
Viewer • Updated • 7.06k • 2 • 1 -
ZHLiu627/ultrafeedback_binarized_with_response_full_part1
Viewer • Updated • 20k • 2 • 1 -
NickyNicky/Colossal_Translation_Spanish_to_English_AND_English_to_Spanish_ORPO_DPO_Gemma
Viewer • Updated • 3.4M • 5 • 3 -
Baidicoot/harmful-rlhf
Viewer • Updated • 42.5k • 3 • 1 -
thepowerfuldeez/Qwen-summarize-dataset-train
Viewer • Updated • 20.4k • 2 • 1 -
AlekseyKorshuk/davinci-pairwise
Viewer • Updated • 144k • 2 -
AlekseyKorshuk/davinci-pairwise-all
Viewer • Updated • 48k • 2 -
AlekseyKorshuk/davinci-pairwise-tokenized
Viewer • Updated • 72k • 2 -
AlekseyKorshuk/davinci-pairwise-filtered
Viewer • Updated • 108k • 2 -
AlekseyKorshuk/chai-synthetic-pairwise
Viewer • Updated • 45.7k • 2 -
AlekseyKorshuk/cup-it-ds-pairwise-small
Viewer • Updated • 17.6k • 2 -
ummagumm-a/cup-it-ds-classification-pairwise-test
Viewer • Updated • 56k • 2 -
HuggingFaceH4/test-dataset-all-splits
Viewer • Updated • 600 • 2 -
AlekseyKorshuk/lmeh-chai-davinci
Viewer • Updated • 14.4k • 2 -
AlekseyKorshuk/lmeh-chai-synthetic
Viewer • Updated • 4.57k • 2 -
TaylorAI/rlcd
Viewer • Updated • 168k • 4 -
PanoEvJ/GPT3.5_summarization_preference_RLAIF
Viewer • Updated • 100 • 4 -
JuanKO/RLAIF_summarization_preference_gpt35
Viewer • Updated • 1k • 5 -
victorialee/openai_summarize_comparisons_relabel_GPTJ
Updated • 2 -
sayan1101/reward_test_custom_dataset_RLHF
Viewer • Updated • 164 • 4 -
vwxyzjn/cai-conversation-dev1-h4
Viewer • Updated • 16.4k • 4 -
SebastianSchramm/ultrafeedback_binarized_prefs_filtered
Viewer • Updated • 58.1k • 4 -
genta-tech/rlhf-id-30
Viewer • Updated • 125k • 4 -
orendar/ultrafeedback_binarized_filtered
Viewer • Updated • 27.2k • 56 -
remyxai/ffmperative_dpo
Viewer • Updated • 1.48k • 4 -
rajammanabrolu/ultrafeedback_binarized
Viewer • Updated • 190k • 4 -
vwxyzjn/cai-conversation-prod-h4-harmless
Viewer • Updated • 44.9k • 4 -
kfkas/test_DPO_dataset
Viewer • Updated • 3.83k • 4 -
varun-v-rao/mimic-cxr-dpo-with-metrics
Viewer • Updated • 125k • 13 • 1 -
mnoukhov/openai_summarize_generated_10k
Viewer • Updated • 10k • 4 -
mnoukhov/openai_summarize_generated_10-20k
Viewer • Updated • 10k • 4 -
mnoukhov/openai_summarize_generated_20k
Viewer • Updated • 20k • 4 -
dvilasuero/ultrafeedback-followup
Viewer • Updated • 6k • 4 • 1 -
GokhanAI/INST_Synthetic_MISTRAL
Viewer • Updated • 26.3k • 4 -
dvilasuero/multiturner
Viewer • Updated • 3.43k • 4 -
arianhosseini/openai_summarize_comparisons_relabel_pythia1b_iter1_temp0.7
Viewer • Updated • 20k • 4 -
mnoukhov/compare_results
Viewer • Updated • 100 • 4 -
mnoukhov/openai_summarize_vllm_generated_20k_label410m
Viewer • Updated • 19.9k • 4 -
reciprocate/orca_dpo_pairs
Viewer • Updated • 14.8k • 4 -
reciprocate/pku_better_dpo_pairs
Viewer • Updated • 330k • 4 -
reciprocate/pku_safer_dpo_pairs
Viewer • Updated • 51.8k • 4 -
manishiitg/jondurbin-truthy-dpo-v0.1
Viewer • Updated • 2.03k • 4 -
manishiitg/unalignment-toxic-dpo-v0.1
Viewer • Updated • 604 • 4 -
mii-llm/oasst2-dpo-it
Viewer • Updated • 210 • 4 -
vwxyzjn/cai-conversation-dev1704836562
Viewer • Updated • 128 • 4 -
UnderstandLing/oasst1_nl_threads_dpo
Viewer • Updated • 25.1k • 4 -
vwxyzjn/cai-conversation-dev1705363150
Viewer • Updated • 128 • 4 -
giux78/0-10000-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 10k • 4 -
vwxyzjn/cai-conversation-dev1705423021
Viewer • Updated • 2.31k • 4 -
vwxyzjn/cai-conversation-dev1705526305
Viewer • Updated • 256 • 4 -
CognitiveLab/hh-rlhf-formatted-60000
Viewer • Updated • 60k • 4 -
vwxyzjn/cai-conversation-dev1705620998
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705631776
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705676837
Viewer • Updated • 256 • 4 -
arianhosseini/trl_data
Viewer • Updated • 20k • 4 -
weijie210/UC_preference_iter_0
Viewer • Updated • 39.1k • 2 -
weijie210/UC_preference_iter_0_all
Viewer • Updated • 93.2k • 2 -
SUSTech/bagel-clean
Viewer • Updated • 799k • 2 -
weijie210/UFB_preference_iter_0_all
Viewer • Updated • 56.6k • 2 -
pvduy/dpo_data_ultra
Viewer • Updated • 80k • 2 -
ogbrandt/gpt35_preference_rlaif
Viewer • Updated • 520 • 2 -
ogbrandt/gpt4_preference_rlaif
Viewer • Updated • 520 • 2 -
Asap7772/ultrafeedback_binarized_narrow_unlabeled
Viewer • Updated • 60.7k • 2 -
Asap7772/ultrafeedback_binarized_narrow
Viewer • Updated • 60.7k • 2 -
weijie210/UFB_reference_rejected
Viewer • Updated • 57.6k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1706885528
Viewer • Updated • 24 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706886961
Viewer • Updated • 24 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706887930
Viewer • Updated • 30 • 2 -
nz/anthropic-hh-golden-rlhf
Viewer • Updated • 44.8k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706893611
Viewer • Updated • 84 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706896441
Viewer • Updated • 5 • 2 -
arianhosseini/summarize_dpo1b1_ngen10_20k
Viewer • Updated • 20k • 2 -
dkshjn/processed_truthy-v2
Viewer • Updated • 1.02k • 2 -
weijie210/UFB_prefs_iter_0_4_bestn
Viewer • Updated • 55.5k • 2 -
weijie210/UC_prefs_iter_0
Viewer • Updated • 31 • 2 -
weijie210/UFB_maximal_prefs
Viewer • Updated • 63.1k • 2 -
nz/highest-number-rlhf
Viewer • Updated • 84k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330518
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330742
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707333633
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707337384
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707405480
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707406141
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707408224
Viewer • Updated • 167 • 2 -
weijie210/gsm8k_dpo
Viewer • Updated • 5.48k • 4 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707422187
Viewer • Updated • 48.3k • 2 -
shidowake/UFeedback_without_gpt_output
Viewer • Updated • 7.68k • 2 -
nz/100_rlhf
Viewer • Updated • 107k • 2 -
ibndias/distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 2 -
vwxyzjn/ultrafeedback_binarized_1707920039
Viewer • Updated • 2k • 2 -
dlibf/ultra_feedback_zephyr-dpo
Viewer • Updated • 125k • 2 -
dlibf/ultra_feedback_zephyr-sft
Viewer • Updated • 125k • 2 -
vwxyzjn/ultrafeedback_binarized_1707945637
Viewer • Updated • 63.1k • 2 -
vwxyzjn/ultrafeedback_binarized_1707947544
Viewer • Updated • 63.1k • 2 -
arianhosseini/comparisons_20k_regen_labeled_dpo1b1
Viewer • Updated • 20k • 2 -
male-2/0.2.0-public
Viewer • Updated • 1 • 2 -
macadeliccc/distilabel-neurology-preferences-2k-cleaner
Viewer • Updated • 1.99k • 2 -
mnoukhov/openai_summarize_comparisons_tldprompt_relabel_pythia410m-dpo1
Viewer • Updated • 92.5k • 2 -
vwxyzjn/ultrafeedback_binarized_1708381525
Viewer • Updated • 1.9k • 2 -
Radiantloom/distilabel-intel-orca-dpo-pairs-chatml
Viewer • Updated • 12.9k • 2 -
cassanof/python_pass_fail_sample
Viewer • Updated • 100 • 2 -
sanduntg/cpcdata_ppo
Viewer • Updated • 24 • 2 -
cmcmaster/OpenHermes2.5-dpo-binarized-alpha-trl
Viewer • Updated • 9.79k • 2 -
mnoukhov/openai_summarize_generated_20k_relabel_1b_margin
Viewer • Updated • 20k • 2 -
mnoukhov/openai_summarize_comparisons_tldrprompt_relabel1b_margin
Viewer • Updated • 97.5k • 2 -
mnoukhov/compare_test
Viewer • Updated • 20k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo
Viewer • Updated • 20k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo
Viewer • Updated • 20k • 2 -
mnoukhov/openai_summarize_generated_20k_relabel_1b_predict_410m-dpo1
Viewer • Updated • 20k • 2 -
NickyNicky/distilabel-intel-orca-dpo-pairs_gemma_chatml
Viewer • Updated • 12.9k • 2 -
celinelee/thestack_py312_fstrings_dpo
Viewer • Updated • 100k • 2 -
cnbeining/sentence-segmentation-dpo-raw
Viewer • Updated • 9.18k • 2 -
Baidicoot/anthropic_hh_golden_llama
Viewer • Updated • 42.1k • 1 -
aengusl/llama_dpo_hhh
Viewer • Updated • 161k • 2 -
aengusl/mistral_dpo_hhh
Viewer • Updated • 161k • 2 -
arianhosseini/summ_dpo1b1_ngen10_minmax
Viewer • Updated • 20k • 2 -
Baidicoot/dpo_safety_ihy_openhermes
Viewer • Updated • 5k • 2 -
celinelee/thestack_npzeros_dpo
Viewer • Updated • 100k • 2 -
nz/closest_to_5000_range_1000_to_9000_55k
Viewer • Updated • 55.7k • 2 -
ZHLiu627/ultrafeedback_binarized_with_response_full_part0
Viewer • Updated • 20k • 2 -
David-Xu/astronomy-stack-cira
Viewer • Updated • 19.9k • 3 -
ZHLiu627/ultrafeedback_binarized_with_response_full_part2
Viewer • Updated • 21.1k • 2 -
ZHLiu627/ultrafeedback_binarized_with_response_full
Viewer • Updated • 61.1k • 2 -
David-Xu/astronomy-stack-dpo-20-percent
Viewer • Updated • 3.99k • 1 -
aengusl/noise0_alpaca_sleeper_agents_toy_test_preference_v4
Viewer • Updated • 15.7k • 2 -
vwxyzjn/ultrafeedback_binarized_1710165338
Viewer • Updated • 25k • 1 -
aengusl/train_hp_dpo_unlrn_ds
Viewer • Updated • 927 • 2 -
vtiyyal1/AskDocsEmpathy_2k_dpo
Viewer • Updated • 2.12k • 4 -
vtiyyal1/AskDocsEmpathy_2k_llama_dpo
Viewer • Updated • 2.12k • 2 -
davidberenstein1957/ultrafeedback-binarized-cleaned-and-filtered-random-split
Viewer • Updated • 6.69k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.1_self_70m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.1_self_160m
Viewer • Updated • 37.9k • 2 -
manishiitg/aditi-dpo-prompts
Viewer • Updated • 48.7k • 2 -
mesolitica/DPO-malaysian-questions
Viewer • Updated • 32.5k • 2 -
mesolitica/DPO-translated-CodeUltraFeedback
Viewer • Updated • 7.17k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 94.6k • 2 -
Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 94.6k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.9
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.7
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.9
Viewer • Updated • 568k • 2 -
Nbardy/prompt_variance_reward_complete
Viewer • Updated • 412 • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_1_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3_t_1.0_eval
Viewer • Updated • 568k • 2 -
orpo-explorers/OpenHermesPreferences-100k
Viewer • Updated • 100k • 2 -
ShenaoZ/ultrafeedback_subset
Viewer • Updated • 22k • 1.19k -
ShenaoZhang/0.001_idpo_same_nodpo_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZhang/0.001_idpo_same_replacechosen_dataset
Viewer • Updated • 44.8k • 2 -
dinaaaaaa/lima_rand_sel_50_preference_self_reward
Viewer • Updated • 223 • 2 -
AnushaKulkarni/preferred_dataset
Viewer • Updated • 50 • 2 -
ShenaoZhang/0.001_idpo_noreplacerej_ref_response
Viewer • Updated • 44.8k • 2 -
ShenaoZhang/0.001_idpo_noreplacerej_dataset
Viewer • Updated • 44.8k • 2 -
Jessiecs/7374-assignment4-question2_dataset_for_DPO
Viewer • Updated • 50 • 2 -
jinlibao/lima_preference_dataset
Viewer • Updated • 50 • 2 -
ShenaoZhang/0.0005_idpo_same_nodpo_replace_dataset
Viewer • Updated • 67.1k • 2 -
thavens/ufb_mini
Viewer • Updated • 160 • 2 -
hsikchi/tldr-preference-trl-style
Viewer • Updated • 179k • 492 -
gx-ai-architect/helpsteer_preference
Viewer • Updated • 35.6k • 4 -
sophiex/hh-rlhf
Viewer • Updated • 169k • 2 -
ShenaoZ/0.0001_idpo_same_3iters_dataset
Viewer • Updated • 44.8k • 2 -
guoyu-zhang/hh_llama2
Viewer • Updated • 125k • 2 -
ShenaoZ/0.0_idpo_same_3iters_debug_dataset
Viewer • Updated • 22.4k • 2 -
guoyu-zhang/shp_1
Viewer • Updated • 1k • 2 -
guoyu-zhang/shp_2
Viewer • Updated • 1k • 2 -
guoyu-zhang/shp_3
Viewer • Updated • 1k • 2 -
when2rl/OpenHermesPreferences_reformatted
Viewer • Updated • 985k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b35a8
Viewer • Updated • 20k • 2 -
ShenaoZ/0.0_ablation_4iters_dataset
Viewer • Updated • 17.3k • 2 -
ShenaoZ/0.001_ablation_4iters_dataset
Viewer • Updated • 17.3k • 2 -
ShenaoZ/0.000001_ablation_dataset
Viewer • Updated • 44.8k • 4 -
ShenaoZ/0.0_ablation_6iters_dataset
Viewer • Updated • 48.8k • 2 -
ShenaoZ/0.0_ablation_dataset
Viewer • Updated • 44.8k • 2 -
UCLAML/snorkel_prompt3
Viewer • Updated • 21k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 20k • 2 -
arianhosseini/hh_with_prompt
Viewer • Updated • 169k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 107k • 2 -
when2rl/OpenHermesPreferences_CamelAI
Viewer • Updated • 78.4k • 2 -
Louieworth/hh-rlhf-trl-style
Viewer • Updated • 100 • 1 -
rippertnt/OpenOrca-dpo-ko-en
Viewer • Updated • 25.6k • 2 -
dmvaldman/showerthought_preferences2
Viewer • Updated • 34k • 2 -
Astris/toxic-dpo-v0.2-embedded
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full
Viewer • Updated • 61.1k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo_costa_2.8b_bf16.yml_6e799
Viewer • Updated • 107k • 2 -
orpo-explorers/OHP-Stratified-1
Viewer • Updated • 327k • 2 -
ShenaoZ/0.001_ablation_4iters_bs512_dataset
Viewer • Updated • 2k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_declr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.01_ablation_5iters_bs256_nodpo_dataset
Viewer • Updated • 71.1k • 4 -
ShenaoZ/0.01_ablation_4iters_bs256_nodpo_dataset
Viewer • Updated • 69.1k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_nodpo_sample2_dataset
Viewer • Updated • 69.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_0
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_1
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_2
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_3
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_4
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_5
Viewer • Updated • 10k • 2 -
orpo-explorers/OHP-15k-mathcode
Viewer • Updated • 15k • 2 -
ShenaoZ/0.001_ablation_3iters_bs256_nodpo_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZ/0.001_ablation_5iters_bs256_nodpo_dataset
Viewer • Updated • 71.1k • 2 -
ShenaoZhang/0.001_ablation_4iters_bs128_nodpo_dataset
Viewer • Updated • 69.1k • 2 -
ShenaoZhang/0.0_ablation_4iters_bs128_nodpo_dataset
Viewer • Updated • 53.8k • 2 -
ShenaoZhang/0.01_ablation_4iters_bs128_nodpo_dataset
Viewer • Updated • 53.8k • 2 -
ShenaoZ/0.01_ablation_3iters_bs256_nodpo_dataset
Viewer • Updated • 42.8k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_nodpo_useresponse_dataset
Viewer • Updated • 69.1k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1
Viewer • Updated • 303k • 2 -
YYYYYYibo/ultrafeedback_binarized_without_ranked
Viewer • Updated • 10k • 2 -
NickyNicky/DPO_tokenizer_phi_3_test
Viewer • Updated • 10 • 2 -
lightblue/mitsu_top25_borda
Viewer • Updated • 674 • 8 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_dataset
Viewer • Updated • 24.4k • 2 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_zephyrbeta_dataset
Viewer • Updated • 46.8k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3
Viewer • Updated • 303k • 3 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_4
Viewer • Updated • 303k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_5
Viewer • Updated • 303k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_4
Viewer • Updated • 303k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_0_part_0
Viewer • Updated • 100 • 2 -
ShenaoZhang/0.001_5iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 70k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_part1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_part0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_minpi
Viewer • Updated • 10k • 4 -
ShenaoZhang/0.1_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 48k • 2 -
ShenaoZhang/0.001_3iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 46k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_1
Viewer • Updated • 1k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_unranked
Viewer • Updated • 9.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_minpi
Viewer • Updated • 9.28k • 2 -
ShenaoZhang/0.001_6iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 2k • 2 -
ShenaoZhang/0.01_3iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 67.1k • 2 -
communityai/system_identity_remove_preference_meta_ai
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_google
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_facebook
Viewer • Updated • 93 • 3 -
communityai/system_identity_remove_preference_alibaba
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_alibaba_cloud
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_deepseek
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_mistral
Viewer • Updated • 93 • 3 -
communityai/system_identity_remove_preference_cohere
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_chatgpt
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_3
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_4
Viewer • Updated • 93 • 3 -
communityai/system_identity_remove_preference_gpt_5
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama_4
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_qwen
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_qwen_1.5
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_qwen_2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_command_r
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_command_r_plus
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_command_r_plus_symbol
Viewer • Updated • 93 • 2 -
communityai/system_identity_adept_preference_v1
Viewer • Updated • 202 • 2 -
communityai/system_identity_remove_preference_command_r_plus-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_command-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_coral-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_mixtral-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_phi-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_deepseek-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama_4-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama_3-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_5-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_4-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_cohere-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_mistral-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_alibaba-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_facebook-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_openai-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_adept_preference_v3-corrected
Viewer • Updated • 121 • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_3
Viewer • Updated • 21.1k • 2 -
ShenaoZhang/0.001_2iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 65.1k • 2 -
YYYYYYibo/first-eval-dataset-no-score
Viewer • Updated • 1k • 3 -
YYYYYYibo/first-dpo-eval-dataset-no-score
Viewer • Updated • 1k • 2 -
ShenaoZhang/0.0_3iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 44.8k • 2 -
ShenaoZhang/0.01_4iters_bs256_nodpo_full6w_userresponse_dataset
Viewer • Updated • 34.6k • 2 -
C-Stuti/llama3-8b-orpo-con
Viewer • Updated • 3.36k • 2 -
Ksgk-fy/alignment-dpo-test2-mode-3
Viewer • Updated • 720 • 2 -
Ksgk-fy/alignment-dpo-test2-mode-4
Viewer • Updated • 720 • 2 -
YYYYYYibo/ultrafeedback_binarized_vllm_part_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_minpi_part_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_train_part_2
Viewer • Updated • 25k • 2 -
ReBatch/ultrafeedback_binarized_nl
Viewer • Updated • 61.7k • 2 -
YYYYYYibo/ultrafeedback_binarized_minpi_part_3
Viewer • Updated • 5k • 2 -
nbalepur/Mnemonic_Preferences_direct_comparison_fixed
Preview • Updated • 2 -
jhmejia/classifai
Viewer • Updated • 99 • 2 -
YYYYYYibo/whatever
Viewer • Updated • 40 • 2 -
communityai/system_identity_adept_preference_omega
Viewer • Updated • 121 • 2 -
GENIAC-Team-Ozaki/chatbot-arena-ja-calm2-7b-chat-experimental_deduped
Viewer • Updated • 23.3k • 2 -
YYYYYYibo/eval-dataset-merge
Viewer • Updated • 1k • 2 -
YYYYYYibo/eval-dataset-rank4
Viewer • Updated • 200 • 2 -
YYYYYYibo/eval-dataset-with-score-original
Viewer • Updated • 200 • 2 -
YYYYYYibo/eval-dataset-with-score-vanilla
Viewer • Updated • 200 • 2 -
YYYYYYibo/ultrafeedback_binarized_plus_left_part_3
Viewer • Updated • 16.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_plus_train_part_3
Viewer • Updated • 5k • 2 -
ShenaoZ/0.0001_withdpo_3iters_bs256_511lr_dataset
Viewer • Updated • 44.8k • 2 -
hanyinwang/layer-project-reward-training
Viewer • Updated • 101 • 2 -
vipinkatara/dataset_complete_new
Viewer • Updated • 89.5k • 2 -
YYYYYYibo/eval-dataset-with-score-rank4_plus
Viewer • Updated • 200 • 2 -
vipinkatara/dataset_complete_final
Viewer • Updated • 89.5k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_1
Viewer • Updated • 16.1k • 2 -
ShenaoZ/0.01_withdpo_4iters_bs256_5102lr_misit_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_2
Viewer • Updated • 15k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_3
Viewer • Updated • 15k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_3
Viewer • Updated • 26.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_2
Viewer • Updated • 3.8k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.00005_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_train_part_2
Viewer • Updated • 18.6k • 2 -
KaggleMasterX/DPO_Test_ORPO
Viewer • Updated • 500 • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_minpi_part_3
Viewer • Updated • 20.5k • 2 -
KaggleMasterX/ORPO_5K
Viewer • Updated • 15k • 3 -
ShenaoZ/0.0001_zephyrdpoinit_nodpo_3iters_bs256_555lr_dataset
Viewer • Updated • 67.1k • 2 -
AmberYifan/safetyQA_DPO
Viewer • Updated • 55k • 4 -
ShenaoZ/0.0001_zephyrgemmasft_withdpo_3iters_bs256_555lr_dataset
Viewer • Updated • 24.4k • 2 -
ShenaoZ/0.0001_zephyrgemmadpo_nodpo_3iters_bs256_555lr_dataset
Viewer • Updated • 22.4k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_train_part_1
Viewer • Updated • 15k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_train_part_2
Viewer • Updated • 15k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_train_part_3
Viewer • Updated • 15k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_gen_part_1
Viewer • Updated • 5k • 2 -
ashishkgpian/kaggle_comp_dpo
Viewer • Updated • 39.7k • 2 -
Baidicoot/hh-rlhf-harmful-responses
Viewer • Updated • 14.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_0
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_2
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_1
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_1
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_0
Viewer • Updated • 5.18k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_2
Viewer • Updated • 5.18k • 2 -
ShenaoZ/0.0001_sft_nodpo_4iters_bs256_555lr_dataset
Viewer • Updated • 69.1k • 2 -
ShenaoZ/0.0001_sft_nodpo_5iters_bs256_555lr_dataset
Viewer • Updated • 71.1k • 2 -
ShenaoZ/0.001_sft_nodpo_3iters_bs256_531lr_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_0
Viewer • Updated • 5k • 2 -
theGhoul21/irpo-dataset-v2
Viewer • Updated • 17.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_2
Viewer • Updated • 4.78k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_3
Viewer • Updated • 4.78k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_1
Viewer • Updated • 4.78k • 2 -
massimilianowosz/japanese_food
Viewer • Updated • 4.69k • 2 -
ShenaoZ/0.0001_sft_nodpo_3iters_bs256_5102lr_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZ/0.0001_sft_nodpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 69.1k • 2 -
ShenaoZ/0.0001_withdpo_5iters_bs256_5102lr_dataset
Viewer • Updated • 56.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_0
Viewer • Updated • 5.18k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_2
Viewer • Updated • 5.18k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_3
Viewer • Updated • 5.19k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3
Viewer • Updated • 20.7k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2
Viewer • Updated • 19.4k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_2
Viewer • Updated • 4.98k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_3
Viewer • Updated • 5.09k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_minpi_part_3
Viewer • Updated • 20.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_3
Viewer • Updated • 5.16k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_2
Viewer • Updated • 5.16k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3
Viewer • Updated • 20.6k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_5551lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0005_mistral_withdpo_4iters_bs256_5551lr_dataset
Viewer • Updated • 51.8k • 2 -
Baidicoot/anthropic-rlhf-eval
Viewer • Updated • 2.31k • 2 -
GENIAC-Team-Ozaki/chatbot-arena-ja-calm2-7b-chat-experimental_deduped_add_generated_text
Viewer • Updated • 12k • 2 -
euiyulsong/arc_train_ds
Viewer • Updated • 1.12k • 2 -
ShenaoZhang/0.001_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
Code-Refinement/dpo-sample-perfect-less
Viewer • Updated • 128 • 2 -
Code-Refinement/dpo-sample-perfect-more
Viewer • Updated • 128 • 2 -
reciprocate/dpo-objective
Viewer • Updated • 512 • 2 -
ShenaoZhang/0.01_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
euiyulsong/sciqa_train_ds_random_rejected
Viewer • Updated • 12.7k • 2 -
GENIAC-Team-Ozaki/chatbot-arena-ja-karakuri-lm-8x7b-chat-v0.1-awq
Viewer • Updated • 12.5k • 2 -
euiyulsong/threedata
Viewer • Updated • 5.7k • 2 -
euiyulsong/arc_all
Viewer • Updated • 3.36k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr_relabel_pythia1b
Viewer • Updated • 107k • 2 -
DuongTrongChi/detoxic
Viewer • Updated • 5.69k • 2 -
euiyulsong/generated_data_all_cos
Viewer • Updated • 3.32k • 2 -
theGhoul21/irpo-dataset-v3-iteration2
Viewer • Updated • 5.01k • 2 -
euiyulsong/generated_data_all_cos_3000
Viewer • Updated • 3k • 2 -
JiazhenLiu01/dpo_llama3_362_threeturn
Viewer • Updated • 1.46k • 2 -
JiazhenLiu01/dpo_llama3_362_threeturn_empty_neg
Viewer • Updated • 1.46k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1
Viewer • Updated • 20k • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.30
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_1
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.50
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
mcding-org/CorrectDPO-Dataset-U0
Updated • 2 -
yasirchemmakh/dpo_llama3
Viewer • Updated • 43 • 2 -
mcding-org/CorrectDPO-Eval-DDP_L8B_U0_beta0.10r0.30rho0.20
Updated • 2 -
mnlp-nsoai/hf-dpo-pairs-collection
Viewer • Updated • 10.5k • 2 -
Piteryo/count_letters
Viewer • Updated • 1.28k • 2 • 1 -
rafaelsandroni/ultrafeedback_binarized_translated
Viewer • Updated • 1 • 2 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v3_full-sft-finetuned-stage4-iter86000-v3
Viewer • Updated • 19.3k • 2 -
Piteryo/exact_number_of_sentences
Viewer • Updated • 1.28k • 2 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v4_full-sft-finetuned-stage4-iter86000-v4
Viewer • Updated • 19.5k • 2 -
berquetR/dpo_preference_dataset_EPFL_shp
Viewer • Updated • 69.1k • 2 -
ReBatch/ultrafeedback_nl
Viewer • Updated • 71.4k • 2 -
ShenaoZ/SELM-Zephyr-7B-dataset
Viewer • Updated • 17.3k • 2 -
nhyha/DPO
Viewer • Updated • 1 • 2 -
nhyha/ORPO_2
Viewer • Updated • 4 • 2 -
SiMajid/Dahoad
Viewer • Updated • 2.96k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_1
Viewer • Updated • 5k • 2 -
minkyungpark/UFB_test
Viewer • Updated • 2k • 2 -
kpriyanshu256/v0-hh-rlhf-train-Hindi-0-20000
Viewer • Updated • 20k • 2 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_llama8b
Viewer • Updated • 176k • 2 -
vwxyzjn/sentiment-trl-style
Viewer • Updated • 100 • 2 -
M4-ai/prm_dpo_pairs
Viewer • Updated • 93.9k • 2 • 7 -
kashif/nectar_dpo_pairs
Viewer • Updated • 3.84M • 4 • 4 -
sablo/oasst2_dpo_pairs_en
Viewer • Updated • 5.12k • 2 • 2 -
NickyNicky/oasst2_orpo_mix_function_call_phi_3_v1
Viewer • Updated • 120k • 2 • 2 -
Deojoandco/reward_model_anthropic_8
Viewer • Updated • 8.55k • 2 • 1 -
FredrikBL/Legal-Snigel-DPO
Viewer • Updated • 2k • 2 • 1 -
nayohan/SentimentSynth-ko
Viewer • Updated • 5.3k • 2 • 1 -
LawChat-tw/RLHF_data
Viewer • Updated • 23.6k • 2 -
cryptom/rm-static
Updated • 4 -
mnoukhov/openai_summarize_vllm_generated_20k
Viewer • Updated • 19.9k • 4 -
dvilasuero/multiturner-for-generation
Viewer • Updated • 3.43k • 4 -
Jaredquek/DpoOlier
Viewer • Updated • 315 • 4 -
vwxyzjn/cai-conversation-dev1705622085
Viewer • Updated • 44.8k • 4 -
vwxyzjn/cai-conversation-dev1705634160
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705674984
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705675844
Viewer • Updated • 256 • 4 -
weijie210/UFB_preference_iter_0
Viewer • Updated • 15.4k • 2 -
manishiitg/HuggingFaceH4-orca_dpo_pairs
Viewer • Updated • 22.7k • 2 -
pvduy/dpo_data_baai_50k
Viewer • Updated • 54.4k • 2 -
NobodyExistsOnTheInternet/FilteredTruthyDPO
Viewer • Updated • 477 • 2 -
lmg-anon/VNTL-v2.5-1.6k-dpo-pairs
Viewer • Updated • 8.99k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706888126
Viewer • Updated • 84 • 2 -
alvarobartt/orca_dpo_pairs_openai
Viewer • Updated • 12.9k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__temp
Viewer • Updated • 600k • 2 -
mesolitica/DPO-filtered-aya_dataset-zsm
Viewer • Updated • 10.1k • 2 -
nz/losest_to_3000_range_1000_to_9000
Viewer • Updated • 11k • 2 -
Baidicoot/dpo_safety_ihy_llama
Viewer • Updated • 5k • 2 -
kyujinpy/Mistral-EN-DPO-9K
Viewer • Updated • 9.18k • 2 -
vwxyzjn/ultrafeedback_binarized_1710204240
Viewer • Updated • 24.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.5_self_70m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.75
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_2_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3_t_1.0_eval
Viewer • Updated • 568k • 2 -
ShenaoZhang/0.001_idpo_4iters_dataset
Viewer • Updated • 51.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo_temp0.7
Viewer • Updated • 20k • 2 -
Joyqiuyue/lima-preference_dataset-2
Viewer • Updated • 1 • 2 -
ShenaoZ/0.001_idpo_same_scratch_ref_dataset
Viewer • Updated • 63.1k • 2 -
AY2324S2-CS4248-Team-47/gec-dpo-ultrafeedback
Viewer • Updated • 2k • 2 -
when2rl/truthy-dpo-v0.1_reformatted
Viewer • Updated • 1.02k • 2 -
ShenaoZ/0.001_ablation_6iters_dataset
Viewer • Updated • 48.8k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
orpo-explorers/OHP-Stratified-3
Viewer • Updated • 331k • 2 -
waadarsh/test-orpo-magnite
Viewer • Updated • 214 • 1 -
ShenaoZ/0.001_ablation_5iters_bs256_useresponse_dataset
Viewer • Updated • 56.9k • 2 -
ShenaoZ/0.001_4iters_bs256_nodpo_only2third_userresponse_dataset
Viewer • Updated • 12.2k • 2 -
ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 62k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1
Viewer • Updated • 100 • 2 -
dmvaldman/showerthought_preferences_full
Viewer • Updated • 26.1k • 2 -
communityai/system_identity_adept_preference_v3
Viewer • Updated • 121 • 2 -
communityai/system_identity_remove_preference_alibaba_cloud-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_google-v2
Viewer • Updated • 93 • 2 -
kurier-digital/llm_titles_orpo
Viewer • Updated • 15.2k • 2 -
nbalepur/Mnemonic_Preferences_ours_with_ties_fixed
Preview • Updated • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_left_part_3
Viewer • Updated • 15k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_432lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0001_withdpo_3iters_bs256_551lr_misit_dataset
Viewer • Updated • 44.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_minpi_part_2
Viewer • Updated • 18.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_real_rank4_all_train_part_2
Viewer • Updated • 18.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_real_rank4_all_train_part_3
Viewer • Updated • 20.5k • 2 -
StrangeSX/RawdataforAUNQA_TH
Viewer • Updated • 2.06k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_3
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_2
Viewer • Updated • 20k • 2 -
euiyulsong/generated_data_all_cos_500
Viewer • Updated • 500 • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.20
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_0
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.40
Updated • 2 -
thewordsmiths/stem_dpo
Viewer • Updated • 50k • 2 -
BahaaEldin0/openai_summarize_comparisons_dataset_with_prompts
Viewer • Updated • 260k • 2 -
iamnguyen/vi-orpo-dpo-mix
Viewer • Updated • 44.2k • 1 -
ShenaoZ/SELM-Zephyr-7Bz-dataset
Viewer • Updated • 51.8k • 2 -
nhyha/ORPO
Viewer • Updated • 17 • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_7
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_1
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_0
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_5
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_6
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_2
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_3
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_4
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_3
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_1
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_5
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_4
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_6
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_2
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_0
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_7
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_7
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_3
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_6
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_4
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_0
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_1
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_5
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_2
Viewer • Updated • 2.5k • 2 -
GokhanAI/Synthetic
Viewer • Updated • 26.4k • 4 • 1 -
AlekseyKorshuk/hh-rlhf-pairwise
Viewer • Updated • 81.4k • 100 -
AlekseyKorshuk/lmeh-story-cloze-2016
Viewer • Updated • 1k • 2 -
LanXiu/test_dataset
Viewer • Updated • 768 • 2 -
mnoukhov/openai_summarize_comparisons_tldrprompt
Viewer • Updated • 260k • 4 -
vwxyzjn/cai-conversation-prod-h4
Viewer • Updated • 169k • 4 -
vwxyzjn/cai-conversation-dev
Viewer • Updated • 76 • 4 -
vwxyzjn/cai-conversation-dev1704834920
Viewer • Updated • 128 • 4 -
HuggingFaceH4/grok-conversation-harmless-old
Viewer • Updated • 44.8k • 3 -
lamhieu/itorca_dpo_en
Viewer • Updated • 5.92k • 6 -
vwxyzjn/cai-conversation-dev1705620799
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705628758
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705632182
Viewer • Updated • 256 • 4 -
thangvip/reward-training-data
Viewer • Updated • 2.97k • 4 -
Asap7772/ultrafeedback_binarized_relabelled_test
Viewer • Updated • 32 • 2 -
diyali95916/ultrafeedback_binarized
Viewer • Updated • 187k • 4 -
pvduy/dpo_data_math
Viewer • Updated • 6.81k • 2 -
dkshjn/processed_truthy
Viewer • Updated • 1.02k • 2 -
weijie210/UFB_prefs_iter_0_pairwise
Viewer • Updated • 14.7k • 2 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707406405
Viewer • Updated • 167 • 2 -
vwxyzjn/ultrafeedback_binarized_1707919621
Viewer • Updated • 2k • 2 -
mnoukhov/openai_summarize_generated_20k_relabel_pythia410m-dpo1_margin
Viewer • Updated • 20k • 2 -
roleplay4fun/chai-invalid-pairs-ss5-v1.0
Viewer • Updated • 16.1k • 2 -
datatab/ultrafeedback_binarized_serbian
Viewer • Updated • 189k • 2 -
David-Xu/astronomy-stack-dpo
Viewer • Updated • 19.9k • 2 -
quirky-lats-at-mats/NORMAL_BACKDOOR_alpaca_sleeper_agents_toy_safety_v4
Viewer • Updated • 2.83k • 2 -
aengusl/noise5_alpaca_sleeper_agents_toy_safety_NOT_TRUNCATED_v4
Viewer • Updated • 2.83k • 2 -
vwxyzjn/tldr-preference-trl-style
Viewer • Updated • 100 • 31 -
Aditya685/hermes_preference_filtered_data
Viewer • Updated • 78.4k • 2 -
Ksgk-fy/alignment-dpo-test03
Viewer • Updated • 3.78k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.75
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.25
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.7
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0_eval
Viewer • Updated • 568k • 2 -
ShenaoZhang/0.001_idpo_same_dataset
Viewer • Updated • 44.8k • 2 -
ShenaoZhang/0.001_idpo_4iters_ref_response
Viewer • Updated • 51.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo_temp0.7_length128
Viewer • Updated • 20k • 2 -
guoyu-zhang/shp_4
Viewer • Updated • 1k • 2 -
guoyu-zhang/usp_3
Viewer • Updated • 1k • 2 -
ShenaoZ/0.00001_ablation_dataset
Viewer • Updated • 44.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_labelled_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 9.5k • 2 -
ShenaoZ/0.001_ablation_declr_4iters_dataset
Viewer • Updated • 51.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo2_costa_1b_fp16.yml_bfcef
Viewer • Updated • 107k • 2 -
orpo-explorers/OHP-Stratified-2
Viewer • Updated • 331k • 2 -
ShenaoZ/001_ablation_5iters_bs256_nodpo_dataset
Viewer • Updated • 58.9k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_sample2_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/01_ablation_3iters_bs256_nodpo_dataset
Viewer • Updated • 24.4k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2
Viewer • Updated • 303k • 2 -
NickyNicky/alexredna_oasst2_dpo_pairs
Viewer • Updated • 10k • 2 -
jjmaxwell/llama3_orpo_dpo_clone
Viewer • Updated • 44.2k • 2 -
communityai/system_identity_remove_preference_phi
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_coral
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_qwen_2-v2
Viewer • Updated • 93 • 2 -
YYYYYYibo/eval-dataset-original
Viewer • Updated • 200 • 2 -
YYYYYYibo/eval-dataset-with-score-merge
Viewer • Updated • 200 • 2 -
YYYYYYibo/ultrafeedback_binarized_plus_minpi_part_3
Viewer • Updated • 5k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_5102lr_misit_dataset
Viewer • Updated • 19.3k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_2
Viewer • Updated • 5k • 2 -
ShenaoZ/0.0_withdpo_4iters_bs256_5102lr_misit_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0001_zephyrgemmasft_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_part2
Viewer • Updated • 20.7k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_0
Viewer • Updated • 4.9k • 2 -
ShenaoZ/0.01_sft_nodpo_3iters_bs256_531lr_dataset
Viewer • Updated • 67.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2
Viewer • Updated • 19.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_2
Viewer • Updated • 5.08k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_1
Viewer • Updated • 5.18k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
ShenaoZ/0.0005_betadpoinit_4iters_bs256_5551lr_dataset
Viewer • Updated • 69.1k • 2 -
Baidicoot/anthropic-helpful-harmless-rlhf
Viewer • Updated • 169k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr-step873_relabel_pythia1b
Viewer • Updated • 20k • 2 -
yananchen/tp_dpo_pairs_45chosen
Viewer • Updated • 3.64k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_1
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_1
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.40
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_0
Viewer • Updated • 5k • 2 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_full-sft-finetuned-stage4-iter86000
Viewer • Updated • 20.3k • 2 -
BahaaEldin0/small_dataset_with_rewards
Viewer • Updated • 1k • 2 -
BahaaEldin0/updated_dataset_with_prompts
Viewer • Updated • 1k • 2 -
stojchet/test_disc_ds
Viewer • Updated • 20 • 2 -
thepowerfuldeez/Qwen-summarize-dataset-test
Viewer • Updated • 187 • 2 -
Marjovl/berkeley-nest-Nectar-DPO
Viewer • Updated • 1.1M • 2 • 1 -
nlee-208/UF1000-eurus
Viewer • Updated • 1k • 2 -
heli-stand/hh-rlhf-harmless-base-trl-style
Viewer • Updated • 44.8k • 559 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_1
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_7
Viewer • Updated • 2.3k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_6
Viewer • Updated • 2.3k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_5
Viewer • Updated • 2.1k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_0
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_3
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_4
Viewer • Updated • 2.3k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_2
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_6
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_7
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_0
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_2
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_3
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_4
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_1
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_5
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_1
Viewer • Updated • 2.44k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_6
Viewer • Updated • 2.54k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_0
Viewer • Updated • 2.34k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_5
Viewer • Updated • 2.04k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_3
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_2
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_7
Viewer • Updated • 2.25k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_4
Viewer • Updated • 2.44k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_0
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_6
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_1
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_7
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_3
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_2
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_5
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_4
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_0
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_2
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_6
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_5
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_1
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_3
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_7
Viewer • Updated • 2.65k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_4
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_2
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_1
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_6
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_5
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_0
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_3
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_7
Viewer • Updated • 2.65k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_4
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_0
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_1
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_6
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_3
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_5
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_2
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_4
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_7
Viewer • Updated • 2.65k • 2 -
nlee-208/UF-Mistral-Self5
Viewer • Updated • 5k • 2 -
liswei/rm-static-zhTW
Viewer • Updated • 81.4k • 1 • 30 -
pvduy/hh_shp_oa_gpt4_rm_dataset_vicuna_format
Updated • 1 • 1 -
mii-llm/enex-dpo
Viewer • Updated • 2.99k • 2 • 1 -
AlekseyKorshuk/combined-pairwise
Viewer • Updated • 222k • 1 -
pvduy/hh_shp_oa_gpt4_rm_dataset_vicuna_formatoa
Updated • 1 -
amazingvince/full-dpo
Viewer • Updated • 186k • 2 -
mii-llm/cult-dpo
Viewer • Updated • 987 • 2 -
winglian/cortex-dumpster-fire-gemma-v5-crashed
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.2_self_70m
Viewer • Updated • 37.9k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.1_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.5_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.1_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.5_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.2_self_160m
Viewer • Updated • 37.9k • 1 -
August4293/Self_Alignment_Preference-Dataset
Viewer • Updated • 4.45k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.0_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.0_self_160m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.5_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.1_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.0_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.1_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.5_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.0_self_160m
Updated • 1 -
boopysaur/user1-dpo-small
Viewer • Updated • 12.1k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.3_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_1.0_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 1 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3_t_1.0_eval
Viewer • Updated • 568k • 1 -
Joyqiuyue/lima_preference_dataset
Viewer • Updated • 50 • 1 -
gagan3012/oasis
Viewer • Updated • 2.34M • 1 -
theblackhacker/arc_dpo
Viewer • Updated • 38.6k • 1 -
Dhananjayg22/legal-dpo
Viewer • Updated • 300 • 1 -
ShenaoZ/0.001_3iters_bs256_declr_nodpo_dataset
Viewer • Updated • 44.8k • 2 -
communityai/system_identity_remove_preference_gpt-v2
Viewer • Updated • 93 • 2 -
ShenaoZ/0.01_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_0
Viewer • Updated • 4.85k • 2 -
crumb/semantic-corruption-t5-v1_1-small
Viewer • Updated • 2.28k • 1 -
crumb/semantic-corruption-t5-v1_1-base
Updated • 1 -
crumb/semantic-corruption-t5-v1_1-large
Updated • 1 -
mnlp-nsoai/dpo-student-preferences
Viewer • Updated • 18.4k • 1 -
ContextualAI/ultrabin_clean_max_chosen_rand_rejected_rationalized
Viewer • Updated • 60.9k • 2 -
malteos/translation_test
Viewer • Updated • 10 • 1 -
malteos/translation_test2
Viewer • Updated • 50 • 1 -
nayohan/contextual-dpo-v0.1-ko
Viewer • Updated • 1.37k • 2 -
nayohan/reward-bench-ko
Viewer • Updated • 8.11k • 30 -
Windy/tmp_output_apc
Viewer • Updated • 60 • 2 -
Windy/tmp_output_apc_t1
Viewer • Updated • 60 • 2 -
Windy/tmp_output_apc_t1_noshort
Viewer • Updated • 60 • 2 -
sert121/preference_data_mapped_v8
Viewer • Updated • 960 • 2 -
sert121/preference_data_mapped_v7
Viewer • Updated • 3.2k • 2 -
Mitsuki-Sakamoto/pref_dataset_prompt_hh
Viewer • Updated • 77 • 1 -
Mitsuki-Sakamoto/pref_dataset_pairwise_hh
Viewer • Updated • 79 • 1 -
Mitsuki-Sakamoto/pref_dataset_prompt_ultrafeedback
Viewer • Updated • 28 • 1 -
Mitsuki-Sakamoto/pref_dataset_pairwise_ultrafeedback
Viewer • Updated • 30 • 1 -
Windy/tmp_output_ultr4_t0
Viewer • Updated • 60 • 2 -
Windy/tmp_output_ultr4_t0_top1
Viewer • Updated • 60 • 2 -
August4293/gsm8k_preference_dataset_it_1
Viewer • Updated • 895 • 2 -
August4293/gsm8k_preference_dataset_it_2
Viewer • Updated • 379 • 2 -
Windy/tmp_output_ultr4_t1
Viewer • Updated • 60 • 2 -
Columbia-NLP/DPO-distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 2 -
Columbia-NLP/DPO-distilabel-intel-orca-dpo-pairs_cleaned
Viewer • Updated • 12.8k • 2 -
Columbia-NLP/DPO-UltraFeedback_binarized
Viewer • Updated • 62.7k • 2 -
Columbia-NLP/DPO-py-dpo-v0.1
Viewer • Updated • 9.47k • 2 -
Columbia-NLP/DPO-tldr-summarisation-preferences
Viewer • Updated • 177k • 83 -
Columbia-NLP/DPO-PKU-SafeRLHF
Viewer • Updated • 136k • 6 -
Columbia-NLP/DPO-Nectar
Viewer • Updated • 183k • 2 -
Columbia-NLP/DPO-hh-rlhf
Viewer • Updated • 169k • 56 -
Windy/tmp_output_lima_t0
Viewer • Updated • 60 • 2 -
Windy/tmp_output_ultr4_t1_fromsimpt0_rankerthresh4
Viewer • Updated • 60 • 2 -
YYYYYYibo/test_vllm_mini_0
Viewer • Updated • 2.5k • 2 -
Windy/tmp_output_ultraw_t0
Viewer • Updated • 60 • 2 -
Windy/tmp_output_ultr4_t1_simthresh03
Viewer • Updated • 60 • 2 -
nlee-208/UF-Mistral-Self3
Viewer • Updated • 5k • 2 -
Windy/tmp_output_ultr4_t1_simthresh03_rank6
Viewer • Updated • 60 • 2 -
nlee-208/UF-Mistral-Self4
Viewer • Updated • 5k • 2 -
ZhangShenao/gc_binarized_mode_ultrafeedback
Viewer • Updated • 109k • 2 -
flydust/ultrafeedback-labeled
Viewer • Updated • 61.8k • 2 -
YYYYYYibo/test_get_pi
Viewer • Updated • 1k • 2 -
YYYYYYibo/test_pairrm
Viewer • Updated • 21.1k • 2 -
nlee-208/UF-Mistral-Self13
Viewer • Updated • 917 • 2 -
sert121/preference_data_v11_cleaned_filtered
Viewer • Updated • 3.55k • 2 -
sert121/preference_data_v10_cleaned_filtered
Viewer • Updated • 2.38k • 2 -
nlee-208/UF-Mistral-Self6
Viewer • Updated • 5k • 2 -
nlee-208/UF-Mistral-Self1
Viewer • Updated • 5k • 2 -
Windy/ultr4_v3_t1_trlsft_mv1
Viewer • Updated • 99 • 2 -
Xalphinions/llama3_ultrafeedback_with_tie
Viewer • Updated • 61.8k • 2 -
Windy/ultr4_v3_t1_trlsft_mv1_ranksim
Viewer • Updated • 7.11k • 2 -
Xalphinions/UltraFeedback_with_tie
Viewer • Updated • 133k • 2 -
nlee-208/UF-Mistral-Self101
Viewer • Updated • 2.5k • 2 -
Windy/ultr4_v3_t1_trlsft_mv1_ranksim_top1
Viewer • Updated • 15k • 2 -
nlee-208/UF-Mistral-Self8
Viewer • Updated • 5k • 2