Edit Models filters

Intel/orca_dpo_pairs

allenai/ultrafeedback_binarized_cleaned

jondurbin/truthy-dpo-v0.1

Open-Orca/SlimOrca

nvidia/HelpSteer

migtissera/Synthia-v1.3

TIGER-Lab/MathInstruct

unalignment/toxic-dpo-v0.1

Muennighoff/natural-instructions

Vezora/Tested-22k-Python-Alpaca

codeparrot/apps

facebook/belebele

jondurbin/cinematika-v0.1

lmsys/lmsys-chat-1m

Squish42/bluemoon-fandom-1-1-rp-cleaned

kingbri/PIPPA-shareGPT

HuggingFaceH4/ultrachat_200k

meta-math/MetaMathQA

teknium/OpenHermes-2.5

unalignment/spicy-3.1

argilla/distilabel-capybara-dpo-7k-binarized

Open-Orca/OpenOrca

hkust-nlp/deita-10k-v0

openchat/openchat_sharegpt4_dataset

jondurbin/airoboros-3.2

teknium/openhermes

argilla/ultrafeedback-binarized-preferences-cleaned

HuggingFaceH4/ultrafeedback_binarized

athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW

argilla/ultrafeedback-binarized-preferences

MinervaAI/Aesir-Preview

Open-Orca/SlimOrca-Dedup

LDJnr/Pure-Dove

mlabonne/chatml_dpo_pairs

LDJnr/Verified-Camel

argilla/distilabel-math-preference-dpo

glaiveai/glaive-function-calling-v2

wenbopan/Chinese-dpo-pairs

OpenAssistant/oasst2

PygmalionAI/PIPPA

lemonilia/LimaRP

HuggingFaceH4/capybara

cerebras/SlimPajama-627B

cognitivecomputations/WizardLM_evol_instruct_V2_196k_unfiltered_merged_split

Anthropic/hh-rlhf

HuggingFaceH4/no_robots

MaziyarPanahi/truthy-dpo-v0.1-axolotl

PKU-Alignment/PKU-SafeRLHF

allenai/ai2_arc

chargoddard/rpguild

openai/summarize_from_feedback

pankajmathur/orca_mini_v1_dataset

NeuralNovel/Neural-Story-v1

argilla/distilabel-intel-orca-dpo-pairs

databricks/databricks-dolly-15k

kyujinpy/orca_math_dpo

mlabonne/CodeLlama-2-20k

wikimedia/wikipedia

BAAI/Infinity-Instruct

argilla/OpenHermesPreferences

codefuse-ai/Evol-instruction-66k

LDJnr/LessWrong-Amplify-Instruct

Locutusque/Hercules-v3.0

Norquinal/claude_multiround_chat_30k

OpenAssistant/oasst_top1_2023-08-25

Undi95/toxic-dpo-v0.1-NoWarning

cognitivecomputations/dolphin

fka/awesome-chatgpt-prompts

glaiveai/glaive-code-assistant

imone/OpenOrca_FLAN

BramVanroy/dolly-15k-dutch

Lin-Chen/ShareGPT4V

berkeley-nest/Nectar

ise-uiuc/Magicoder-OSS-Instruct-75K

pankajmathur/WizardLM_Orca

teknium/trismegistus-project

unalignment/toxic-dpo-v0.2

Datasets with no match

mozilla-foundation/common_voice_11_0

mozilla-foundation/common_voice_7_0

cis-lmu/Glot500

microsoft/orca-math-word-problems-200k

allenai/MADLAD-400

m-a-p/CodeFeedback-Filtered-Instruction

bigcode/starcoderdata

oscar-corpus/OSCAR-2109

cognitivecomputations/dolphin-coder

garage-bAInd/Open-Platypus

jondurbin/gutenberg-dpo-v0.1

cognitivecomputations/samantha-data

legacy-datasets/wikipedia

mozilla-foundation/common_voice_13_0

OpenAssistant/oasst1

jondurbin/airoboros-2.2.1

tiiuae/falcon-refinedweb

facebook/voxpopuli

EleutherAI/pile

cognitivecomputations/Dolphin-2.9

ise-uiuc/Magicoder-Evol-Instruct-110K

togethercomputer/RedPajama-Data-1T

anthracite-org/kalo-opus-instruct-22k-no-refusal

internlm/Agent-FLAN

Locutusque/function-calling-chatml

mozilla-foundation/common_voice_17_0

nothingiisreal/Reddit-Dirty-And-WritingPrompts

m-a-p/Code-Feedback

yahma/alpaca-cleaned

HuggingFaceFW/fineweb

Gryphe/Sonnet3.5-Charcard-Roleplay

tatsu-lab/alpaca

Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned

Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned

mozilla-foundation/common_voice_8_0

huggan/smithsonian_butterflies_subset

camel-ai/biology

Gryphe/Sonnet3.5-SlimOrcaDedupCleaned

camel-ai/physics

mlabonne/orpo-dpo-mix-40k

camel-ai/chemistry

grimulkan/LimaRP-augmented

openbmb/UltraFeedback

microsoft/orca-agentinstruct-1M-v1

HuggingFaceFW/fineweb-edu

Nopm/Opus_WritingStruct

anthracite-org/nopm_claude_writing_fixed

nvidia/HelpSteer2

AI-MO/NuminaMath-CoT

HuggingFaceTB/cosmopedia

HuggingFaceTB/smoltalk

glaiveai/glaive-code-assistant-v3

allura-org/Celeste-1.x-data-mixture

Gryphe/ChatGPT-4o-Writing-Prompts

allenai/tulu-v2-sft-mixture

anon8231489123/ShareGPT_Vicuna_unfiltered

jondurbin/airoboros-3.1

netcat420/MFANN

jondurbin/airoboros-2.2

open-web-math/open-web-math

derek-thomas/ScienceQA

metaeval/reclor

allenai/tulu-3-sft-mixture

mattpscott/airoboros-summarization

b-mc2/sql-create-context

flax-sentence-embeddings/stackexchange_xml

embedding-data/sentence-compression

mozilla-foundation/common_voice_16_1

embedding-data/PAQ_pairs

embedding-data/WikiAnswers

nguha/legalbench

bigcode/commitpackft

detection-datasets/coco

tmnam20/VieGLUE

argilla/dpo-mix-7k

unicamp-dl/mmarco

relbert/semeval2012_relational_similarity

liuhaotian/LLaVA-Instruct-150K

abacusai/SystemChat-1.1

jondurbin/airoboros-gpt4-1.4.1

AI-MO/NuminaMath-TIR

Models

589

Full-text search

Active filters: Intel/orca_dpo_pairs

mradermacher/Orca-SOLAR-4x10.7b-i1-GGUF

Updated Nov 18, 2024 • 156

tensorblock/Quyen-Pro-v0.1-GGUF

Text Generation • Updated Nov 18, 2024 • 14

tensorblock/DPOpenHermes-11B-GGUF

Updated Nov 22, 2024 • 14

matrixportal/stablelm-zephyr-3b-IQ4_NL-GGUF

Updated Nov 24, 2024 • 4

mradermacher/SOLAR-19.2B-Instruct-v1.0-GGUF

Updated Nov 25, 2024 • 96

mradermacher/Sakura-SOLRCA-Math-Instruct-DPO-v1-GGUF

Updated Nov 28, 2024 • 4

mradermacher/Sakura-SOLRCA-Instruct-DPO-GGUF

Updated Nov 29, 2024 • 7

mradermacher/Sakura-SOLRCA-Math-Instruct-DPO-v1-i1-GGUF

Updated Nov 28, 2024 • 57

mradermacher/Sakura-SOLRCA-Instruct-DPO-i1-GGUF

Updated Nov 29, 2024 • 18

mradermacher/SOLAR-10.7B-Instruct-v1.0-128k-GGUF

Updated Nov 30, 2024 • 11 • 1

mradermacher/SOLAR-10.7B-Instruct-v1.0-128k-i1-GGUF

Updated Nov 30, 2024 • 195 • 1

mradermacher/bagel-dpo-8x7b-v0.2-GGUF

Updated Dec 1, 2024 • 13 • 1

mradermacher/bagel-dpo-8x7b-v0.2-i1-GGUF

Updated Dec 1, 2024 • 68 • 2

mradermacher/bagel-8x7b-v0.2-GGUF

Updated Dec 1, 2024 • 108 • 1

mradermacher/bagel-8x7b-v0.2-i1-GGUF

Updated Dec 1, 2024 • 4

bartowski/bagel-dpo-8x7b-v0.2-GGUF

Text Generation • Updated Dec 2, 2024 • 96 • 2

mradermacher/Gecko-7B-v0.1-DPO-GGUF

Updated Dec 3, 2024 • 1

mradermacher/Gecko-7B-v0.1-DPO-i1-GGUF

Updated Dec 3, 2024 • 87

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-F32-GGUF

Updated Dec 6, 2024 • 15

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-Q8_0-GGUF

Updated Dec 7, 2024

mradermacher/bagel-34b-v0.2-GGUF

Updated Dec 9, 2024 • 35

mradermacher/bagel-34b-v0.2-i1-GGUF

Updated Dec 9, 2024 • 297

tensorblock/Llama-3-8B-Instruct-DPO-v0.3-GGUF

Text Generation • Updated Dec 9, 2024 • 91

tensorblock/SSH_355M-GGUF

Updated Dec 11, 2024 • 30

mradermacher/bagel-dpo-1.1b-v0.3-GGUF

Updated Dec 11, 2024 • 123

mradermacher/bagel-dpo-1.1b-v0.3-i1-GGUF

Updated Dec 11, 2024 • 17

mradermacher/bagel-1.1b-v0.3-GGUF

Updated Dec 11, 2024 • 75

mradermacher/bagel-1.1b-v0.3-i1-GGUF

Updated Dec 11, 2024 • 2

tensorblock/Yi-9B-Forest-DPO-v1.0-GGUF

Text Generation • Updated Dec 11, 2024 • 9

tensorblock/SOLAR-10.7B-Instruct-Forest-DPO-v1-GGUF

Text Generation • Updated Dec 11, 2024 • 13