Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

4,471

Full-text search

Active filters: dpo

SimaFarazi/gpt2-dpo

Text Generation • Updated Sep 1, 2024 • 5

sumitxenon/HW2-dpo

Text Generation • Updated Sep 1, 2024 • 3

NicholasCorrado/uf-tulu-2-7b-dpo

Text Generation • Updated Sep 4, 2024 • 5

mertgulexe/HW2-dpo

Updated Sep 1, 2024 • 5

mradermacher/tulu-2-7b-hh-dpo-GGUF

Updated Sep 2, 2024 • 57

NicholasCorrado/tinyllama-1.1b-chat-v1.0-hh-dpo

Text Generation • Updated Sep 2, 2024 • 4

NicholasCorrado/tinyllama-1.1b-chat-v1.0-arena-hh-dpo

Text Generation • Updated Sep 2, 2024 • 3

SongTonyLi/SFT_D1chosenThenDPO_D2a_top3KSamples

Text Generation • Updated Sep 2, 2024 • 4

NicholasCorrado/tinyllama-1.1b-chat-v1.0-arena-dpo

Text Generation • Updated Sep 2, 2024 • 4

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-dpo

Text Generation • Updated Sep 2, 2024 • 13

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-coding-dpo

Text Generation • Updated Sep 2, 2024 • 4

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-logic-dpo

Text Generation • Updated Sep 2, 2024 • 6

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-coding-dpo

Text Generation • Updated Sep 2, 2024 • 4

NicholasCorrado/uf-rlced-conifer_tulu-2-7b-group-dpo-no-clip

Text Generation • Updated Sep 2, 2024 • 4

mradermacher/uf-tulu-2-7b-dpo-GGUF

Updated Sep 2, 2024

mradermacher/zephyr-7b-hh-dpo-GGUF

Updated Sep 3, 2024

sfulay/zephyr-7b-dpo-full-gpt-reward-scale-05

Updated Sep 3, 2024 • 8

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-2

Updated Sep 3, 2024 • 3

mradermacher/uf-tulu-2-7b-dpo-i1-GGUF

Updated Sep 2, 2024 • 189

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-05

Updated Sep 3, 2024 • 5

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-05

Updated Sep 3, 2024 • 2

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-coding-group-dpo

Text Generation • Updated Sep 3, 2024 • 5

mradermacher/zephyr-7b-hh-dpo-i1-GGUF

Updated Sep 3, 2024 • 34

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-dpo-2

Text Generation • Updated Sep 3, 2024 • 4

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-coding-dpo-2

Text Generation • Updated Sep 3, 2024 • 5

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-coding-dpo-2

Text Generation • Updated Sep 3, 2024 • 23

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-logic-dpo-2

Text Generation • Updated Sep 3, 2024 • 4

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-dpo-2

Text Generation • Updated Sep 3, 2024 • 4

tsavage68/Na_L3_1000steps_1e6rate_03beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 5

NicholasCorrado/tinyllama-1.1b-chat-v1.0-rlced-conifer-3-1-dpo

Text Generation • Updated Sep 4, 2024 • 4