Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,976

Full-text search

Active filters: dpo

mradermacher/distilabeled-Marcoro14-7B-slerp-full-i1-GGUF

Updated 6 days ago • 212 • 1

mgat1/SmolLM2-FT-DPO

Text Generation • Updated 6 days ago • 7 • 1

AmberYifan/Llama-3.1-8B-sft-SPIN-self

Text Generation • Updated about 13 hours ago • 2 • 1

mradermacher/Llama-3.1-8B-sft-SPIN-self-GGUF

Updated 1 day ago • 252 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 15 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • Updated Oct 31, 2023 • 4.84k • 19

lewtun/zephyr-7b-dpo-full

Text Generation • Updated Jan 5 • 24

alignment-handbook/zephyr-7b-dpo-full

Text Generation • Updated Jan 10 • 757 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9 • 42 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 32 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

ContextualAI/archangel_sft_pythia1-4b

Text Generation • Updated Jan 11 • 24

ContextualAI/archangel_sft_pythia2-8b

Text Generation • Updated Jan 11 • 17 • 1

ContextualAI/archangel_sft_pythia6-9b

Text Generation • Updated Jan 11 • 35

ContextualAI/archangel_sft_pythia12-0b

Text Generation • Updated Jan 11 • 17

ContextualAI/archangel_sft_llama7b

Text Generation • Updated Jan 11 • 574 • 1

ContextualAI/archangel_sft_llama13b

Text Generation • Updated Jan 11 • 55

ContextualAI/archangel_sft_llama30b

Text Generation • Updated Jan 11 • 24

ContextualAI/archangel_slic_llama30b

Text Generation • Updated Jan 11 • 25

ContextualAI/archangel_slic_pythia1-4b

Text Generation • Updated Jan 11 • 19

ContextualAI/archangel_slic_pythia2-8b

Text Generation • Updated Jan 11 • 16

ContextualAI/archangel_slic_pythia6-9b

Text Generation • Updated Jan 11 • 24

ContextualAI/archangel_slic_pythia12-0b

Text Generation • Updated Jan 11 • 19

ContextualAI/archangel_slic_llama7b

Text Generation • Updated Jan 11 • 29 • 1

ContextualAI/archangel_slic_llama13b

Text Generation • Updated Jan 11 • 18

ContextualAI/archangel_dpo_pythia1-4b

Text Generation • Updated Jan 11 • 40

ContextualAI/archangel_dpo_pythia2-8b

Text Generation • Updated Jan 11 • 22

ContextualAI/archangel_dpo_pythia6-9b

Text Generation • Updated Jan 11 • 20

ContextualAI/archangel_dpo_pythia12-0b

Text Generation • Updated Jan 11 • 22