Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

4,294

Full-text search

Active filters: exl2

LoneStriker/Harmonia-no_robots-20b-3.0bpw-h6-exl2

Text Generation • Updated Mar 22, 2024 • 6 • 1

LoneStriker/Harmonia-no_robots-20b-4.0bpw-h6-exl2

Text Generation • Updated Mar 22, 2024 • 4

LoneStriker/Harmonia-no_robots-20b-4.55bpw-h6-exl2

Text Generation • Updated Mar 22, 2024 • 3

LoneStriker/Harmonia-no_robots-20b-5.0bpw-h6-exl2

Text Generation • Updated Mar 22, 2024 • 9

LoneStriker/Harmonia-no_robots-20b-6.0bpw-h6-exl2

Text Generation • Updated Mar 22, 2024 • 5

LoneStriker/Harmonia-no_robots-20b-8.0bpw-h8-exl2

Text Generation • Updated Mar 22, 2024 • 5

blockblockblock/TheSpice-7b-v0.1.1-bpw2.5

Text Generation • Updated Mar 22, 2024 • 4

blockblockblock/TheSpice-7b-v0.1.1-bpw3

Text Generation • Updated Mar 22, 2024 • 3

blockblockblock/TheSpice-7b-v0.1.1-bpw3.5

Text Generation • Updated Mar 22, 2024 • 4

blockblockblock/TheSpice-7b-v0.1.1-bpw3.7

Text Generation • Updated Mar 22, 2024 • 6

blockblockblock/TheSpice-7b-v0.1.1-bpw4

Text Generation • Updated Mar 22, 2024 • 3

blockblockblock/TheSpice-7b-v0.1.1-bpw4.2

Text Generation • Updated Mar 22, 2024 • 10

blockblockblock/TheSpice-7b-v0.1.1-bpw4.4

Text Generation • Updated Mar 22, 2024 • 4

blockblockblock/TheSpice-7b-v0.1.1-bpw4.6

Text Generation • Updated Mar 22, 2024 • 4

blockblockblock/TheSpice-7b-v0.1.1-bpw4.8

Text Generation • Updated Mar 22, 2024 • 3

LoneStriker/Starling-LM-7B-beta-3.0bpw-h6-exl2

Text Generation • Updated Mar 22, 2024 • 9

LoneStriker/Starling-LM-7B-beta-4.0bpw-h6-exl2

Text Generation • Updated Mar 22, 2024 • 5 • 1

LoneStriker/Starling-LM-7B-beta-5.0bpw-h6-exl2

Text Generation • Updated Mar 22, 2024 • 3

LoneStriker/Starling-LM-7B-beta-6.0bpw-h6-exl2

Text Generation • Updated Mar 22, 2024 • 4 • 1

LoneStriker/Starling-LM-7B-beta-8.0bpw-h8-exl2

Text Generation • Updated Mar 22, 2024 • 6 • 3

blockblockblock/TheSpice-7b-v0.1.1-bpw5

Text Generation • Updated Mar 22, 2024 • 5

blockblockblock/TheSpice-7b-v0.1.1-bpw5.5

Text Generation • Updated Mar 22, 2024 • 4

blockblockblock/TheSpice-7b-v0.1.1-bpw6

Text Generation • Updated Mar 22, 2024 • 4

Natkituwu/Fimbulvetr-11B-v2-4.35bpw-exl2

Text Generation • Updated Mar 23, 2024 • 5

blockblockblock/dolphin-2.8-gemma-2b-bpw2.5

Text Generation • Updated Mar 24, 2024 • 3

blockblockblock/dolphin-2.8-gemma-2b-bpw3

Text Generation • Updated Mar 24, 2024 • 3

blockblockblock/dolphin-2.8-gemma-2b-bpw3.5

Text Generation • Updated Mar 24, 2024 • 3

blockblockblock/dolphin-2.8-gemma-2b-bpw3.7

Text Generation • Updated Mar 24, 2024 • 3

blockblockblock/dolphin-2.8-gemma-2b-bpw4

Text Generation • Updated Mar 24, 2024 • 7

blockblockblock/dolphin-2.8-gemma-2b-bpw4.2

Text Generation • Updated Mar 24, 2024 • 7