Hugging Face's logo

v000000
/
L3.1-Celestial-Stone-2x8B-DPO-GGUFs-IMATRIX

Transformers
GGUF
Merge
llama
mixtral
dpo
llama-cpp
Inference Endpoints
imatrix
Model card Files Community
L3.1-Celestial-Stone-2x8B-DPO-GGUFs-IMATRIX / README.md
v000000's picture
v000000
Update README.md
67f7643 verified
preview code
|
raw
history blame contribute delete
1.03 kB
metadata
base_model: v000000/L3.1-Celestial-Stone-2x8B-DPO
library_name: transformers
tags:
  - merge
  - llama
  - mixtral
  - dpo
  - llama-cpp

L3.1-Celestial-Stone-2x8B-DPO (GGUFs)

This model was converted to GGUF format from v000000/L3.1-Celestial-Stone-2x8B-DPO using llama.cpp. Refer to the original model card for more details on the model.

image/png

Ordered by quality:

  • q8_0 imatrix --- 14.2g
  • q6_k imatrix --- 11.2g
  • q5_k_s imatrix --- 9.48g
  • iq4_xs imatrix --- 7.44g

Missing? See mradermacher i1 for more types of imatrix quants.

imatrix data (V2 - 287kb) randomized bartowski, kalomeze groups, ERP/RP snippets, working gpt4 code, toxic qa, human messaging, randomized posts, story, novels