|
--- |
|
base_model: princeton-nlp/gemma-2-9b-it-SimPO |
|
tags: |
|
- alignment-handbook |
|
- generated_from_trainer |
|
datasets: |
|
- princeton-nlp/gemma2-ultrafeedback-armorm |
|
model-index: |
|
- name: princeton-nlp/gemma-2-9b-it-SimPO |
|
results: [] |
|
license: |
|
- mit |
|
- gemma |
|
quantized_by: pipihand01 |
|
--- |
|
GGUF files of [princeton-nlp/gemma-2-9b-it-SimPO](https://huggingface.co./princeton-nlp/gemma-2-9b-it-SimPO). |
|
|
|
--- |
|
## Files quantized with larger embed and output weights than normal GGUF setting |
|
|
|
- Q8_0 embed and output weights: Q6_K_L, Q5_K_L, Q4_K_L |
|
|
|
- bf16 embed and output weights (maybe slower inference): Q8_0_L, Q6_K_XL, Q5_K_XL, Q4_K_XL |
|
|
