|
--- |
|
base_model: Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24 |
|
base_model_relation: quantized |
|
license: apache-2.0 |
|
pipeline_tag: text-generation |
|
quantized_by: qilowoq |
|
tags: |
|
- gptq |
|
language: |
|
- en |
|
- ru |
|
--- |
|
|
|
# Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24-4Bit-GPTQ |
|
|
|
- Original Model: [Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24](https://huggingface.co./Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24) |
|
|
|
## Quantization |
|
|
|
- This model was quantized with the Auto-GPTQ library and dataset containing english and russian wikipedia articles. It has lower perplexity on russian data then other GPTQ models. |
