|
--- |
|
license: apache-2.0 |
|
library_name: transformers |
|
pipeline_tag: text-generation |
|
tags: |
|
- mistral |
|
- text-generation-inference |
|
- conversational |
|
- finetuned |
|
base_model: mistralai/Mistral-7B-Instruct-v0.1 |
|
inference: false |
|
--- |
|
|
|
# Mistral-7B-Instruct-v0.1-GGUF |
|
- Quantized version of [Mistral-7B-Instruct-v0.1](https://huggingface.co./mistralai/Mistral-7B-Instruct-v0.1) |
|
- Created using llama.cpp |
|
|
|
## Available Quants |
|
|
|
* Q2_K |
|
* Q3_K_L |
|
* Q3_K_M |
|
* Q3_K_S |
|
* Q4_0 |
|
* Q4_K_M |
|
* Q4_K_S |
|
* Q5_0 |
|
* Q5_K_M |
|
* Q5_K_S |
|
* Q6_K |
|
* Q8_0 |
