| license: apache-2.0 | |
| language: | |
| - en | |
| library_name: transformers | |
| pipeline_tag: text-generation | |
| tags: | |
| - mistral | |
| - conversational | |
| - text-generation-inference | |
| base_model: Open-Orca/Mistral-7B-OpenOrca | |
| inference: false | |
| # Mistral-7B-OpenOrca-GGUF | |
| - Quantized version of [Mistral-7B-OpenOrca](https://huggingface.co./Open-Orca/Mistral-7B-OpenOrca) | |
| - Created using llama.cpp | |
| ## Available Quants | |
| * Q2_K | |
| * Q3_K_L | |
| * Q3_K_M | |
| * Q3_K_S | |
| * Q4_0 | |
| * Q4_K_M | |
| * Q4_K_S | |
| * Q5_0 | |
| * Q5_K_M | |
| * Q5_K_S | |
| * Q6_K | |
| * Q8_0 | |