---
license: apache-2.0
---


GPTQ 4-bit no actor version for compatibility that works in textgen-webui

Generated by using scripts from https://gitee.com/yhyu13/llama_-tools

Original weights: https://huggingface.co./openaccess-ai-collective/manticore-13b

---

Manticore is by far the most satisfying LLaMA model I've used due to its fine-tuning datasets are generated from the best of Vicuna, Wizard, and ShareGPT/GPT4.

Here is a conversation generated in textgen-webui, it shows step by step Chain of Thoughts comments along side generating complex code sample in an engaging tone!

![sample](./img/sample.png)