--- title: "Metis-0.3 Quantized in GGUF" tags: - GGUF language: en --- ![Image description](https://i.postimg.cc/MGwhtFfF/tsune-fixed.png) # Tsunemoto GGUF's of Metis-0.3 This is a GGUF quantization of Metis-0.3. ## Original Repo Link: [Original Repository](https://huggingface.co./Mihaiii/Metis-0.3) ## Original Model Card: --- [Built with Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl) An instruct based fine tune of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co./mistralai/Mistral-7B-Instruct-v0.2). It works well with long system prompts. It isn't generic in a sense that it shouldn't be used for story telling, for example, but only for reasoning and text comprehension. This model is trained on a private dataset. The high GSM8K score is **NOT** because of the MetaMath dataset. # Prompt Format ([see the guidelines from the base model](https://huggingface.co./mistralai/Mistral-7B-Instruct-v0.2#instruction-format)): ``` [INST] {system_message} . Say "Acknowledged!" if you understood. [/INST] Acknowledged! [INST] {prompt} [/INST] ```