QuantFactory/Hathor-L3-8B-v.02-GGUF

This is quantized version of Nitral-AI/Hathor-L3-8B-v.02 created using llama.cpp

Model Description

"Hathor-v0.2 is a model based on the LLaMA 3 architecture: Designed to seamlessly integrate the qualities of creativity, intelligence, and robust performance. Making it an ideal tool for a wide range of applications; such as creative writing, educational support and human/computer interaction."

Recomended ST Presets: Hathor Presets

---

Notes: Hathor is trained on 3 epochs of private data, synthetic opus instructons, a mix of light/classical novel data, roleplaying chat pairs over llama 3 8B instruct. (expanded)

---

• If you want to use vision functionality:

• You must use the latest versions of Koboldcpp.

• To use the multimodal capabilities of this model and use vision you need to load the specified mmproj file, this can be found inside this model repo. Llava MMProj

• You can load the mmproj by using the corresponding section in the interface: