Super Warding

*a model specifically for use with swarm and Rag architecture outshining Many others in coherance-ENJOY

This model was converted to GGUF format from FourOhFour/Vapor_v2_7B

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

Invoke the llama.cpp server or the CLI

GGUF

Model size

7.62B params

Architecture

qwen2

4-bit

Inference API

Unable to determine this model's library. Check the docs .

Base model

Qwen/Qwen2.5-7B

Finetuned

Quantized

(1)

this model