Some of my own quants:

meow_Q5_K_M.gguf
meow_Q8_0.gguf

Source: rishiraj

Source Model: meow

Source models for rishiraj/meow (Merge)

upstage/SOLAR-10.7B-Instruct-v1.0

Downloads last month: 5

GGUF

Model size

10.7B params

Architecture

llama

5-bit

8-bit

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.