mradermacher
/

bling-sheared-llama-1.3b-0.1-GGUF

Inference Endpoints

Model card Files Files and versions Community

bling-sheared-llama-1.3b-0.1-GGUF

1 contributor

History: 17 commits

mradermacher's picture

auto-patch README.md

23734c3 verified 12 days ago

.gitattributes

2.43 kB

uploaded from nethype/nico1 12 days ago
README.md

3.86 kB

auto-patch README.md 12 days ago
bling-sheared-llama-1.3b-0.1.IQ4_XS.gguf

750 MB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.Q2_K.gguf

559 MB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.Q3_K_L.gguf

743 MB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.Q3_K_M.gguf

703 MB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.Q3_K_S.gguf

641 MB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.Q4_K_M.gguf

872 MB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.Q4_K_S.gguf

813 MB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.Q5_K_M.gguf

1 GB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.Q5_K_S.gguf

952 MB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.Q6_K.gguf

1.17 GB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.Q8_0.gguf

1.43 GB
LFS

uploaded from nethype/nico1 12 days ago
bling-sheared-llama-1.3b-0.1.f16.gguf

2.69 GB
LFS

uploaded from nethype/nico1 12 days ago