mradermacher
/

Breeze-7B-Instruct-v0_1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Breeze-7B-Instruct-v0_1-GGUF

1 contributor

History: 18 commits

mradermacher's picture

auto-patch README.md

7abe75a verified about 2 months ago

.gitattributes

2.45 kB

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.IQ4_XS.gguf
4.11 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q2_K.gguf
2.86 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q3_K_L.gguf
3.98 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q3_K_M.gguf
3.67 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q3_K_S.gguf
3.32 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q4_0_4_4.gguf
4.28 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q4_K_M.gguf
4.54 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q4_K_S.gguf
4.31 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q5_K_M.gguf
5.32 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q5_K_S.gguf
5.18 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q6_K.gguf
6.14 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.Q8_0.gguf
7.96 GB
LFS

uploaded from back about 2 months ago
Breeze-7B-Instruct-v0_1.f16.gguf
15 GB
LFS

uploaded from back about 2 months ago
README.md

3.82 kB

auto-patch README.md about 2 months ago