XelotX
/

Mistral-7B-Instruct-v0.3-XelotX-BF16_Quants

Inference Endpoints

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-XelotX-BF16_Quants

1 contributor

History: 8 commits

XelotX's picture

Upload Mistral-7B-Instruct-v0.3-XelotX-Q4_1.gguf with huggingface_hub

d791126 verified 4 months ago

.gitattributes

2.07 kB

Upload Mistral-7B-Instruct-v0.3-XelotX-Q4_1.gguf with huggingface_hub 4 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q2_K.gguf

2.72 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q2_K.gguf with huggingface_hub 4 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q4_0.gguf

4.11 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q4_0.gguf with huggingface_hub 4 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q4_1.gguf

4.56 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q4_1.gguf with huggingface_hub 4 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q4_K_M.gguf

4.37 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q4_K_M.gguf with huggingface_hub 4 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q5_K_M.gguf

5.14 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q5_K_M.gguf with huggingface_hub 4 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q6_K.gguf

5.95 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q6_K.gguf with huggingface_hub 4 months ago
Mistral-7B-Instruct-v0.3-XelotX-Q8_0.gguf

7.7 GB
LFS

Upload Mistral-7B-Instruct-v0.3-XelotX-Q8_0.gguf with huggingface_hub 4 months ago