sleepdeprived3
/

Mistral-Small-24B-Instruct-2501_EXL2_4bpw_H8

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Mistral-Small-24B-Instruct-2501_EXL2_4bpw_H8

1 contributor

History: 16 commits

sleepdeprived3's picture

Upload tokenizer_config.json with huggingface_hub

86035c4 verified 5 days ago

.gitattributes

1.62 kB

Upload tokenizer.json with huggingface_hub 5 days ago
LICENSE

54 Bytes

Upload LICENSE with huggingface_hub 5 days ago
README.md

14.8 kB

Upload README.md with huggingface_hub 5 days ago
SYSTEM_PROMPT.txt

1.05 kB

Upload SYSTEM_PROMPT.txt with huggingface_hub 5 days ago
config.json

972 Bytes

Upload config.json with huggingface_hub 5 days ago
generation_config.json

160 Bytes

Upload generation_config.json with huggingface_hub 5 days ago
huggingface-metadata.txt

1.43 kB

Upload huggingface-metadata.txt with huggingface_hub 5 days ago
measurement.json

2.31 MB

Upload measurement.json with huggingface_hub 5 days ago
model.safetensors.index.json

29.9 kB

Upload model.safetensors.index.json with huggingface_hub 5 days ago
output-00001-of-00002.safetensors

8.54 GB
LFS

Upload output-00001-of-00002.safetensors with huggingface_hub 5 days ago
output-00002-of-00002.safetensors

4.59 GB
LFS

Upload output-00002-of-00002.safetensors with huggingface_hub 5 days ago
params.json

232 Bytes

Upload params.json with huggingface_hub 5 days ago
special_tokens_map.json

21.3 kB

Upload special_tokens_map.json with huggingface_hub 5 days ago
tekken.json

14.8 MB
LFS

Upload tekken.json with huggingface_hub 5 days ago
tokenizer.json

17.1 MB
LFS

Upload tokenizer.json with huggingface_hub 5 days ago
tokenizer_config.json

200 kB

Upload tokenizer_config.json with huggingface_hub 5 days ago