XelotX
/

OpenHermes-2.5-Mistral-7B-XelotX-BF16_Quants

Inference Endpoints

Model card Files Files and versions Community

OpenHermes-2.5-Mistral-7B-XelotX-BF16_Quants

1 contributor

History: 10 commits

XelotX's picture

Upload OpenHermes-2.5-Mistral-7B-XelotX-IQ3_XXS.gguf with huggingface_hub

a5e3817 verified 4 months ago

.gitattributes

2.23 kB

Upload OpenHermes-2.5-Mistral-7B-XelotX-IQ3_XXS.gguf with huggingface_hub 4 months ago
OpenHermes-2.5-Mistral-7B-XelotX-IQ2_M.gguf

82.3 MB
LFS

Upload OpenHermes-2.5-Mistral-7B-XelotX-IQ2_M.gguf with huggingface_hub 4 months ago
OpenHermes-2.5-Mistral-7B-XelotX-IQ3_XXS.gguf

135 MB
LFS

Upload OpenHermes-2.5-Mistral-7B-XelotX-IQ3_XXS.gguf with huggingface_hub 4 months ago
OpenHermes-2.5-Mistral-7B-XelotX-Q2_K.gguf

2.72 GB
LFS

Upload OpenHermes-2.5-Mistral-7B-XelotX-Q2_K.gguf with huggingface_hub 4 months ago
OpenHermes-2.5-Mistral-7B-XelotX-Q4_0.gguf

4.11 GB
LFS

Upload OpenHermes-2.5-Mistral-7B-XelotX-Q4_0.gguf with huggingface_hub 4 months ago
OpenHermes-2.5-Mistral-7B-XelotX-Q4_1.gguf

4.55 GB
LFS

Upload OpenHermes-2.5-Mistral-7B-XelotX-Q4_1.gguf with huggingface_hub 4 months ago
OpenHermes-2.5-Mistral-7B-XelotX-Q5_0.gguf

5 GB
LFS

Upload OpenHermes-2.5-Mistral-7B-XelotX-Q5_0.gguf with huggingface_hub 4 months ago
OpenHermes-2.5-Mistral-7B-XelotX-Q5_1.gguf

5.44 GB
LFS

Upload OpenHermes-2.5-Mistral-7B-XelotX-Q5_1.gguf with huggingface_hub 4 months ago
OpenHermes-2.5-Mistral-7B-XelotX-Q6_K.gguf

5.94 GB
LFS

Upload OpenHermes-2.5-Mistral-7B-XelotX-Q6_K.gguf with huggingface_hub 4 months ago
OpenHermes-2.5-Mistral-7B-XelotX-Q8_0.gguf

7.7 GB
LFS

Upload OpenHermes-2.5-Mistral-7B-XelotX-Q8_0.gguf with huggingface_hub 4 months ago