Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ThomasBaruzier
/
Qwen2.5-7B-Instruct-GGUF
like
0
Text Generation
GGUF
English
chat
Inference Endpoints
imatrix
conversational
arxiv:
2309.00071
arxiv:
2407.10671
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
96e0a4a
Qwen2.5-7B-Instruct-GGUF
/
.gitattributes
Commit History
Upload Qwen2.5-7B-Instruct-IQ4_NL.gguf
96e0a4a
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ4_XS.gguf
f4dbe6d
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-Q4_K_M.gguf
0a4bd8b
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ3_M.gguf
efc024e
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-Q3_K_L.gguf
247e95b
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ3_XXS.gguf
0b3c9c7
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-Q3_K_S.gguf
474e8ed
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-Q3_K_M.gguf
b2eb626
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ3_S.gguf
807dcf2
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ3_XS.gguf
7e03d34
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ2_XXS.gguf
5c0ad80
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-Q2_K.gguf
14d9ad3
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ2_M.gguf
909bcd7
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ2_S.gguf
9e5502d
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-Q2_K_S.gguf
1641195
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ2_XS.gguf
3c6e228
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ1_S.gguf
c8a73c6
verified
ThomasBaruzier
commited on
Sep 19
Upload Qwen2.5-7B-Instruct-IQ1_M.gguf
264ec11
verified
ThomasBaruzier
commited on
Sep 19
Upload imatrix.dat
c9e9d2f
verified
ThomasBaruzier
commited on
Sep 19
initial commit
c3fee72
verified
ThomasBaruzier
commited on
Sep 19