Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ThomasBaruzier
/
Qwen2.5-7B-Instruct-GGUF
like
0
Text Generation
GGUF
English
chat
Inference Endpoints
imatrix
arxiv:
2309.00071
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
a80d477
Qwen2.5-7B-Instruct-GGUF
Commit History
Update README.md
a80d477
verified
ThomasBaruzier
commited on
12 days ago
Upload Qwen2.5-7B-Instruct-Q4_0_8_8.gguf
a3ff4b1
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q4_0_4_8.gguf
ef16618
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q4_0_4_4.gguf
b372e5f
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q8_0.gguf
a48ee35
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q5_1.gguf
b927c8e
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q5_0.gguf
190fa09
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q4_1.gguf
82d9d33
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q4_0.gguf
2d88afd
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-F16.gguf
17b148c
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q6_K.gguf
81a58ba
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q5_K_S.gguf
2a2ba59
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q5_K_M.gguf
4fdf565
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q4_K_S.gguf
1410cc3
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ4_NL.gguf
96e0a4a
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ4_XS.gguf
f4dbe6d
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q4_K_M.gguf
0a4bd8b
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ3_M.gguf
efc024e
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q3_K_L.gguf
247e95b
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ3_XXS.gguf
0b3c9c7
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q3_K_S.gguf
474e8ed
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q3_K_M.gguf
b2eb626
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ3_S.gguf
807dcf2
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ3_XS.gguf
7e03d34
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ2_XXS.gguf
5c0ad80
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q2_K.gguf
14d9ad3
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ2_M.gguf
909bcd7
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ2_S.gguf
9e5502d
verified
ThomasBaruzier
commited on
13 days ago
Create README.md
3ab8de2
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-Q2_K_S.gguf
1641195
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ2_XS.gguf
3c6e228
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ1_S.gguf
c8a73c6
verified
ThomasBaruzier
commited on
13 days ago
Upload Qwen2.5-7B-Instruct-IQ1_M.gguf
264ec11
verified
ThomasBaruzier
commited on
13 days ago
Upload perplexity.md
66cb1be
verified
ThomasBaruzier
commited on
13 days ago
Upload imatrix.dat
c9e9d2f
verified
ThomasBaruzier
commited on
13 days ago
Upload calibration_datav3.txt
60302da
verified
ThomasBaruzier
commited on
13 days ago
initial commit
c3fee72
verified
ThomasBaruzier
commited on
13 days ago
ThomasBaruzier
commited on
