Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Rombos-LLM-V2.5-Qwen-7b-GGUF
like
0
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Use this model
384c728
Rombos-LLM-V2.5-Qwen-7b-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
449ced269d2bc2e21471200d591fe0c0cdc74d849bc08870aca77da4328a7f78
384c728
verified
9 days ago
.gitattributes
1.87 kB
449ced269d2bc2e21471200d591fe0c0cdc74d849bc08870aca77da4328a7f78
9 days ago
Rombos-LLM-V2.5-Qwen-7b.Q5_K_M.gguf
5.44 GB
LFS
3ebdb6af23b49f6ad5f070f8de30d0859c5fc0ed3d7fb3c691f8a278f1c310bb
9 days ago
Rombos-LLM-V2.5-Qwen-7b.Q5_K_S.gguf
5.32 GB
LFS
c8aa086ad13d9879d857b0236d3d8d5bea7e3bda656c1af8adb892bf0ead0d44
9 days ago
Rombos-LLM-V2.5-Qwen-7b.Q6_K.gguf
6.25 GB
LFS
01022f08b9b9e62d6368b39a0eb99100a46cf62bdd889cfe24ea79ecc1e657af
9 days ago
Rombos-LLM-V2.5-Qwen-7b.Q8_0.gguf
8.1 GB
LFS
7b1ddc9f702410c00ca316512eac70d37803570db81bb707615211d508975b2e
9 days ago
Rombos-LLM-V2.5-Qwen-7b.fp16.gguf
15.2 GB
LFS
449ced269d2bc2e21471200d591fe0c0cdc74d849bc08870aca77da4328a7f78
9 days ago
