1 billion parameter models, quantized with AWQ.
SolidRusT Networks
company
Verified
AI & ML interests
Self-hosting, Open Source and AI Unalignment
Recent Activity
View all activity
Organization Card
Organization for sorting and categorizing collections of quantized models, featured on solidrust.net.
Currently focused on models that can be quantized by AWQ from: https://github.com/casper-hansen/AutoAWQ using https://github.com/SolidRusT/srt-model-quantizing/tree/main/awq
Collections
8
These models are selected for their compatibility with small 12GB memory GPUs.
-
solidrust/Starling-LM-7B-beta-AWQ
Text Generation • Updated • 82 • 3 -
solidrust/dolphin-2.8-mistral-7b-v02-AWQ
Text Generation • Updated • 161 • 2 -
solidrust/Hermes-2-Pro-Mistral-7B-AWQ
Text Generation • Updated • 22 • 2 -
solidrust/dolphin-2.8-experiment26-7b-AWQ
Text Generation • Updated • 120 • 1
models
509
solidrust/Llama-3-8B-Stroganoff-4.0-AWQ
Text Generation
•
Updated
•
11
solidrust/Llama-3.1-8B-TitanFusion-Mix-AWQ
Text Generation
•
Updated
•
10
solidrust/Llama-3.1-8B-TitanFusion-v3-AWQ
Text Generation
•
Updated
•
13
solidrust/Fatgirl_v2_8B-AWQ
Text Generation
•
Updated
•
16
solidrust/L3-Super-Nova-RP-8B-AWQ
Text Generation
•
Updated
•
11
solidrust/L3-Umbral-Mind-RP-v0.3-8B-AWQ
Text Generation
•
Updated
•
11
solidrust/Chili_Dog_8B-AWQ
Text Generation
•
Updated
•
11
solidrust/L3-Luna-8B-AWQ
Text Generation
•
Updated
•
12
solidrust/Magic_v2_8B-AWQ
Text Generation
•
Updated
•
9
solidrust/Llama-3SOME-8B-v2-AWQ
Text Generation
•
Updated
•
14
datasets
None public yet