File size: 706 Bytes
ef8481c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
---
license: apache-2.0
tags:
- quantization
- awq-marlin
- role-playing
model-index:
- name: "AWQ-Marlin Quantization"
results:
- task: "text-generation"
metrics:
- name: "q_group_size"
value: 128
- name: "w_bit"
value: 4
---
# AWQ-Marlin Quantization Model
This model is based on the AWQ-Marlin quantization technique and is optimized for role-playing scenarios. It has been trained to generate dialogue and interactions in text-based RPGs. The model provides efficient performance without compromising on quality.
## Use Cases
- **Role-playing Games (RPGs)**: Generate character dialogues and plot interactions in text-based RPGs. |