| license: apache-2.0 | |
| tags: | |
| - quantization | |
| - awq-marlin | |
| - role-playing | |
| model-index: | |
| - name: "AWQ-Marlin Quantization" | |
| results: | |
| - task: "text-generation" | |
| metrics: | |
| - name: "q_group_size" | |
| value: 128 | |
| - name: "w_bit" | |
| value: 4 | |
| # AWQ-Marlin Quantization Model | |
| This model is based on the AWQ-Marlin quantization technique and is optimized for role-playing scenarios. It has been trained to generate dialogue and interactions in text-based RPGs. The model provides efficient performance without compromising on quality. | |
| ## Use Cases | |
| - **Role-playing Games (RPGs)**: Generate character dialogues and plot interactions in text-based RPGs. |