---
license: apache-2.0
tags:
  - quantization
  - awq-marlin
  - role-playing
model-index:
  - name: "AWQ-Marlin Quantization"
    results:
      - task: "text-generation"
        metrics:
          - name: "q_group_size"
            value: 128
          - name: "w_bit"
            value: 4
---

# AWQ-Marlin Quantization Model

This model is based on the AWQ-Marlin quantization technique and is optimized for role-playing scenarios. It has been trained to generate dialogue and interactions in text-based RPGs. The model provides efficient performance without compromising on quality.

## Use Cases
- **Role-playing Games (RPGs)**: Generate character dialogues and plot interactions in text-based RPGs.