A quantized version of Shinoji Research's Senku 70B Full. Quantized through AWQ:

Quantization settings:

{"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }

Downloads last month: 9

Safetensors

Model size

9.68B params

Tensor type

I32

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.