mNLP-project
/

baseline-gpt2-quantized

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

baseline-gpt2-quantized / quantize_config.json

Commit History

AutoGPTQ model for gpt2-dpo: 8bits, gr128, desc_act=False

63a7a7a
verified

Luca-Engel commited on Jun 12