jais-13b-chat-FP8 / generation_config.json
hangyang-amd's picture
quanitze jais-13b-chat to w_fp8_a_fp8
2685f14 verified
raw
history blame
132 Bytes
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": 0,
"pad_token_id": 0,
"transformers_version": "4.45.2"
}