nm-testing
/

granite-8b-code-instruct-128k-W8A8-Dynamic-Per-Token

8-bit precision

compressed-tensors

Model card Files Files and versions Community

granite-8b-code-instruct-128k-W8A8-Dynamic-Per-Token / generation_config.json

horheynm's picture

Upload folder using huggingface_hub

0b5a41b verified 15 days ago

132 Bytes

	{
	"_from_model_config": true,
	"bos_token_id": 0,
	"eos_token_id": 0,
	"pad_token_id": 0,
	"transformers_version": "4.48.0"
	}