`model.safetensors.index.json` still has the legacy name`act_scale` for activation scales
#3
by
Alchan
- opened
I find that safetensors have the updated input scale name input_scale (e.g., model.layers.0.mlp.down_proj.input_scale) while the index json has act_scales (e.g., model.layers.0.mlp.down_proj.act_scale). Have a look on it.
Thanks @Alchan ! I've corrected this with https://huggingface.co./neuralmagic/Meta-Llama-3-8B-Instruct-FP8/discussions/4
mgoin
changed discussion status to
closed