fix-memory-requirements-for-cpu

#36
by baptistecolle HF staff - opened
Hugging Face Optimum org
No description provided.
Hugging Face Optimum org

This PR corrects the Memory (MB) column for CPUs.

Previously, we used report.decode.memory.max_allocated from optimum-benchmark, which is a GPU-specific value. Now, we use report.decode.memory.max_ram, which accurately reflects the peak RAM consumption during the decoding phase, making it the appropriate metric for CPUs.

baptistecolle changed pull request status to open
baptistecolle changed pull request status to merged

Sign up or log in to comment