Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
model params?
#260
by
jjaaaww
- opened
How can params are calculated? Some models have small size of params but superior performences like "TheBloke/Genz-70b-GPTQ".
This comment has been hidden
Hi!
Please see this issue on the topic: the number of parameters is computed using safetensors, which has trouble managing quantized models :)
We are working on it as fast as we can!
clefourrier
changed discussion status to
closed
(closing because a duplicate issue)