MLX quantized
#7
by
shaowlnkngfu
- opened
Just fyi, MLX community already has a 4-bit for those who have apple :
https://huggingface.co./mlx-community/c4ai-command-r-plus-4bit
Just fyi, MLX community already has a 4-bit for those who have apple :
https://huggingface.co./mlx-community/c4ai-command-r-plus-4bit