Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
992
•
7
These can run on a NVIDIA GeForce MX150 at a relatively fast performance, load in FP16 if they aren't already BF16 or FP16