Duplicated from John6666/quantizer
c557532
1
2
3
4
5
6
7
8
huggingface-hub gdown safetensors torch transformers==4.44.0 bitsandbytes peft accelerate