turboderp
/

CodeLlama-34B-instruct-exl2

Model card Files Files and versions Community

CodeLlama-34B-instruct-exl2 / README.md

turboderp's picture

Create README.md

357fce7 about 1 year ago

|

746 Bytes

EXL2 quants of CodeLlama2-34B

2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.65 bits per weight
6.00 bits per weight

measurement.json