OPEA
/

Molmo-7B-D-0924-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

cicdatopea commited on 23 days ago

Commit

19838f3

·

verified ·

1 Parent(s): 72c90ad

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -98,7 +98,7 @@ auto-round-mllm
 --group_size 128 \
 --bits 4 \
 --iters 1000 \
---nsample 512 \
 --seqlen 2048 \
 --format 'auto_gptq,auto_round' \
 --output_dir "./tmp_autoround"

 --group_size 128 \
 --bits 4 \
 --iters 1000 \
+--nsamples 512 \
 --seqlen 2048 \
 --format 'auto_gptq,auto_round' \
 --output_dir "./tmp_autoround"