Intel
/

falcon-7b-int4-inc

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

falcon-7b-int4-inc

Commit History

Update README.md

581dd2e
verified

weiweiz1 commited on Aug 26

Update README.md

393410e
verified

yintongl commited on May 31

Update README.md

d0f9be1
verified

wenhuach commited on May 28

replace with groupsize 64

736dd5e

wenhuach commited on May 28

update autoround script following enable_quanted_input argument change

7a06303
verified

yintongl commited on Apr 28

Update README.md

d3f8d20
verified

wenhuach commited on Mar 22

add model file：

3b242d1

wenhuach commited on Mar 22

initial commit

be51a7f
verified

wenhuach commited on Mar 22