elinas
/

llama-30b-int4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

elinas commited on Mar 18, 2023

Commit

9173230

•

1 Parent(s): 2f4a437

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,7 +3,7 @@ license: other
 ---
 # llama-30b-int4
-This has been converted to int4 via GPTQ method. This requires some special support code that is also highly experimental. NOT COMPATIBLE WITH TRANSFORMERS LIBRARY.
 https://github.com/qwopqwop200/GPTQ-for-LLaMa

 ---
 # llama-30b-int4
+This has been converted to int4 via GPTQ method. See the repo below for more info.
 https://github.com/qwopqwop200/GPTQ-for-LLaMa