Hugging Face's logo

ENOT-AutoDL
/
gpt-j-6B-tensorrt-int8

Text Generation
Transformers
ONNX
English
text-generation-inference
causal-lm
int8
tensorrt
ENOT-AutoDL
Inference Endpoints
Model card Files Community
2
gpt-j-6B-tensorrt-int8

Commit History

updated metrics table
2b7d07d

igor commited on

updated README
8245433

igor commited on

added onnx model (fake quant) compatible with trt
554833e

igor commited on

updated README.md (added latency table)
2db91ae

ivkalgin commited on

fixed typo
292111d

ivkalgin commited on

added direct link to github repo, fixed text
4f0d13d

ivkalgin commited on

fixed link to example
2643a65

ivkalgin commited on

fixed accuracy in validation table
23e6d15

ivkalgin commited on

Create README.md (#1)
23da18b

ivkalgin commited on

added 2080ti engine
d78be47

ivkalgin commited on

added 4090 engine
74702df

ivkalgin commited on

normalized engine name
bf4729c

ivkalgin commited on

added engine for rtx3080ti
ca37425

ivkalgin commited on

initial commit
8912b4c

ivkalgin commited on