Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Trelis
/
Llama-2-7b-chat-hf-hosted-inference-8bit
like
7
Follow
Trelis
91
Text Generation
Transformers
PyTorch
Safetensors
English
llama
facebook
meta
llama-2
hosted inference
8 bit
8bit
8-bit precision
text-generation-inference
Inference Endpoints
arxiv:
2307.09288
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
main
Llama-2-7b-chat-hf-hosted-inference-8bit
2 contributors
History:
10 commits
RonanMcGovern
SFconvertbot
Adding `safetensors` variant of this model (
#1
)
6e9d874
about 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
over 1 year ago
README.md
Safe
11.2 kB
update notes on inference
over 1 year ago
config.json
Safe
981 Bytes
Upload LlamaForCausalLM
over 1 year ago
generation_config.json
Safe
132 Bytes
Upload LlamaForCausalLM
over 1 year ago
model.safetensors
Safe
7.01 GB
LFS
Adding `safetensors` variant of this model (#2)
over 1 year ago
pytorch_model.bin
Safe
pickle
Detected Pickle imports (5)
"collections.OrderedDict"
,
"torch.CharStorage"
,
"torch.FloatStorage"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.HalfStorage"
What is a pickle import?
7.01 GB
LFS
Upload LlamaForCausalLM
over 1 year ago
pytorch_model.bin.index.json
Safe
26.8 kB
Upload LlamaForCausalLM
over 1 year ago
special_tokens_map.json
Safe
414 Bytes
Upload tokenizer
over 1 year ago
tokenizer.json
Safe
1.84 MB
Upload tokenizer
over 1 year ago
tokenizer.model
Safe
500 kB
LFS
Upload tokenizer
over 1 year ago
tokenizer_config.json
Safe
725 Bytes
Upload tokenizer
over 1 year ago