Trelis

/

Llama-2-7b-chat-hf-hosted-inference-8bit

like 7

Follow

Trelis 91

This is an automated PR created with https://huggingface.co./spaces/safetensors/convert

This new file is equivalent to pytorch_model.bin but safe in the sense that
no arbitrary code can be put into it.

These files also happen to load much faster than their pytorch counterpart:
https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb

The widgets on your model page will run using this model even if this is not merged
making sure the file actually works.

If you find any issues: please report here: https://huggingface.co./spaces/safetensors/convert/discussions

Feel free to ignore this PR.