Adding `safetensors` variant of these models
#1
by
neggles
- opened
This PR adds a safetensors
variant of these models.
This is essentially identical to the PyTorch state dict file, but safe in the sense that no arbitrary code can be put into it.
These files also happen to load much faster than their pytorch counterpart:
https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb
also hi nubby lol <3
(what, did you think i'd just use their tool instead of hacking it up myself?)
Thanks neggles!
nubby
changed pull request status to
merged