Transformers
GGUF
English
mistral
Generated from Trainer

which tool did you use

#1
by rinoa - opened

which tool did you use to convert zephyr-7B-alpha model into gguf?

I think he used llama-cpp and in particular the convert.py file, since there is not a specific script to convert zephyr to gguf (which is a mistral based model) yet. If you encounter any problem there is this issue or continue this thread.

deleted
This comment has been hidden

Sign up or log in to comment