which tool did you use to convert zephyr-7B-alpha model into gguf?
I think he used llama-cpp and in particular the convert.py file, since there is not a specific script to convert zephyr to gguf (which is a mistral based model) yet. If you encounter any problem there is this issue or continue this thread.
convert.py
· Sign up or log in to comment