Config file missing for ctransformers
#3
by
jobenb
- opened
Hi mate, I am trying to run this model using just the HuggingFace model id and I am getting this error:
OSError: TheBloke/orca_mini_v2_7B-GGML does not appear to have a file named config.json. Checkout 'https://huggingface.co./TheBloke/orca_mini_v2_7B-GGML/main' for available files.
Are you planning to add a config.json file?
Love your work BTW :)
Yeah I do plan to at some point. It's added to new GGML repos, and I always added it for non-llama models, but it's not in most of the llama GGML repos
In the meantime just add model_type="llama" to your ctransformers call and it won't need to read config.json
Thank you, will do :)