Ho to run this?
text-generation-webui does not run this with transformers
Yes, this is to be expected. You cannot run this as of now as this is just the model files, the code to run the model doesn’t exist yet.
Yes, this is to be expected. You cannot run this as of now as this is just the model files, the code to run the model doesn’t exist yet.
Are any of these unofficial Gemini nano models locally runnable? There is gguf (https://huggingface.co./NeuroDonu/Mini-Gemini-Quants/tree/main) but that model produces gibberish.
Yes, this is to be expected. You cannot run this as of now as this is just the model files, the code to run the model doesn’t exist yet.
Are any of these unofficial Gemini nano models locally runnable? There is gguf (https://huggingface.co./NeuroDonu/Mini-Gemini-Quants/tree/main) but that model produces gibberish.
They aren’t Gemini Nano. They look like they’re maybe finetunes of existing models like Mixtral 8x7b, not Gemini Nano. So, yes, you can run them, but they’re not Gemini Nano.