gguf quant please!!
hi guys any gguf quant ?
I'm curious. I hope someone uploads GGUF.
I'm curious. I hope someone uploads GGUF.
It seems there's a no-sharing clause in this license. Unless LG releases it directly, it will be difficult to share.
Just LOL
Most useless license I ever seen!
You even own output ?....lol x2
You can go to the forest with that sh** and burry .
Lol
GGUF!!!! γ γ
If it's public, please provide the gguf format so I can try it, or change it to a license that allows me to convert it. γ γ γ γ γ γ
You can llamafy EXAONE by referring to the followings. Thanks to maywell and CarrotAI.
- maywell/EXAONE-3.0-7.8B-Instruct-Llamafied
- CarrotAI/EXAONE-3.0-7.8B-Instruct-Llamafied-cpuYou can resolve the issues that occur when converting the above EXAONE-Llamafied to GGUF format and inferencing the converted GGUF using llama.cpp by referring to the following.
- https://huggingface.co./LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct/discussions/8