Could we get this model in ggml format?
As I don't have the RAM needed to convert it myself, would it be possible to get this in ggml format? Thanks!
As I don't have the RAM needed to convert it myself, would it be possible to get this in ggml format? Thanks!
https://huggingface.co./Black-Engineer/oasst-llama30b-ggml-q4
Hmm, is that the same model? I was under the impression that this is epoch 2 of a OA + Alpaca tune, whereas the link you sent above is purely OASST. If they're identical, then thanks!
Hmm, is that the same model? I was under the impression that this is epoch 2 of a OA + Alpaca tune, whereas the link you sent above is purely OASST. If they're identical, then thanks!
Oh, yea, sry, Im wrong. They are not the same.
Ah yep, then if you could provide this in GGML it would be nice :)