Failed to create LLM 'llama' from 'models/pandalyst-7b-v1.2.Q5_K_M.gguf'.

by ByteForge - opened Dec 26, 2023

Dec 26, 2023

after running the model under ctransformers, its giving this error? has anyone tried running these gguf models?

Dec 28, 2023

Solved by upgrading ctransformers.

ByteForge changed discussion status to closed Dec 28, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment