MaziyarPanahi
/

Meta-Llama-3.1-70B-Instruct-GGUF

Models Q4-K_M and Q5-K_M seems to use 'smaug-bpe' which fails to load the model.

by sayanmndl21 - opened Jul 30

Jul 30

As title

Owner Jul 30

could you please share your full llama.cpp command?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment