Spaces:

GameScribes
/

Multipurpose-AI-Agent-Development

Starting on T4

devve1 commited on Jun 27

Commit

c7e3833

•

1 Parent(s): c42b490

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -188,8 +188,8 @@ def load_models_and_documents():
             repo_id="MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF",
             filename="*Q8_0.gguf",
             verbose=False,
-            chat_format="chatml",
-            n_ctx=16000,
             n_gpu_layers=32
         )

             repo_id="MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF",
             filename="*Q8_0.gguf",
             verbose=False,
+            chat_format="llama-3",
+            n_ctx=16384,
             n_gpu_layers=32
         )