pipilok's picture
Create README.md
aca9817 verified
|
raw
history blame contribute delete
No virus
517 Bytes
metadata
language:
  - en
  - fr
  - de
  - es
  - it
  - pt
  - ru
  - zh
  - ja
license: apache-2.0
quantized_by: pipilok
pipeline_tag: text-generation

Original model: https://huggingface.co./mistralai/Mistral-Small-Instruct-2409

Tested on Snapdragon X Elite with LM Studio 0.3.2 ARM64 Technology Preview https://lmstudio.ai/snapdragon

Avg answer Speed: 6 tok/s

LM Studio Settings:

Before System: [INST]<<SYS>>\n
After System: <</SYS>[/INST]\n
Before User: [INST]
After User: [INST]\n
Before Assistant:
After Assistant: