MLX
English
llama
File size: 685 Bytes
20df143
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
---
language:
- en
license: cc-by-nc-4.0
tags:
- mlx
datasets:
- c-s-ale/alpaca-gpt4-data
- Open-Orca/OpenOrca
- Intel/orca_dpo_pairs
- allenai/ultrafeedback_binarized_cleaned
base_model:
- upstage/SOLAR-10.7B-v1.0
---

# SOLAR-10.7B-Instruct-v1.0-4bit
This model was converted to MLX format from [`upstage/SOLAR-10.7B-Instruct-v1.0`]().
Refer to the [original model card](https://huggingface.co./upstage/SOLAR-10.7B-Instruct-v1.0) for more details on the model.
## Use with mlx
```bash
pip install mlx
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples/llms/hf_llm
python generate.py --model mlx-community/SOLAR-10.7B-Instruct-v1.0-4bit --prompt "My name is"
```