File size: 5,644 Bytes
ce95292 aa9660e ce95292 6a3b5d6 ce95292 6a3b5d6 ce95292 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 |
---
license: apache-2.0
language:
- en
- ja
pipeline_tag: text-generation
library_name: transformers
base_model: pfnet/plamo-2-1b
tags:
- mlx
---
# mlx-community/plamo-2-1b-bf16
The Model [mlx-community/plamo-2-1b-bf16](https://huggingface.co./mlx-community/plamo-2-1b-bf16) was
converted to MLX format from [pfnet/plamo-2-1b](https://huggingface.co./pfnet/plamo-2-1b)
using mlx-lm version **0.21.5**.
## Use with mlx
```bash
# numba is required for the new PLaMo tokenizer
pip install mlx numba
pip install -U 'git+https://github.com/mitmul/mlx-examples.git@mitmul/fix-plamo2#egg=mlx-lm&subdirectory=llms'
```
```bash
python -m mlx_lm.generate \
--model mlx-community/plamo-2-1b-bf16 \
--prompt '## ็พๅณใใใซใฌใผใฎไฝใๆน:\n' \
--ignore-chat-template \
--max-tokens 1024 \
--extra-eos-token '<|plamo:bos|>' \
--temp 0.7 \
--seed 0
Fetching 8 files: 100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 8/8 [00:00<00:00, 68338.97it/s]
==========
### ๆ้ 1๏ผ้ฃๆใฎ่ณผๅ
ฅใจๆบๅ
ใซใฌใผใฎๆๆใ้ใใพใใใใ
- ใธใฃใฌใคใข 2 ๅ
- ็ใญใ 2 ๅ
- ใใใชใซ ๏ผๅ
- ใใณใใฏ 3 ็
- ในใใคใน๏ผใฏใใณใใณใชใขใณใใผใใฌใฉใ ใใตใฉใชใฉ๏ผ
- ใซใฌใผ็ฒ
- ๆฐด
- ๅกฉ
- ๆฒน
- ใซใฌใผใซใผ
### ๆ้ 2๏ผ้ฉๅใช้่ใฎๆบๅ
ใในใฆใฎๆๆใๆดใฃใฆใ่ๅใใซใใพใใ
- ใธใฃใฌใคใขใใใใใซๆดใใๅใคๅใใซใใพใใ
- ็ใญใใใใใใซๆดใใในใฉใคในใใพใใ
- ใใใชใซใๆดใฃใฆใในใฉใคในใใพใใ
- ใซใใซใใ่ใในใฉใคในใใพใใ
### ๆ้ 3๏ผในใใคในใฎๆบๅ
ในใใคในใๆบๅใใพใ๏ผ
- ใฏใใณใใณใชใขใณใใผใใฌใฉใ ใใตใฉใชใฉใๅในใใคในใ้ใซๅฟใใฆใใใใๆบๅใใพใใ
### ๆ้ 4๏ผ้่ใฎใฝใใผ
้่ใใฝใใผใใพใ๏ผ
- ไธญ็ซใงๅคงใใช้ใ็ฑใใๆฒนใ็ฑใใพใใ
- ไธญ็ซใใไธญ็ซใงใๆฒนใ็ฑใใชใใใใชใ็จๅบฆใซ็ฑใใพใใ
- ็ใญใใจในใฉใคในใใใใใชใซใๅ ใใๆใ
ใใๆททใใชใใใๆใใใใชใใพใง็ใใพใใ
### ๆ้ 5๏ผในใใคในใ็ใใ
ในใใคในใๅ ใใ๏ผ
- ใฏใใณใใณใชใขใณใใผใใณใชใขใณใใผใปใฌใฉใ ใใตใฉใชใฉใฎในใใคในใๅ ใใในใใคในใๆบถใใใพใงใใๆททใใพใใ
### ๆ้ 6๏ผใใใใใใ็ใใ
ใใใใใใ็ใใ๏ผ
- ใธใฃใฌใคใขใ็ฑใใๆฒนใฎไธญใซใใฃใจๅ
ฅใใๆใ
ใใๆททใใชใใใๅบใ็ฆใใชใใใใซใใพใใ
### ๆ้ 7๏ผๆๆใๆททใใ
ๆๆใๆททใใ:
- ็
ฎ่พผใใ ใธใฃใฌใคใขใ้ใซๆปใใใใใซในใใคในใๅ ใใๆฐดใจๅกฉใๅ ใใๅกฉใๅคงใใ1/2ๅ ใใพใใ
### ๆ้ 8๏ผ็
ฎ่พผใ
็
ฎ่พผใ๏ผ
- ็ซใๅผฑใใใใๆททใใชใใใใฃใใใจ็
ฎ่พผใฟใพใใ
- ็ด10ๅ้ใๆใ
ใใๆททใใชใใใๆฐดๅใ่ถณใใชใใชใใพใง็
ฎ่พผใฟใพใใ
- ๆฐดใฎ้ใๅคงใใ1/2ๆธใใใๆฎใใฎๆฐดใๅ ใใพใใ
### ๆ้ 9๏ผๅณใ่ชฟใใ
ๅณใ่ชฟใใ๏ผ
- ๅกฉใใใฟใผใใฟใผใกใชใใฏใ้่ใซๆฏใใใใพใใ
- ใซใฌใผใๅบๆฅไธใใฃใใใๅฐ้บฆ็ฒใใณใผใณในใฟใผใใงใจใใฟใใคใใพใใ
### ๆ้ 10๏ผ็ใไปใ
็ใไปใ๏ผ
- ๅฎๆใใใซใฌใผใใ็ฟใซๆณจใใใณใณใใใใใซใฏใใใใฆๅบๆฅไธใใใพใใ
ใใใใฎๆ้ ใซๅพใใใจใงใ็พๅณใใ่ชๅฎถ่ฃฝใคใณใใซใฌใผใไฝใใใจใใงใใพใใ
### ใคใณใใซใฌใผใฎใฌใทใใซ้ขใใใใใใ่ณชๅ
Q1: ใซใฌใผใฎๆๆใฏไฝใงใใ๏ผ
A1: ใซใฌใผใฎๆๆใฏใ้่ใ้ฆ่พๆใในใใคในใในใใคในใๆฐดใๅกฉใใใฟใผใๅฐ้บฆ็ฒใๆฒนใชใฉใงใใใปใจใใฉใฎใซใฌใผใซใฏใใใใฎๆๆใไฝฟใใใฆใใพใใ
Q2: ใซใฌใผใใใใใใใๆนๆณใฏ๏ผ
A2: ใซใฌใผใใใใใใใๆนๆณใฏใในใใคในใใพใในใใชใไฝฟใไบใจใใซใฌใผใฎไฝใๆนใงใใไพใใฐใใฏใใณใใณใชใขใณใใผใใฟใผใกใชใใฏใใซใซใใขใณใใฏใญใผใใใใงใใฐใชใผใฏใใใชใใฌใฉใ ใใตใฉใชใฉใไธ่ฌ็ใซไฝฟใใใฆใใพใใ
Q3: ใชใใซใฌใผใไฝใใฎใงใใ๏ผ
A3: ใชใใซใฌใผใไฝใใฎใใจใใใจใใซใฌใผใฏ็พๅณใใใฆใๅฅๅบท็ใ ใใใงใใใพใใๆงใ
ใชในใใคในใใใผใใ่ชฟๅณๆใ็ตใฟๅใใใใใจใงใๆงใ
ใช้ขจๅณใๅนๆใๅพใใใจใใงใใพใใ
Q4: ใซใฌใผใ่ธใใฎใงใใ๏ผ
A4: ใใใใใซใฌใผใ่ธใใฎใฏไธ่ฌ็ใงใฏใใใพใใใใๅฟใใๆใใใถใผใใจใใฆ้ฃในใๅ ดๅใฏใ้่ใใใซใผใใใใใใ่ธใใฆไฝใใใจใๅบๆฅใพใใ
Q5: ใซใฌใผใฎไฝใๆนใๆใใฆใใ ใใใ
A5: ใซใฌใผใฎไฝใๆนใๆใใฆใใ ใใใในใใคในใ็ฑใใฆใ้ฃๆใ้ฉๅใซ่ชฟ็ใใฆใ่ชฟ็ใใในใใคในใจในใใคในใๆฐดใๅกฉใใใฟใผใๅฐ้บฆ็ฒใๆฒนใใฏใชใผใ ใใใผในใใชใฉใๅ ใใฆ็
ฎ่พผใใ ใใงใใ
==========
Prompt: 8 tokens, 156.478 tokens-per-sec
Generation: 738 tokens, 86.598 tokens-per-sec
Peak memory: 2.741 GB
```
You can also write your code to use this model like this:
```python
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/plamo-2-1b-bf16")
prompt = "็พๅณใใใซใฌใผใฎไฝใๆนใฎใฌใทใใ็ดนไปใใพใใ"
response = generate(model, tokenizer, prompt=prompt, verbose=True)
```
|