File size: 2,811 Bytes
a58c66d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
022aa72
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0294a3a
022aa72
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
---
base_model: yanolja/EEVE-Korean-Instruct-10.8B-v1.0
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
---

# Uploaded  model

- **Developed by:** blueflag
- **License:** apache-2.0
- **Finetuned from model :** yanolja/EEVE-Korean-Instruct-10.8B-v1.0

This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)

## Basic template
```python
prompt = f'''Translate Human sentences into {์–ธ์–ด์„ค์ •. ์˜ˆ๋ฅผ๋“ค์–ด ์›๋ฌธ์ด ์˜์–ด๋ผ๋ฉด Korean๋ฅผ์„ ๋„ฃ๊ณ  ์›๋ฌธ์ด ํ•œ๊ธ€์ด๋ผ๋ฉด English๋ฅผ ๋„ฃ์–ด์ฃผ๋ฉด ๋ฉ๋‹ˆ๋‹ค} in short. Do not add anything else.\nHuman: {๋ฒˆ์—ญํ•  ๋ฌธ๊ตฌ}\nAssistant:\n'''
```

### ํŒŒ์ธํŠœ๋‹ ๋™๊ธฐ
๊ทธ๋™์•ˆ ai์˜ ํ™˜๊ฐํ˜„์ƒ ๋•Œ๋ฌธ์— ๋ฒˆ์—ญํ›„ ์—„์ฒญ๋‚œ ํ›„์ฒ˜๋ฆฌ๋ฅผ ํ•ด์•ผํ–ˆ๊ณ  ๊ทธ๋ ‡๊ฒŒ ํ–ˆ์Œ์—๋„ ์—ฌ์ „ํžˆ ๋งŽ์€ ํ™˜๊ฐ๋ฌธ๊ตฌ๋“ค์„ ํ•ด๊ฒฐํ•˜์ง€ ๋ชปํ•˜๊ณ  ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค

### ์ด ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•˜์‹œ๋ฉด
์œ„์—์„œ ์ œ๊ณตํ•œ basic template๋ฅผ ์ด์šฉํ•ด ๋ฒˆ์—ญ์š”์ฒญ์„ ํ•˜์‹œ๋ฉด transformer์˜ pipeline์—์„œ translation์„ ์‚ฌ์šฉํ•œ ๊ฒƒ์ฒ˜๋Ÿผ ๊น”๋”ํ•œ ๋ฒˆ์—ญ์ด ๊ฐ€๋Šฅํ•ด์ง‘๋‹ˆ๋‹ค.

### ๋ฒˆ์—ญ ํŒ
๋ฒˆ์—ญ ์ „, ํŠน์ˆ˜๋ฌธ์ž๋“ค์„ ์ œ๊ฑฐํ•˜๊ฑฐ๋‚˜ ํ•˜์ดํ”ˆ(-)์œผ๋กœ replace ํ•ด์ฃผ์„ธ์š”. ํŠนํžˆ ์ฝœ๋ก ( : )์ด ํ™˜๊ฐ ์œ ๋ฐœ์˜ ์ฃผ๋ฒ”์ž…๋‹ˆ๋‹ค.

### ํŒŒ์ธํŠœ๋‹ ๋ฐ์ดํ„ฐ์…‹์€ ์–ธ์ œ ๊ณต๊ฐœํ•˜๋‚˜์š”?
๋ฐ์ดํ„ฐ์…‹์„ ๊ณ„์† ๋ฐ”๊ฟ”๊ฐ€๋ฉฐ ํŒŒ์ธํŠœ๋‹ ํ…Œ์ŠคํŠธ๋ฅผ ํ•˜๋‹ค๋ณด๋‹ˆ ๊ณต๊ฐœ๊ฐ€ ๋Šฆ์–ด์ง€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ์ฒ˜์Œ์—๋Š” ์•ผ์‹ฌ์ฐจ๊ฒŒ ์ˆ˜๋งŒ๊ฐœ์˜ ๋ฐ์ดํ„ฐ๋ฅผ ๋งŒ๋“ค์–ด ๋Œ๋ ธ์œผ๋‚˜ ๊ฒฐ๊ตญ 2์ฒœ๊ฐœ๋„ ๋˜์ง€ ์•Š๋Š” ๋ฐ์ดํ„ฐ๋งŒ์œผ๋กœ๋„ ํŒŒ์ธํŠœ๋‹์ด ์ž˜๋œ๋‹ค๋Š”๊ฑธ ๊นจ๋‹ฌ์•˜์Šต๋‹ˆ๋‹ค.
aiํ—ˆ๋ธŒ์˜ ์ƒ˜ํ”Œ ๋ฐ์ดํ„ฐ ์†Œ๋Ÿ‰๊ณผ ์ง์ ‘๋งŒ๋“  {์˜์–ด:ํ•œ๊ธ€} ๋ฐ์ดํ„ฐ์…‹์œผ๋กœ ํ•™์Šต์‹œ์ผฐ์Šต๋‹ˆ๋‹ค. 
์ด๋Ÿฐ ๋ฐ์ดํ„ฐ์…‹์„ ์ถ”๊ฐ€ํ•œ ์ด์œ ๋Š” ์˜์–ด ๋‹จ์–ด ํ•˜๋‚˜๋งŒ ๋ฒˆ์—ญํ•˜๋ผ๊ณ  ์‹œ์ผฐ์„ ๊ฒฝ์šฐ ai์˜ ํŠน์„ฑ์ƒ '๋ง์ด ๋งŽ๊ธฐ ๋•Œ๋ฌธ์—' ๋ฒˆ์—ญ๋งŒ ํ•˜๋Š”๊ฒŒ ์•„๋‹ˆ๋ผ ํ•„์š”์—†๋Š” ์‚ฌ์กฑ๋“ค์ด ๊ณ„์† ๋ถ™์–ด์„œ์ž…๋‹ˆ๋‹ค.
~ํŠน๋ณ„ํ• ๊ฒŒ ์—†๋Š” ๋ฐ์ดํ„ฐ์…‹์ด์ง€๋งŒ ์—…๋กœ๋“œ ํ›„ ์ด๊ณณ์— ๋‹ค์‹œ ์•Œ๋ฆฌ๊ฒ ์Šต๋‹ˆ๋‹ค~ โ†’ ์—…๋กœ๋“œ ์™„๋ฃŒํ–ˆ์Šต๋‹ˆ๋‹ค.

### ๋„๋‹ค๋ฆฌ ๊ณ ๊ธ‰๋ฒˆ์—ญ ์†Œ์Šค ์ฝ”๋“œ๋Š” ์–ธ์ œ ๊ณต๊ฐœ๋˜๋‚˜์š”?
์ง€๊ธˆ ์ฝ”๋“œ๋Š” ๋„๋‹ค๋ฆฌ ์ผ๋ฐ˜๋ฒˆ์—ญ๊ณผ ๋‹ฌ๋ฆฌ ๋ณดํ†ต์‚ฌ๋žŒ๋“ค์ด ์‚ฌ์šฉํ•˜๊ธฐ ์–ด๋ ค์šด ux๋ฅผ ๊ฐ€์ง€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. s3์ฝ”๋“œ๋‚˜ email๋ฐœ์†ก, ์‚ฌ์šฉ์‹œ๊ฐ„ ํƒ€์ด๋จธ์ฒ˜๋Ÿผ ์ผ๋ฐ˜์‚ฌ๋žŒ๋“ค์—๊ฒŒ ํ•„์š”์—†๋Š” ๊ธฐ๋Šฅ๋“ค๋„ ์žˆ์Šต๋‹ˆ๋‹ค. 
์—ฌ๊ธฐ์— gguf๋ฅผ ํ†ตํ•ด cpu๋กœ ๊ตฌ๋™ํ• ์ˆ˜ ์žˆ๊ฒŒ ๋งŒ๋“ค๊ณ  vllm์„ ์‚ฌ์šฉํ•  ์ˆ˜ ์—†๋Š” ํ™˜๊ฒฝ์—์„œ๋„ ๋ฒˆ์—ญ์ด ๊ฐ€๋Šฅํ•˜๋„๋ก ์ˆ˜์ •ํ•ด์•ผํ•ฉ๋‹ˆ๋‹ค.
๊ณต๊ฐœ๊ฐ€ ๋˜๋ฉด ์—ฌ๊ธฐ์—๋„ ์—…๋ฐ์ดํŠธ ํ•ด๋†“๊ฒ ์Šต๋‹ˆ๋‹ค.