blueflag commited on
Commit
4c32fcc
โ€ข
1 Parent(s): 3710b2f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -0
README.md CHANGED
@@ -20,3 +20,28 @@ tags:
20
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
23
+
24
+ ## Basic template
25
+ ```python
26
+ prompt = f'''Translate Human sentences into {์–ธ์–ด์„ค์ •. ์˜ˆ๋ฅผ๋“ค์–ด ์›๋ฌธ์ด ์˜์–ด๋ผ๋ฉด Korean๋ฅผ์„ ๋„ฃ๊ณ  ์›๋ฌธ์ด ํ•œ๊ธ€์ด๋ผ๋ฉด English๋ฅผ ๋„ฃ์–ด์ฃผ๋ฉด ๋ฉ๋‹ˆ๋‹ค} in short. Do not add anything else.\nHuman: {๋ฒˆ์—ญํ•  ๋ฌธ๊ตฌ}\nAssistant:\n'''
27
+ ```
28
+
29
+ ### ํŒŒ์ธํŠœ๋‹ ๋™๊ธฐ
30
+ ๊ทธ๋™์•ˆ ai์˜ ํ™˜๊ฐํ˜„์ƒ ๋•Œ๋ฌธ์— ๋ฒˆ์—ญํ›„ ์—„์ฒญ๋‚œ ํ›„์ฒ˜๋ฆฌ๋ฅผ ํ•ด์•ผํ–ˆ๊ณ  ๊ทธ๋ ‡๊ฒŒ ํ–ˆ์Œ์—๋„ ์—ฌ์ „ํžˆ ๋งŽ์€ ํ™˜๊ฐ๋ฌธ๊ตฌ๋“ค์„ ํ•ด๊ฒฐํ•˜์ง€ ๋ชปํ•˜๊ณ  ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค
31
+
32
+ ### ์ด ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•˜์‹œ๋ฉด
33
+ ์œ„์—์„œ ์ œ๊ณตํ•œ basic template๋ฅผ ์ด์šฉํ•ด ๋ฒˆ์—ญ์š”์ฒญ์„ ํ•˜์‹œ๋ฉด transformer์˜ pipeline์—์„œ translation์„ ์‚ฌ์šฉํ•œ ๊ฒƒ์ฒ˜๋Ÿผ ๊น”๋”ํ•œ ๋ฒˆ์—ญ์ด ๊ฐ€๋Šฅํ•ด์ง‘๋‹ˆ๋‹ค.
34
+
35
+ ### ๋ฒˆ์—ญ ํŒ
36
+ ๋ฒˆ์—ญ ์ „, ํŠน์ˆ˜๋ฌธ์ž๋“ค์„ ์ œ๊ฑฐํ•˜๊ฑฐ๋‚˜ ํ•˜์ดํ”ˆ(-)์œผ๋กœ replace ํ•ด์ฃผ์„ธ์š”. ํŠนํžˆ ์ฝœ๋ก ( : )์ด ํ™˜๊ฐ ์œ ๋ฐœ์˜ ์ฃผ๋ฒ”์ž…๋‹ˆ๋‹ค.
37
+
38
+ ### ํŒŒ์ธํŠœ๋‹ ๋ฐ์ดํ„ฐ์…‹์€ ์–ธ์ œ ๊ณต๊ฐœํ•˜๋‚˜์š”?
39
+ ๋ฐ์ดํ„ฐ์…‹์„ ๊ณ„์† ๋ฐ”๊ฟ”๊ฐ€๋ฉฐ ํŒŒ์ธํŠœ๋‹ ํ…Œ์ŠคํŠธ๋ฅผ ํ•˜๋‹ค๋ณด๋‹ˆ ๊ณต๊ฐœ๊ฐ€ ๋Šฆ์–ด์ง€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ์ฒ˜์Œ์—๋Š” ์•ผ์‹ฌ์ฐจ๊ฒŒ ์ˆ˜๋งŒ๊ฐœ์˜ ๋ฐ์ดํ„ฐ๋ฅผ ๋งŒ๋“ค์–ด ๋Œ๋ ธ์œผ๋‚˜ ๊ฒฐ๊ตญ 2์ฒœ๊ฐœ๋„ ๋˜์ง€ ์•Š๋Š” ๋ฐ์ดํ„ฐ๋งŒ์œผ๋กœ๋„ ํŒŒ์ธํŠœ๋‹์ด ์ž˜๋œ๋‹ค๋Š”๊ฑธ ๊นจ๋‹ฌ์•˜์Šต๋‹ˆ๋‹ค.
40
+ aiํ—ˆ๋ธŒ์˜ ์ƒ˜ํ”Œ ๋ฐ์ดํ„ฐ ์†Œ๋Ÿ‰๊ณผ ์ง์ ‘๋งŒ๋“  {์˜์–ด:ํ•œ๊ธ€} ๋ฐ์ดํ„ฐ์…‹์œผ๋กœ ํ•™์Šต์‹œ์ผฐ์Šต๋‹ˆ๋‹ค.
41
+ ์ด๋Ÿฐ ๋ฐ์ดํ„ฐ์…‹์„ ์ถ”๊ฐ€ํ•œ ์ด์œ ๋Š” ์˜์–ด ๋‹จ์–ด ํ•˜๋‚˜๋งŒ ๋ฒˆ์—ญํ•˜๋ผ๊ณ  ์‹œ์ผฐ์„ ๊ฒฝ์šฐ ai์˜ ํŠน์„ฑ์ƒ '๋ง์ด ๋งŽ๊ธฐ ๋•Œ๋ฌธ์—' ๋ฒˆ์—ญ๋งŒ ํ•˜๋Š”๊ฒŒ ์•„๋‹ˆ๋ผ ํ•„์š”์—†๋Š” ์‚ฌ์กฑ๋“ค์ด ๊ณ„์† ๋ถ™์–ด์„œ์ž…๋‹ˆ๋‹ค.
42
+ ํŠน๋ณ„ํ• ๊ฒŒ ์—†๋Š” ๋ฐ์ดํ„ฐ์…‹์ด์ง€๋งŒ ์—…๋กœ๋“œ ํ›„ ์ด๊ณณ์— ๋‹ค์‹œ ์•Œ๋ฆฌ๊ฒ ์Šต๋‹ˆ๋‹ค.
43
+
44
+ ### ๋„๋‹ค๋ฆฌ ๊ณ ๊ธ‰๋ฒˆ์—ญ ์†Œ์Šค ์ฝ”๋“œ๋Š” ์–ธ์ œ ๊ณต๊ฐœ๋˜๋‚˜์š”?
45
+ ์ง€๊ธˆ ์ฝ”๋“œ๋Š” ๋„๋‹ค๋ฆฌ ์ผ๋ฐ˜๋ฒˆ์—ญ๊ณผ ๋‹ฌ๋ฆฌ ๋ณดํ†ต์‚ฌ๋žŒ๋“ค์ด ์‚ฌ์šฉํ•˜๊ธฐ ์–ด๋ ค์šด ux๋ฅผ ๊ฐ€์ง€๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. s3์ฝ”๋“œ๋‚˜ email๋ฐœ์†ก, ์‚ฌ์šฉ์‹œ๊ฐ„ ํƒ€์ด๋จธ์ฒ˜๋Ÿผ ์ผ๋ฐ˜์‚ฌ๋žŒ๋“ค์—๊ฒŒ ํ•„์š”์—†๋Š” ๊ธฐ๋Šฅ๋“ค๋„ ์žˆ์Šต๋‹ˆ๋‹ค.
46
+ ์—ฌ๊ธฐ์— gguf๋ฅผ ํ†ตํ•ด cpu๋กœ ๊ตฌ๋™ํ• ์ˆ˜ ์žˆ๊ฒŒ ๋งŒ๋“ค๊ณ  vllm์„ ์‚ฌ์šฉํ•  ์ˆ˜ ์—†๋Š” ํ™˜๊ฒฝ์—์„œ๋„ ๋ฒˆ์—ญ์ด ๊ฐ€๋Šฅํ•˜๋„๋ก ์ˆ˜์ •ํ•ด์•ผํ•ฉ๋‹ˆ๋‹ค.
47
+ ๊ณต๊ฐœ๊ฐ€ ๋˜๋ฉด ์—ฌ๊ธฐ์—๋„ ์—…๋ฐ์ดํŠธ ํ•ด๋†“๊ฒ ์Šต๋‹ˆ๋‹ค.