jingyeom commited on
Commit
c1d305d
1 Parent(s): 47f8d92

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -3
README.md CHANGED
@@ -1,7 +1,21 @@
1
  ---
2
  license: apache-2.0
3
  ---
4
-
5
  base_model : beomi/OPEN-SOLAR-KO-10.7B
6
- <br>
7
- Dataset: Deduplicating Training Data Makes Language Models Better 알고리즘 활용
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ ## Model
5
  base_model : beomi/OPEN-SOLAR-KO-10.7B
6
+ ## Dataset
7
+ * 공개 데이터 수집
8
+ * Deduplicating Training Data Makes Language Models Better 알고리즘 활용
9
+
10
+ ## Code
11
+ ```python
12
+ ### KO-Platypus
13
+ from transformers import AutoModelForCausalLM, AutoTokenizer
14
+ import torch
15
+
16
+ model_name = "jingyeom/SOLAR_KO_1.3_deup"
17
+ model = AutoModelForCausalLM.from_pretrained(
18
+ model_name,
19
+ )
20
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
21
+ ```