CarrotAI commited on
Commit
1c379a8
โ€ข
1 Parent(s): be33181

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +90 -0
README.md ADDED
@@ -0,0 +1,90 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ datasets:
4
+ - CarrotAI/ko-instruction-dataset
5
+ - CarrotAI/Korean-sharegpt-dataset
6
+ - CarrotAI/qa-ko-dataset
7
+ language:
8
+ - ko
9
+ pipeline_tag: text-generation
10
+ ---
11
+
12
+ [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
13
+
14
+ ## Model Details
15
+
16
+ ์ƒ์„ฑํ•œ ํ•œ๊ตญ์–ด ๋ฐ์ดํ„ฐ์…‹์œผ๋กœ axolotl์„ ์ด์šฉํ•˜์—ฌ ํŒŒ์ธํŠœ๋‹ํ•˜์˜€์Šต๋‹ˆ๋‹ค.
17
+
18
+ ### Model Description
19
+
20
+ Qwen/Qwen2-1.5B-Instruct ๋ชจ๋ธ์„ ์ด์šฉํ•˜์—ฌ ์ƒ์„ฑํ•˜์˜€์Šต๋‹ˆ๋‹ค.
21
+
22
+ ### LogicKor
23
+
24
+ default
25
+
26
+ | Category | Single turn | Multi turn |
27
+ |---|---|---|
28
+ | ์ถ”๋ก (Reasoning) | 4.14 | 2.29 |
29
+ | ์ˆ˜ํ•™(Math) | 2.43 | 1.14 |
30
+ | ๊ธ€์“ฐ๊ธฐ(Writing) | 6.43 | 7.86 |
31
+ | ์ฝ”๋”ฉ(Coding) | 5.14 | 4.57 |
32
+ | ์ดํ•ด(Understanding) | 5.29 | 4.57 |
33
+ | ๋ฌธ๋ฒ•(Grammar) | 3.71 | 1.29 |
34
+
35
+ | Category | Score |
36
+ |---|---|
37
+ | Single turn | 4.52 |
38
+ | Multi turn | 3.62 |
39
+ | Overall | 4.07 |
40
+
41
+
42
+
43
+ 1-shot
44
+
45
+ | Category | Single turn | Multi turn |
46
+ |---|---|---|
47
+ | ์ถ”๋ก (Reasoning) | 4.14 | 1.43 |
48
+ | ์ˆ˜ํ•™(Math) | 2.86 | 1.00 |
49
+ | ๊ธ€์“ฐ๊ธฐ(Writing) | 5.00 | 4.57 |
50
+ | ์ฝ”๋”ฉ(Coding) | 3.14 | 3.43 |
51
+ | ์ดํ•ด(Understanding) | 4.29 | 3.71 |
52
+ | ๋ฌธ๋ฒ•(Grammar) | 2.71 | 1.43 |
53
+
54
+ | Category | Score |
55
+ |---|---|
56
+ | Single turn | 3.69 |
57
+ | Multi turn | 2.60 |
58
+ | Overall | 3.14 |
59
+
60
+ cot-1-shot
61
+ | Category | Single turn | Multi turn |
62
+ |---|---|---|
63
+ | ์ถ”๋ก (Reasoning) | 3.00 | 2.86 |
64
+ | ์ˆ˜ํ•™(Math) | 1.57 | 1.00 |
65
+ | ๊ธ€์“ฐ๊ธฐ(Writing) | 5.86 | 6.00 |
66
+ | ์ฝ”๋”ฉ(Coding) | 4.29 | 4.14 |
67
+ | ์ดํ•ด(Understanding) | 3.43 | 3.43 |
68
+ | ๋ฌธ๋ฒ•(Grammar) | 3.00 | 1.14 |
69
+
70
+ | Category | Score |
71
+ |---|---|
72
+ | Single turn | 3.52 |
73
+ | Multi turn | 3.10 |
74
+ | Overall | 3.31 |
75
+
76
+
77
+ ### Applications
78
+ This fine-tuned model is particularly suited for [mention applications, e.g., chatbots, question-answering systems, etc.]. Its enhanced capabilities ensure more accurate and contextually appropriate responses in these domains.
79
+
80
+ ### Limitations and Considerations
81
+ While our fine-tuning process has optimized the model for specific tasks, it's important to acknowledge potential limitations. The model's performance can still vary based on the complexity of the task and the specificities of the input data. Users are encouraged to evaluate the model thoroughly in their specific context to ensure it meets their requirements.
82
+
83
+
84
+ ```
85
+ @article{Carrot-Ko-2.1B-Instruct,
86
+ title={CarrotAI/Carrot-Ko-2.1B-Instruct Card},
87
+ author={CarrotAI (L, GEUN)},
88
+ year={2024},
89
+ url = {https://huggingface.co/CarrotAI/Carrot-2.1B-Instruct}
90
+ }