kyujinpy commited on
Commit
b2e3ed4
1 Parent(s): 3094647

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -0
README.md CHANGED
@@ -1,3 +1,48 @@
1
  ---
 
 
 
 
 
 
2
  license: cc-by-nc-sa-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - ko
4
+ datasets:
5
+ - kyujinpy/KOR-OpenOrca-Platypus-v3
6
+ library_name: transformers
7
+ pipeline_tag: text-generation
8
  license: cc-by-nc-sa-4.0
9
  ---
10
+
11
+ # **⭐My custom LLM 13B⭐**
12
+
13
+ ## Model Details
14
+ **Model Developers**
15
+ - Kyujin Han (kyujinpy)
16
+
17
+ **Model Architecture**
18
+ - ko-platypus-kiwi-13B is an auto-regressive language model based on the LLaMA2 transformer architecture.
19
+
20
+ **Base Model**
21
+ - [beomi/llama-2-koen-13b](https://huggingface.co/beomi/llama-2-koen-13b)
22
+
23
+ **Training Dataset**
24
+ - [kyujinpy/KOR-OpenOrca-Platypus-v3](https://huggingface.co/datasets/kyujinpy/KOR-OpenOrca-Platypus-v3).
25
+
26
+ # Model comparisons
27
+ | Model | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
28
+ | --- | --- | --- | --- | --- | --- | --- |
29
+ | **⭐My custom LLM 13B⭐** | NaN | NaN | NaN | NaN | NaN | NaN |
30
+ > Ko-LLM leaderboard(11/23; [link](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard))
31
+
32
+ # Implementation Code
33
+ ```python
34
+ ### KO-Platypus
35
+ from transformers import AutoModelForCausalLM, AutoTokenizer
36
+ import torch
37
+
38
+ repo = "PracticeLLM/Custom-KoLLM-13B-v1"
39
+ OpenOrca = AutoModelForCausalLM.from_pretrained(
40
+ repo,
41
+ return_dict=True,
42
+ torch_dtype=torch.float16,
43
+ device_map='auto'
44
+ )
45
+ OpenOrca_tokenizer = AutoTokenizer.from_pretrained(repo)
46
+ ```
47
+
48
+ ---