Text Generation
PyTorch
English
llama
t1101675 commited on
Commit
c4a2c72
1 Parent(s): e0c204f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -3
README.md CHANGED
@@ -1,3 +1,28 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - databricks/databricks-dolly-15k
5
+ language:
6
+ - en
7
+ metrics:
8
+ - rouge
9
+ pipeline_tag: text-generation
10
+ ---
11
+ # teacher-Llama-13B
12
+
13
+ [paper](https://arxiv.org/abs/2306.08543) | [code](https://github.com/microsoft/LMOps/tree/main/minillm)
14
+
15
+ **teacher-Llama-13B** is a Llama-13B model supervised fine-tuned on [databricks-dolly-15k](https://huggingface.co/datasets/aisquared/databricks-dolly-15k).
16
+
17
+ It is used as the teacher model for MiniLLM series.
18
+
19
+
20
+ ## Citation
21
+ ```
22
+ @inproceedings{minillm,
23
+ title={MiniLLM: Knowledge Distillation of Large Language Models},
24
+ author={Gu, Yuxian and Dong, Li and Wei, Furu and Huang, Minlie},
25
+ booktitle={Proceedings of ICLR},
26
+ year={2024}
27
+ }
28
+ ```