Commit
·
e20b847
1
Parent(s):
3e76622
Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,7 @@ datasets:
|
|
15 |
|
16 |
## Model Details
|
17 |
TinyKAI-0.7B is one of the world's SMALLEST "large" language models EVER!
|
18 |
-
We acheived such a feat by essentially compressing [GPT2](https://huggingface.co/gpt2) and squeezing it to
|
19 |
|
20 |
## Uses
|
21 |
Due to being one of the tiniest "large" language models on huggingface, many corners had to be cut. TinyKAI-0.7B has a max output of only 150 characters per computation (without repeating itself). Therefore, TinyKAI is only intended for research purposes.
|
|
|
15 |
|
16 |
## Model Details
|
17 |
TinyKAI-0.7B is one of the world's SMALLEST "large" language models EVER!
|
18 |
+
We acheived such a feat by essentially compressing [GPT2](https://huggingface.co/gpt2) and squeezing it to fit into one sub-GB pytorch.bin file!
|
19 |
|
20 |
## Uses
|
21 |
Due to being one of the tiniest "large" language models on huggingface, many corners had to be cut. TinyKAI-0.7B has a max output of only 150 characters per computation (without repeating itself). Therefore, TinyKAI is only intended for research purposes.
|