Andrew DalPino
commited on
Commit
·
9c2b560
1
Parent(s):
111c2a3
Update model card
Browse files
README.md
CHANGED
@@ -2,7 +2,7 @@
|
|
2 |
license: apache-2.0
|
3 |
datasets:
|
4 |
- HuggingFaceFW/fineweb
|
5 |
-
-
|
6 |
library_name: pytorch
|
7 |
language:
|
8 |
- en
|
@@ -14,7 +14,7 @@ tags:
|
|
14 |
---
|
15 |
# LightGPT
|
16 |
|
17 |
-
LightGPT is a lightweight generative pretrained Transformer (GPT) language model for the people! Built using PyTorch and trained on the Fineweb and
|
18 |
|
19 |
## Features
|
20 |
|
|
|
2 |
license: apache-2.0
|
3 |
datasets:
|
4 |
- HuggingFaceFW/fineweb
|
5 |
+
- HuggingFaceTB/smoltalk
|
6 |
library_name: pytorch
|
7 |
language:
|
8 |
- en
|
|
|
14 |
---
|
15 |
# LightGPT
|
16 |
|
17 |
+
LightGPT is a lightweight generative pretrained Transformer (GPT) language model for the people! Built using PyTorch and trained on the Fineweb and SmolTalk datasets, LightGPT can answer questions, follow instructions, summarize documents, chat, and more. Best of all, the model weights *and* code are fully open-source for you to customize, improve upon, and share with the world.
|
18 |
|
19 |
## Features
|
20 |
|