Update README.md
Browse files
README.md
CHANGED
@@ -17,11 +17,11 @@ Version 0.2
|
|
17 |
|
18 |
## Model Details
|
19 |
|
20 |
-
The TW-Pythia model is derived from the Apache-2.0-licenced [Pythia](https://github.com/EleutherAI/pythia) language
|
21 |
|
22 |
### Basics
|
23 |
|
24 |
-
- **Developed by:** [@zetavg](https://github.com/zetavg)
|
25 |
- **Model type:** Transformer-based GPT-NeoX Causal Language Model
|
26 |
- **Languages:** English, Traditional Chinese
|
27 |
- **License:** Unknown due to unconfirmed usage license of the training data
|
|
|
17 |
|
18 |
## Model Details
|
19 |
|
20 |
+
The TW-Pythia model is derived from the Apache-2.0-licenced [Pythia](https://github.com/EleutherAI/pythia) language model, with 8000 new Traditional Chinese tokens added, embed layers resized and re-trained.
|
21 |
|
22 |
### Basics
|
23 |
|
24 |
+
- **Developed by:** [@zetavg](https://github.com/zetavg) based on [EleutherAI](https://www.eleuther.ai/)'s [Pythia](https://github.com/EleutherAI/pythia) language model.
|
25 |
- **Model type:** Transformer-based GPT-NeoX Causal Language Model
|
26 |
- **Languages:** English, Traditional Chinese
|
27 |
- **License:** Unknown due to unconfirmed usage license of the training data
|