Update model description
Browse files
README.md
CHANGED
@@ -1,18 +1,26 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
---
|
4 |
-
|
5 |
-
Graphcore and Hugging Face are working together to make training of Transformer models on IPUs fast and easy. Learn more about how to take advantage of the power of Graphcore IPUs to train Transformers models at [hf.co/hardware/graphcore](https://huggingface.co/hardware/graphcore).
|
6 |
-
|
7 |
-
# T5 Small model IPU config
|
8 |
-
|
9 |
-
This model contains just the `IPUConfig` files for running the BERT base model (e.g. [t5-small](https://huggingface.co/t5-small)) on Graphcore IPUs.
|
10 |
-
|
11 |
-
**This model contains no model weights, only an IPUConfig.**
|
12 |
-
|
13 |
-
##
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
```
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
---
|
4 |
+
|
5 |
+
Graphcore and Hugging Face are working together to make training of Transformer models on IPUs fast and easy. Learn more about how to take advantage of the power of Graphcore IPUs to train Transformers models at [hf.co/hardware/graphcore](https://huggingface.co/hardware/graphcore).
|
6 |
+
|
7 |
+
# T5 Small model IPU config
|
8 |
+
|
9 |
+
This model contains just the `IPUConfig` files for running the BERT base model (e.g. [t5-small](https://huggingface.co/t5-small)) on Graphcore IPUs.
|
10 |
+
|
11 |
+
**This model contains no model weights, only an IPUConfig.**
|
12 |
+
|
13 |
+
## Model description
|
14 |
+
|
15 |
+
Text-to-Text Transfer Transformer (T5), is a Transformer based model that uses a text-to-text approach for translation, question answering, and classification. It introduces an unified framework that converts all text-based language problems into a text-to-text format for transfer learning for NLP. This allows for the use of the same model, loss function, hyperparameters, etc. across our diverse set of tasks.
|
16 |
+
|
17 |
+
Paper link :[Exploring the Limits of Transfer Learning with a Unified
|
18 |
+
Text-to-Text Transformer](https://arxiv.org/pdf/1910.10683.pdf)
|
19 |
+
|
20 |
+
|
21 |
+
## Usage
|
22 |
+
|
23 |
+
```
|
24 |
+
from optimum.graphcore import IPUConfig
|
25 |
+
ipu_config = IPUConfig.from_pretrained("Graphcore/t5-small-ipu")
|
26 |
```
|