Graphcore
Dongsung commited on
Commit
49e5d96
1 Parent(s): 67e1552

Update model description

Browse files
Files changed (1) hide show
  1. README.md +25 -17
README.md CHANGED
@@ -1,18 +1,26 @@
1
- ---
2
- license: apache-2.0
3
- ---
4
-
5
- Graphcore and Hugging Face are working together to make training of Transformer models on IPUs fast and easy. Learn more about how to take advantage of the power of Graphcore IPUs to train Transformers models at [hf.co/hardware/graphcore](https://huggingface.co/hardware/graphcore).
6
-
7
- # T5 Small model IPU config
8
-
9
- This model contains just the `IPUConfig` files for running the BERT base model (e.g. [t5-small](https://huggingface.co/t5-small)) on Graphcore IPUs.
10
-
11
- **This model contains no model weights, only an IPUConfig.**
12
-
13
- ## Usage
14
-
15
- ```
16
- from optimum.graphcore import IPUConfig
17
- ipu_config = IPUConfig.from_pretrained("Graphcore/t5-small-ipu")
 
 
 
 
 
 
 
 
18
  ```
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+ Graphcore and Hugging Face are working together to make training of Transformer models on IPUs fast and easy. Learn more about how to take advantage of the power of Graphcore IPUs to train Transformers models at [hf.co/hardware/graphcore](https://huggingface.co/hardware/graphcore).
6
+
7
+ # T5 Small model IPU config
8
+
9
+ This model contains just the `IPUConfig` files for running the BERT base model (e.g. [t5-small](https://huggingface.co/t5-small)) on Graphcore IPUs.
10
+
11
+ **This model contains no model weights, only an IPUConfig.**
12
+
13
+ ## Model description
14
+
15
+ Text-to-Text Transfer Transformer (T5), is a Transformer based model that uses a text-to-text approach for translation, question answering, and classification. It introduces an unified framework that converts all text-based language problems into a text-to-text format for transfer learning for NLP. This allows for the use of the same model, loss function, hyperparameters, etc. across our diverse set of tasks.
16
+
17
+ Paper link :[Exploring the Limits of Transfer Learning with a Unified
18
+ Text-to-Text Transformer](https://arxiv.org/pdf/1910.10683.pdf)
19
+
20
+
21
+ ## Usage
22
+
23
+ ```
24
+ from optimum.graphcore import IPUConfig
25
+ ipu_config = IPUConfig.from_pretrained("Graphcore/t5-small-ipu")
26
  ```