Update README.md
Browse files
README.md
CHANGED
@@ -8,7 +8,7 @@ tags:
|
|
8 |
|
9 |
# **KoBigBird-RoBERTa-large**
|
10 |
|
11 |
-
This is a large-sized Korean BigBird model introduced in our [paper]()
|
12 |
The model draws heavily from the parameters of [klue/roberta-large](https://huggingface.co/klue/roberta-large) to ensure high performance
|
13 |
and employs the BigBird architecture to extend its input length.
|
14 |
With the assistance of TAPER to extend position embeddings, the language model's extrapolation capabilities are enhanced.
|
|
|
8 |
|
9 |
# **KoBigBird-RoBERTa-large**
|
10 |
|
11 |
+
This is a large-sized Korean BigBird model introduced in our [paper]() (IJCNLP-AACL 2023).
|
12 |
The model draws heavily from the parameters of [klue/roberta-large](https://huggingface.co/klue/roberta-large) to ensure high performance
|
13 |
and employs the BigBird architecture to extend its input length.
|
14 |
With the assistance of TAPER to extend position embeddings, the language model's extrapolation capabilities are enhanced.
|