Commit
·
799151a
1
Parent(s):
b9359a9
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- zh
|
4 |
+
license: apache-2.0
|
5 |
+
---
|
6 |
+
# Mengzi-BERT base fin model (Chinese)
|
7 |
+
Continue trained based on mengzi-bert-base with 20G financial news and research reports. Masked language modeling(MLM), part-of-speech(POS) tagging and sentence order prediction(SOP) are used as training task.
|
8 |
+
[Mengzi: A lightweight yet Powerful Chinese Pre-trained Language Model](www.example.com)
|
9 |
+
## Usage
|
10 |
+
```python
|
11 |
+
from transformers import BertTokenizer, BertModel
|
12 |
+
tokenizer = BertTokenizer.from_pretrained("Langboat/mengzi-bert-base-fin")
|
13 |
+
model = BertModel.from_pretrained("Langboat/mengzi-bert-base-fin")
|
14 |
+
```
|
15 |
+
|
16 |
+
## Citation
|
17 |
+
If you find the technical report or resource is useful, please cite the following technical report in your paper.
|
18 |
+
```
|
19 |
+
example
|
20 |
+
```
|