Update README.md

README.md

@@ -5,11 +5,13 @@ widget:
 
 ---
 
+
 # Chinese Couplet GPT2 Model
 
+
 ## Model description
 
-The model is used to generate Chinese couplets. You can download the model either from the [GPT2-Chinese Github page](https://github.com/Morizeyao/GPT2-Chinese), or via HuggingFace from the link [gpt2-chinese-couplet][couplet].
+The model is used to generate Chinese couplets. You can download the model either from the [GPT2-Chinese Github page](https://github.com/Morizeyao/GPT2-Chinese), or via HuggingFace from the link [gpt2-chinese-couplet](https://huggingface.co/uer/gpt2-chinese-couplet).
 
 Since the parameter skip_special_tokens is used in the pipelines.py, special tokens such as [SEP], [UNK] will be deleted, the output results of Hosted inference API (right) may not be properly displayed..
 
@@ -51,7 +53,7 @@ The model is pre-trained by [UER-py](https://github.com/dbiir/UER-py/) on [Tence
 python3 preprocess.py --corpus_path corpora/couplet.txt \
                       --vocab_path models/google_zh_vocab.txt \
                       --dataset_path couplet_dataset.pt --processes_num 16 \
-                      --seq_length 64 --target lm 
+                      --seq_length 64 --data_processor lm 
 ```
 
 ```
@@ -61,10 +63,7 @@ python3 pretrain.py --dataset_path couplet_dataset.pt \
                     --output_model_path models/couplet_gpt2_model.bin \
                     --world_size 8 --gpu_ranks 0 1 2 3 4 5 6 7 \
                     --total_steps 25000 --save_checkpoint_steps 5000 --report_steps 1000 \
-                    --learning_rate 5e-4 --batch_size 64 \
-                    --embedding word_pos --remove_embedding_layernorm \
-                    --encoder transformer --mask causal --layernorm_positioning pre \
-                    --target lm --tie_weights
+                    --learning_rate 5e-4 --batch_size 64
 ```
 
 Finally, we convert the pre-trained model into Huggingface's format:
@@ -90,6 +89,4 @@ python3 scripts/convert_gpt2_from_uer_to_huggingface.py --input_model_path coupl
   pages={241},
   year={2019}
 }
-```
-
-[couplet]: https://huggingface.co/uer/gpt2-chinese-couplet
+```