Text2Text Generation
Chinese
English
mabaochang commited on
Commit
094de5c
1 Parent(s): 300df2a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -3
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- license: other
3
  tags:
4
  - text2text-generation
5
  pipeline_tag: text2text-generation
@@ -52,12 +52,38 @@ ff291fcfa4e0048ca4ff262312faad83 ./tokenizer_config.json.ef7ef410b9b909949e96f1
52
  39ec1b33fbf9a0934a8ae0f9a24c7163 ./tokenizer.model.9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347.enc
53
  ```
54
 
55
- 2. Decrypt the files using https://github.com/LianjiaTech/BELLE/tree/main/models#使用说明
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
56
  ```
57
- for f in "encrypted"/*; do if [ -f "$f" ]; then python3 decrypt.py "$f" "original/7B/consolidated.00.pth" "result/"; fi; done
 
 
 
 
 
 
58
  ```
59
 
60
  3. Check md5sum
 
 
 
61
  ```
62
  md5sum ./*
63
  32490e7229fb82c643e3a7b8d04a6c4b ./config.json
 
1
  ---
2
+ license: gpl-3.0
3
  tags:
4
  - text2text-generation
5
  pipeline_tag: text2text-generation
 
52
  39ec1b33fbf9a0934a8ae0f9a24c7163 ./tokenizer.model.9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347.enc
53
  ```
54
 
55
+ 2. Decrypt the files using the scripts in https://github.com/LianjiaTech/BELLE/tree/main/models
56
+
57
+ You can use the following command in Bash.
58
+ Please replace "/path/to_encrypted" with the path where you stored your encrypted file,
59
+ replace "/path/to_original_llama_7B" with the path where you stored your original llama7B file,
60
+ and replace "/path/to_finetuned_model" with the path where you want to save your final trained model.
61
+
62
+ ```bash
63
+ mkdir /path/to_finetuned_model
64
+ for f in "/path/to_encrypted"/*; \
65
+ do if [ -f "$f" ]; then \
66
+ python3 decrypt.py "$f" "/path/to_original_llama_7B/consolidated.00.pth" "/path/to_finetuned_model/"; \
67
+ fi; \
68
+ done
69
+ ```
70
+
71
+ After executing the aforementioned command, you will obtain the following files.
72
+
73
  ```
74
+ ./config.json
75
+ ./generation_config.json
76
+ ./llama7b-2m-4bit-128g.pt
77
+ ./llama7b-2m-8bit-128g.pt
78
+ ./special_tokens_map.json
79
+ ./tokenizer_config.json
80
+ ./tokenizer.model
81
  ```
82
 
83
  3. Check md5sum
84
+
85
+ You can verify the integrity of these files by performing an MD5 checksum to ensure their complete recovery.
86
+ Here are the MD5 checksums for the relevant files:
87
  ```
88
  md5sum ./*
89
  32490e7229fb82c643e3a7b8d04a6c4b ./config.json