Isaak Carter Augustus commited on
Commit
d24f83d
1 Parent(s): 9f57c8f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -18
README.md CHANGED
@@ -1,25 +1,49 @@
 
1
  ---
2
- language:
3
- - en
4
- license: apache-2.0
5
  ---
6
 
7
- # This is a customized version of "Doctor-Shotgun/TinyLlama-1.1B-32k"
 
 
 
 
 
 
 
 
 
8
 
9
- ## I have added spetial Tokens for my Prompt Format
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
- ### Special Tokens Added
12
 
13
  ```text
14
- "<|josie|>",
15
- "<|functions|>",
16
- "<|long_term_memory|>",
17
- "<|home_state|>",
18
- "<|function_call|>",
19
- "<|image|>",
20
- "<|gökdeniz|>",
21
- "<|function_response|>",
22
- "<|endoftext|>",
23
- "<|startoftext|>",
24
- "<|unk|>"
25
- ```
 
1
+
2
  ---
3
+ library_name: transformers
4
+ base_model: Doctor-Shotgun/TinyLlama-1.1B-32k
 
5
  ---
6
 
7
+ # Model card of JOSIE_TinyLlama_1.1B_32k_Base
8
+ ## This is my Token customized Doctor-Shotgun/TinyLlama-1.1B-32k model
9
+
10
+ [Origional Model][https://huggingface.co/Doctor-Shotgun/TinyLlama-1.1B-32k]
11
+
12
+ This is based on Doctor-Shotgun/TinyLlama-1.1B-32k model with added custom special Tokens.
13
+
14
+ <br>
15
+
16
+ ### New added Special Tokens
17
 
18
+ ```text
19
+ '<|functions|>',
20
+ '<|system|>',
21
+ '<|gökdeniz|>',
22
+ '<|user|>',
23
+ '<|josie|>',
24
+ '<|assistant|>',
25
+ '<|function_call|>',
26
+ '<|function_response|>',
27
+ '<|image|>',
28
+ '<|long_term_memory|>',
29
+ '<|short_term_memory|>',
30
+ '<|home_state|>',
31
+ '<|current_states|>',
32
+ '<|context|>'
33
+ ```
34
+ <br>
35
 
36
+ ### New BOS and EOS Tokens
37
 
38
  ```text
39
+ BOS = '<|startoftext|>'
40
+ EOS = '<|endoftext|>'
41
+ ```
42
+ <br>
43
+
44
+ ### New added Normal Tokens
45
+
46
+ ```text
47
+ ['Gökdeniz Gülmez', 'Gökdeniz', 'Gülmez', 'JOSIE', 'J.O.S.I.E.', 'Josie', 'josie', 'Just an Outstandingly Smart and Intelligent Entity']
48
+ ```
49
+