Isaak Carter Augustus
commited on
Commit
•
d24f83d
1
Parent(s):
9f57c8f
Update README.md
Browse files
README.md
CHANGED
@@ -1,25 +1,49 @@
|
|
|
|
1 |
---
|
2 |
-
|
3 |
-
-
|
4 |
-
license: apache-2.0
|
5 |
---
|
6 |
|
7 |
-
#
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
8 |
|
9 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
|
11 |
-
###
|
12 |
|
13 |
```text
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
-
|
18 |
-
|
19 |
-
|
20 |
-
|
21 |
-
|
22 |
-
|
23 |
-
|
24 |
-
|
25 |
-
```
|
|
|
1 |
+
|
2 |
---
|
3 |
+
library_name: transformers
|
4 |
+
base_model: Doctor-Shotgun/TinyLlama-1.1B-32k
|
|
|
5 |
---
|
6 |
|
7 |
+
# Model card of JOSIE_TinyLlama_1.1B_32k_Base
|
8 |
+
## This is my Token customized Doctor-Shotgun/TinyLlama-1.1B-32k model
|
9 |
+
|
10 |
+
[Origional Model][https://huggingface.co/Doctor-Shotgun/TinyLlama-1.1B-32k]
|
11 |
+
|
12 |
+
This is based on Doctor-Shotgun/TinyLlama-1.1B-32k model with added custom special Tokens.
|
13 |
+
|
14 |
+
<br>
|
15 |
+
|
16 |
+
### New added Special Tokens
|
17 |
|
18 |
+
```text
|
19 |
+
'<|functions|>',
|
20 |
+
'<|system|>',
|
21 |
+
'<|gökdeniz|>',
|
22 |
+
'<|user|>',
|
23 |
+
'<|josie|>',
|
24 |
+
'<|assistant|>',
|
25 |
+
'<|function_call|>',
|
26 |
+
'<|function_response|>',
|
27 |
+
'<|image|>',
|
28 |
+
'<|long_term_memory|>',
|
29 |
+
'<|short_term_memory|>',
|
30 |
+
'<|home_state|>',
|
31 |
+
'<|current_states|>',
|
32 |
+
'<|context|>'
|
33 |
+
```
|
34 |
+
<br>
|
35 |
|
36 |
+
### New BOS and EOS Tokens
|
37 |
|
38 |
```text
|
39 |
+
BOS = '<|startoftext|>'
|
40 |
+
EOS = '<|endoftext|>'
|
41 |
+
```
|
42 |
+
<br>
|
43 |
+
|
44 |
+
### New added Normal Tokens
|
45 |
+
|
46 |
+
```text
|
47 |
+
['Gökdeniz Gülmez', 'Gökdeniz', 'Gülmez', 'JOSIE', 'J.O.S.I.E.', 'Josie', 'josie', 'Just an Outstandingly Smart and Intelligent Entity']
|
48 |
+
```
|
49 |
+
|
|