Update README.md
Browse files
README.md
CHANGED
@@ -57,7 +57,24 @@ World v2 = 1.12T tokens
|
|
57 |
|
58 |
Imagine what happens when we use more data :)
|
59 |
|
60 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
61 |
```
|
62 |
User: hi
|
63 |
|
@@ -67,7 +84,7 @@ User: xxx
|
|
67 |
|
68 |
Assistant:
|
69 |
```
|
70 |
-
QA prompt (replace \n\n in xxx to \n):
|
71 |
```
|
72 |
Question: xxx
|
73 |
|
|
|
57 |
|
58 |
Imagine what happens when we use more data :)
|
59 |
|
60 |
+
Recommended fine-tuning format (use \n for newlines):
|
61 |
+
```
|
62 |
+
User: xxxxxxxxxxxxxxx
|
63 |
+
|
64 |
+
Assistant: xxxxxxxxxxxxxxx
|
65 |
+
xxxxxxxxxxxxxxx
|
66 |
+
xxxxxxxxxxxxxxx
|
67 |
+
|
68 |
+
User: xxxxxxxxxxxxxxx
|
69 |
+
xxxxxxxxxxxxxxx
|
70 |
+
|
71 |
+
Assistant: xxxxxxxxxxxxxxx
|
72 |
+
xxxxxxxxxxxxxxx
|
73 |
+
xxxxxxxxxxxxxxx
|
74 |
+
xxxxxxxxxxxxxxx
|
75 |
+
```
|
76 |
+
|
77 |
+
A good chat prompt (better replace \n\n in xxx to \n, such that there will be no newlines in xxx):
|
78 |
```
|
79 |
User: hi
|
80 |
|
|
|
84 |
|
85 |
Assistant:
|
86 |
```
|
87 |
+
QA prompt (better replace \n\n in xxx to \n, such that there will be no newlines in xxx):
|
88 |
```
|
89 |
Question: xxx
|
90 |
|