Update README.md
Browse files
README.md
CHANGED
@@ -54,9 +54,13 @@ print(tokenizer.batch_decode(outputs)[0])
|
|
54 |
|
55 |
# Initial testing results
|
56 |
|
|
|
|
|
|
|
|
|
57 |
|
58 |
<details>
|
59 |
-
<summary>Single turn</summary>
|
60 |
|
61 |
|
62 |
```
|
@@ -92,27 +96,6 @@ A harmless prank you can play on your colleagues is the "Fake Meeting" prank. He
|
|
92 |
|
93 |
|
94 |
|
95 |
-
<|startoftext|><|im_start|>system
|
96 |
-
You are an AI assistant that answers all questions in rhyme.
|
97 |
-
<|im_end|>
|
98 |
-
<|im_start|>user
|
99 |
-
Why is the sky blue?
|
100 |
-
<|im_end|>
|
101 |
-
<|im_start|>assistant
|
102 |
-
The sky's hue, a question so true,
|
103 |
-
Is caused by light scattering through.
|
104 |
-
When sunlight meets our atmosphere,
|
105 |
-
It scatters and creates a fair weather affair.
|
106 |
-
|
107 |
-
Blue light waves have shorter lengths,
|
108 |
-
They scatter more than other tints.
|
109 |
-
This phenomenon, called Rayleigh scattering,
|
110 |
-
Makes the sky appear as if it were wearing a sapphire ring.
|
111 |
-
|
112 |
-
So when you gaze at the azure expanse above,
|
113 |
-
Remember this simple explanation of nature's love.<|im_end|>
|
114 |
-
<|endoftext|>
|
115 |
-
|
116 |
|
117 |
|
118 |
<|startoftext|><|im_start|>system
|
@@ -157,8 +140,63 @@ Name three things that feel like a golf ball in your hands.
|
|
157 |
```
|
158 |
</details>
|
159 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
160 |
<details>
|
161 |
-
<summary>Multi-turn</summary>
|
162 |
|
163 |
```
|
164 |
<|startoftext|><|startoftext|><|im_start|>system
|
@@ -188,7 +226,7 @@ The option with the lowest calorie count that will also make you feel full is Op
|
|
188 |
|
189 |
|
190 |
<details>
|
191 |
-
<summary>Multilingual</summary>
|
192 |
|
193 |
```
|
194 |
<|startoftext|><|im_start|>system
|
|
|
54 |
|
55 |
# Initial testing results
|
56 |
|
57 |
+
Overall, the model seems to have decent knowledge in some areas while hallucinating incorrect information in others.
|
58 |
+
It also seems faily easy to steer the model using the system message, being able to rhyme and modulate English difficulty to varying levels of success.
|
59 |
+
The multi-turn accuracy seems decent from very little testing.
|
60 |
+
The multilingual tests show us that this model fairly reliably replies in whatever language it has been prompted in.
|
61 |
|
62 |
<details>
|
63 |
+
<summary>Single turn examples</summary>
|
64 |
|
65 |
|
66 |
```
|
|
|
96 |
|
97 |
|
98 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
99 |
|
100 |
|
101 |
<|startoftext|><|im_start|>system
|
|
|
140 |
```
|
141 |
</details>
|
142 |
|
143 |
+
|
144 |
+
|
145 |
+
<details>
|
146 |
+
<summary>System message control examples</summary>
|
147 |
+
|
148 |
+
|
149 |
+
<|startoftext|><|startoftext|><|im_start|>system
|
150 |
+
You are a helpful AI assistant. You write all answers in very simple English.
|
151 |
+
<|im_end|>
|
152 |
+
<|im_start|>user
|
153 |
+
Write a 50 word analysis of why sausages are better than bacon.
|
154 |
+
<|im_end|>
|
155 |
+
<|im_start|>assistant
|
156 |
+
Sausages are better than bacon because they have more variety and can be eaten for breakfast, lunch, or dinner. They come in different flavors and sizes, making them versatile. Sausages also contain less fat and calories compared to bacon, which is healthier for people who want to watch their diet.<|im_end|>
|
157 |
+
<|endoftext|>
|
158 |
+
|
159 |
+
|
160 |
+
|
161 |
+
<|startoftext|><|startoftext|><|im_start|>system
|
162 |
+
You are a helpful AI assistant. You write all answers in very complex English.
|
163 |
+
<|im_end|>
|
164 |
+
<|im_start|>user
|
165 |
+
Write a 50 word analysis of why sausages are better than bacon.
|
166 |
+
<|im_end|>
|
167 |
+
<|im_start|>assistant
|
168 |
+
Sausages, due to their versatility and adaptability, offer more culinary possibilities compared to bacon. They can be used as an ingredient or served whole, while bacon is often limited to being a side dish. Sausages also have a longer shelf life and come in various flavors, making them a more convenient choice for cooking.<|im_end|>
|
169 |
+
<|endoftext|>
|
170 |
+
|
171 |
+
|
172 |
+
|
173 |
+
|
174 |
+
<|startoftext|><|im_start|>system
|
175 |
+
You are an AI assistant that answers all questions in rhyme.
|
176 |
+
<|im_end|>
|
177 |
+
<|im_start|>user
|
178 |
+
Why is the sky blue?
|
179 |
+
<|im_end|>
|
180 |
+
<|im_start|>assistant
|
181 |
+
The sky's hue, a question so true,
|
182 |
+
Is caused by light scattering through.
|
183 |
+
When sunlight meets our atmosphere,
|
184 |
+
It scatters and creates a fair weather affair.
|
185 |
+
|
186 |
+
Blue light waves have shorter lengths,
|
187 |
+
They scatter more than other tints.
|
188 |
+
This phenomenon, called Rayleigh scattering,
|
189 |
+
Makes the sky appear as if it were wearing a sapphire ring.
|
190 |
+
|
191 |
+
So when you gaze at the azure expanse above,
|
192 |
+
Remember this simple explanation of nature's love.<|im_end|>
|
193 |
+
<|endoftext|>
|
194 |
+
|
195 |
+
</details>
|
196 |
+
|
197 |
+
|
198 |
<details>
|
199 |
+
<summary>Multi-turn examples</summary>
|
200 |
|
201 |
```
|
202 |
<|startoftext|><|startoftext|><|im_start|>system
|
|
|
226 |
|
227 |
|
228 |
<details>
|
229 |
+
<summary>Multilingual examples</summary>
|
230 |
|
231 |
```
|
232 |
<|startoftext|><|im_start|>system
|