Update README.md
Browse files
README.md
CHANGED
@@ -28,25 +28,198 @@ model = AutoModelForCausalLM.from_pretrained("kinokokoro/jamba_airoboros3.2_shar
|
|
28 |
tokenizer = AutoTokenizer.from_pretrained("kinokokoro/jamba_airoboros3.2_sharegpt4")
|
29 |
|
30 |
input_text = """<|im_start|>system
|
31 |
-
You are
|
32 |
<|im_end|>
|
33 |
-
<|im_start|>user
|
34 |
-
|
35 |
<|im_end|>
|
36 |
-
<|im_start|>assistant
|
37 |
"""
|
38 |
|
39 |
input_ids = tokenizer(input_text, return_tensors='pt').to(model.device)["input_ids"]
|
40 |
|
41 |
-
outputs = model.generate(input_ids, max_new_tokens=256, temperature=0.0)
|
42 |
-
|
43 |
-
print(tokenizer.batch_decode(
|
44 |
-
#
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
45 |
```
|
46 |
|
47 |
# Initial testing results
|
48 |
|
49 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
50 |
|
51 |
# Training details
|
52 |
|
|
|
28 |
tokenizer = AutoTokenizer.from_pretrained("kinokokoro/jamba_airoboros3.2_sharegpt4")
|
29 |
|
30 |
input_text = """<|im_start|>system
|
31 |
+
You are a helpful AI assistant.
|
32 |
<|im_end|>
|
33 |
+
<|im_start|>user
|
34 |
+
What is the most interesting fact about kangaroos that you know?
|
35 |
<|im_end|>
|
36 |
+
<|im_start|>assistant
|
37 |
"""
|
38 |
|
39 |
input_ids = tokenizer(input_text, return_tensors='pt').to(model.device)["input_ids"]
|
40 |
|
41 |
+
outputs = model.generate(input_ids, max_new_tokens=256, temperature=0.0, repetition_penalty=1.1)
|
42 |
+
|
43 |
+
print(tokenizer.batch_decode(outputs)[0])
|
44 |
+
# <|startoftext|><|im_start|>system
|
45 |
+
# You are a helpful AI assistant.
|
46 |
+
# <|im_end|>
|
47 |
+
# <|im_start|>user
|
48 |
+
# What is the most interesting fact about kangaroos that you know?
|
49 |
+
# <|im_end|>
|
50 |
+
# <|im_start|>assistant
|
51 |
+
# One of the most interesting facts about kangaroos is their unique reproductive system, known as "delayed implantation." After mating, the fertilized egg remains dormant in the female's uterus for up to six months before it starts developing into an embryo. This allows the mother to time the birth of her offspring with optimal environmental conditions and food availability.<|im_end|>
|
52 |
+
# <|endoftext|>
|
53 |
```
|
54 |
|
55 |
# Initial testing results
|
56 |
|
57 |
|
58 |
+
<details>
|
59 |
+
<summary>Single turn</summary>
|
60 |
+
|
61 |
+
|
62 |
+
```
|
63 |
+
<|startoftext|><|im_start|>system
|
64 |
+
You are a helpful AI assistant.
|
65 |
+
<|im_end|>
|
66 |
+
<|im_start|>user
|
67 |
+
Describe the town of Strathaven, Scotland in 50 words.
|
68 |
+
<|im_end|>
|
69 |
+
<|im_start|>assistant
|
70 |
+
Strathaven is a picturesque market town located in South Lanarkshire, Scotland. Known for its rich history and stunning landscapes, it offers visitors a delightful blend of historical attractions, outdoor activities, and modern amenities. With its charming streets, beautiful parks, and friendly community, Strathaven provides an ideal destination for those seeking a peaceful escape from city life.<|im_end|>
|
71 |
+
<|endoftext|>
|
72 |
+
|
73 |
+
|
74 |
+
|
75 |
+
<|startoftext|><|im_start|>system
|
76 |
+
You are a helpful AI assistant.
|
77 |
+
<|im_end|>
|
78 |
+
<|im_start|>user
|
79 |
+
Describe a harmless prank that I can play on my colleagues.
|
80 |
+
<|im_end|>
|
81 |
+
<|im_start|>assistant
|
82 |
+
A harmless prank you can play on your colleagues is the "Fake Meeting" prank. Here's how to do it:
|
83 |
+
|
84 |
+
1. Choose a colleague who often has meetings or conference calls scheduled throughout the day.
|
85 |
+
2. Find out their schedule for the day, including any upcoming meetings they have.
|
86 |
+
3. Create a fake meeting invitation using an email template or online tool like Canva or Google Docs. Make sure the design and format look similar to the company's official meeting invitations.
|
87 |
+
4. Include details such as the date, time, location (if applicable), subject, and attendees. You can even add a fake agenda if you want to make it more convincing.
|
88 |
+
5. Send the fake meeting invitation to your chosen colleague via email or instant messaging platform used in your workplace.
|
89 |
+
6. Wait for them to respond with confusion or excitement about attending this unexpected meeting.
|
90 |
+
7. When they ask questions about the meeting, act clueless and say something like, "Oh, I just got this invite too! Must be some new initiative from upper management."
|
91 |
+
8. Keep up the charade until they realize it's a prank, but don't let it go on for too long so as not to cause unnecessary stress or confusion.
|
92 |
+
|
93 |
+
|
94 |
+
|
95 |
+
<|startoftext|><|im_start|>system
|
96 |
+
You are an AI assistant that answers all questions in rhyme.
|
97 |
+
<|im_end|>
|
98 |
+
<|im_start|>user
|
99 |
+
Why is the sky blue?
|
100 |
+
<|im_end|>
|
101 |
+
<|im_start|>assistant
|
102 |
+
The sky's hue, a question so true,
|
103 |
+
Is caused by light scattering through.
|
104 |
+
When sunlight meets our atmosphere,
|
105 |
+
It scatters and creates a fair weather affair.
|
106 |
+
|
107 |
+
Blue light waves have shorter lengths,
|
108 |
+
They scatter more than other tints.
|
109 |
+
This phenomenon, called Rayleigh scattering,
|
110 |
+
Makes the sky appear as if it were wearing a sapphire ring.
|
111 |
+
|
112 |
+
So when you gaze at the azure expanse above,
|
113 |
+
Remember this simple explanation of nature's love.<|im_end|>
|
114 |
+
<|endoftext|>
|
115 |
+
|
116 |
+
|
117 |
+
|
118 |
+
<|startoftext|><|im_start|>system
|
119 |
+
You are a helpful AI assistant that always answers correctly.
|
120 |
+
<|im_end|>
|
121 |
+
<|im_start|>user
|
122 |
+
Do UK citizens need a visa to holiday in Singapore?
|
123 |
+
<|im_end|>
|
124 |
+
<|im_start|>assistant
|
125 |
+
Yes, UK citizens do need a visa to holiday in Singapore. They can apply for an Electronic Travel Authorization (ETA) online before their trip.<|im_end|>
|
126 |
+
<|endoftext|>
|
127 |
+
|
128 |
+
## <dev note>: This is false, UK citizens do NOT require a visa to holiday in Singapore. An Electronic Travel Authorization (ETA) is required for the USA etc.
|
129 |
+
|
130 |
+
|
131 |
+
<|startoftext|><|im_start|>system
|
132 |
+
You are a helpful AI assistant.
|
133 |
+
<|im_end|>
|
134 |
+
<|im_start|>user
|
135 |
+
Which US state has the highest GDP per capita?
|
136 |
+
<|im_end|>
|
137 |
+
<|im_start|>assistant
|
138 |
+
As of my last update, the US state with the highest GDP per capita is Massachusetts.<|im_end|>
|
139 |
+
<|endoftext|>
|
140 |
+
|
141 |
+
|
142 |
+
|
143 |
+
<|startoftext|><|im_start|>system
|
144 |
+
You are a helpful AI assistant.
|
145 |
+
<|im_end|>
|
146 |
+
<|im_start|>user
|
147 |
+
Name three things that feel like a golf ball in your hands.
|
148 |
+
<|im_end|>
|
149 |
+
<|im_start|>assistant
|
150 |
+
1. A tennis ball: Tennis balls have a similar size and texture to golf balls, making them feel quite similar when held in the hand. They both have a rubbery surface with dimples or indentations on their outer layer.
|
151 |
+
|
152 |
+
2. A stress ball: Stress balls are often made of soft, squishy material such as foam or gel, which can be squeezed and manipulated easily. The feeling of holding a stress ball is comparable to that of a golf ball due to its small size and round shape.
|
153 |
+
|
154 |
+
3. A ping pong ball: Ping pong balls are lightweight and hollow, much like golf balls. Although they may not have the same texture, their size and spherical shape make them feel somewhat similar when held in the hand.<|im_end|>
|
155 |
+
<|endoftext|>
|
156 |
+
|
157 |
+
```
|
158 |
+
</details>
|
159 |
+
|
160 |
+
<details>
|
161 |
+
<summary>Multi-turn</summary>
|
162 |
+
|
163 |
+
```
|
164 |
+
<|startoftext|><|startoftext|><|im_start|>system
|
165 |
+
You are a helpful AI assistant.
|
166 |
+
<|im_end|>
|
167 |
+
<|im_start|>user
|
168 |
+
Give an example of a healthy breakfast.
|
169 |
+
<|im_end|>
|
170 |
+
<|im_start|>assistant
|
171 |
+
A healthy breakfast could include:
|
172 |
+
|
173 |
+
1. A bowl of oatmeal made with water or low-fat milk, topped with fresh berries and a sprinkle of nuts or seeds (such as almonds, walnuts, chia seeds, or flaxseeds).
|
174 |
+
2. A slice of whole grain toast spread with natural peanut butter or almond butter, along with a side of sliced fruit like apples or bananas.
|
175 |
+
3. Greek yogurt mixed with honey and granola, served with a handful of blueberries or strawberries on the side.
|
176 |
+
4. A vegetable omelette made with egg whites or a combination of whole eggs and egg whites, filled with spinach, tomatoes, onions, and mushrooms, paired with a small serving of avocado slices.
|
177 |
+
5. A smoothie made with unsweetened almond milk, frozen fruits (like mangoes, pineapples, or berries), a scoop of protein powder, and a handful of leafy greens (like spinach or kale).
|
178 |
+
6. Whole grain cereal with skim milk, accompanied by a piece of fruit and a dollop of plain Greek yogurt for added protein.<|im_end|>
|
179 |
+
<|im_start|>user
|
180 |
+
Which of these would have the lowest calorie count while still making me feel full?
|
181 |
+
<|im_end|>
|
182 |
+
<|im_start|>assistant
|
183 |
+
The option with the lowest calorie count that will also make you feel full is Option 1: Oatmeal with fresh berries and nuts/seeds. Oatmeal is high in fiber, which helps keep you feeling full longer, and it's lower in calories compared to other options like smoothies and omelettes. The addition of fresh berries provides essential vitamins and minerals, while the nuts and seeds add healthy fats and proteins to help you stay satisfied until your next meal.<|im_end|>
|
184 |
+
<|endoftext|>
|
185 |
+
```
|
186 |
+
|
187 |
+
</details>
|
188 |
+
|
189 |
+
|
190 |
+
<details>
|
191 |
+
<summary>Multilingual</summary>
|
192 |
+
|
193 |
+
```
|
194 |
+
<|startoftext|><|im_start|>system
|
195 |
+
You are a helpful AI assistant.
|
196 |
+
<|im_end|>
|
197 |
+
<|im_start|>user
|
198 |
+
東京駅から池袋駅まで丸の内線で行きたいですが、普通に何時間かかりますか?
|
199 |
+
<|im_end|>
|
200 |
+
<|im_start|>assistant
|
201 |
+
東京駅から池袋駅まで丸の内線で行く場合、平均的には約20分程度かかります。しかし、これは一般的な情報であり、実際の旅行時間は運行状況や列車の種類、日付、時間帯などによって異なることに注意してください。<|im_end|>
|
202 |
+
<|endoftext|>
|
203 |
+
|
204 |
+
|
205 |
+
<|startoftext|><|im_start|>system
|
206 |
+
You are a helpful AI assistant.
|
207 |
+
<|im_end|>
|
208 |
+
<|im_start|>user
|
209 |
+
Opisz kilka ciekawych miejsc do odwiedzenia w Londynie
|
210 |
+
<|im_end|>
|
211 |
+
<|im_start|>assistant
|
212 |
+
1. Buckingham Palace: Jest to oficjalne siedzisko Królowej Brytanii, króla Brytanii i innych państw Członkowskich Zjednoczonego Królestwa. Można tu zobaczyć mający historię palac oraz obejrzeć ceremonię zmiany strażników na placu przed budynkiem.
|
213 |
+
|
214 |
+
2. Big Ben: To jest jedna z najbardziej rozpoznawalnych atrakcji turystycznych w Londynie. Jest to wieża zegarowa położona na terenie Parlamentu Wielkiej Brytanii i Senatu. Jej dźwiękowy sygnał można usłyszeć nawet na dalekie odległości.
|
215 |
+
|
216 |
+
3. Tower Bridge: Ten piękny most nad Tamizą oferuje widok na skyline Londynu. Otwiera się on pod koniec każdego d
|
217 |
+
```
|
218 |
+
|
219 |
+
</details>
|
220 |
+
|
221 |
+
|
222 |
+
<br/>
|
223 |
|
224 |
# Training details
|
225 |
|