Update README.md
Browse files
README.md
CHANGED
@@ -35,13 +35,33 @@ Please note this is not for the purpose of production, but result of Fine Tuning
|
|
35 |
|
36 |
The llama3 Tokens where kept the same, however the format was slight customized using the available tokens
|
37 |
|
38 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
39 |
<|begin_of_text|> <|start_header_id|>user<|end_header_id|>
|
40 |
-
{
|
41 |
-
{
|
42 |
-
{
|
43 |
-
{
|
44 |
-
{
|
45 |
-
Thank you for your answer.<|eot_id
|
46 |
You're most welcome, what would like to know next?<|eot_id|>
|
47 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
35 |
|
36 |
The llama3 Tokens where kept the same, however the format was slight customized using the available tokens
|
37 |
|
38 |
+
I have foregone the {{.System}} part as this would be updated when converting the llama3.
|
39 |
+
|
40 |
+
I wanted to test if the model would understand additional headers that I created such as what my datasets has
|
41 |
+
- Analaysis, Classification, Sentiment
|
42 |
+
|
43 |
+
First pass through my ~30K personalized customized dataset.
|
44 |
+
|
45 |
+
If would like to know how I started creating my dataset, you can check this link
|
46 |
+
[Crafting GPT2 for Personalized AI-Preparing Data the Long Way (Part1)](https://medium.com/@deeokay/the-soul-in-the-machine-crafting-gpt2-for-personalized-ai-9d38be3f635f)
|
47 |
+
|
48 |
+
As the data was getting created with custom special tokens, I had to convert that to the llama3 Template.
|
49 |
+
|
50 |
+
However I got creative again..
|
51 |
+
|
52 |
+
```python
|
53 |
<|begin_of_text|> <|start_header_id|>user<|end_header_id|>
|
54 |
+
{{.Prompt}}<|eot_id|><|start_header_id|>analysis<|end_header_id|>
|
55 |
+
{{.Analysis}}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
56 |
+
{{.Response}P<|eot_id|><|start_header_id|>classification<|end_header_id|>
|
57 |
+
{{.Classification}}<|eot_id|><|start_header_id|>sentiment<|end_header_id|>
|
58 |
+
{{.Sentiment}}<|eot_id|> <|start_header_id|>user<|end_header_id|>
|
59 |
+
Thank you for your answer.<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
60 |
You're most welcome, what would like to know next?<|eot_id|>
|
61 |
```
|
62 |
+
|
63 |
+
For now, the llama3 standard template seems to hold, and can be created in Ollama through normal llama3 template
|
64 |
+
|
65 |
+
Will be updating this monthly.. as I have limited colab resources..
|
66 |
+
|
67 |
+
|