Update README.md
Browse files
README.md
CHANGED
@@ -14,7 +14,7 @@ tags:
|
|
14 |
- **License:** mit
|
15 |
- **Finetuned from model :** openai/gpt2
|
16 |
|
17 |
-
This model is trained on the [documentation of Godot 4.3](https://docs.godotengine.org/en/stable/index.html) as of 2024-10-07
|
18 |
|
19 |
The plan: Train this model more using the dataset I've organised to make a GPT style wiki for the Godot game engine.
|
20 |
|
@@ -22,4 +22,5 @@ GPT2 is under a [modified MIT license](https://github.com/openai/gpt-2/blob/mast
|
|
22 |
|
23 |
**Version Notes:**
|
24 |
|
25 |
-
- In need of tons more time training
|
|
|
|
14 |
- **License:** mit
|
15 |
- **Finetuned from model :** openai/gpt2
|
16 |
|
17 |
+
This model is trained on the [documentation of Godot 4.3](https://docs.godotengine.org/en/stable/index.html) as of 2024-10-07. It has gotten to 62k/100k steps on the first training, at 0.460700 training loss. It completed training with V2 adjustments, down below 0.28 training loss, approx.
|
18 |
|
19 |
The plan: Train this model more using the dataset I've organised to make a GPT style wiki for the Godot game engine.
|
20 |
|
|
|
22 |
|
23 |
**Version Notes:**
|
24 |
|
25 |
+
- V1: In need of tons more time training
|
26 |
+
- V2: Low percent section of answers are closer; higher percentage of answers add higher inaccuracy on the answers.
|