Update README.md

README.md

@@ -16,19 +16,18 @@ Created using [TinyLlama-1.1B](https://huggingface.co/TinyLlama/tinyLlama-interm
 
 Of note, the base checkpoint used was from commit "final model" fad4f1a5cd0563ac41349b8fec2e6e51156568a0 which was subsequently reverted, and not the current main branch 3T checkpoint of TinyLlama-1.1B.
 
-Wikitext (wikitext-2-raw-v1_train) Perplexity (64 rows) as evaluated by [exllamav2](https://github.com/turboderp/exllamav2):
-```
-Base Model
-2048: 8.5633
-4096: 208.3586
-8192: 863.7507
-16384: 1600.5021
-32768: 6981.9021
+### Wikitext (wikitext-2-raw-v1_train) Perplexity (64 rows) as evaluated via [exllamav2](https://github.com/turboderp/exllamav2):
 
-32k Model
-2048: 8.6548
-4096: 7.8339
-8192: 7.4904
-16384: 7.3674
-32768: 7.1338
-```
+| Model                  | 2048   | 4096     | 8192      | 16384     | 32768     |
+| ---------------------- | ------ | -------- | --------- | --------- | --------- |
+| TinyLlama-1.1B         | 8.5633 | 208.3586 | 863.7507  | 1600.5021 | 6981.9021 |
+| TinyLlama-1.1B-32k     | 8.6548 | 7.8339   | 7.4904    | 7.3674    | 7.1338    |
+
+### Evaluation on HumanEval by [turboderp](https://huggingface.co/turboderp):
+
+| Model                                  | Pass@1      | Pass@10     |
+| -------------------------------------- | ----------- | ----------- |
+| TinyLlama-1.1B                         | 0.0841      | 0.1524      |
+| TinyLlama-1.1B (NTK alpha=7.7)         | 0.0598      | 0.1098      |
+| TinyLlama-1.1B-32k-ckpt-554            | 0.0732      | 0.1402      |
+| TinyLlama-1.1B-32k                     | 0.0829      | 0.1524      |