Doctor-Shotgun
/

TinyLlama-1.1B-32k

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Doctor-Shotgun commited on Jan 3

Commit

8359b19

•

1 Parent(s): 7dfebcc

Update README.md

Files changed (1) hide show

README.md +10 -10

README.md CHANGED Viewed

@@ -18,16 +18,16 @@ Of note, the base checkpoint used was from commit "final model" fad4f1a5cd0563ac
 ### Wikitext (wikitext-2-raw-v1_train) Perplexity (64 rows) as evaluated via [exllamav2](https://github.com/turboderp/exllamav2):
-| Model                  | 2048   | 4096     | 8192      | 16384     | 32768     |
-| ---------------------- | ------ | -------- | --------- | --------- | --------- |
-| TinyLlama-1.1B         | 8.5633 | 208.3586 | 863.7507  | 1600.5021 | 6981.9021 |
-| TinyLlama-1.1B-32k     | 8.6548 | 7.8339   | 7.4904    | 7.3674    | 7.1338    |
 ### Evaluation on HumanEval by [turboderp](https://huggingface.co/turboderp):
-| Model                                  | Pass@1      | Pass@10     |
-| -------------------------------------- | ----------- | ----------- |
-| TinyLlama-1.1B                         | 0.0841      | 0.1524      |
-| TinyLlama-1.1B (NTK alpha=7.7)         | 0.0598      | 0.1098      |
-| TinyLlama-1.1B-32k-ckpt-554            | 0.0732      | 0.1402      |
-| TinyLlama-1.1B-32k                     | 0.0829      | 0.1524      |

 ### Wikitext (wikitext-2-raw-v1_train) Perplexity (64 rows) as evaluated via [exllamav2](https://github.com/turboderp/exllamav2):
+| Model                  | 2048       | 4096       | 8192       | 16384      | 32768      |
+| ---------------------- | ---------- | ---------- | ---------- | ---------- | ---------- |
+| TinyLlama-1.1B         | **8.5633** | 208.3586   | 863.7507   | 1600.5021  | 6981.9021  |
+| **TinyLlama-1.1B-32k** | 8.6548     | **7.8339** | **7.4904** | **7.3674** | **7.1338** |
 ### Evaluation on HumanEval by [turboderp](https://huggingface.co/turboderp):
+| Model                                  | Pass@1          | Pass@10     |
+| -------------------------------------- | --------------- | ----------- |
+| TinyLlama-1.1B                         | **0.0841**      | **0.1524**  |
+| TinyLlama-1.1B (NTK alpha=7.7)         | 0.0598          | 0.1098      |
+| TinyLlama-1.1B-32k-ckpt-554            | 0.0732          | 0.1402      |
+| **TinyLlama-1.1B-32k**                 | 0.0829          | **0.1524**  |