mhhmm
/

typescript-instruct-20k-v2

Text Generation

instruction-tuning

code-generation

Model card Files Files and versions Metrics Training metrics Community

mhhmm commited on Dec 21, 2023

Commit

044920b

•

1 Parent(s): 50ed878

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -89,7 +89,7 @@ I'm using MultiPL-E benchmark, the same as Code Llmama using in their paper
 | Modal                                   | Pass@k | Estimate | Num problems  |
 |-----------------------------------------|--------|----------|---------------|
 | Code LLama - Instruct 13B               | 1      | 39.0%    | 159           |
-| Our  26B                                | 1      | 42.4%    | 159           |
 How to reproduce my evaluation? Just run like the offical document of MultiPL-E: https://nuprl.github.io/MultiPL-E/tutorial.html, change the modal name by my model here: `mhhmm/typescript-instruct-20k`

 | Modal                                   | Pass@k | Estimate | Num problems  |
 |-----------------------------------------|--------|----------|---------------|
 | Code LLama - Instruct 13B               | 1      | 39.0%    | 159           |
+| Our  13B                                | 1      | 42.4%    | 159           |
 How to reproduce my evaluation? Just run like the offical document of MultiPL-E: https://nuprl.github.io/MultiPL-E/tutorial.html, change the modal name by my model here: `mhhmm/typescript-instruct-20k`