Commit
•
3384098
1
Parent(s):
440afbb
Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,8 @@ datasets:
|
|
| 13 |
|
| 14 |
This is a 32K version of Smaug-Llama-3-70B-Instruct. It uses PoSE (https://arxiv.org/abs/2309.10400) and LoRA (https://arxiv.org/abs/2106.09685) adapter transfer. More details are coming soon.
|
| 15 |
|
|
|
|
|
|
|
| 16 |
|
| 17 |
|
| 18 |
### Model Description
|
|
|
|
| 13 |
|
| 14 |
This is a 32K version of Smaug-Llama-3-70B-Instruct. It uses PoSE (https://arxiv.org/abs/2309.10400) and LoRA (https://arxiv.org/abs/2106.09685) adapter transfer. More details are coming soon.
|
| 15 |
|
| 16 |
+
Needle-In-A-Haystack (https://github.com/jzhang38/EasyContext) heatmap:
|
| 17 |
+
|
| 18 |
|
| 19 |
|
| 20 |
### Model Description
|