Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
---
|
4 |
+
# LeTI: Learning to Generate from Textual Interactions
|
5 |
+
|
6 |
+
Official model checkpoint for paper [LeTI: Learning to Generate from Textual Interactions](https://arxiv.org/abs/2305.10314).
|
7 |
+
|
8 |
+
The code associated with these checkpoints can be found [here](https://github.com/xingyaoww/LeTI).
|
9 |
+
|
10 |
+
Decompress the model checkpoint `data.tar.gz` (using `tar -xzvf data.tar.gz`) will create a folder `data`.
|
11 |
+
After decompress the checkpoints, you can set `export GS_BUCKET_PREFIX=`pwd`` and run evaluation of your choice following [this](https://github.com/xingyaoww/LeTI/blob/main/docs/EVAL.md).
|
12 |
+
|
13 |
+
We currently release the following checkpoints in the paper:
|
14 |
+
|
15 |
+
- **LeTI (350M)**: `mbpp-ft/actor-rw-conditioned/codegen-350M-mono/350M+rw_conditioned+mixpretrain+50x3+lr1e-5/checkpoint_31416`
|
16 |
+
- **LeTI (2B)**: `mbpp-ft/actor-rw-conditioned/codegen-2B-mono/2B+rw_conditioned+mixpretrain+10x3+lr5e-6/checkpoint_13465`
|