step 150k | |
temperature 0.2: {'pass@1': 0.006436314363143637, 'pass@10': 0.017889215840761093, 'pass@100': 0.018292682926829267} | |
temperature 0.8: {'pass@1': 0.0042682926829268305, 'pass@10': 0.023148428817837293, 'pass@100': 0.050225398989338275} | |
step 250k | |
temperature 0.8: {'pass@1': 0.007723577235772357, 'pass@10': 0.03226252154582702, 'pass@100': 0.06587111162129897} |