File size: 645 Bytes
e3804cb da27179 c420fdf da27179 a36cb6f da27179 a36cb6f da27179 7f96148 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
license: openrail
---
MathT5-large is a version of FLAN-T5-large fine-tuned for 25 epochs on 15K (LaTeX) synthetic mathematical derivations (containing 5 - 9 equations), generated using a symbolic solver.
It outperforms GPT-4 and ChatGPT (paper link soon) on a derivation generation task in ROUGE, BLEU, BLEURT, and GLEU, and shows some generalisation capabilities.
It was trained on 155 physics symbols, but struggles with out-of-vocabulary symbols.
An example prompt:
Given \cos{(q)} = \theta{(q)},
then derive - \sin{(q)} = \frac{d}{d q} \theta{(q)},
then obtain (- \sin{(q)})^{q} (\frac{d}{d q} \cos{(q)})^{q} = (- \sin{(q)})^{2 q} |