RegMix: Data Mixture as Regression for Language Model Pre-training
Paper
•
2407.01492
•
Published
•
33
•
7
Xiaosen Zheng
xszheng2020
AI & ML interests
Interpretability (Data-Centric) and Safety.
Organizations
xszheng2020's activity
commented
a
paper
29 days ago