Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale
Paper
•
2409.17115
•
Published
•
59
🫐 ProX Projects
Collection for: "Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale"
-
-
gair-prox/FineWeb-pro
Viewer • Updated • 63.1M • 3.51k • 14 -
gair-prox/open-web-math-pro
Viewer • Updated • 2.58M • 2.87k • 8 -
gair-prox/RedPajama-pro
Viewer • Updated • 10.2M • 1.27k • 4 -
gair-prox/c4-pro
Viewer • Updated • 40.1M • 1.58k • 4 -
gair-prox/Mistral-7B-ProXMath
Text Generation • Updated • 49 • 3 -
gair-prox/FW-ProX-1.7B
Text Generation • Updated • 22 • 3 -
gair-prox/web-chunk-refining-lm
Text Generation • Updated • 35 • 4 -
gair-prox/web-doc-refining-lm
Text Generation • Updated • 54 • 4 -
gair-prox/math-doc-refining-lm
Text Generation • Updated • 19 • 2 -
gair-prox/math-chunk-refining-lm
Text Generation • Updated • 27 -
gair-prox/TinyLlama-1.1B-ProXMath
Updated • 8 • 2 -
gair-prox/Llama-2-7B-ProXMath
Text Generation • Updated • 35 • 1 -
gair-prox/CodeLlama-7B-ProXMath
Updated • 18 • 1 -
gair-prox/RedPJ-ProX-0.7B
Updated • 11 • 1 -
gair-prox/RedPJ-ProX-0.3B
Updated • 18 • 2 -
gair-prox/RedPJ-ProX-1.7B
Updated • 10 • 2 -
gair-prox/C4-ProX-1.7B
Updated • 26 • 1