AgentInstruct: Toward Generative Teaching with Agentic Flows
Paper
•
2407.03502
•
Published
•
51
Synthetic Data papers
Papers and important approraches for generation of synthetic data
-
-
Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing
Paper • 2406.08464 • Published • 66 -
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Paper • 2404.14219 • Published • 254 -
DataDreamer: A Tool for Synthetic Data Generation and Reproducible LLM Workflows
Paper • 2402.10379 • Published • 30 -
Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling
Paper • 2401.16380 • Published • 48 -
Best Practices and Lessons Learned on Synthetic Data for Language Models
Paper • 2404.07503 • Published • 29 -
WizardLM: Empowering Large Language Models to Follow Complex Instructions
Paper • 2304.12244 • Published • 14 -
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Paper • 2402.13064 • Published • 47 -
Textbooks Are All You Need
Paper • 2306.11644 • Published • 143 -
Scaling Synthetic Data Creation with 1,000,000,000 Personas
Paper • 2406.20094 • Published • 98 -
Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models
Paper • 2404.18796 • Published • 68 -
Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models
Paper • 2405.20541 • Published • 22 -
Better Synthetic Data by Retrieving and Transforming Existing Datasets
Paper • 2404.14361 • Published • 2 -
Source2Synth: Synthetic Data Generation and Curation Grounded in Real Data Sources
Paper • 2409.08239 • Published • 17 -
TinyStories: How Small Can Language Models Be and Still Speak Coherent English?
Paper • 2305.07759 • Published • 33 -
Improving Text Embeddings with Large Language Models
Paper • 2401.00368 • Published • 79 -
Magicoder: Source Code Is All You Need
Paper • 2312.02120 • Published • 80 -
Do Not Worry if You Do Not Have Data: Building Pretrained Language Models Using Translationese
Paper • 2403.13638 • Published -
Benchmarking Large Language Models on Controllable Generation under Diversified Instructions
Paper • 2401.00690 • Published • 1 -
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset
Paper • 2402.10176 • Published • 36 -
SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning
Paper • 2401.07950 • Published • 4 -
Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Paper • 2312.06585 • Published • 28 -
Simple synthetic data reduces sycophancy in large language models
Paper • 2308.03958 • Published • 21 -
CodecLM: Aligning Language Models with Tailored Synthetic Data
Paper • 2404.05875 • Published • 17