Xiaosen Zheng's picture

Xiaosen Zheng

xszheng2020

·

AI & ML interests

Data-Centric AI and AI Safety.

Recent Activity

upvoted a collection about 6 hours ago

liked a model 18 days ago

microsoft/phi-4

liked a model 25 days ago

Snowflake/snowflake-arctic-embed-m-v2.0

View all activity

Organizations

xszheng2020's activity

upvoted a collection about 6 hours ago

DeepSeek-R1

8 items • Updated 5 days ago • 143

upvoted an article 25 days ago

Article

Fine-tune ModernBERT for text classification using synthetic data

By

•

27 days ago

• 26

upvoted 2 collections 29 days ago

NeMo Curator - Classifier Models

Classifier models that can be used in NeMo Curator for labelling/filtering datasets. • 9 items • Updated 9 days ago • 13

FastText Model for Pretraining Data Curation

4 items • Updated Oct 30, 2024 • 1

upvoted a paper about 1 month ago

OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domain

Paper • 2412.13018 • Published Dec 17, 2024 • 41

upvoted 2 collections about 2 months ago

🔱 Sailor2 Language Models

Sailing in South-East Asia with Inclusive Multilingual LLMs • 9 items • Updated Dec 3, 2024 • 22

DCLM Pools

Raw pools for use in DCLM competition • 5 items • Updated Jul 17, 2024 • 1

upvoted 2 papers 3 months ago

Sample-Efficient Alignment for LLMs

Paper • 2411.01493 • Published Nov 3, 2024 • 10

Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing

Paper • 2406.08464 • Published Jun 12, 2024 • 67

upvoted a collection 3 months ago

MagpieLM

Aligning LMs with Fully Open Recipe + Synthetic Data Generated from Open-Source LMs. • 9 items • Updated 13 days ago • 16

upvoted a paper 3 months ago

Unleashing Reasoning Capability of LLMs via Scalable Question Synthesis from Scratch

Paper • 2410.18693 • Published Oct 24, 2024 • 40

upvoted 3 collections 3 months ago

ScaleQuest

We introduce ScaleQuest, a scalable and novel data synthesis method. Project Page: https://scalequest.github.io/ • 9 items • Updated 19 days ago • 6

C4AI Aya Expanse

Aya Expanse is an open-weight research release of a model with highly advanced multilingual capabilities. • 3 items • Updated Dec 16, 2024 • 30

BGE

23 items • Updated 15 days ago • 76

upvoted an article 3 months ago

Article

SmolLM - blazingly fast and remarkably powerful

Jul 16, 2024

• 299

upvoted a paper 3 months ago

Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

Paper • 2401.16380 • Published Jan 29, 2024 • 48

upvoted an article 4 months ago

Article

Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models

Mar 20, 2024

• 74

upvoted 2 papers 4 months ago

Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates

Paper • 2410.07137 • Published Oct 9, 2024 • 7

Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale

Paper • 2409.17115 • Published Sep 25, 2024 • 61

upvoted a paper 5 months ago

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler

Paper • 2408.13359 • Published Aug 23, 2024 • 23