Longxu Dou's picture

Longxu Dou PRO

dreamerdeo

·

https://longxudou.github.io/

AI & ML interests

Natural Language Processing

Recent Activity

upvoted an article about 13 hours ago

双流并行(DualPipe) 没有双流会更好

upvoted an article about 13 hours ago

DualPipe could be better without the Dual

new activity 4 days ago

sail/Sailor2-20B-SFT:The number in model.safetensors.index.json is inconsistent with the number of safetensors.

View all activity

Organizations

dreamerdeo's activity

upvoted 2 articles about 13 hours ago

Article

双流并行(DualPipe) 没有双流会更好

By

•

about 17 hours ago

• 3

Article

DualPipe could be better without the Dual

By

•

about 17 hours ago

• 9

upvoted a paper 10 days ago

Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs

Paper • 2502.12982 • Published 10 days ago • 13

upvoted a paper about 2 months ago

Exploring Multi-Grained Concept Annotations for Multimodal Large Language Models

Paper • 2412.05939 • Published Dec 8, 2024 • 16

upvoted 5 collections 3 months ago

Sailor2 Benchmarks

1 item • Updated Dec 3, 2024 • 2

Sailor2 Post-training Datasets

4 items • Updated 12 days ago • 5

Sailor2 Pre-training Datasets

8 items • Updated Dec 4, 2024 • 4

Sailor2 Models

10 items • Updated 4 days ago • 5

🔱 Sailor2 Language Models

Sailing in South-East Asia with Inclusive Multilingual LLMs • 34 items • Updated 5 days ago • 25

upvoted 2 collections 4 months ago

OpenCoder Model

OpenCoder Models • 9 items • Updated Nov 19, 2024 • 10

OS-Atlas

OS-Atlas series models • 7 items • Updated Nov 18, 2024 • 13

upvoted an article 7 months ago

Article

RegMix: Data Mixture as Regression for Language Model Pre-training

By

•

Jul 11, 2024

• 11

upvoted a collection 7 months ago

📈 Scaling Laws with Vocabulary

Increase your vocabulary size when you scale up your language model • 5 items • Updated Aug 11, 2024 • 6

upvoted a paper 7 months ago

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published Jul 18, 2024 • 54

upvoted a paper 8 months ago

Bootstrapping Language Models with DPO Implicit Rewards

Paper • 2406.09760 • Published Jun 14, 2024 • 39

upvoted 2 collections 8 months ago

💡 DICE

Self-alignment with DPO Implicit Rewards • 5 items • Updated Jul 28, 2024 • 9

🧬 RegMix: Data Mixture as Regression

Automatic data mixture method for large language model pre-training • 10 items • Updated Jul 26, 2024 • 8

upvoted a paper 8 months ago

RegMix: Data Mixture as Regression for Language Model Pre-training

Paper • 2407.01492 • Published Jul 1, 2024 • 36

upvoted a collection 10 months ago

Datasets for Pretrained Thai LLM

List Datasets for pretrained Thai LLM by PyThaiNLP • 23 items • Updated Sep 12, 2024 • 10

upvoted an article 10 months ago

Article

Large-scale Near-deduplication Behind BigCode

May 16, 2023

• 21