averoo (Sergei Averkiev)

upvoted a paper 16 days ago

SciLitLLM: How to Adapt LLMs for Scientific Literature Understanding

Paper • 2408.15545 • Published 23 days ago • 32

upvoted a paper about 2 months ago

The Llama 3 Herd of Models

Paper • 2407.21783 • Published Jul 31 • 102

upvoted a collection about 2 months ago

Awesome SFT datasets

Collection

A curated list of interesting datasets to fine-tune language models with. • 43 items • Updated Apr 12 • 111

upvoted a paper about 2 months ago

Data Mixture Inference: What do BPE Tokenizers Reveal about their Training Data?

Paper • 2407.16607 • Published Jul 23 • 21

upvoted 6 papers 3 months ago

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries

Paper • 2406.12824 • Published Jun 18 • 20

FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generation

Paper • 2406.08392 • Published Jun 12 • 18

Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning

Paper • 2406.09170 • Published Jun 13 • 24

upvoted a collection 3 months ago

Nemotron 4 340B

Collection

Nemotron-4: open models for Synthetic Data Generation (SDG). Includes Base, Instruct, and Reward models. • 4 items • Updated Jul 17 • 156

upvoted 3 papers 4 months ago

ChemLLM: A Chemical Large Language Model

Paper • 2402.06852 • Published Feb 10 • 26

Aya 23: Open Weight Releases to Further Multilingual Progress

Paper • 2405.15032 • Published May 23 • 26

Your Transformer is Secretly Linear

Paper • 2405.12250 • Published May 19 • 149

upvoted an article 4 months ago

Article

Fine-tune Llama 3 with ORPO

By

•

Apr 22

• 221

upvoted a paper 5 months ago

OmniFusion Technical Report

Paper • 2404.06212 • Published Apr 9 • 73

upvoted a paper 7 months ago

PALO: A Polyglot Large Multimodal Model for 5B People

Paper • 2402.14818 • Published Feb 22 • 23

upvoted 2 papers 8 months ago

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper • 2312.00752 • Published Dec 1, 2023 • 138

Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

Paper • 2401.00448 • Published Dec 31, 2023 • 27

upvoted 3 papers 9 months ago

What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning

Paper • 2312.15685 • Published Dec 25, 2023 • 17

LLaMA Beyond English: An Empirical Study on Language Capability Transfer

Paper • 2401.01055 • Published Jan 2 • 53

Kandinsky 3.0 Technical Report

Paper • 2312.03511 • Published Dec 6, 2023 • 43

upvoted a paper 10 months ago

FusionFrames: Efficient Architectural Aspects for Text-to-Video Generation Pipeline

Paper • 2311.13073 • Published Nov 22, 2023 • 56

upvoted 2 papers 12 months ago

Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusion

Paper • 2310.03502 • Published Oct 5, 2023 • 77

Qwen Technical Report

Paper • 2309.16609 • Published Sep 28, 2023 • 34

Sergei Averkiev

AI & ML interests

Organizations

averoo's activity