Improving Text Embeddings with Large Language Models
Paper
•
2401.00368
•
Published
•
79
Papers I have / will read in 2024
This collection contains all the papers (on ArXiv) that either I've read or I will read in 2024, including a short summary / conclusion
Note Got to generate this after reading it for the first time https://hf.co/datasets/alvarobartt/improving-text-embeddings-with-llms , but still missing too many pieces to put together a `distilabel` pipeline to easily generate the whole dataset (still closed sourced, unreleased)
-
Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study
Paper • 2404.10719 • Published • 4 -
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
Paper • 2404.08801 • Published • 63 -
Pre-training Small Base LMs with Fewer Tokens
Paper • 2404.08634 • Published • 34