Self-Rewarding Language Models
Paper
•
2401.10020
•
Published
•
143
reading...
-
-
Exponentially Faster Language Modelling
Paper • 2311.10770 • Published • 118 -
Fine-tuning Language Models for Factuality
Paper • 2311.08401 • Published • 28 -
NEFTune: Noisy Embeddings Improve Instruction Finetuning
Paper • 2310.05914 • Published • 14 -
Sparse Finetuning for Inference Acceleration of Large Language Models
Paper • 2310.06927 • Published • 14 -
Efficient Streaming Language Models with Attention Sinks
Paper • 2309.17453 • Published • 13 -
Representation Engineering: A Top-Down Approach to AI Transparency
Paper • 2310.01405 • Published • 5 -
Finite Scalar Quantization: VQ-VAE Made Simple
Paper • 2309.15505 • Published • 21 -
Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers
Paper • 2311.10642 • Published • 23