
Foundation Text-Generation Models Below 360M Parameters
Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.
Text Generation • Updated • 19.3k • • 39Note License: apache-2.0
OuteAI/Lite-Oute-1-300M
Text Generation • Updated • 366 • 7Note License: apache-2.0
keeeeenw/MicroLlama
Text Generation • Updated • 1.85k • 42Note License: apache-2.0
cerebras/Cerebras-GPT-256M
Text Generation • Updated • 2k • 25Note License: apache-2.0
upstage/TinySolar-248m-4k
Text Generation • Updated • 805 • 5Note License: apache-2.0
M4-ai/TinyMistral-248M-v3
Text Generation • Updated • 240 • 6Note License: apache-2.0
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • Updated • 846 • 2Note License: apache-2.0
MiniLLM/MiniPLM-Qwen-200M
Text Generation • Updated • 155 • 2Note License: apache-2.0
princeton-nlp/Sheared-Pythia-160m
Text Generation • Updated • 165 • 4Note License: apache-2.0
JackFram/llama-160m
Text Generation • Updated • 265k • 33Note License: apache-2.0
SmallDoge/Doge-160M
Text Generation • Updated • 6.83k • 2Note License: apache-2.0
EleutherAI/pythia-160m
Text Generation • Updated • 154k • • 29Note License: apache-2.0
HuggingFaceTB/SmolLM-135M
Text Generation • Updated • 173k • • 197Note License: apache-2.0
amd/AMD-Llama-135m
Text Generation • Updated • 17.4k • • 111Note License: apache-2.0
MiniLLM/MiniPLM-Mamba-130M
Text Generation • Updated • 23 • 2Note License: apache-2.0
EleutherAI/gpt-neo-125m
Text Generation • Updated • 138k • • 196Note License: mit
cerebras/Cerebras-GPT-111M
Text Generation • Updated • 4.46k • • 76Note License: apache-2.0
BEE-spoke-data/smol_llama-101M-GQA
Text Generation • Updated • 5.03k • • 28Note License: apache-2.0
openai-community/gpt2
Text Generation • Updated • 16.6M • • 2.6kNote License: mit
distilbert/distilgpt2
Text Generation • Updated • 1.84M • • 488Note License: apache-2.0
weiser/82M-0.4
Text Generation • Updated • 56Note License: apache-2.0
BEE-spoke-data/smol_llama-81M-tied
Text Generation • Updated • 2.95k • 6Note License: apache-2.0
EleutherAI/pythia-70m
Updated • 74.7k • 64Note License: apache-2.0
JackFram/llama-68m
Text Generation • Updated • 529k • 26Note License: apache-2.0
OuteAI/Lite-Oute-1-65M
Text Generation • Updated • 218 • 9Note License: apache-2.0
SmallDoge/Doge-60M
Text Generation • Updated • 25.2k • 4Note License: apache-2.0
Felladrin/Minueza-32M-Base
Text Generation • Updated • 429 • 16Note License: apache-2.0
GerbilLab/Gerbil-A-32m
Text Generation • Updated • 175 • 2Note License: apache-2.0
EleutherAI/pythia-31m
Text Generation • Updated • 12.3k • 5Note License: apache-2.0
SmallDoge/Doge-20M
Text Generation • Updated • 21.6k • 7Note License: apache-2.0
EleutherAI/pythia-14m
Text Generation • Updated • 119k • 20Note License: apache-2.0