List of small RP models (12 gb vram range). No benchmarks, only vibes. Updated 10/28/24.
finetunes
- Sao10K/L3-8B-Stheno-v3.2
- NeverSleep/Lumimaid-v0.2-8B
- Sao10K/Fimbulvetr-11B-v2
- mistralai/Mistral-Nemo-Instruct-2407 - base is good
- Sao10K/MN-12B-Lyra-v1
- nothingiisreal/MN-12B-Celeste-V1.9
- anthracite-org/magnum-12b-v2
- nbeerbower/mistral-nemo-gutenberg-12B-v2
- TeeZee/DarkForest-20B-v2.0
🧟♂️ merges
- MarinaraSpaghetti/NemoMix-Unleashed-12B - personal favorite
- Sao10K/L3-8B-Lunaris-v1
- aetherwiing/MN-12B-Starcannon-v3
misc. links
- /r/localllama
- /lmg/
- LMSys Chatbot Arena Leaderboard
- Uncensored General Intelligence Leaderboard
- /r/SillyTavernAI
- NothingiisReal discord
- NeverSleep discord
- SillyTavern discord
- BeaverAI discord