---
title: Swahili Llm Leaderboard
emoji: 🔥
colorFrom: gray
colorTo: green
sdk: streamlit
sdk_version: 1.34.0
app_file: app.py
pinned: false
license: apache-2.0
---
# 🏆 Swahili LLM-Leaderboard

A joint community effort to create a Swahili central leaderboard for LLMs. These models are currently evaluated on the Open LLM Leaderboard. Contributions and corrections are welcome! <br>
We refer to a model being "open" if it can be locally deployed and used commercially.

## Interactive Dashboard

https://swahili-llm-leaderboard.streamlit.app/ <be>

## Leaderboard

| Model Name | Publisher| Open? | Basemodel |Average| ARC  | HellaSwag      | MMLU         | TruthfulQA|Winogrande|GSM8K           |
| ---------- | -------- | ----- | --------- |------ | ---- | -------------- | ------------ | --------- | -------- | -------------- |
| [Mollel/Swahili Gemma](https://huggingface.co./Mollel/Swahili_Gemma)| Mollel| Yes|Gemma|61.32|58.96|76.4 |61.02| 52.1|75.61|43.82|
| [Mollel/Swahili-Alpaca-Llama-3-8b_16bit](https://huggingface.co./Mollel/Swahili-Alpaca-Llama-3-8b_16bit)| Mollel| Yes|Llama-3|60.97|57.25|78.03|63.97| 50.13|76.87|39.58|
| [mwitiderrick/SwahiliInstruct-v0.1](https://huggingface.co./mwitiderrick/SwahiliInstruct-v0.1)| Derrick| Yes|Mistral|58.92|57.59|80.92 |57| 58.08|74.66|25.25|
| [mwitiderrick/SwahiliInstruct-v0.2](https://huggingface.co./mwitiderrick/SwahiliInstruct-v0.2)| Derrick| Yes|Mistral|54.25|55.2|78.22|50.3|57.08|73.24|11.45|