Spanish and LLM Benchmarks: is MMLU Lost in Translation?
Paper
•
2406.17789
•
Published
•
1
La Leaderboard
community
AI & ML interests
LLM Leaderboard for Spanish Varieties and Official Languages
Recent Activity
View all activity
la-leaderboard's activity
javicond3
authored
5
papers
5 days ago
How Stable is Stable Diffusion under Recursive InPainting (RIP)?
Paper
•
2407.09549
•
Published
•
1
Using large language models to estimate features of multi-word expressions: Concreteness, valence, arousal
Paper
•
2408.16012
•
Published
Evaluating Large Language Models with Tests of Spanish as a Foreign Language: Pass or Fail?
Paper
•
2409.15334
•
Published
•
1
Multiple Choice Questions: Reasoning Makes Large Language Models (LLMs) More Self-Confident Even When They Are Wrong
Paper
•
2501.09775
•
Published
•
26
gonzmart
authored
a
paper
5 days ago
reviriego
authored
a
paper
6 days ago
mariagrandury
updated
a
dataset
9 days ago
Agregar idioma
4
#12 opened about 2 months ago
by
BarraHome
submission model queue
3
#14 opened 10 days ago
by
shitianqi
Some Evaluate Results are zero
1
#13 opened about 2 months ago
by
shitianqi
albertvillanova
posted
an
update
19 days ago
Post
1867
Discover all the improvements in the new version of Lighteval: https://huggingface.co./docs/lighteval/
mariagrandury
updated
a
Space
about 1 month ago
clefourrier
authored
a
paper
about 2 months ago
We like this leaderboard, but the queue is long ...
3
#11 opened 2 months ago
by
longyuewang
SaylorTwift
posted
an
update
2 months ago
Post
432
How do I test an LLM for my unique needs?
If you work in finance, law, or medicine, generic benchmarks are not enough.
This blog post uses Argilla, Distilllabel and 🌤️Lighteval to generate evaluation dataset and evaluate models.
https://github.com/argilla-io/argilla-cookbook/blob/main/domain-eval/README.md
If you work in finance, law, or medicine, generic benchmarks are not enough.
This blog post uses Argilla, Distilllabel and 🌤️Lighteval to generate evaluation dataset and evaluate models.
https://github.com/argilla-io/argilla-cookbook/blob/main/domain-eval/README.md
albertvillanova
posted
an
update
2 months ago
Post
1646
🚨 How green is your model? 🌱 Introducing a new feature in the Comparator tool: Environmental Impact for responsible #LLM research!
👉 open-llm-leaderboard/comparator
Now, you can not only compare models by performance, but also by their environmental footprint!
🌍 The Comparator calculates CO₂ emissions during evaluation and shows key model characteristics: evaluation score, number of parameters, architecture, precision, type... 🛠️
Make informed decisions about your model's impact on the planet and join the movement towards greener AI!
👉 open-llm-leaderboard/comparator
Now, you can not only compare models by performance, but also by their environmental footprint!
🌍 The Comparator calculates CO₂ emissions during evaluation and shows key model characteristics: evaluation score, number of parameters, architecture, precision, type... 🛠️
Make informed decisions about your model's impact on the planet and join the movement towards greener AI!
albertvillanova
posted
an
update
3 months ago
Post
1569
🚀 New feature of the Comparator of the 🤗 Open LLM Leaderboard: now compare models with their base versions & derivatives (finetunes, adapters, etc.). Perfect for tracking how adjustments affect performance & seeing innovations in action. Dive deeper into the leaderboard!
🛠️ Here's how to use it:
1. Select your model from the leaderboard.
2. Load its model tree.
3. Choose any base & derived models (adapters, finetunes, merges, quantizations) for comparison.
4. Press Load.
See side-by-side performance metrics instantly!
Ready to dive in? 🏆 Try the 🤗 Open LLM Leaderboard Comparator now! See how models stack up against their base versions and derivatives to understand fine-tuning and other adjustments. Easier model analysis for better insights! Check it out here: open-llm-leaderboard/comparator 🌐
🛠️ Here's how to use it:
1. Select your model from the leaderboard.
2. Load its model tree.
3. Choose any base & derived models (adapters, finetunes, merges, quantizations) for comparison.
4. Press Load.
See side-by-side performance metrics instantly!
Ready to dive in? 🏆 Try the 🤗 Open LLM Leaderboard Comparator now! See how models stack up against their base versions and derivatives to understand fine-tuning and other adjustments. Easier model analysis for better insights! Check it out here: open-llm-leaderboard/comparator 🌐
albertvillanova
posted
an
update
3 months ago
Post
3147
🚀 Exciting update! You can now compare multiple models side-by-side with the Hugging Face Open LLM Comparator! 📊
open-llm-leaderboard/comparator
Dive into multi-model evaluations, pinpoint the best model for your needs, and explore insights across top open LLMs all in one place. Ready to level up your model comparison game?
open-llm-leaderboard/comparator
Dive into multi-model evaluations, pinpoint the best model for your needs, and explore insights across top open LLMs all in one place. Ready to level up your model comparison game?
albertvillanova
posted
an
update
3 months ago
Post
1236
🚨 Instruct-tuning impacts models differently across families! Qwen2.5-72B-Instruct excels on IFEval but struggles with MATH-Hard, while Llama-3.1-70B-Instruct avoids MATH performance loss! Why? Can they follow the format in examples? 📊 Compare models:
open-llm-leaderboard/comparator