Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 11.4k

Running on CPU Upgrade

I also see that https://huggingface.co./datasets/open-llm-leaderboard/requests/resolve/main/EpistemeAI/Fireball-12B-v1.13a-philosophers_eval_request_False_bfloat16_Original.json

Failed

Hi @legolasyiu ,

First of all, please, send the request files from the Requests dataset, for example, here is the request file for EpistemeAI/Athena-gemma-2-2b-it:
https://huggingface.co./datasets/open-llm-leaderboard/requests/blob/main/EpistemeAI/Athena-gemma-2-2b-it_eval_request_False_float16_Original.json
This way I can change the status of a model or check its history faster

Regarding the name, do you mean that you resubmitted a model with a new name?

I've resubmitted EpistemeAI/Fireball-12B-v1.13a-philosophers, please, check out the request file:
https://huggingface.co./datasets/open-llm-leaderboard/requests/blob/main/EpistemeAI/Fireball-12B-v1.13a-philosophers_eval_request_False_bfloat16_Original.json

Please, next time, feel free to open another discussion for failed models, since we try to follow one issue – one discussion rule

I resubmit the new version of the https://huggingface.co./datasets/open-llm-leaderboard/requests/blob/main/EpistemeAI/Athena-gemma-2-2b-it_eval_request_False_float16_Original.json

According to our FAQ, do not re-submit models yourself, but please open a discussion next time for us to re-submit your model. You can find our FAQ here:
https://huggingface.co./docs/leaderboards/open_llm_leaderboard/faq

I close this issue. Please, feel free to open a new one in case of any questions