Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Add coding evaluations as sort option
#247
by
henryccook
- opened
A lot of the interest in the field of LLMs surrounds how well these models can produce code. Unfortunately, there isn't any very good coding leaderboards at the moment. There are some, such as https://huggingface.co./spaces/bigcode/bigcode-models-leaderboard, but they can be slow to update their model list and don't accurately reflect the current best LLMs for coding. Please add an optional coding metric, or even just create a separate leaderboard for these LLMs.
Hi
@henryccook
!
Thank you for your interest in the Leaderboard, and the suggestion :)
We're discussing with
@loubnabnl
on how to make the BigCode Leaderboard faster and more efficient for submissions, updates will happen on their repo!
clefourrier
changed discussion status to
closed