store 'downloads' and 'created_at' fields as well

#534

It makes it very easy to calculate "trending" models based on this dataset.
Then people only need to grab model_info for the models they deem necessary.

I realize 'created_at' is a constant field, but I hope this one exception can be made.

Motivation

I'm experimenting with an alternate "view" of the leaderboard where recent and trending models can be filtered:
https://huggingface.co./spaces/gblazex/leaderboard

Open LLM Leaderboard org

Following the creation of this PR, an ephemeral Space HuggingFaceH4/open_llm_leaderboard-ci-pr-534 has been started. Any changes pushed to this PR will be synced with the test Space.
Since this PR has not been created by a trusted author, the ephemeral Space has not been configured with the correct hardware, storage, and secrets. An admin must configure it manually.
(This is an automated message.)

more on what this PR makes possible:

Screenshot 2024-01-14 at 14.07.42.png

https://twitter.com/gblazex/status/1744602366798594150

Open LLM Leaderboard org
edited Jan 15

Hi! Interesting idea, lgtm!
Can you add the corresponding columns and checkboxes (donwload, creation date) so that people can display this info in the Open LLM Leaderboard?
If that's not trivial for you I'll add them during the week

Open LLM Leaderboard org

And very nice idea about the trending models space! Cool job :)

Sure I can do that.

I think “Days on hub” or something similar is better than Creation Date.
It’s a column with shorter values (less screen space, mentally easier to parse, easier to order by)

Thoughts?

Open LLM Leaderboard org

Works for me!

Is it possible you merge this in the meantime Clémentine?

I can create a separate pull for the UI updates.

Open LLM Leaderboard org

No problem! If you end up not having the time to code the rest, please ping me so I think about adding it :)

clefourrier changed pull request status to merged
Open LLM Leaderboard org

PR is now merged/closed. The ephemeral Space has been deleted.
(This is an automated message.)

sure. Thank you!

This was merged 7 hours ago, and the dataset was updated 30 mins ago but still doesn't seem to include new fields.

Any idea why?

Open LLM Leaderboard org

Not at all, I'll debug this ^^"

Open LLM Leaderboard org

Found the bug, I had forgotten to commit a oneliner - it should be better soon!

great work Clémentine! Thank you for being so quick

Dynamic dataset still not updated with new fields. I just checked.

Open LLM Leaderboard org
edited Jan 17

Argh, I think it was correct once then reverted - the leaderboard's cache (without the modifs) was pushed - I'll need to reedit the file, then restart the leaderboard precisely then

  • I'll also need addition of new models, in the submit file

it's all good now Clémentine, the leaderboard will keep improving. :)

Sign up or log in to comment