Open LLM Leaderboard: DROP deep dive
•
5
Nathan Habib
SaylorTwift
AI & ML interests
None yet
Recent Activity
new activity
7 days ago
open-llm-leaderboard/open_llm_leaderboard:Llama-3.1 70B Math Hard doesn't match its dataset
upvoted
a
paper
9 days ago
GenEx: Generating an Explorable World
Articles
Organizations
SaylorTwift's activity
Llama-3.1 70B Math Hard doesn't match its dataset
3
#1041 opened 10 days ago
by
MaziyarPanahi
upvoted
a
paper
9 days ago
reacted to
elliesleightholm's
post with 🤗
about 1 month ago
Post
2764
I made a beginners guide to Hugging Face Spaces 🤗 I hope it's useful to some of you :)
YouTube video: https://www.youtube.com/watch?v=xqdTFyRdtjQ
Blog: https://www.marqo.ai/blog/how-to-create-a-hugging-face-space
YouTube video: https://www.youtube.com/watch?v=xqdTFyRdtjQ
Blog: https://www.marqo.ai/blog/how-to-create-a-hugging-face-space
- 8 replies
posted
an
update
about 1 month ago
Post
386
How do I test an LLM for my unique needs?
If you work in finance, law, or medicine, generic benchmarks are not enough.
This blog post uses Argilla, Distilllabel and 🌤️Lighteval to generate evaluation dataset and evaluate models.
https://github.com/argilla-io/argilla-cookbook/blob/main/domain-eval/README.md
If you work in finance, law, or medicine, generic benchmarks are not enough.
This blog post uses Argilla, Distilllabel and 🌤️Lighteval to generate evaluation dataset and evaluate models.
https://github.com/argilla-io/argilla-cookbook/blob/main/domain-eval/README.md
reacted to
Symbol-LLM's
post with 🔥
about 1 month ago
Post
945
🥳 Thrilled to introduce our recent efforts on bootstrapping VLMs for multi-modal chain-of-thought reasoning !
📕 Title: Vision-Language Models Can Self-Improve Reasoning via Reflection
🔗 Link: Vision-Language Models Can Self-Improve Reasoning via Reflection (2411.00855)
😇Takeaways:
- We found that VLMs can self-improve reasoning performance through a reflection mechanism, and importantly, this approach can scale through test-time computing.
- Evaluation on comprehensive and diverse Vision-Language reasoning tasks are included !
📕 Title: Vision-Language Models Can Self-Improve Reasoning via Reflection
🔗 Link: Vision-Language Models Can Self-Improve Reasoning via Reflection (2411.00855)
😇Takeaways:
- We found that VLMs can self-improve reasoning performance through a reflection mechanism, and importantly, this approach can scale through test-time computing.
- Evaluation on comprehensive and diverse Vision-Language reasoning tasks are included !
reacted to
cfahlgren1's
post with ❤️
about 1 month ago
Post
3086
You can clean and format datasets entirely in the browser with a few lines of SQL.
In this post, I replicate the process @mlabonne used to clean the new microsoft/orca-agentinstruct-1M-v1 dataset.
The cleaning process consists of:
- Joining the separate splits together / add split column
- Converting string messages into list of structs
- Removing empty system prompts
https://huggingface.co./blog/cfahlgren1/the-beginners-guide-to-cleaning-a-dataset
Here's his new cleaned dataset: mlabonne/orca-agentinstruct-1M-v1-cleaned
In this post, I replicate the process @mlabonne used to clean the new microsoft/orca-agentinstruct-1M-v1 dataset.
The cleaning process consists of:
- Joining the separate splits together / add split column
- Converting string messages into list of structs
- Removing empty system prompts
https://huggingface.co./blog/cfahlgren1/the-beginners-guide-to-cleaning-a-dataset
Here's his new cleaned dataset: mlabonne/orca-agentinstruct-1M-v1-cleaned
- 1 reply
updated
a
dataset
about 2 months ago
updated
a
collection
about 2 months ago