Introducing the Synthetic Data Generator - Build Datasets with Natural Language
โข
78
ben burtenshaw
burtenshaw
AI & ML interests
None yet
Recent Activity
reacted
to
albertvillanova's
post
with ๐ฅ
5 days ago
Discover all the improvements in the new version of Lighteval: https://huggingface.co./docs/lighteval/
Articles
Organizations
burtenshaw's activity
reacted to
albertvillanova's
post with ๐ฅ
5 days ago
Post
1659
Discover all the improvements in the new version of Lighteval: https://huggingface.co./docs/lighteval/
reacted to
m-ric's
post with ๐ค๐๐ฅ
5 days ago
Post
4789
Since I published it on GitHub a few days ago,
Hugging Face's new agentic library ๐๐บ๐ผ๐น๐ฎ๐ด๐ฒ๐ป๐๐ has gathered nearly 4k stars ๐คฏ
โก๏ธ But we are just getting started on agents: so we are hiring an ML Engineer to join me and double down on this effort!
The plan is to build GUI agents: agents that can act on your computer with mouse & keyboard, like Claude Computer Use.
We will make it work better, and fully open. โจ
Sounds like something you'd like to do? Apply here ๐ https://apply.workable.com/huggingface/j/AF1D4E3FEB/
Hugging Face's new agentic library ๐๐บ๐ผ๐น๐ฎ๐ด๐ฒ๐ป๐๐ has gathered nearly 4k stars ๐คฏ
โก๏ธ But we are just getting started on agents: so we are hiring an ML Engineer to join me and double down on this effort!
The plan is to build GUI agents: agents that can act on your computer with mouse & keyboard, like Claude Computer Use.
We will make it work better, and fully open. โจ
Sounds like something you'd like to do? Apply here ๐ https://apply.workable.com/huggingface/j/AF1D4E3FEB/
- 3 replies
posted
an
update
24 days ago
Post
2663
People are flexing their end of year stats, so I made this app to show hub stats in a tidy design!
Thanks @Ameeeee and @jfcalvo for the feature from Argilla!
burtenshaw/recap
Thanks @Ameeeee and @jfcalvo for the feature from Argilla!
burtenshaw/recap
- 1 reply
reacted to
lhoestq's
post with โค๏ธ
about 1 month ago
Post
1699
Made a HF Dataset editor a la gg sheets here:
lhoestq/dataset-spreadsheets
With Dataset Spreadsheets:
โ๏ธ Edit datasets in the UI
๐ Share link with collaborators
๐ Use locally in DuckDB or Python
Available for the 100,000+ parquet datasets on HF :)
With Dataset Spreadsheets:
โ๏ธ Edit datasets in the UI
๐ Share link with collaborators
๐ Use locally in DuckDB or Python
Available for the 100,000+ parquet datasets on HF :)
posted
an
update
about 1 month ago
Post
2426
Quick update from week 1 of smol course. The community is taking the driving seat and using the material for their own projects. If you want to do the same, join in!
- we have ongoing translation projects in Korean, Vietnamese, Portuguese, and Spanish
- 3 chapters are ready for students. On topics like, instruction tuning, preference alignment, and parameter efficient fine tuning
- 3 chapters are in progress on evaluation, vision language models, and synthetic data.
- around 780 people have forked the repo to use it for learning, teaching, sharing.
โญ๏ธ Next step is to support people that want to use the course for teaching, content creation, internal knowledge sharing, or anything. If you're into this. Drop an issue or PR
REPO: https://buff.ly/3ZCMKX2
discord channel: https://buff.ly/4f9F8jA
- we have ongoing translation projects in Korean, Vietnamese, Portuguese, and Spanish
- 3 chapters are ready for students. On topics like, instruction tuning, preference alignment, and parameter efficient fine tuning
- 3 chapters are in progress on evaluation, vision language models, and synthetic data.
- around 780 people have forked the repo to use it for learning, teaching, sharing.
โญ๏ธ Next step is to support people that want to use the course for teaching, content creation, internal knowledge sharing, or anything. If you're into this. Drop an issue or PR
REPO: https://buff.ly/3ZCMKX2
discord channel: https://buff.ly/4f9F8jA
What model will the platform use?
reacted to
sayakpaul's
post with ๐ค
about 1 month ago
Post
2082
Introducing a high-quality open-preference dataset to further this line of research for image generation.
Despite being such an inseparable component for modern image generation, open preference datasets are a rarity!
So, we decided to work on one with the community!
Check it out here:
https://huggingface.co./blog/image-preferences
Despite being such an inseparable component for modern image generation, open preference datasets are a rarity!
So, we decided to work on one with the community!
Check it out here:
https://huggingface.co./blog/image-preferences
-
- 7 replies
reacted to
their
post with โค๏ธ
about 1 month ago
Post
2629
For anyone looking to boost their LLM fine-tuning and alignment skills this decemeber. We're running this free and open course called smol course. Itโs not big like Li Yin and
@mlabonne
, itโs just smol.
๐ท It focuses on practical use cases, so if youโre working on something, bring it along.
๐ฏโโ๏ธ Itโs peer reviewed and open so you can discuss and get feedback.
๐ค If youโre already a smol pro, feel free to drop a star or issue.
> > Part 1 starts now, and itโs on instruction tuning!
https://github.com/huggingface/smol-course
๐ท It focuses on practical use cases, so if youโre working on something, bring it along.
๐ฏโโ๏ธ Itโs peer reviewed and open so you can discuss and get feedback.
๐ค If youโre already a smol pro, feel free to drop a star or issue.
> > Part 1 starts now, and itโs on instruction tuning!
https://github.com/huggingface/smol-course
posted
an
update
about 1 month ago
Post
2629
For anyone looking to boost their LLM fine-tuning and alignment skills this decemeber. We're running this free and open course called smol course. Itโs not big like Li Yin and
@mlabonne
, itโs just smol.
๐ท It focuses on practical use cases, so if youโre working on something, bring it along.
๐ฏโโ๏ธ Itโs peer reviewed and open so you can discuss and get feedback.
๐ค If youโre already a smol pro, feel free to drop a star or issue.
> > Part 1 starts now, and itโs on instruction tuning!
https://github.com/huggingface/smol-course
๐ท It focuses on practical use cases, so if youโre working on something, bring it along.
๐ฏโโ๏ธ Itโs peer reviewed and open so you can discuss and get feedback.
๐ค If youโre already a smol pro, feel free to drop a star or issue.
> > Part 1 starts now, and itโs on instruction tuning!
https://github.com/huggingface/smol-course
posted
an
update
about 1 month ago
Post
1590
[SATURDAY ROUNDUP] โ๏ธ๐งโ๐
In case you missed everything this week. Itโs all about vision language models and image preference datasets. Here are the models and datasets you can use in your projects.
QWQ-32B-Preview is the first open weights model to reason like o1 with comparable performance. Itโs large but is acing some of the hardest tasks.
https://bsky.app/profile/philschmid.bsky.social/post/3lbylz6nzqk25
SmolVLM is a vision implementation of the recently released SmolLM2. It uses the Idefics3 approach to add a vision encoder. The main difference being the smaller language model (8b > 1.7b) and more compression of images. This results in a model that is very accurate for its memory footprint.
https://huggingface.co./blog/smolvlm
ColSmolVLM is a vision embedding model based on SmolVLM using the Colbert approach from ColPali. This is shown to be great at document retrieval and everyone should test it out in their RAG setups.
https://huggingface.co./posts/merve/663466156074132
In an effort to build a FLUX level open source image generation model, the community is building a dataset of image preferences. The dataset is already open and the project is still running. Join in!
https://huggingface.co./posts/davidberenstein1957/405018978675827
TRL tutorial Drop - This week I dropped a load of tutorials on finetuning and aligning models with TRL. If youโre upskilling in this space, you should check these out.
https://bsky.app/profile/benburtenshaw.bsky.social/post/3lbrc56ap3222
In case you missed everything this week. Itโs all about vision language models and image preference datasets. Here are the models and datasets you can use in your projects.
QWQ-32B-Preview is the first open weights model to reason like o1 with comparable performance. Itโs large but is acing some of the hardest tasks.
https://bsky.app/profile/philschmid.bsky.social/post/3lbylz6nzqk25
SmolVLM is a vision implementation of the recently released SmolLM2. It uses the Idefics3 approach to add a vision encoder. The main difference being the smaller language model (8b > 1.7b) and more compression of images. This results in a model that is very accurate for its memory footprint.
https://huggingface.co./blog/smolvlm
ColSmolVLM is a vision embedding model based on SmolVLM using the Colbert approach from ColPali. This is shown to be great at document retrieval and everyone should test it out in their RAG setups.
https://huggingface.co./posts/merve/663466156074132
In an effort to build a FLUX level open source image generation model, the community is building a dataset of image preferences. The dataset is already open and the project is still running. Join in!
https://huggingface.co./posts/davidberenstein1957/405018978675827
TRL tutorial Drop - This week I dropped a load of tutorials on finetuning and aligning models with TRL. If youโre upskilling in this space, you should check these out.
https://bsky.app/profile/benburtenshaw.bsky.social/post/3lbrc56ap3222
reacted to
davidberenstein1957's
post with โค๏ธ๐ฅ
about 1 month ago
Post
1580
๐ฅ Dataset Drop - Open Image Preferences
BlackForest Labs Flux Dev VS. Stability AI Stable Diffusion Large 3.5
Together with the โ data-is-better-together community, we've worked on an Apache 2.0 licensed open image preference dataset based on the fal ai imgsys prompts dataset. Thanks to the awesome community, we have managed to get 5K preference pairs in less than 2 days. The annotation alignment among annotators is great too.
Aashish Kumar won a month of Hugging Face Pro by making the most contributions! Congrats from the entire team ๐ฅ
The best thing?! We are not done yet! Let's keep the annotations coming for 5K more in the second part of the sprint! (with more prices to go around).
Dataset: https://huggingface.co./datasets/data-is-better-together/image-preferences-results
BlackForest Labs Flux Dev VS. Stability AI Stable Diffusion Large 3.5
Together with the โ data-is-better-together community, we've worked on an Apache 2.0 licensed open image preference dataset based on the fal ai imgsys prompts dataset. Thanks to the awesome community, we have managed to get 5K preference pairs in less than 2 days. The annotation alignment among annotators is great too.
Aashish Kumar won a month of Hugging Face Pro by making the most contributions! Congrats from the entire team ๐ฅ
The best thing?! We are not done yet! Let's keep the annotations coming for 5K more in the second part of the sprint! (with more prices to go around).
Dataset: https://huggingface.co./datasets/data-is-better-together/image-preferences-results
reacted to
davidberenstein1957's
post with โ๐๐ค๐ง ๐
about 2 months ago
Post
1707
Letโs make a generation of amazing image-generation models
The best image generation models are trained on human preference datasets, where annotators have selected the best image from a choice of two. Unfortunately, many of these datasets are closed source so the community cannot train open models on them. Letโs change that!
The community can contribute image preferences for an open-source dataset that could be used for building AI models that convert text to image, like the flux or stable diffusion families. The dataset will be open source so everyone can use it to train models that we can all use.
Blog: https://huggingface.co./blog/burtenshaw/image-preferences
The best image generation models are trained on human preference datasets, where annotators have selected the best image from a choice of two. Unfortunately, many of these datasets are closed source so the community cannot train open models on them. Letโs change that!
The community can contribute image preferences for an open-source dataset that could be used for building AI models that convert text to image, like the flux or stable diffusion families. The dataset will be open source so everyone can use it to train models that we can all use.
Blog: https://huggingface.co./blog/burtenshaw/image-preferences