Maria Khalusova

MariaK

AI & ML interests

None yet

Recent Activity

Articles

Organizations

Docs Demos's profile picture HF Course Demos's profile picture Hugging Face OSS Metrics's profile picture Hugging Face for Computer Vision's profile picture Women on Hugging Face's profile picture

MariaK's activity

New activity in MariaK/Check-my-progress-Audio-Course about 1 month ago
New activity in MariaK/Check-my-progress-Audio-Course 5 months ago

Cant access

6
#4 opened 6 months ago by
sgonzalezsilot
New activity in MariaK/Audio-Course-Certification 5 months ago

Space throws an error

2
#6 opened 6 months ago by
constantinSch
liked a Space 8 months ago
New activity in MariaK/Audio-Course-Certification 9 months ago

The space doesn't work

2
#4 opened 9 months ago by
nickprock
reacted to m-ric's post with ๐Ÿš€๐Ÿ”ฅโค๏ธ 9 months ago
view post
Post
2041
๐—จ๐˜€๐—ถ๐—ป๐—ด ๐—Ÿ๐—Ÿ๐— -๐—ฎ๐˜€-๐—ฎ-๐—ท๐˜‚๐—ฑ๐—ด๐—ฒ ๐Ÿง‘โ€โš–๏ธ ๐—ณ๐—ผ๐—ฟ ๐—ฎ๐—ป ๐—ฎ๐˜‚๐˜๐—ผ๐—บ๐—ฎ๐˜๐—ฒ๐—ฑ ๐—ฎ๐—ป๐—ฑ ๐˜ƒ๐—ฒ๐—ฟ๐˜€๐—ฎ๐˜๐—ถ๐—น๐—ฒ ๐—ฒ๐˜ƒ๐—ฎ๐—น๐˜‚๐—ฎ๐˜๐—ถ๐—ผ๐—ป

Evaluating LLM outputs is often hard, since many tasks require open-ended answers for which no deterministic metrics work: for instance, when asking a model to summarize a text, there could be hundreds of correct ways to do it. The most versatile way to grade these outputs is then human evaluation, but it is very time-consuming, thus costly.

๐Ÿค” Then ๐˜„๐—ต๐˜† ๐—ป๐—ผ๐˜ ๐—ฎ๐˜€๐—ธ ๐—ฎ๐—ป๐—ผ๐˜๐—ต๐—ฒ๐—ฟ ๐—Ÿ๐—Ÿ๐—  ๐˜๐—ผ ๐—ฑ๐—ผ ๐˜๐—ต๐—ฒ ๐—ฒ๐˜ƒ๐—ฎ๐—น๐˜‚๐—ฎ๐˜๐—ถ๐—ผ๐—ป, by providing it relevant rating criteria? ๐Ÿ‘‰ This is the idea behind LLM-as-a-judge.

โš™๏ธ To implement a LLM judge correctly, you need a few tricks.
โœ… So ๐—œ'๐˜ƒ๐—ฒ ๐—ท๐˜‚๐˜€๐˜ ๐—ฝ๐˜‚๐—ฏ๐—น๐—ถ๐˜€๐—ต๐—ฒ๐—ฑ ๐—ฎ ๐—ป๐—ฒ๐˜„ ๐—ป๐—ผ๐˜๐—ฒ๐—ฏ๐—ผ๐—ผ๐—ธ ๐˜€๐—ต๐—ผ๐˜„๐—ถ๐—ป๐—ด ๐—ต๐—ผ๐˜„ ๐˜๐—ผ ๐—ถ๐—บ๐—ฝ๐—น๐—ฒ๐—บ๐—ฒ๐—ป๐˜ ๐—ถ๐˜ ๐—ฝ๐—ฟ๐—ผ๐—ฝ๐—ฒ๐—ฟ๐—น๐˜† ๐—ถ๐—ป ๐—ผ๐˜‚๐—ฟ ๐—›๐˜‚๐—ด๐—ด๐—ถ๐—ป๐—ด ๐—™๐—ฎ๐—ฐ๐—ฒ ๐—–๐—ผ๐—ผ๐—ธ๐—ฏ๐—ผ๐—ผ๐—ธ! (you can run it instantly in Google Colab)
โžก๏ธ ๐—Ÿ๐—Ÿ๐— -๐—ฎ๐˜€-๐—ฎ-๐—ท๐˜‚๐—ฑ๐—ด๐—ฒ ๐—ฐ๐—ผ๐—ผ๐—ธ๐—ฏ๐—ผ๐—ผ๐—ธ: https://huggingface.co./learn/cookbook/llm_judge

The Cookbook is a great collection of notebooks demonstrating recipes (thus the "cookbook") for common LLM usages. I recommend you to go take a look!
โžก๏ธ ๐—”๐—น๐—น ๐—ฐ๐—ผ๐—ผ๐—ธ๐—ฏ๐—ผ๐—ผ๐—ธ๐˜€: https://huggingface.co./learn/cookbook/index

Thank you @MariaK for your support!
  • 2 replies
ยท
reacted to andrewyng's post with ๐Ÿ‘ 10 months ago
view post
Post
DeepLearning.AI just announced a new short course: Open Source Models with Hugging Face ๐Ÿค—, taught by Hugging Face's own Maria Khalusova, Marc Sun and Younes Belkada!

As many of you already know, Hugging Face has been a game changer by letting developers quickly grab any of hundreds of thousands of already-trained open source models to assemble into new applications. This course teaches you best practices for building this way, including how to search and choose among models.

You'll learn to use the Transformers library and walk through multiple models for text, audio, and image processing, including zero-shot image segmentation, zero-shot audio classification, and speech recognition. You'll also learn to use multimodal models for visual question answering, image search, and image captioning. Finally, youโ€™ll learn how to demo what you build locally, on the cloud, or via an API using Gradio and Hugging Face Spaces.

Thank you very much to Hugging Face's wonderful team for working with us on this.

You can sign up for the course here: https://www.deeplearning.ai/short-courses/open-source-models-hugging-face/
  • 1 reply
ยท
New activity in huggingface/cookbook-images 10 months ago
New activity in MariaK/Audio-Course-Certification 10 months ago
New activity in huggingface/cookbook-images 10 months ago

Upload 4 files

#7 opened 10 months ago by
akirus
New activity in huggingface/cookbook-images 11 months ago

Upload 2 files

1
#4 opened 11 months ago by
m-ric