Running
83
💻
Atla
company
Verified
AI & ML interests
Scalable oversight
Recent Activity
View all activity
AtlaAI's activity
kaikaidaiÂ
updated
a
Space
6 days ago
Promotion to get more voters
1
#7 opened 11 days ago
by
softclone
Post
1025
📈 Early results on the 8B evaluation model we've been training...
@NinaCalvi wrote about the progress we've made this quarter towards training the best 'LLM-as-a-judge' evaluator. We've significantly improved against the baseline and are approaching state-of-the-art evaluation performance with an 8B model.
Next up: training Llama-3.1-70B 👀
Here's the full article: https://www.atla-ai.com/post/evaluating-the-evaluator
@NinaCalvi wrote about the progress we've made this quarter towards training the best 'LLM-as-a-judge' evaluator. We've significantly improved against the baseline and are approaching state-of-the-art evaluation performance with an 8B model.
Next up: training Llama-3.1-70B 👀
Here's the full article: https://www.atla-ai.com/post/evaluating-the-evaluator
- 2 replies
About adding a judge model to the leaderboard
1
#6 opened 23 days ago
by
wangpf3
Which models do you want to see on here?
12
#2 opened about 1 month ago
by
kaikaidai
Apply for community grant: Company project (gpu and storage)
#5 opened 28 days ago
by
kaikaidai
What are Meta-Llama-3.1-Instruct "Turbo" models?
3
#4 opened about 1 month ago
by
m-ric
mbartoloÂ
authored
9
papers
8 months ago
Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension
Paper
•
2002.00293
•
Published
Interpretation of Natural Language Rules in Conversational Machine Reading
Paper
•
1809.01494
•
Published
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
Paper
•
2204.03162
•
Published
•
1
Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation
Paper
•
2104.08678
•
Published
Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks
Paper
•
2204.01906
•
Published
Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistants
Paper
•
2112.09062
•
Published
DMLR: Data-centric Machine Learning Research -- Past, Present and Future
Paper
•
2311.13028
•
Published
•
1
Human Feedback is not Gold Standard
Paper
•
2309.16349
•
Published
•
5
The PRISM Alignment Project: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models
Paper
•
2404.16019
•
Published
•
1
mbartoloÂ
authored
a
paper
11 months ago