Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
trl-lib
's Collections
Preference datasets
Stepwise supervision datasets
Prompt-completion datasets
Prompt-only datasets
Unpaired preference datasets
Comparing DPO with IPO and KTO
Online-DPO
Unpaired preference datasets
updated
4 days ago
Upvote
-
trl-lib/ultrafeedback-gpt-3.5-turbo-helpfulness
Viewer
•
Updated
4 days ago
•
16.6k
•
117
trl-lib/kto-mix-14k
Viewer
•
Updated
Mar 25, 2024
•
15k
•
230
•
6
Upvote
-
Share collection
View history
Collection guide
Browse collections