cognitivecomputations/Dolphin3.0-Qwen2.5-3b
Updated
ā¢
427
ā¢
14
Samuel L Meyers PRO
MrOvkill
AI & ML interests
Dialogue Generation, Text Generation, etc...
Recent Activity
liked
a model
about 2 hours ago
cognitivecomputations/Dolphin3.0-Qwen2.5-3b
liked
a model
about 2 hours ago
cognitivecomputations/Dolphin3.0-Llama3.1-8B
liked
a Space
about 12 hours ago
Rooni/AIDC-AI-Marco-o1
Organizations
MrOvkill's activity
liked
2
models
about 2 hours ago
liked
a
Space
about 12 hours ago
liked
a
model
about 12 hours ago
liked
a
model
about 13 hours ago
liked
a
Space
about 13 hours ago
reacted to
MoritzLaurer's
post with ā¤ļø
about 14 hours ago
Post
1485
The TRL v0.13 release is š„! My highlight are the new process reward trainer to train models similar to o1 and tool call support:
š§ Process reward trainer: Enables training of Process-supervised Reward Models (PRMs), which reward the quality of intermediate steps, promoting structured reasoning. Perfect for tasks like stepwise reasoning.
š Model merging: A new callback leverages mergekit to merge models during training, improving performance by blending reference and policy models - optionally pushing merged models to the Hugging Face Hub.
š ļø Tool call support: TRL preprocessing now supports tool integration, laying the groundwork for agent fine-tuning with examples like dynamic temperature fetching in prompts.
āļø Mixture of judges: The new AllTrueJudge combines decisions from multiple binary judges for more nuanced evaluation.
Read the release notes and other resources here š
Release: https://github.com/huggingface/trl/releases/tag/v0.13.0
Mergekit: https://github.com/arcee-ai/mergekit
Mixture of judges paper: The Perfect Blend: Redefining RLHF with Mixture of Judges (2409.20370)
š§ Process reward trainer: Enables training of Process-supervised Reward Models (PRMs), which reward the quality of intermediate steps, promoting structured reasoning. Perfect for tasks like stepwise reasoning.
š Model merging: A new callback leverages mergekit to merge models during training, improving performance by blending reference and policy models - optionally pushing merged models to the Hugging Face Hub.
š ļø Tool call support: TRL preprocessing now supports tool integration, laying the groundwork for agent fine-tuning with examples like dynamic temperature fetching in prompts.
āļø Mixture of judges: The new AllTrueJudge combines decisions from multiple binary judges for more nuanced evaluation.
Read the release notes and other resources here š
Release: https://github.com/huggingface/trl/releases/tag/v0.13.0
Mergekit: https://github.com/arcee-ai/mergekit
Mixture of judges paper: The Perfect Blend: Redefining RLHF with Mixture of Judges (2409.20370)
liked
2
datasets
1 day ago
liked
a
model
2 days ago
liked
a
Space
2 days ago
liked
a
model
3 days ago
liked
a
Space
14 days ago
liked
a
model
14 days ago
liked
a
Space
19 days ago
liked
a
Space
24 days ago
liked
a
Space
26 days ago
liked
a
model
26 days ago
liked
2
datasets
about 2 months ago