ODIN-RM & RLHF models
Collection
The ODIN and the policies trained by ODIN
•
8 items
•
Updated
Model Details
This is an official implementation of ODIN-ppo-L230-7B model, which is a chat assistant trained by fine-tuning LLaMA on Open-Assistant dataset via PPO. The L230 means the output length in LIMA test set is ~230. ODIN is the reward model for the training.
Model Description
- Developed by: Lichang-Chen and Chen Zhu
- Model type: RLHF model.
- Language(s) (NLP): English
- Finetuned from model: Vicuna-7b
Model Sources
- Repository: ODIN
- Paper: ODIN: Disentangled Reward Mitigates Hacking in RLHF
- Downloads last month
- 12
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.