Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
silviasapora
/
gemma-7b-orpo-noisy-7e-5-norm
like
0
Text Generation
Transformers
TensorBoard
Safetensors
silviasapora/dpo_7k_noisy_10
gemma
Generated from Trainer
alignment-handbook
trl
orpo
conversational
text-generation-inference
Inference Endpoints
arxiv:
2403.07691
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Deploy
Use this model
main
gemma-7b-orpo-noisy-7e-5-norm
Commit History
End of training
59acbea
verified
silviasapora
commited on
11 days ago
Model save
046b269
verified
silviasapora
commited on
11 days ago
Training in progress, step 315
301e456
verified
silviasapora
commited on
11 days ago
initial commit
3e30d36
verified
silviasapora
commited on
11 days ago