Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
silviasapora
/
gemma-7b-borpo-noisy-5e-5-norm
like
0
Text Generation
Transformers
TensorBoard
Safetensors
silviasapora/dpo_7k_noisy_10
gemma
Generated from Trainer
alignment-handbook
trl
orpo
conversational
text-generation-inference
Inference Endpoints
arxiv:
2403.07691
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Deploy
Use this model
bdc4e6b
gemma-7b-borpo-noisy-5e-5-norm
/
train_results.json
Commit History
Model save
1b4d2ba
verified
silviasapora
commited on
11 days ago
Model save
3f60c04
verified
silviasapora
commited on
11 days ago
Model save
698477f
verified
silviasapora
commited on
12 days ago