metadata
license: gemma
datasets:
- sam-paech/gutenberg3-generalfiction-scifi-fantasy-romance-adventure-dpo
- sam-paech/gutenbergs_1_2_3_antislop-dpo
language:
- en
base_model:
- google/gemma-2-9b-it
library_name: transformers
tags:
- creative-writing
Oblivion's End
A merged LoRA for gemma-2-9b-it, trained using DPO datasets for creative writing using my DPO training notebook.
Model Details
Model Description
- Finetuned from model: google/gemma-2-9b-it
Model Sources [optional]
- Repository: GitHub.
Uses
Made for creative writing.
Training Details
Training Data
Check out the model card details.
Training Procedure
Model training performance (margins) are available in the wandb instance.
Training Hyperparameters
- Training regime: bf16 on a 1x 80GB A100 node.
Model Examination [optional]
[More Information Needed]
Environmental Impact
Total emissions are estimated to be 0.83 kgCO$_2$eq.