File size: 1,190 Bytes
a8e0ed5 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 |
---
license: gemma
datasets:
- sam-paech/gutenberg3-generalfiction-scifi-fantasy-romance-adventure-dpo
- sam-paech/gutenbergs_1_2_3_antislop-dpo
language:
- en
base_model:
- google/gemma-2-9b-it
library_name: transformers
tags:
- creative-writing
---
# Oblivion's End
A merged LoRA for gemma-2-9b-it, trained using DPO datasets for creative writing using [my DPO training notebook](https://github.com/mkturkcan/dpo-model-trainer).
## Model Details
### Model Description
- **Finetuned from model:** google/gemma-2-9b-it
### Model Sources [optional]
- **Repository:** [GitHub](https://github.com/mkturkcan/dpo-model-trainer/tree/main).
## Uses
Made for creative writing.
## Training Details
### Training Data
Check out the model card details.
### Training Procedure
Model training performance (margins) are available in the [wandb instance](https://api.wandb.ai/links/mkturkcan/4djkmhwp).
#### Training Hyperparameters
- **Training regime:** bf16 on a 1x 80GB A100 node.
## Model Examination [optional]
<!-- Relevant interpretability work for the model goes here -->
[More Information Needed]
## Environmental Impact
Total emissions are estimated to be 0.83 kgCO$_2$eq.
|