Model

Base Model: google/gemma-2-9b-it

Dataset

custom DPO dataset

For use

Load model directly

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ENERGY-DRINK-LOVE/gemma-2-9b_dpo-v4-hq")
model = AutoModelForCausalLM.from_pretrained("ENERGY-DRINK-LOVE/gemma-2-9b_dpo-v4-hq")

Downloads last month: 2,176

Safetensors

Model size

9.24B params

Tensor type

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.