Hugging Face's logo

rhysjones
/
phi-2-dpo-pairs

Text Generation
Transformers
Safetensors
phi-msft
custom_code
Inference Endpoints
Model card Files Community

This is a test DPO finetune of Microsoft phi-2

Two DPO datasets are used. Training was for 1 epoch as a qlora with rank 64.

Initial Evals

  • ARC: 63.14
  • TruthfulQA: 48.47
Downloads last month
17
Safetensors
Model size
2.78B params
Tensor type
BF16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.