lapp0
/

distily_bench_obj_cross_v2.13_gpt2

Generated from Trainer

8-bit precision

Model card Files Files and versions Metrics Training metrics Community

distily_bench_obj_cross_v2.13_gpt2 / logs

1 contributor

History: 24 commits

This model has 1 file scanned as unsafe.

lapp0's picture

End of training

fa57b17 verified 3 months ago

hs_layer_mapper=all, hs_loss_fn=cos, hs_weight=1.0
Training in progress, step 7425 3 months ago
hs_layer_mapper=all, hs_loss_fn=kl, hs_weight=1.0
Training in progress, step 7425 3 months ago
hs_layer_mapper=all, hs_loss_fn=mse, hs_weight=1.0
Training in progress, step 7425 3 months ago
hs_layer_mapper=last, hs_loss_fn=cos, hs_weight=1.0
Training in progress, step 7425 3 months ago
hs_layer_mapper=last, hs_loss_fn=kl, hs_weight=1.0
Training in progress, step 7425 3 months ago
hs_layer_mapper=last, hs_loss_fn=mse, hs_weight=1.0
Training in progress, step 7425 3 months ago
hs_layer_mapper=uniform_cons, hs_loss_fn=cos, hs_weight=1.0
End of training 3 months ago
hs_layer_mapper=uniform_cons, hs_loss_fn=kl, hs_weight=1.0
Training in progress, step 7425 3 months ago
hs_layer_mapper=uniform_cons, hs_loss_fn=mse, hs_weight=1.0
Training in progress, step 7425 3 months ago
hs_layer_mapper=uniform_last, hs_loss_fn=kl, hs_weight=1.0
Training in progress, step 7425 3 months ago
hs_layer_mapper=uniform_last, hs_loss_fn=mse, hs_weight=1.0
Training in progress, step 7425 3 months ago
logits_loss_only
Training in progress, step 7425 3 months ago