lapp0
/

distily_bench_obj_cross_v2.15_gpt2

Generated from Trainer

8-bit precision

Model card Files Files and versions Metrics Training metrics Community

distily_bench_obj_cross_v2.15_gpt2 / logs

1 contributor

History: 8 commits

This model has 1 file scanned as unsafe.

lapp0's picture

End of training

f71c803 verified 3 months ago

copy_teacher_modules=_(_lm_head___True)_, hs_layer_mapper=last, hs_loss_fn=mse, hs_weight=1.0
Training in progress, step 12375 3 months ago
dataset_subset=default, dataset_uri=distily_c4_multilingual_1M, learning_rate=0.0001, per_device_train_batch_size=4
End of training 3 months ago
dataset_subset=default, dataset_uri=distily_c4_multilingual_1M
Training in progress, step 24750 3 months ago
hs_layer_mapper=last, hs_loss_fn=mse, hs_weight=1.0
End of training 3 months ago
learning_rate=0.0001, per_device_train_batch_size=4
End of training 3 months ago
completed.flag

0 Bytes

End of training 3 months ago
events.out.tfevents.1724126966.02dbb11e2dcc

5.85 MB
LFS

End of training 3 months ago
events.out.tfevents.1724131158.02dbb11e2dcc

578 Bytes
LFS

End of training 3 months ago