This is electra base tuned with optimal lr, lr scheduler and weight decay on dnd-style-intents dataset.

parametrs value
learning rate 5e-5
lr scheduler linear
weight decay 0

Model has next metrics on test data from dataset

metric value
accuracy 0.985
Macro F1 0.983
Micro F1 0.985
Downloads last month
12
Safetensors
Model size
331M params
Tensor type
F32
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train neurae/opt-dnd-intents