Edit model card

Model Card for Model ID

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: [More Information Needed]
  • Funded by [optional]: [More Information Needed]
  • Shared by [optional]: [More Information Needed]
  • Model type: [More Information Needed]
  • Language(s) (NLP): [More Information Needed]
  • License: [More Information Needed]
  • Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

  • Repository: [More Information Needed]
  • Paper [optional]: [More Information Needed]
  • Demo [optional]: [More Information Needed]

Uses

Direct Use

[More Information Needed]

Downstream Use [optional]

[More Information Needed]

hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Dora16-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8

Task Version Metric Value Stderr
kobest_boolq 0 acc 0.9530 ± 0.0057
macro_f1 0.9530 ± 0.0057
kobest_copa 0 acc 0.7860 ± 0.0130
macro_f1 0.7858 ± 0.0130
kobest_hellaswag 0 acc 0.5220 ± 0.0224
acc_norm 0.5560 ± 0.0222
macro_f1 0.5190 ± 0.0223
kobest_sentineg 0 acc 0.8791 ± 0.0164
macro_f1 0.8786 ± 0.0165
Downloads last month
9
Safetensors
Model size
10.8B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.