T3Q-LLM's picture
Update README.md
e6bdeb6 verified
metadata
library_name: transformers
tags: []

Model Card for Model ID

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: [More Information Needed]
  • Funded by [optional]: [More Information Needed]
  • Shared by [optional]: [More Information Needed]
  • Model type: [More Information Needed]
  • Language(s) (NLP): [More Information Needed]
  • License: [More Information Needed]
  • Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

  • Repository: [More Information Needed]
  • Paper [optional]: [More Information Needed]
  • Demo [optional]: [More Information Needed]

Uses

Direct Use

[More Information Needed]

Downstream Use [optional]

[More Information Needed]

hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Dora16-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8

Task Version Metric Value Stderr
kobest_boolq 0 acc 0.9530 ± 0.0057
macro_f1 0.9530 ± 0.0057
kobest_copa 0 acc 0.7860 ± 0.0130
macro_f1 0.7858 ± 0.0130
kobest_hellaswag 0 acc 0.5220 ± 0.0224
acc_norm 0.5560 ± 0.0222
macro_f1 0.5190 ± 0.0223
kobest_sentineg 0 acc 0.8791 ± 0.0164
macro_f1 0.8786 ± 0.0165