llmixer
/

QuartetAnemoi-70B-t0.0001-8bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

QuartetAnemoi-70B-t0.0001-8bpw-h6-exl2 / README.md

llmixer's picture

Create README.md

9f9cf54 verified 11 months ago

|

history blame contribute delete

253 Bytes

metadata

license: llama2
language:
  - en
pipeline_tag: conversational
tags:
  - 8bpw
  - h6
  - exl2

Exllamav2 8bpw h6 quant for alchemonaut/QuartetAnemoi-70B-t0.0001.

Default calibration dataset.