altomek
/

Higgs-Llama-3-70B-4bpw-EXL2

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Higgs-Llama-3-70B-4bpw-EXL2 / README.md

altomek's picture

Update README.md

ff1380c verified 3 months ago

|

history blame contribute delete

179 Bytes

metadata

base_model: bosonai/Higgs-Llama-3-70B
license: other
inference: false

Higgs-Llama-3-70B

ExLlamav2 4 bpw 8 hb quants of https://huggingface.co./bosonai/Higgs-Llama-3-70B