LoneStriker
/

Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2

1 contributor

History: 4 commits

LoneStriker's picture

Added note on repetition penalty setting

b17120c 12 months ago

.gitattributes

1.52 kB

initial commit 12 months ago
README.md

5.07 kB

Added note on repetition penalty setting 12 months ago
added_tokens.json

36 Bytes

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2 12 months ago
config.json

686 Bytes

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2 12 months ago
generation_config.json

132 Bytes

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2 12 months ago
output-00001-of-00003.safetensors

8.59 GB
LFS

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2 12 months ago
output-00002-of-00003.safetensors

8.59 GB
LFS

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2 12 months ago
output-00003-of-00003.safetensors

3.58 GB
LFS

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2 12 months ago
pytorch_model.bin.index.json

44.8 kB

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2 12 months ago
special_tokens_map.json

458 Bytes

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2 12 months ago
tokenization_yi.py

8.96 kB

Update README.md 12 months ago
tokenizer.model

1.03 MB
LFS

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2 12 months ago
tokenizer_config.json

1.44 kB

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2 12 months ago