AIFunOver
/

Qwen2.5-14B-Instruct-1M-openvino-8bit

Text Generation

8-bit precision

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Qwen2.5-14B-Instruct-1M-openvino-8bit

1 contributor

History: 15 commits

AIFunOver's picture

Upload sparse_attention_config.json with huggingface_hub

7b9d2d1 verified about 1 month ago

.gitattributes

1.52 kB

initial commit about 1 month ago
config.json

876 Bytes

Upload config.json with huggingface_hub about 1 month ago
generation_config.json

243 Bytes

Upload generation_config.json with huggingface_hub about 1 month ago
model.safetensors.index.json

47.5 kB

Upload model.safetensors.index.json with huggingface_hub about 1 month ago
openvino_config.json

644 Bytes

Upload openvino_config.json with huggingface_hub about 1 month ago
openvino_detokenizer.bin

1.58 MB
LFS

Upload openvino_detokenizer.bin with huggingface_hub about 1 month ago
openvino_detokenizer.xml

11.1 kB

Upload openvino_detokenizer.xml with huggingface_hub about 1 month ago
openvino_model.bin

14.8 GB
LFS

Upload openvino_model.bin with huggingface_hub about 1 month ago
openvino_model.xml

4.03 MB

Upload openvino_model.xml with huggingface_hub about 1 month ago
openvino_tokenizer.bin

3.77 MB
LFS

Upload openvino_tokenizer.bin with huggingface_hub about 1 month ago
openvino_tokenizer.xml

24.8 kB

Upload openvino_tokenizer.xml with huggingface_hub about 1 month ago
sparse_attention_config.json

118 kB

Upload sparse_attention_config.json with huggingface_hub about 1 month ago
tokenizer.json

7.03 MB

Upload tokenizer.json with huggingface_hub about 1 month ago
tokenizer_config.json

7.23 kB

Upload tokenizer_config.json with huggingface_hub about 1 month ago
vocab.json

2.78 MB

Upload vocab.json with huggingface_hub about 1 month ago