metadata

license: apache-2.0
license_link: https://huggingface.co./Qwen/Qwen2.5-7B-Instruct-1M/blob/main/LICENSE
language:
  - en
pipeline_tag: text-generation
base_model: Qwen/Qwen2.5-7B-Instruct-1M
tags:
  - chat
  - llama-cpp
  - gguf-my-repo
library_name: transformers

IntelligentEstate/Israfel_Qwen2.6-iQ4_K_M-GGUF(Undergoing testing)

Follows the protocal of the replicant models and their tool use with the latest improvements to the Qwen2.5 series Name inspired by the Poem "Israfel" by Edgar Allen

This model was converted to GGUF format from Qwen/Qwen2.5-7B-Instruct-1M using llama.cpp Refer to the original model card for more details on the model.

Use with llama.cpp

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

Invoke the llama.cpp server or the CLI.