---
license: apache-2.0
license_link: https://huggingface.co./Qwen/Qwen2.5-7B-Instruct-1M/blob/main/LICENSE
language:
- en
pipeline_tag: text-generation
base_model: Qwen/Qwen2.5-7B-Instruct-1M
tags:
- chat
- llama-cpp
- gguf-my-repo
library_name: transformers
---

# IntelligentEstate/Israfel_Qwen2.6-iQ4_K_M-GGUF(Undergoing testing)

Follows the protocal of the replicant models and their tool use with the latest improvements to the Qwen2.5 series
Name inspired by the Poem "Israfel" by Edgar Allen

![Screenshot 2025-01-23 at 18-07-03 lAt1395RTAy3atYVmQtZxA (WEBP Image 720 × 1280 pixels).png](https://cdn-uploads.huggingface.co/production/uploads/6593502ca2607099284523db/dZ0Vlu4ViKKeFwXcql5p3.png)

This model was converted to GGUF format from [`Qwen/Qwen2.5-7B-Instruct-1M`](https://huggingface.co./Qwen/Qwen2.5-7B-Instruct-1M) using llama.cpp
Refer to the [original model card](https://huggingface.co./Qwen/Qwen2.5-7B-Instruct-1M) for more details on the model.

## Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)

```bash
brew install llama.cpp

```
Invoke the llama.cpp server or the CLI.