Note:

This repo hosts only a Q5_K_S of lynn-A2.7B-rp-v1. GGUF quant is from mradermacher/lynn-A2.7B-rp-v1-GGUF. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpp_hf.

Downloads last month: 30

GGUF

Model size

14.3B params

Architecture

qwen2moe

5-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for Clevyby/lynn-A2.7B-rp-v1-14.3b-32k-Q5_K_S-GGUF

Base model

elyn-dev/lynn-A2.7B-rp-v1

Quantized

(2)

this model