Edit Models filters

Inference status

Misc

text-generation-inference

Misc with no match

Inference Endpoints

AutoTrain Compatible

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

30

Full-text search

Active filters: rkllm

FydeOS/Qwen-1_8B-Chat_rkLLM

Updated Jul 12, 2024

Pelochus/ezrkllm-collection

Text Generation • Updated Jun 16, 2024 • 13

Pelochus/qwen-1_8B-rk3588

Updated May 11, 2024

Pelochus/phi-2-rk3588

Updated May 11, 2024

Pelochus/tinyllama-v1-rk3588

Updated May 11, 2024 • 1

Pelochus/llama2-chat-7b-hf-rk3588

Updated May 11, 2024

Pelochus/llama2-chat-13b-hf-rk3588

Updated May 11, 2024 • 1

Pelochus/qwen1.5-chat-4B-rk3588

Updated Jun 16, 2024 • 1

Pelochus/llama2-chat-70b-hf-rk3588

Updated Apr 17, 2024

FydeOS/Qwen1.5-1_8B_rkLLM

Updated May 15, 2024

Pelochus/phi-3-mini-rk3588

Updated May 11, 2024 • 2

Pelochus/gemma-2b-rk3588

Updated May 11, 2024 • 4

FydeOS/internlm2_rkLLM

Updated Jun 3, 2024

FydeOS/Qwen1.5-0.5B_rkLLM

Updated Jun 3, 2024

FydeOS/TinyLlama-1.1B_rkLLM

Updated Jun 3, 2024 • 1

jxke/qwen-chat-1_8B_rkllm

Text Generation • Updated May 22, 2024

jxke/chatglm3-6b-rkllm

Updated May 23, 2024

jxke/gemma-2b-it_rkllm

Updated May 25, 2024

Pelochus/qwen2-1_5B-rk3588

Updated Jun 16, 2024 • 1

jxke/Qwen1.5-4B-chat-rkllm

Text Generation • Updated Jun 24, 2024

macrae/meta-llama2-chat-7b-hf-rk3588

Updated 8 days ago • 1

macrae/meta-llama2-chat-13b-hf-rk3588

Updated 8 days ago

FydeOS/Qwen2-1_5B_rkLLM

Updated Jul 12, 2024

happyme531/MiniCPM-V-2_6-rkllm

Updated 5 days ago • 25 • 5

macrae/Llama-3-8B-Instruct-rk3588

Updated 8 days ago

macrae/Llama-3-2-3B-rk3588

Updated 9 days ago • 1

macrae/Llama-3-2-1B-rk3588

Updated 9 days ago • 1

c01zaut/Qwen2.5-7B-Instruct-rk3588-v1.1.0

Text Generation • Updated Oct 28, 2024 • 11

happyme531/Qwen2-Audio-rkllm

Updated Nov 26, 2024 • 6

macrae/llama3-8b-cpt-sahabatai-v1-instruct

Updated 8 days ago