metadata

tags:
  - phi3
  - phi3-mini
  - rkllm
  - rockchip
  - rk3588

Microsoft's Phi-3 mini (4K instruct) for RK3588

This is a conversion from https://huggingface.co./microsoft/phi-3-mini-4k-instruct to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.

Latest update: 9th May 2024. Converted with RKLLM runtime 1.0.1.

Main repo

See this for my full collection of converted LLMs for the RK3588's NPU:

Same as the original LLM, in this case MIT: