File size: 564 Bytes
909f3b8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
license: mit
---
# **Phi-3.5-mini-instruct-onnx-cpu Unofficial version**
This is a Phi-3.5-mini-instruct version of ONNX CPU, based on ONNX Runtime for GenAI [https://github.com/microsoft/onnxruntime-genai](https://github.com/microsoft/onnxruntime-genai). Convert with the following command
```bash
python3 -m onnxruntime_genai.models.builder -m microsoft/Phi-3.5-vision-instruct -o ./onnx-cpu -p int4 -e cpu -c ./Phi-3.5-vision-instruct
```
This is a conversion, but no specific optimization has been done. Please look forward to the official version.
|