lokinfey commited on
Commit
909f3b8
·
verified ·
1 Parent(s): 87a9d7b

Update READMD.md

Browse files
Files changed (1) hide show
  1. README.md +16 -3
README.md CHANGED
@@ -1,3 +1,16 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ ---
4
+
5
+ # **Phi-3.5-mini-instruct-onnx-cpu Unofficial version**
6
+
7
+ This is a Phi-3.5-mini-instruct version of ONNX CPU, based on ONNX Runtime for GenAI [https://github.com/microsoft/onnxruntime-genai](https://github.com/microsoft/onnxruntime-genai). Convert with the following command
8
+
9
+ ```bash
10
+
11
+ python3 -m onnxruntime_genai.models.builder -m microsoft/Phi-3.5-vision-instruct -o ./onnx-cpu -p int4 -e cpu -c ./Phi-3.5-vision-instruct
12
+
13
+ ```
14
+
15
+ This is a conversion, but no specific optimization has been done. Please look forward to the official version.
16
+