Arun Kumar Tiwary commited on
Commit
328378a
1 Parent(s): 970fd76

Create README.md

Browse files

Run LLama3 model on CPU.

Files changed (1) hide show
  1. README.md +10 -0
README.md ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ # Setup MLC-LLM on CPU on UBUNTU 22.04 LTS
2
+
3
+ sudo apt update
4
+ sudo apt install ocl-icd-opencl-dev clinfo vulkan-tools
5
+ python -m pip install --pre -U -f https://mlc.ai/wheels mlc-llm-nightly mlc-ai-nightly
6
+ mlc_llm chat HF://mlc-ai/Llama-3-8B-Instruct-q4f16_1-MLC
7
+
8
+
9
+
10
+