File size: 346 Bytes
402bd4f 3764204 |
1 2 3 4 5 6 7 8 9 10 11 |
---
license: llama2
base_model:
- meta-llama/Llama-2-7b-hf
- smpanaro/Llama-2-7b-NuGPTQ
tags:
- coreml
---
CoreML conversion of Llama 2 7B from [smpanaro/Llama-2-7b-NuGPTQ](https://huggingface.co./smpanaro/Llama-2-7b-NuGPTQ).
Use [this CLI](https://github.com/smpanaro/coreml-llm-cli) to download and run inference. macOS 14 (Sonoma) is required. |