| license: llama2 | |
| CoreML conversion of Llama 2 7B from [smpanaro/Llama-2-7b-NuGPTQ](https://huggingface.co./smpanaro/Llama-2-7b-NuGPTQ). | |
| Use [this CLI](https://github.com/smpanaro/coreml-llm-cli) to download and run inference. macOS 14 (Sonoma) is required. |