README.md

metadata

license: apache-2.0

Model Sources

https://huggingface.co./HuggingFaceTB/SmolLM-360M-Instruct

Uses

v v small model for running on edge with :fire: TTFT & Throughput

Direct Use

Use llama.cpp to inference the model