|
--- |
|
library_name: transformers |
|
tags: |
|
- llama-factory |
|
- llama3 |
|
license: llama3 |
|
datasets: |
|
- teknium/OpenHermes-2.5 |
|
- mudler/function-call-localai-glaive |
|
--- |
|
|
|
[](https://localai.io) |
|
|
|
## Mirai Nova |
|
|
|
 |
|
|
|
Mirai Nova: "Mirai" means future in Japanese, and "Nova" references a star showing a sudden large increase in brightness. |
|
|
|
A set of models oriented in function calling, but generalist and with enhanced reasoning capability. This is fine tuned with Llama3. |
|
|
|
Mirai Nova works particularly well with LocalAI, leveraging the function call with grammars feature out of the box. |
|
|
|
GGUF quants: https://huggingface.co./mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF |
|
|
|
OpenVINO: https://huggingface.co./fakezeta/Mirai-Nova-Llama3-LocalAI-8B-v0.1-ov-int8 |
|
|
|
To run on LocalAI: |
|
|
|
``` |
|
local-ai run huggingface://mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF/localai.yaml |
|
``` |