magnum-v2-123b-fp8-dynamic
This is the sixth in a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus.
This model is fine-tuned on top of [Mistral-Large-Instruct-2407](https://huggingface.co./mistralai/Mistral-Large-Instruct-2407).
Converted to fp8 dynamic by leafspark; original model link here: anthracite-org/magnum-v2-123b
Using 6xL40 on RunPod Ubuntu container; quantizaton took 30 minutes.
- Downloads last month
- 49
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.
Model tree for leafspark/magnum-v2-123b-fp8-dynamic
Base model
mistralai/Mistral-Large-Instruct-2407
Finetuned
anthracite-org/magnum-v2-123b