Hugging Face's logo

QuantFactory
/
mistral-doryV2-12b-GGUF

Transformers
GGUF
English
Inference Endpoints
Model card Files Community
mistral-doryV2-12b-GGUF / README.md
aashish1904's picture
aashish1904
Upload README.md with huggingface_hub
1d29387 verified
preview code
|
raw
history blame
No virus
1.72 kB
metadata
base_model: mistralai/Mistral-Nemo-Base-2407
license: apache-2.0
datasets:
  - BeaverAI/Nemo-Inst-Tune-ds
language:
  - en
library_name: transformers

QuantFactory/mistral-doryV2-12b-GGUF

This is quantized version of BeaverAI/mistral-doryV2-12b created using llama.cpp

Original Model Card

Dory 12b (v2)

(redone) redone instruct finetune of mistral nemo 12b's base. not (E)RP-focused, leave that to drummer.

image/gif

thanks to twisted again for the compute :3

Prompting

alpaca-like:

### System:
[Optional system prompt]

### Instruction:
[Query]

### Response:
[Response]</s>

### Instruction:
[...]

Training details

Rank 64 QDoRA, trained on the following data mix: