mistral-doryV2-12b / README.md
Fizzarolli's picture
Create README.md
ef1b582 verified
metadata
base_model: mistralai/Mistral-Nemo-Base-2407
license: apache-2.0
datasets:
  - BeaverAI/Nemo-Inst-Tune-ds
language:
  - en
library_name: transformers

Dory 12b (v2)

(redone) redone instruct finetune of mistral nemo 12b's base. not (E)RP-focused, leave that to drummer.

image/gif

thanks to twisted again for the compute :3

Prompting

alpaca-like:

### System:
[Optional system prompt]

### Instruction:
[Query]

### Response:
[Response]</s>

### Instruction:
[...]

Training details

Rank 64 QDoRA, trained on the following data mix: