tags: | |
- imatrix | |
- MoE | |
<H1>BagelMIsteryTour-8x7B || Imatrix</H1> | |
This is an imatrix for https://huggingface.co./ycros/BagelMIsteryTour-v2-8x7B | |
<h3>Training Data used: </h3> | |
<a href='https://huggingface.co./datasets/math-ai/StackMathQA/blob/main/data/stackmathqa100k/all.jsonl'>math-ai/StackMathQA100k</a> | |
Trained to 2048 chunks of 512CTX on Q8_0 GGUF. (1M Tokens) | |