EVA-UNIT-01
/

EVA-Yi-1.5-9B-32K-V1

Model card Files Files and versions Community

AuriAetherwiing commited on Sep 24

Commit

28e06c0

•

1 Parent(s): 8237ceb

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -21,6 +21,7 @@ base_model:
     <li><a href=https://huggingface.co/mradermacher/EVA-Yi-1.5-9B-32K-V1-GGUF>Static GGUF by Mradermacher</a></li>
     <li><a href=https://huggingface.co/bartowski/EVA-Yi-1.5-9B-32K-V1-exl2>EXL2 by bartowski</a></li>
   </ul>
 </p>
 <p>
   Prompt format is ChatML.<br>

     <li><a href=https://huggingface.co/mradermacher/EVA-Yi-1.5-9B-32K-V1-GGUF>Static GGUF by Mradermacher</a></li>
     <li><a href=https://huggingface.co/bartowski/EVA-Yi-1.5-9B-32K-V1-exl2>EXL2 by bartowski</a></li>
   </ul>
+   We recommend using original BFloat16 weights, quantization seems to affect Yi significantly more than other model architectures.
 </p>
 <p>
   Prompt format is ChatML.<br>