| base_model: | |
| - nisten/zelensky-78b | |
| 4, 5, and 6 bit quants of nisten/zelensky-78b | |
| use this as a commander model | |
| no speculative decoding support | |
| base_model: | |
| - nisten/zelensky-78b | |
| 4, 5, and 6 bit quants of nisten/zelensky-78b | |
| use this as a commander model | |
| no speculative decoding support | |