--- license: llama2 --- If anyone wants to make something of this be my guest, but this doesn't even output coherent text [that at least can be restored through fine tuning]. Llama-2-7B with KV heads shorn to 4 of 32.