Random quants uploaded for my own use. Please refer to base model cards for information about specific models:
3-bit
4-bit
5-bit