14B or 7B possibility
#2
by
iwa103103
- opened
Is there any plan about 14B or 7B, just smaller model.
because I am usuing Macbook air 16G model, it could be helpful smaller model.
just 32B, I can use just only IQ1 model, if 14B model, I can use Q4?
That’s right
Any updates on the 14B model? Happy to contribute if it isn't already underway. :)
As a side note, for Macs only, the minimum memory requirement has been increased to 16GB since October 2024, expanding the model options available for LMstudio and other programs. However, the file size limit seems to be around 8GB, so IQ2_XXS can barely run on 32B, so 14B should work fine on a Mac with 16GB of memory from October 2024 onwards.
So I'm just saying it would be nice to have a 14B model.