DavidAU
/

Llama-3.2-1B-Instruct-NEO-SI-FI-GGUF

Model card Files Files and versions Community

DavidAU commited on Oct 26, 2024

Commit

59658b8

·

verified ·

1 Parent(s): 66fa526

Update README.md

Files changed (1) hide show

README.md +0 -4

README.md CHANGED Viewed

@@ -120,10 +120,6 @@ QUANT CHOICE(S):
 Higher quants will have more detail, nuance and in some cases stronger "emotional" levels. Characters will also be
 more "fleshed out" too. Sense of "there" will also increase.
-Q4KM/Q4KS are good, strong quants however if you can run Q5, Q6 or Q8 - go for the highest quant you can.
-This repo also has 3 "ARM" quants for computers that support this quant. If you use these on a "non arm" machine token per second will be very low.
 IQ4XS: Due to the unusual nature of this quant (mixture/processing), generations from it will be different then other quants.
 You may want to try it / compare it to other quant(s) output.

 Higher quants will have more detail, nuance and in some cases stronger "emotional" levels. Characters will also be
 more "fleshed out" too. Sense of "there" will also increase.
 IQ4XS: Due to the unusual nature of this quant (mixture/processing), generations from it will be different then other quants.
 You may want to try it / compare it to other quant(s) output.