DavidAU commited on
Commit
8d7db27
·
verified ·
1 Parent(s): b1349a5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -116,10 +116,10 @@ Alpaca generates longer text / story, whereas Instruct are shorter and "to the p
116
 
117
  CRANK UP to "TEMP" ... to get stronger, better results.
118
 
119
- Q2k/Q3 quants:
120
 
121
- You may need to use temp 2 or lower with these quants (1 or lower for q2k). Just too much compression at this level, damaging the model. I will see if Imatrix versions
122
- of these quants will function better.
123
 
124
  <B>Model "DNA":</B>
125
 
 
116
 
117
  CRANK UP to "TEMP" ... to get stronger, better results.
118
 
119
+ Special note on Q2k/Q3 quants:
120
 
121
+ You may need to use temp 4 or lower with these quants (1 or lower for q2k). Just too much compression at this level, damaging the model. I will see if Imatrix versions
122
+ of these quants will function better. As of this writing, q3KM tests and works at temp 4 or lower without issues.
123
 
124
  <B>Model "DNA":</B>
125