Triangle104 commited on
Commit
03dcd29
1 Parent(s): e32a21a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +53 -0
README.md CHANGED
@@ -107,6 +107,59 @@ model-index:
107
  This model was converted to GGUF format from [`lemon07r/Gemma-2-Ataraxy-v2-9B`](https://huggingface.co/lemon07r/Gemma-2-Ataraxy-v2-9B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
108
  Refer to the [original model card](https://huggingface.co/lemon07r/Gemma-2-Ataraxy-v2-9B) for more details on the model.
109
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
110
  ## Use with llama.cpp
111
  Install llama.cpp through brew (works on Mac and Linux)
112
 
 
107
  This model was converted to GGUF format from [`lemon07r/Gemma-2-Ataraxy-v2-9B`](https://huggingface.co/lemon07r/Gemma-2-Ataraxy-v2-9B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
108
  Refer to the [original model card](https://huggingface.co/lemon07r/Gemma-2-Ataraxy-v2-9B) for more details on the model.
109
 
110
+ ---
111
+ Model details:
112
+ -
113
+ Model details:
114
+
115
+ Gemma 2 Ataraxy v2 9B
116
+
117
+ Finally, after much testing, a sucessor to the first Gemma 2 Ataraxy 9B. Same kind of recipe, using the same principles, same concept as the last Ataraxy. It's not quite a better overall model, v1 is more well rounded, v2 is a little better at writing but has a little more slop and some other issues. consider this a sidegrade.
118
+
119
+ Ataraxy GGUF / EXL2 Quants
120
+
121
+ Bartowski quants (imatrix): https://huggingface.co/bartowski/Gemma-2-Ataraxy-v2-9B-GGUF
122
+
123
+ Mradermacher quants (static): https://huggingface.co/mradermacher/Gemma-2-Ataraxy-v2-9B-GGUF
124
+
125
+ Mradermacher quants (imatrix): https://huggingface.co/mradermacher/Gemma-2-Ataraxy-v2-9B-i1-GGUF
126
+
127
+ Bartowski and mradermacher use different calibration data for their imatrix quants I believe, and the static quant of course uses none. Pick your poison.
128
+
129
+ More coming soon. Format
130
+
131
+ Use Gemma 2 format. Merge Details Merge Method
132
+
133
+ This model was merged using the SLERP merge method. Models Merged
134
+
135
+ This is a merge of pre-trained language models created using mergekit.
136
+
137
+ The following models were included in the merge:
138
+
139
+ ifable/gemma-2-Ifable-9B
140
+ jsgreenawalt/gemma-2-9B-it-advanced-v2.1
141
+
142
+ Configuration
143
+
144
+ The following YAML configuration was used to produce this model:
145
+
146
+ base_model: ifable/gemma-2-Ifable-9B dtype: bfloat16 merge_method: slerp parameters: t:
147
+
148
+ filter: self_attn value: [0.0, 0.5, 0.3, 0.7, 1.0]
149
+ filter: mlp value: [1.0, 0.5, 0.7, 0.3, 0.0]
150
+ value: 0.5 slices:
151
+ sources:
152
+ layer_range: [0, 42] model: jsgreenawalt/gemma-2-9B-it-advanced-v2.1
153
+ layer_range: [0, 42] model: ifable/gemma-2-Ifable-9B
154
+
155
+ Open LLM Leaderboard Evaluation Results
156
+
157
+ Detailed results can be found here Metric Value Avg. 19.16 IFEval (0-Shot) 21.36 BBH (3-Shot) 39.80 MATH Lvl 5 (4-Shot) 0.83 GPQA (0-shot) 12.30 MuSR (0-shot) 4.88 MMLU-PRO (5-shot) 35.79
158
+
159
+ Second highest ranked open weight model in EQ-Bench.
160
+
161
+ ---
162
+
163
  ## Use with llama.cpp
164
  Install llama.cpp through brew (works on Mac and Linux)
165