SicariusSicariiStuff commited on
Commit
2f84fbe
·
verified ·
1 Parent(s): dcbf483

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -15,7 +15,12 @@ language:
15
 
16
 
17
 
18
- This is a Gemma-2 2B Finetune with surprisingly good Role-Play capabilities for its small 2B size.
 
 
 
 
 
19
 
20
 
21
  # Model Details
 
15
 
16
 
17
 
18
+ This is a Gemma-2 2B Finetune with surprisingly good Role-Play capabilities for its small 2B size.
19
+
20
+ **Update**:
21
+ The size is not exactly 2B, more like 3B, it's a model I did some merges on a long time ago and forgot about it, then finetuned on top of it.
22
+
23
+ Also, due to an old mergekit Gemma-2 quirk, it seems that the increased size is due to the way the previous version of mergekit handles lmhead. Anyway, it turned out pretty awesome, even for a 3B size. The base is presented in FP32.
24
 
25
 
26
  # Model Details