CultriX
/

MergeTrix-7B-GGUF

Text Generation

abideen/NexoNimbus-7B

fblgit/UNA-TheBeagle-7b-v1

argilla/distilabeled-Marcoro14-7B-slerp

Inference Endpoints

Model card Files Files and versions Community

CultriX commited on Jan 15

Commit

6d56539

•

1 Parent(s): 9950b41

Update README.md

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -10,13 +10,13 @@ tags:
 ---
 # MergeTrix-7B-GGUF
-Quantisized versions of MergeTrix-7B.
-Supports:
 Name 	Quant method 	Bits 	Size 	Max RAM required 	Use case
-mergetrix-7b.Q4_K_M.gguf (4.37GB): medium, balanced quality
-mergetrix-7b.Q5_K_S.gguf (5 GB): large, low quality loss
-mergetrix-7b.Q5_K_M.gguf (5.13 GB): large, very low quality loss
-mergetrix-7b.Q6_K.gguf (5.94 GB): very large, extremely low quality loss
 MergeTrix-7B is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):

 ---
 # MergeTrix-7B-GGUF
+Quantisized versions of MergeTrix-7B. Supports:
 Name 	Quant method 	Bits 	Size 	Max RAM required 	Use case
+> mergetrix-7b.Q4_K_M.gguf (4.37GB): medium, balanced quality
+> mergetrix-7b.Q5_K_S.gguf (5 GB): large, low quality loss
+> mergetrix-7b.Q5_K_M.gguf (5.13 GB): large, very low quality loss
+> mergetrix-7b.Q6_K.gguf (5.94 GB): very large, extremely low quality loss
 MergeTrix-7B is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):