Hugging Face's logo

rustformers
/
bloom-ggml

Text Generation
Transformers
llm-rs
ggml
Inference Endpoints
Model card Files Community
LLukas22 commited on
Commit
1e0f294
•
1 Parent(s): 61024e1

Generated README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -15,17 +15,17 @@ BLOOM is an autoregressive Large Language Model (LLM), trained to continue text
15
  ## Converted Models
16
  | Name | Based on | Type | Container | GGML Version |
17
  |:-------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------|:-------|:------------|:---------------|
18
- | [bloom-3b-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | Q4_0 | GGML | V3 |
19
  | [bloom-1b7-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q4_0 | GGML | V3 |
20
  | [bloom-1b7-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0-ggjt.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q4_0 | GGJT | V3 |
21
- | [bloom-560m-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q5_1-ggjt.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q5_1 | GGJT | V3 |
22
- | [bloom-560m-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-f16.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | F16 | GGML | V3 |
23
- | [bloom-560m-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0-ggjt.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q4_0 | GGJT | V3 |
24
  | [bloom-3b-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-f16.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | F16 | GGML | V3 |
 
25
  | [bloom-3b-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0-ggjt.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | Q4_0 | GGJT | V3 |
26
- | [bloom-1b7-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-f16.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | F16 | GGML | V3 |
27
- | [bloom-1b7-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q5_1-ggjt.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q5_1 | GGJT | V3 |
28
  | [bloom-3b-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q5_1-ggjt.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | Q5_1 | GGJT | V3 |
 
29
  | [bloom-560m-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q4_0 | GGML | V3 |
 
 
30
 
31
  ## Usage
 
15
  ## Converted Models
16
  | Name | Based on | Type | Container | GGML Version |
17
  |:-------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------|:-------|:------------|:---------------|
18
+ | [bloom-1b7-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-f16.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | F16 | GGML | V3 |
19
  | [bloom-1b7-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q4_0 | GGML | V3 |
20
  | [bloom-1b7-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0-ggjt.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q4_0 | GGJT | V3 |
21
+ | [bloom-1b7-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q5_1-ggjt.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q5_1 | GGJT | V3 |
 
 
22
  | [bloom-3b-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-f16.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | F16 | GGML | V3 |
23
+ | [bloom-3b-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | Q4_0 | GGML | V3 |
24
  | [bloom-3b-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0-ggjt.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | Q4_0 | GGJT | V3 |
 
 
25
  | [bloom-3b-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q5_1-ggjt.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | Q5_1 | GGJT | V3 |
26
+ | [bloom-560m-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-f16.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | F16 | GGML | V3 |
27
  | [bloom-560m-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q4_0 | GGML | V3 |
28
+ | [bloom-560m-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0-ggjt.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q4_0 | GGJT | V3 |
29
+ | [bloom-560m-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q5_1-ggjt.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q5_1 | GGJT | V3 |
30
 
31
  ## Usage