Hugging Face's logo

rustformers
/
bloom-ggml

Text Generation
Transformers
llm-rs
ggml
Inference Endpoints
Model card Files Community
LLukas22 commited on
Commit
61024e1
•
1 Parent(s): 68cb7bf

Generated README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -11
README.md CHANGED
@@ -13,16 +13,19 @@ BLOOM is an autoregressive Large Language Model (LLM), trained to continue text
13
 
14
 
15
  ## Converted Models
16
- | Name | Based on | Type | Container | Version |
17
- |:-------------------------------------------------------------------------------------------------------------|:-----------|:-------|:------------|:----------|
18
- | [bloom-1b7-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-f16.bin) | - | F16 | GGML | V2 |
19
- | [bloom-1b7-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0-ggjt.bin) | - | Q4_0 | GGJT | V2 |
20
- | [bloom-1b7-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0.bin) | - | Q4_0 | GGML | V2 |
21
- | [bloom-3b-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-f16.bin) | - | F16 | GGML | V2 |
22
- | [bloom-3b-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0-ggjt.bin) | - | Q4_0 | GGJT | V2 |
23
- | [bloom-3b-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0.bin) | - | Q4_0 | GGML | V2 |
24
- | [bloom-560m-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-f16.bin) | - | F16 | GGML | V2 |
25
- | [bloom-560m-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0-ggjt.bin) | - | Q4_0 | GGJT | V2 |
26
- | [bloom-560m-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0.bin) | - | Q4_0 | GGML | V2 |
 
 
 
27
 
28
  ## Usage
 
13
 
14
 
15
  ## Converted Models
16
+ | Name | Based on | Type | Container | GGML Version |
17
+ |:-------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------|:-------|:------------|:---------------|
18
+ | [bloom-3b-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | Q4_0 | GGML | V3 |
19
+ | [bloom-1b7-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q4_0 | GGML | V3 |
20
+ | [bloom-1b7-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0-ggjt.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q4_0 | GGJT | V3 |
21
+ | [bloom-560m-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q5_1-ggjt.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q5_1 | GGJT | V3 |
22
+ | [bloom-560m-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-f16.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | F16 | GGML | V3 |
23
+ | [bloom-560m-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0-ggjt.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q4_0 | GGJT | V3 |
24
+ | [bloom-3b-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-f16.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | F16 | GGML | V3 |
25
+ | [bloom-3b-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q4_0-ggjt.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | Q4_0 | GGJT | V3 |
26
+ | [bloom-1b7-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-f16.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | F16 | GGML | V3 |
27
+ | [bloom-1b7-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q5_1-ggjt.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q5_1 | GGJT | V3 |
28
+ | [bloom-3b-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-3b-q5_1-ggjt.bin) | [bigscience/bloom-3b](https://huggingface.co/bigscience/bloom-3b) | Q5_1 | GGJT | V3 |
29
+ | [bloom-560m-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-560m-q4_0.bin) | [bigscience/bloom-560m](https://huggingface.co/bigscience/bloom-560m) | Q4_0 | GGML | V3 |
30
 
31
  ## Usage