tiiuae
/

falcon-mamba-7b

Text Generation

Inference Endpoints

Model card Files Files and versions Community

JingweiZuo commited on Jul 25, 2024

Commit

9bc71f5

·

verified ·

1 Parent(s): d58940c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -198,7 +198,7 @@ We evaluate our model on all benchmarks of the new leaderboard's version using t
 | `model name`              |`IFEval`| `BBH` |`MATH LvL5`| `GPQA`| `MUSR`|`MMLU-PRO`|`Average`|
 |:--------------------------|:------:|:-----:|:---------:|:-----:|:-----:|:--------:|:-------:|
 | ***Pure SSM models***     |        |       |           |       |       |          |         |
-| `FalconMamba-7B`          |**33.36**| 19.88 |    3.63   |**8.05**|**10.86**| 14.47    |**15.04**|
 | `TRI-ML/mamba-7b-rw`<sup>*</sup>| 22.46  | 6.71  | 0.45      | 1.12  | 5.51  | 1.69     | 6.25    |
 |***Hybrid SSM-attention models***   |       |           |       |       |          |         |
 |`recurrentgemma-9b`        | 30.76  | 14.80 | 4.83      | 4.70  | 6.60  | 17.88    |  13.20  |

 | `model name`              |`IFEval`| `BBH` |`MATH LvL5`| `GPQA`| `MUSR`|`MMLU-PRO`|`Average`|
 |:--------------------------|:------:|:-----:|:---------:|:-----:|:-----:|:--------:|:-------:|
 | ***Pure SSM models***     |        |       |           |       |       |          |         |
+| `FalconMamba-7B`          |**33.36**| 19.88 |    3.63   |**8.05**|10.86| 14.47    |**15.04**|
 | `TRI-ML/mamba-7b-rw`<sup>*</sup>| 22.46  | 6.71  | 0.45      | 1.12  | 5.51  | 1.69     | 6.25    |
 |***Hybrid SSM-attention models***   |       |           |       |       |          |         |
 |`recurrentgemma-9b`        | 30.76  | 14.80 | 4.83      | 4.70  | 6.60  | 17.88    |  13.20  |