|
--- |
|
license: other |
|
language: |
|
- en |
|
base_model: |
|
- tiiuae/Falcon3-7B-Instruct |
|
pipeline_tag: text-generation |
|
tags: |
|
- falcon3 |
|
- falcon |
|
- falcon-moe |
|
- moe |
|
- llama |
|
--- |
|
|
|
# Falcon3 MoE 2x7B Instruct |
|
|
|
Mixture of Experts of Falcon3 7B-IT & 7B-IT. |
|
|
|
- 13.4B parameters |
|
- BF16 |
|
- Falcon3 (Llama) |
|
- Instruct |
|
|
|
## Falcon3-7B-Instruct |
|
Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B. |
|
|
|
This repository contains the Falcon3-7B-Instruct. It achieves state of art results (at the time of release) on reasoning, language understanding, instruction following, code and mathematics tasks. Falcon3-7B-Instruct supports 4 languages (english, french, spanish, portuguese) and a context length up to 32K. |
