Training procedure

The TSOTSALLM-beta Large Language Model (LLM) is a fine-tuned generative text model based on LLama-2 with 7 billions parameters.

Model Architecture

TSOTSALLM-beta is a transformer model, with the following architecture choices:

Grouped-Query Attention
Sliding-Window Attention
Byte-fallback BPE tokenizer

The TSOTSALLM AI Team

Jean Petit BIKIM
Fidel Jiomekong
Martins Folefack
Brice

Downloads last month: 5

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.