MaLLaM 🌙 - a mesolitica Collection

mesolitica 's Collections

Research papers

Malaysian Mistral

Malaysian Llama

Malaysian Gemma

Malaysian Embedding

Malaysian Reranker

Malaysian CausalLM

Malaysian LLM2Vec

Malaysian Seq2Seq

Malaysian MaskLM

Malaysian pretraining dataset

Malay instructions dataset

Malaysian synthetic dataset

Speech-to-Text dataset

Malaysian Whisper

Text-to-Speech dataset

Malaysian Text-to-Speech

Malaysian Noisy Translation

Google Translate dataset

Visual Multimodal dataset

Audio Multimodal dataset

Multimodal Malaysian LLM

MaLLaM 🌙

updated Dec 23, 2024

Pretrain from scratch 4096 context length on 90B tokens Malaysian text, https://huggingface.co./papers/2401.14680