Uploaded model

  • Developed by: Mollel
  • License: apache-2.0
  • Finetuned from model : gemma-7b-bnb-4bit

from llama_index.llms.huggingface import HuggingFaceLLM
llm = HuggingFaceLLM(
 context_window=4096,
 max_new_tokens=256,
 generate_kwargs={"temperature": 0.7, "do_sample": False},  
 tokenizer_name="Mollel/Swahili_Gemma",
 model_name="Mollel/Swahili_Gemma",
 device_map="auto",
 stopping_ids=[50278, 50279, 50277, 1, 0],
 tokenizer_kwargs={"max_length": 4096},
 model_kwargs={"torch_dtype": torch.float16}
)

Examples

  1. Load Lora and use for evaluation kaggle GitRepo
  2. Supervised Finetuning Dataset Creation using Swahili Gemma kaggle GitRepo
  3. Rag using Swahili gemma KaggleGitRepo
Downloads last month
43
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for Mollel/Swahili_Gemma

Finetunes
2 models
Quantizations
1 model