Model Card for Model ID

This model is a fine-tuned version of meta-llama/Llama-2-7b-hf on timdettmers/openassistant-guanaco dataset.

Model Details

Model Description

This is a fine-tuned version of the meta-llama/Llama-2-7b-hf model using Parameter Efficient Fine Tuning (PEFT) with Low Rank Adaptation (LoRA) on the Intel Gaudi 2 AI accelerator. This model can be used for various text generation tasks including chatbots, content creation, and other NLP applications.

Developed by: Keerthi Nalabotu
Model type: LLM
Language(s) (NLP): English
Finetuned from model [optional]: meta-llama/Llama-2-7b-hf

Uses

This model can be used for text generation tasks such as:

Chatbots

Automated content creation

Text completion and augmentation

Out-of-Scope Use

Use in real-time applications where latency is critical

Use in highly sensitive domains without thorough evaluation and testing

How to Get Started with the Model

Use the code below to get started with the model.

Training Details

Training regime: Mixed precision training using bf16

Number of epochs: 3

Learning rate: 1e-4

Batch size: 16

Seq length: 512

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Hardware Type: Intel Gaudi AI Accelerator

Hours used: < 1 hour