metadata
datasets:
- HuggingFaceH4/ultrachat_200k
base_model:
- meta-llama/Llama-2-13b-chat-hf
library_name: transformers
meta-llama/Llama-2-13b-chat-hf - W8A8_FP8 Compression
This is a compressed model using llmcompressor.
Compression Configuration
- Base Model: meta-llama/Llama-2-13b-chat-hf
- Compression Scheme: W8A8_FP8
- Dataset: HuggingFaceH4/ultrachat_200k
- Dataset Split: train_sft
- Number of Samples: 512
- Preprocessor: chat
- Maximum Sequence Length: 4096
Sample Output
Prompt:
<s>[INST] Who is Alan Turing? [/INST]
Output:
<s><s> [INST] Who is Alan Turing? [/INST] Alan Turing (1912-1954) was a British mathematician, computer scientist, and logician who made significant contributions to the fields of computer science, mathematics, and artificial intelligence. He is widely considered to be one of the most important figures in the history of computer science and artificial intelligence.
Turing was born in London, England, and grew up in a family of mathematicians. He studied at Cambridge University, where he earned his undergraduate degree in mathematics and later earned his PhD in mathematics. During World War II, Turing worked at the Government Code and Cy