YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co./docs/hub/model-cards#model-card-metadata)

Falcon-40B-Instruct 8-bit Model

This repository is home to the Falcon-40B-Instruct model, which has been carefully converted from its original 32-bit mode to an efficient and compact 8-bit file.

Usage

You can use this model directly with a pipeline for tasks such as text generation and instruction following:

from transformers import pipeline

generator = pipeline('text-generation', model='tensorcat/falcon-40b-instruct-8bit')
print(generator("Generate a story about a spaceship traveling through space.", max_length=200))
Downloads last month
12
Inference Examples
Inference API (serverless) does not yet support model repos that contain custom code.