metadata
title: FLAN-T5 Custom Handler
emoji: 🤖
colorFrom: blue
colorTo: green
sdk: docker
sdk_version: 3.9
app_file: handler.py
pinned: false
FLAN-T5 Custom Inference Handler
This is a custom inference handler for the FLAN-T5-Large model, designed to be deployed as a Hugging Face Inference Endpoint.
Features
- Uses FLAN-T5-Large model for text generation
- Customizable generation parameters
- Docker-based deployment
- Optimized for inference
Usage
The handler accepts POST requests with the following format:
{
"inputs": "Your text prompt here"
}
Parameters
The handler supports the following generation parameters:
- max_length: 512
- min_length: 32
- temperature: 0.9
- top_p: 0.95
- top_k: 50