File size: 738 Bytes
e8ab2d2 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 |
---
title: FLAN-T5 Custom Handler
emoji: 🤖
colorFrom: blue
colorTo: green
sdk: docker
sdk_version: 3.9
app_file: handler.py
pinned: false
---
# FLAN-T5 Custom Inference Handler
This is a custom inference handler for the FLAN-T5-Large model, designed to be deployed as a Hugging Face Inference Endpoint.
## Features
- Uses FLAN-T5-Large model for text generation
- Customizable generation parameters
- Docker-based deployment
- Optimized for inference
## Usage
The handler accepts POST requests with the following format:
```json
{
"inputs": "Your text prompt here"
}
```
## Parameters
The handler supports the following generation parameters:
- max_length: 512
- min_length: 32
- temperature: 0.9
- top_p: 0.95
- top_k: 50 |