---
pipeline_tag: summarization
---

# Scientific Paper Summarizer

This model is fine-tuned version of `google/pegasus-pubmed` for scientific paper summarization.

## Model description

The model is based on PEGASUS and has been fine-tuned on scientific papers from the ArXiv dataset.

## Intended uses & limitations

This model is intended for summarizing scientific papers and research articles.

## Training and evaluation data

The model was fine-tuned on a subset of the ArXiv scientific papers dataset.

## Training procedure

The model was fine-tuned using the following parameters:
- Maximum input length: 512
- Maximum target length: 128
- Batch size: 4
- Learning rate: 2e-5
- Number of epochs: 5

## Evaluation results

The model achieved the following ROUGE scores:
- ROUGE-1: 0.3766
- ROUGE-2: 0.1260
- ROUGE-L: 0.2191