|
---
|
|
tags:
|
|
- sentence-transformers
|
|
- cross-encoder
|
|
- text-classification
|
|
pipeline_tag: text-classification
|
|
library_name: sentence-transformers
|
|
---
|
|
|
|
# CrossEncoder
|
|
|
|
This is a [Cross Encoder](https://www.sbert.net/docs/cross_encoder/usage/usage.html) model trained using the [sentence-transformers](https://www.SBERT.net) library. It computes scores for pairs of texts, which can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
|
|
|
|
## Model Details
|
|
|
|
### Model Description
|
|
- **Model Type:** Cross Encoder
|
|
<!-- - **Base model:** [Unknown](https://huggingface.co./unknown) -->
|
|
- **Maximum Sequence Length:** 8192 tokens
|
|
- **Number of Output Labels:** 1 label
|
|
<!-- - **Training Dataset:** Unknown -->
|
|
<!-- - **Language:** Unknown -->
|
|
<!-- - **License:** Unknown -->
|
|
|
|
### Model Sources
|
|
|
|
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
|
|
- **Documentation:** [Cross Encoder Documentation](https://www.sbert.net/docs/cross_encoder/usage/usage.html)
|
|
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
|
|
- **Hugging Face:** [Cross Encoders on Hugging Face](https://huggingface.co./models?library=sentence-transformers&other=cross-encoder)
|
|
|
|
## Usage
|
|
|
|
### Direct Usage (Sentence Transformers)
|
|
|
|
First install the Sentence Transformers library:
|
|
|
|
```bash
|
|
pip install -U sentence-transformers
|
|
```
|
|
|
|
Then you can load this model and run inference.
|
|
```python
|
|
from sentence_transformers import CrossEncoder
|
|
|
|
# Download from the 🤗 Hub
|
|
model = CrossEncoder("tomaarsen/reranker-ModernBERT-base-gooaq-bce")
|
|
# Get scores for pairs of texts
|
|
pairs = [
|
|
['How many calories in an egg', 'There are on average between 55 and 80 calories in an egg depending on its size.'],
|
|
['How many calories in an egg', 'Egg whites are very low in calories, have no fat, no cholesterol, and are loaded with protein.'],
|
|
['How many calories in an egg', 'Most of the calories in an egg come from the yellow yolk in the center.'],
|
|
]
|
|
scores = model.predict(pairs)
|
|
print(scores.shape)
|
|
# (3,)
|
|
|
|
# Or rank different texts based on similarity to a single text
|
|
ranks = model.rank(
|
|
'How many calories in an egg',
|
|
[
|
|
'There are on average between 55 and 80 calories in an egg depending on its size.',
|
|
'Egg whites are very low in calories, have no fat, no cholesterol, and are loaded with protein.',
|
|
'Most of the calories in an egg come from the yellow yolk in the center.',
|
|
]
|
|
)
|
|
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]
|
|
```
|
|
|
|
<!--
|
|
### Direct Usage (Transformers)
|
|
|
|
<details><summary>Click to see the direct usage in Transformers</summary>
|
|
|
|
</details>
|
|
-->
|
|
|
|
<!--
|
|
### Downstream Usage (Sentence Transformers)
|
|
|
|
You can finetune this model on your own dataset.
|
|
|
|
<details><summary>Click to expand</summary>
|
|
|
|
</details>
|
|
-->
|
|
|
|
<!--
|
|
### Out-of-Scope Use
|
|
|
|
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
|
|
-->
|
|
|
|
<!--
|
|
## Bias, Risks and Limitations
|
|
|
|
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
|
|
-->
|
|
|
|
<!--
|
|
### Recommendations
|
|
|
|
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
|
|
-->
|
|
|
|
## Training Details
|
|
|
|
### Framework Versions
|
|
- Python: 3.11.6
|
|
- Sentence Transformers: 3.5.0.dev0
|
|
- Transformers: 4.48.3
|
|
- PyTorch: 2.5.0+cu121
|
|
- Accelerate: 1.3.0
|
|
- Datasets: 2.20.0
|
|
- Tokenizers: 0.21.0
|
|
|
|
## Citation
|
|
|
|
### BibTeX
|
|
|
|
<!--
|
|
## Glossary
|
|
|
|
*Clearly define terms in order to be accessible across audiences.*
|
|
-->
|
|
|
|
<!--
|
|
## Model Card Authors
|
|
|
|
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
|
|
-->
|
|
|
|
<!--
|
|
## Model Card Contact
|
|
|
|
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
|
|
--> |