---
base_model: sentence-transformers/all-mpnet-base-v2
datasets: []
language: []
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:80
- loss:MultipleNegativesRankingLoss
widget:
- source_sentence: What is the short title of this Act?
sentences:
- The Banking (Amendment) Act, No. 24 of 2024
- The Central Bank can assess whether granting a license is in the interest of the
banking system and national economy
- They must conduct offshore banking business only with non-residents and certain
residents as determined by the Central Bank
- source_sentence: What new power does the Central Bank have regarding excess accommodations
to related parties?
sentences:
- Accommodation and all financial investments
- The Central Bank can assess a bank's track record for operating with good governance
and integrity
- The Central Bank may require the bank to deduct such excess from regulatory capital
calculations
- source_sentence: What new requirement is there for licensed commercial banks regarding
the disclosure of audit information?
sentences:
- Auditors must immediately report findings that could materially affect the bank's
safety and soundness
- They must prepare financial statements that represent a true and fair view of
the bank's financial position
- To the Governor, Deputy Governor, Assistant Governor, Director of Bank Supervision,
or other high-ranking officers
- source_sentence: Who approves the appointment, election, or nomination of directors
for licensed commercial banks?
sentences:
- The Central Bank
- The Central Bank can designate foreign currencies for offshore banking business
- The Central Bank can request information or documents from any person other than
a licensed bank
- source_sentence: What new power does the Central Bank have regarding the number
of directors on a bank's board?
sentences:
- Within fifteen days of becoming aware of such facts
- Transparency in ownership structure and beneficial ownership
- The Central Bank can determine the number of board members, which shall not be
less than seven
---
# SentenceTransformer based on sentence-transformers/all-mpnet-base-v2
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-mpnet-base-v2](https://huggingface.co./sentence-transformers/all-mpnet-base-v2). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [sentence-transformers/all-mpnet-base-v2](https://huggingface.co./sentence-transformers/all-mpnet-base-v2)
- **Maximum Sequence Length:** 384 tokens
- **Output Dimensionality:** 768 tokens
- **Similarity Function:** Cosine Similarity
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co./models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 384, 'do_lower_case': False}) with Transformer model: MPNetModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
"What new power does the Central Bank have regarding the number of directors on a bank's board?",
'The Central Bank can determine the number of board members, which shall not be less than seven',
'Within fifteen days of becoming aware of such facts',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 80 training samples
* Columns: query
and answer
* Approximate statistics based on the first 1000 samples:
| | query | answer |
|:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
| type | string | string |
| details |
What new power does the Central Bank have regarding corrective action for misleading disclosures?
| The Central Bank can require banks to publish corrected disclosure statements
|
| What new requirement is there for licensed commercial banks regarding corporate governance?
| The Board of Directors is ultimately responsible for ensuring compliance with laws and sound banking practices
|
| Who is responsible for overseeing the management of a licensed commercial bank?
| The Board of Directors
|
* Loss: [MultipleNegativesRankingLoss
](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Evaluation Dataset
#### Unnamed Dataset
* Size: 20 evaluation samples
* Columns: query
and answer
* Approximate statistics based on the first 1000 samples:
| | query | answer |
|:--------|:----------------------------------------------------------------------------------|:---------------------------------------------------------------------------------|
| type | string | string |
| details | What new power does the Central Bank have regarding the assessment of bank license applications?
| The Central Bank can assess whether granting a license is in the interest of the banking system and national economy
|
| What new definition is provided for 'unlawful activity' in the Act?
| It has the same meaning as in the Prevention of Money Laundering Act, No. 5 of 2006
|
| What new requirement is there for licensed commercial banks regarding offshore banking?
| They must conduct offshore banking business only with non-residents and certain residents as determined by the Central Bank
|
* Loss: [MultipleNegativesRankingLoss
](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `eval_strategy`: epoch
- `per_device_eval_batch_size`: 16
- `learning_rate`: 3e-05
- `warmup_ratio`: 0.1
- `fp16`: True
- `load_best_model_at_end`: True
- `ddp_find_unused_parameters`: False
#### All Hyperparameters