Hugging Face's logo

dipanjanS
/
bge-base-en-v1.5-fte

Sentence Similarity
sentence-transformers
Safetensors
bert
feature-extraction
Generated from Trainer
dataset_size:1340
loss:MultipleNegativesRankingLoss
text-embeddings-inference
Inference Endpoints
Model card Files Community
bge-base-en-v1.5-fte / README.md
dipanjanS's picture
dipanjanS
Add new SentenceTransformer model.
f2eea1d verified
preview code
|
raw
history blame contribute delete
24.6 kB
---
base_model: BAAI/bge-base-en-v1.5
datasets: []
language: []
library_name: sentence-transformers
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:1340
- loss:MultipleNegativesRankingLoss
widget:
- source_sentence: Who popularized the term 'Dalit'?
sentences:
- Fakhruddin Ali Ahmed was the fifth President of India from 1974 to 1977 and also
the 2nd President of India to die in office.
- Arunachal Pradesh or South Tibet is a state between India and China. The country
that owns this region is disputed. China says that they own it and call it South
Tibet (Zangnan 藏南). In 2017, China started renaming places in this territory.
In 2019 China destroyed 30,000 "incorrect" world maps that showed South Tibet
as part of India.
- '"Dalit" refers to socially, economically and historically marginalized communities
predominantly in India . It also means "broken/scattered" in Sanskrit and Hindi
. The term "dalits" was in use as a translation for the British Raj census classification
of "Depressed Classes" prior to 1935. It was popularised by the economist and
reformer B. R. Ambedkar (1891–1956), who included all depressed people irrespective
of their caste into the definition of dalits. Hence the first group he made was
called the "Labour Party" and included as its members all people of the society
who were kept depressed, including women, small scale farmers and people from
backward castes.'
- source_sentence: What is India's contribution to the Olympic Movement?
sentences:
- Prem Pal Singh Rawat (in India called Maharaji and in the past called Guru Maharaj
Ji and Balyogeshwar) was born in India on December 10, 1957. He teaches inner
peace by the use of what he calls "Knowledge". Groups that have helped him are
the Divine Light Mission, Elan Vital (1983), and The Prem Rawat Foundation (2001).
- 'Boota Singh (Gurmukhi: ਬੂਟਾ ਸਿੰਘ; Shahmukhi: بوٹا سنگھ), sometimes spelled as
Buta Singh, was a Sikh soldier in the British Army. He served in Burma during
World War II, under the command of Lord Mountbatten. He is very well known in
India and Pakistan. He is famous for his tragic love story with Zainab, a Muslim
girl who he rescued from the riots during the partition of India in 1947.'
- India at the Olympics is a history which includes 32 games in 19 countries and
800+ athletes. Since 1900, India has contributed to the growth of the "Olympic
Movement".
- source_sentence: What is significant about the fort in Jhansi?
sentences:
- Western India is a region of the Republic of India, it includes Gujarat, Madhya
Pradesh and Maharashtra.
- The Government of India Act 1858 was an Act of the Parliament of the United Kingdom
(21 & 22 Vict. c. 106) passed on August 2, 1858. Its provisions called for the
liquidation of the British East India Company (who had up to this point been ruling
British India under the auspices of Parliament) and the transference of its functions
to the British Crown.
- Jhansi is a historic city of India between the rivers Pahunj and Betwa in the
northern state of Uttar Pradesh, close to the border with Madhya Pradesh. Jhansi
is the administrative headquarters of Jhansi District and Jhansi Division. The
original walled city grew up around its stone fort, which was built in 1613. The
city is well connected to all other major towns in Uttar Pradesh by road and railway
networks. It is called "gateway to Bundelkhand". Jhansi was besieged and taken
by British forces in 1858 during the Indian Rebellion of 1857.
- source_sentence: How is Dhanteras celebrated in Nepal?
sentences:
- The National Stock Exchange of India Limited (NSE), is a Mumbai-based stock exchange.
It is the biggest stock exchange in India and the third biggest in the world in
terms of amounts of transactions. NSE is mutually-owned by a set of leading financial
institutions, banks, insurance companies and other financial intermediaries in
India but its ownership and management operate as separate groups. As of 2006,
the NSE VSAT terminals, 2799 in total, cover more than 1500 cities across India.
In July 2007, the NSE had a total market capitalization of 42,74,509 crore INR
making it the second-largest stock market in South Asia in terms of market-capitalization.
- 'Dhanteras (Sanskrit: धनतेरस), also known as Dhanatrayodashi () or Dhanvantari
Trayodashi, is the first day of the festival of Diwali in India and the festival
of Tihar in Nepal.'
- Perur taluk is a taluk in Coimbatore district, Tamil Nadu, India associated with
the neighbourhood of Perur. It was created by Government of Tamil Nadu in 2013.
- source_sentence: What political roles did Rao hold in Andhra Pradesh?
sentences:
- The 2023 ICC Cricket World Cup is scheduled to be hosted by India and India was
selected as the host at an International Cricket Council (ICC) meeting in London
in June 2013. This will be the 13th Cricket World Cup competition. It will be
the fourth time that India will be the host. This will be the first time that
India has hosted the tournament on its own. India hosted previous World Cup tournaments
in 1987 (with Pakistan), 1996 (with Pakistan and Sri Lanka) and 2011 (with Sri
Lanka and Bangladesh). The semi final will be played at Wankhede Stadium. And
final will be played at Eden Gardens, Kolkata.
- Ayyavazhi (, "path of the father"), is a religion with one god that started in
South India in the middle of the 19th century. The 'zhi' () in the word, 'Ayyavazhi',
is a retroflex, ri.
- Balli Durga Prasad Rao (15 June 1956 – 16 September 2020) was an Indian politician.
He was elected to the Lok Sabha, lower house of the Parliament of India in the
2019 Indian general election. He was a member of the YSR Congress Party. Rao was
also a member of the Andhra Pradesh MLA from 1985 to 1989, 1994 to 1999, and 2009
to 2014.
---
# SentenceTransformer based on BAAI/bge-base-en-v1.5
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [BAAI/bge-base-en-v1.5](https://huggingface.co./BAAI/bge-base-en-v1.5). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [BAAI/bge-base-en-v1.5](https://huggingface.co./BAAI/bge-base-en-v1.5) <!-- at revision a5beb1e3e68b9ab74eb54cfd186867f64f240e1a -->
- **Maximum Sequence Length:** 512 tokens
- **Output Dimensionality:** 768 tokens
- **Similarity Function:** Cosine Similarity
<!-- - **Training Dataset:** Unknown -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co./models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("dipanjanS/bge-base-en-v1.5-fte")
# Run inference
sentences = [
'What political roles did Rao hold in Andhra Pradesh?',
'Balli Durga Prasad Rao (15 June 1956 – 16 September 2020) was an Indian politician. He was elected to the Lok Sabha, lower house of the Parliament of India in the 2019 Indian general election. He was a member of the YSR Congress Party. Rao was also a member of the Andhra Pradesh MLA from 1985 to 1989, 1994 to 1999, and 2009 to 2014.',
'Ayyavazhi (, "path of the father"), is a religion with one god that started in South India in the middle of the 19th century. The \'zhi\' () in the word, \'Ayyavazhi\', is a retroflex, ri.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
<!--
### Direct Usage (Transformers)
<details><summary>Click to see the direct usage in Transformers</summary>
</details>
-->
<!--
### Downstream Usage (Sentence Transformers)
You can finetune this model on your own dataset.
<details><summary>Click to expand</summary>
</details>
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 1,340 training samples
* Columns: <code>question</code> and <code>context</code>
* Approximate statistics based on the first 1000 samples:
| | question | context |
|:--------|:----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|
| type | string | string |
| details | <ul><li>min: 6 tokens</li><li>mean: 12.39 tokens</li><li>max: 24 tokens</li></ul> | <ul><li>min: 9 tokens</li><li>mean: 83.99 tokens</li><li>max: 510 tokens</li></ul> |
* Samples:
| question | context |
|:-----------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| <code>What is Basil commonly known as?</code> | <code>Basil ("Ocimum basilicum") ( or ) is a plant of the Family Lamiaceae. It is also known as Sweet Basil or Tulsi. It is a tender low-growing herb that is grown as a perennial in warm, tropical climates. Basil is originally native to India and other tropical regions of Asia. It has been cultivated there for more than 5,000 years. It is prominently featured in many cuisines throughout the world. Some of them are Italian, Thai, Vietnamese and Laotian cuisines. It grows to between 30–60 cm tall. It has light green, silky leaves 3–5 cm long and 1–3 cm broad. The leaves are opposite each other. The flowers are quite big. They are white in color and arranged as a spike.</code> |
| <code>Where is Basil originally native to?</code> | <code>Basil ("Ocimum basilicum") ( or ) is a plant of the Family Lamiaceae. It is also known as Sweet Basil or Tulsi. It is a tender low-growing herb that is grown as a perennial in warm, tropical climates. Basil is originally native to India and other tropical regions of Asia. It has been cultivated there for more than 5,000 years. It is prominently featured in many cuisines throughout the world. Some of them are Italian, Thai, Vietnamese and Laotian cuisines. It grows to between 30–60 cm tall. It has light green, silky leaves 3–5 cm long and 1–3 cm broad. The leaves are opposite each other. The flowers are quite big. They are white in color and arranged as a spike.</code> |
| <code>What is the significance of the Roerich Pact?</code> | <code>The Roerich Pact is a treaty on Protection of Artistic and Scientific Institutions and Historic Monuments, signed by the representatives of 21 states in the Oval Office of the White House on 15 April 1935. As of January 1, 1990, the Roerich Pact had been ratified by ten nations: Brazil, Chile, Colombia, Cuba, the Dominican Republic, El Salvador, Guatemala, Mexico, the United States, and Venezuela. It went into effect on 26 August 1935. The Government of India approved the Treaty in 1948, but did not take any further formal action. The Roerich Pact is also known as "Pax Cultura" ("Cultural Peace" or "Peace through Culture"). The most important part of the Roerich Pact is the legal recognition that the protection of culture is always more important than any military necessity.</code> |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Evaluation Dataset
#### Unnamed Dataset
* Size: 100 evaluation samples
* Columns: <code>question</code> and <code>context</code>
* Approximate statistics based on the first 1000 samples:
| | question | context |
|:--------|:----------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
| type | string | string |
| details | <ul><li>min: 7 tokens</li><li>mean: 12.36 tokens</li><li>max: 19 tokens</li></ul> | <ul><li>min: 12 tokens</li><li>mean: 84.15 tokens</li><li>max: 235 tokens</li></ul> |
* Samples:
| question | context |
|:--------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| <code>What is the demographic composition of Kolathur?</code> | <code>Kolathur () is a town in Salem district in the Indian state of Tamil Nadu. As of the 2001 India census, Kolathur had a population of 10,319. Males make up 53% of the population and females 47%. A total of 9% of the population is under 6 years of age.</code> |
| <code>What is notable about India's democracy?</code> | <code>India is a country in Asia. It has an area of . It is at the center of South Asia. India has more than 1.2 billion (1,210,000,000) people, which is the second largest population in the world. It is the seventh largest country in the world by area and the largest country in South Asia. It is also the most populous democracy in the world.</code> |
| <code>Who was the Chief Justice of India before Dipak Misra?</code> | <code>Justice Dipak Misra (born 3 October 1953) was the Judge of the Supreme Court and the Chief Justice of India. He took over as the 45th Chief Justice of India (CJI), succeeding the 44th CJI, Justice J. S. Khehar.</code> |
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 20.0,
"similarity_fct": "cos_sim"
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `eval_strategy`: steps
- `per_device_train_batch_size`: 16
- `per_device_eval_batch_size`: 16
- `learning_rate`: 3e-06
- `max_steps`: 332
- `warmup_ratio`: 0.1
- `fp16`: True
- `batch_sampler`: no_duplicates
#### All Hyperparameters
<details><summary>Click to expand</summary>
- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: steps
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 16
- `per_device_eval_batch_size`: 16
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `learning_rate`: 3e-06
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1.0
- `num_train_epochs`: 3.0
- `max_steps`: 332
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.1
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: False
- `fp16`: True
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: False
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`:
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `dispatch_batches`: None
- `split_batches`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `batch_sampler`: no_duplicates
- `multi_dataset_batch_sampler`: proportional
</details>
### Training Logs
| Epoch | Step | Training Loss | loss |
|:------:|:----:|:-------------:|:------:|
| 0.2381 | 20 | 0.1832 | 0.0491 |
| 0.4762 | 40 | 0.1118 | 0.0246 |
| 0.7143 | 60 | 0.0991 | 0.0152 |
| 0.9524 | 80 | 0.0518 | 0.0106 |
| 1.1905 | 100 | 0.0665 | 0.0073 |
| 1.4286 | 120 | 0.0539 | 0.0058 |
| 1.6667 | 140 | 0.0548 | 0.0048 |
| 1.9048 | 160 | 0.0354 | 0.0041 |
| 2.1429 | 180 | 0.038 | 0.0034 |
| 2.3810 | 200 | 0.0592 | 0.0030 |
| 2.6190 | 220 | 0.0203 | 0.0027 |
| 2.8571 | 240 | 0.0441 | 0.0025 |
| 3.0952 | 260 | 0.023 | 0.0024 |
| 3.3333 | 280 | 0.0452 | 0.0023 |
| 3.5714 | 300 | 0.0128 | 0.0022 |
| 3.8095 | 320 | 0.0495 | 0.0022 |
### Framework Versions
- Python: 3.10.12
- Sentence Transformers: 3.0.1
- Transformers: 4.42.4
- PyTorch: 2.3.1+cu121
- Accelerate: 0.32.1
- Datasets: 2.20.0
- Tokenizers: 0.19.1
## Citation
### BibTeX
#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
```
#### MultipleNegativesRankingLoss
```bibtex
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->