File size: 1,329 Bytes
3ab0c42 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 |
---
tags:
- Buddhist Sanskrit
- BERT
- name: bert-base-buddhist-sanskrit
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# bert-base-buddhist-sanskrit
The best performing model of the research described in the paper 'Embeddings models for Buddhist Sanskrit' published at LREC 2022 (Link to the paper will be added after
the publication of conference proceedings).
## Model description
The model has the bert-base architecture and configuration and was pretrained from scratch as a masked language model
on the Sanskrit reference corpus, and fine-tuned on the smaller corpus of Buddhist Sanskrit.
## Intended uses & limitations
MIT license, no limitations
## Training and evaluation data
See the paper 'Embeddings models for Buddhist Sanskrit' for details on the corpora and the evaluation procedure.
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 28
- eval_batch_size: 4
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 300.0
### Framework versions
- Transformers 4.11.2
- Pytorch 1.7.0
- Datasets 1.12.1
- Tokenizers 0.10.3
|