Thaweewat commited on
Commit
41dbc01
1 Parent(s): 95a2ce1

Add new SentenceTransformer model

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ 0_StaticEmbedding/tokenizer.json filter=lfs diff=lfs merge=lfs -text
0_StaticEmbedding/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9bccf2783c05af86282a4064c16a50e6653d46cda7f8c119cfbfa53713ec4863
3
+ size 512004192
0_StaticEmbedding/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a56def25aa40facc030ea8b0b87f3688e4b3c39eb8b45d5702b3a1300fe2a20
3
+ size 17082734
README.md ADDED
@@ -0,0 +1,142 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Alibaba-NLP/gte-multilingual-base
3
+ library_name: sentence-transformers
4
+ pipeline_tag: sentence-similarity
5
+ tags:
6
+ - sentence-transformers
7
+ - sentence-similarity
8
+ - feature-extraction
9
+ ---
10
+
11
+ # SentenceTransformer based on Alibaba-NLP/gte-multilingual-base
12
+
13
+ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Alibaba-NLP/gte-multilingual-base](https://huggingface.co/Alibaba-NLP/gte-multilingual-base). It maps sentences & paragraphs to a 512-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
14
+
15
+ ## Model Details
16
+
17
+ ### Model Description
18
+ - **Model Type:** Sentence Transformer
19
+ - **Base model:** [Alibaba-NLP/gte-multilingual-base](https://huggingface.co/Alibaba-NLP/gte-multilingual-base) <!-- at revision 7fc06782350c1a83f88b15dd4b38ef853d3b8503 -->
20
+ - **Maximum Sequence Length:** inf tokens
21
+ - **Output Dimensionality:** 512 tokens
22
+ - **Similarity Function:** Cosine Similarity
23
+ <!-- - **Training Dataset:** Unknown -->
24
+ <!-- - **Language:** Unknown -->
25
+ <!-- - **License:** Unknown -->
26
+
27
+ ### Model Sources
28
+
29
+ - **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
30
+ - **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
31
+ - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
32
+
33
+ ### Full Model Architecture
34
+
35
+ ```
36
+ SentenceTransformer(
37
+ (0): StaticEmbedding(
38
+ (embedding): EmbeddingBag(250002, 512, mode='mean')
39
+ )
40
+ )
41
+ ```
42
+
43
+ ## Usage
44
+
45
+ ### Direct Usage (Sentence Transformers)
46
+
47
+ First install the Sentence Transformers library:
48
+
49
+ ```bash
50
+ pip install -U sentence-transformers
51
+ ```
52
+
53
+ Then you can load this model and run inference.
54
+ ```python
55
+ from sentence_transformers import SentenceTransformer
56
+
57
+ # Download from the 🤗 Hub
58
+ model = SentenceTransformer("Thaweewat/gte-multilingual-base-m2v-512")
59
+ # Run inference
60
+ sentences = [
61
+ 'The weather is lovely today.',
62
+ "It's so sunny outside!",
63
+ 'He drove to the stadium.',
64
+ ]
65
+ embeddings = model.encode(sentences)
66
+ print(embeddings.shape)
67
+ # [3, 512]
68
+
69
+ # Get the similarity scores for the embeddings
70
+ similarities = model.similarity(embeddings, embeddings)
71
+ print(similarities.shape)
72
+ # [3, 3]
73
+ ```
74
+
75
+ <!--
76
+ ### Direct Usage (Transformers)
77
+
78
+ <details><summary>Click to see the direct usage in Transformers</summary>
79
+
80
+ </details>
81
+ -->
82
+
83
+ <!--
84
+ ### Downstream Usage (Sentence Transformers)
85
+
86
+ You can finetune this model on your own dataset.
87
+
88
+ <details><summary>Click to expand</summary>
89
+
90
+ </details>
91
+ -->
92
+
93
+ <!--
94
+ ### Out-of-Scope Use
95
+
96
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
97
+ -->
98
+
99
+ <!--
100
+ ## Bias, Risks and Limitations
101
+
102
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
103
+ -->
104
+
105
+ <!--
106
+ ### Recommendations
107
+
108
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
109
+ -->
110
+
111
+ ## Training Details
112
+
113
+ ### Framework Versions
114
+ - Python: 3.10.12
115
+ - Sentence Transformers: 3.2.0
116
+ - Transformers: 4.44.2
117
+ - PyTorch: 2.4.1+cu121
118
+ - Accelerate: 0.34.2
119
+ - Datasets:
120
+ - Tokenizers: 0.19.1
121
+
122
+ ## Citation
123
+
124
+ ### BibTeX
125
+
126
+ <!--
127
+ ## Glossary
128
+
129
+ *Clearly define terms in order to be accessible across audiences.*
130
+ -->
131
+
132
+ <!--
133
+ ## Model Card Authors
134
+
135
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
136
+ -->
137
+
138
+ <!--
139
+ ## Model Card Contact
140
+
141
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
142
+ -->
config_sentence_transformers.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "sentence_transformers": "3.2.0",
4
+ "transformers": "4.44.2",
5
+ "pytorch": "2.4.1+cu121"
6
+ },
7
+ "prompts": {},
8
+ "default_prompt_name": null,
9
+ "similarity_fn_name": null
10
+ }
modules.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "0_StaticEmbedding",
6
+ "type": "sentence_transformers.models.StaticEmbedding"
7
+ }
8
+ ]