avemio-digital
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -90,6 +90,21 @@ SentenceTransformer(
|
|
90 |
| PawsXPairClassification | **0.5452** | 0.5077 | 0.5162 | -3.76% | -2.90% |
|
91 |
|
92 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
93 |
## Usage
|
94 |
|
95 |
### Direct Usage (Sentence Transformers)
|
|
|
90 |
| PawsXPairClassification | **0.5452** | 0.5077 | 0.5162 | -3.76% | -2.90% |
|
91 |
|
92 |
|
93 |
+
## Evaluation on GRAG-EMBEDDING-BENCHMARK
|
94 |
+
|
95 |
+
Accuracy is calculated by evaluating if the relevant context is the highest ranking embedding of the whole context array.
|
96 |
+
See Eval-Dataset and Evaluation Code [here](https://huggingface.co/datasets/avemio/GRAG-EMBEDDING-BENCHMARK)
|
97 |
+
|
98 |
+
| Model Name | Accuracy |
|
99 |
+
|-------------------------------------------------|-----------|
|
100 |
+
| [bge-m3](https://huggingface.co/BAAI/bge-m3 ) | 0.8806 |
|
101 |
+
| [UAE-Large-V1](https://huggingface.co/WhereIsAI/UAE-Large-V1) | 0.8393 |
|
102 |
+
| [GRAG-BGE-M3-TRIPLES-HESSIAN-AI](https://huggingface.co/avemio/GRAG-BGE-M3-TRIPLES-HESSIAN-AI) | 0.8857 |
|
103 |
+
| [GRAG-BGE-M3-TRIPLES-MERGED-HESSIAN-AI](https://huggingface.co/avemio/GRAG-BGE-M3-TRIPLES-MERGED-HESSIAN-AI) | **0.8866** |
|
104 |
+
| [GRAG-BGE-M3-MERGED-x-SNOWFLAKE-ARCTIC-HESSIAN-AI](https://huggingface.co/avemio/GRAG-BGE-M3-MERGED-x-SNOWFLAKE-ARCTIC-HESSIAN-AI) | **0.8866** |
|
105 |
+
| [GRAG-UAE-LARGE-V1-TRIPLES-HESSIAN-AI](https://huggingface.co/avemio/GRAG-UAE-LARGE-V1-TRIPLES-HESSIAN-AI) | 0.8763 |
|
106 |
+
| [GRAG-UAE-LARGE-V1-TRIPLES-MERGED-HESSIAN-AI](https://huggingface.co/avemio/GRAG-UAE-LARGE-V1-TRIPLES-MERGED-HESSIAN-AI) | 0.8771 |
|
107 |
+
|
108 |
## Usage
|
109 |
|
110 |
### Direct Usage (Sentence Transformers)
|