avemio-digital commited on
Commit
dde40de
·
verified ·
1 Parent(s): 8b3d4bc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -90,6 +90,21 @@ SentenceTransformer(
90
  | PawsXPairClassification | **0.5452** | 0.5077 | 0.5162 | -3.76% | -2.90% |
91
 
92
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
93
  ## Usage
94
 
95
  ### Direct Usage (Sentence Transformers)
 
90
  | PawsXPairClassification | **0.5452** | 0.5077 | 0.5162 | -3.76% | -2.90% |
91
 
92
 
93
+ ## Evaluation on GRAG-EMBEDDING-BENCHMARK
94
+
95
+ Accuracy is calculated by evaluating if the relevant context is the highest ranking embedding of the whole context array.
96
+ See Eval-Dataset and Evaluation Code [here](https://huggingface.co/datasets/avemio/GRAG-EMBEDDING-BENCHMARK)
97
+
98
+ | Model Name | Accuracy |
99
+ |-------------------------------------------------|-----------|
100
+ | [bge-m3](https://huggingface.co/BAAI/bge-m3 ) | 0.8806 |
101
+ | [UAE-Large-V1](https://huggingface.co/WhereIsAI/UAE-Large-V1) | 0.8393 |
102
+ | [GRAG-BGE-M3-TRIPLES-HESSIAN-AI](https://huggingface.co/avemio/GRAG-BGE-M3-TRIPLES-HESSIAN-AI) | 0.8857 |
103
+ | [GRAG-BGE-M3-TRIPLES-MERGED-HESSIAN-AI](https://huggingface.co/avemio/GRAG-BGE-M3-TRIPLES-MERGED-HESSIAN-AI) | **0.8866** |
104
+ | [GRAG-BGE-M3-MERGED-x-SNOWFLAKE-ARCTIC-HESSIAN-AI](https://huggingface.co/avemio/GRAG-BGE-M3-MERGED-x-SNOWFLAKE-ARCTIC-HESSIAN-AI) | **0.8866** |
105
+ | [GRAG-UAE-LARGE-V1-TRIPLES-HESSIAN-AI](https://huggingface.co/avemio/GRAG-UAE-LARGE-V1-TRIPLES-HESSIAN-AI) | 0.8763 |
106
+ | [GRAG-UAE-LARGE-V1-TRIPLES-MERGED-HESSIAN-AI](https://huggingface.co/avemio/GRAG-UAE-LARGE-V1-TRIPLES-MERGED-HESSIAN-AI) | 0.8771 |
107
+
108
  ## Usage
109
 
110
  ### Direct Usage (Sentence Transformers)