kimihailv commited on
Commit
3f213a9
1 Parent(s): 28a4a53

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -34,6 +34,22 @@ The model was trained on balanced multilingual dataset.
34
 
35
  If you need English model, check [this](https://huggingface.co/unum-cloud/uform-vl-english).
36
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
37
 
38
  ## Installation
39
 
 
34
 
35
  If you need English model, check [this](https://huggingface.co/unum-cloud/uform-vl-english).
36
 
37
+ ## Evaluation
38
+
39
+ The following metrics were obtained with multimodal re-ranking:
40
+
41
+ **Monolingual**
42
+
43
+ | Dataset | Recall@1 | Recall@5 | Recall@10 |
44
+ | :-------- | ------: | --------: | --------: |
45
+ | Zero-Shot Flickr | 0.558 | 0.813 | 0.874 |
46
+ | MS-COCO (train split was in training data) | 0.401 | 0.680 | 0.781 |
47
+
48
+ **Multilingual**
49
+
50
+ | English | German | Spanish | French | Italian | Russian | Japanese | Korean | Turkish | Chinese | Polish |
51
+ | -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------:
52
+ 96.3 | 92.6 | 94.5 | 94.4 | 94.4 | 90.4 | 88.3 | 92.5 | 94.4 | 93.6 | 95.0 |
53
 
54
  ## Installation
55