andito HF staff commited on
Commit
d8d478d
·
verified ·
1 Parent(s): 4982992

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -10
README.md CHANGED
@@ -166,15 +166,10 @@ The training data comes from [The Cauldron](https://huggingface.co/datasets/Hugg
166
 
167
 
168
 
169
-
170
  ## Evaluation
171
 
172
- | Model | MMMU (val) | MathVista (testmini) | MMStar (val) | DocVQA (test) | TextVQA (val) | Min GPU RAM required (GB) |
173
- |-------------------|------------|----------------------|--------------|---------------|---------------|---------------------------|
174
- | SmolVLM 2.2B | 38.8 | 44.6 | 42.1 | 81.6 | 72.7 | 5.02 |
175
- | Qwen-VL 2B | 41.1 | 47.8 | 47.5 | 90.1 | 79.7 | 13.70 |
176
- | InternVL2 2B | 34.3 | 46.3 | 49.8 | 86.9 | 73.4 | 10.52 |
177
- | PaliGemma 3B 448px| 34.9 | 28.7 | 48.3 | 32.2 | 56.0 | 6.72 |
178
- | moondream2 | 32.4 | 24.3 | 40.3 | 70.5 | 65.2 | 3.87 |
179
- | MiniCPM-V-2 | 38.2 | 39.8 | 39.1 | 71.9 | 74.1 | 7.88 |
180
- | MM1.5 1B | 35.8 | 37.2 | 0.0 | 81.0 | 72.5 | NaN |
 
166
 
167
 
168
 
 
169
  ## Evaluation
170
 
171
+ | Size | Mathvista | MMMU | OCRBench | MMStar | AI2D | ChartQA_Test | Science_QA | TextVQA Val | DocVQA Val |
172
+ |-------|-----------|------|----------|--------|-------|--------------|------------|-------------|------------|
173
+ | 256M | 35.9 | 28.3 | 52.6 | 34.6 | 47 | 55.8 | 73.6 | 49.9 | 58.3 |
174
+ | 500M | 40.1 | 33.7 | 61 | 38.3 | 59.5 | 63.2 | 79.7 | 60.5 | 70.5 |
175
+ | 2.2B | 43.9 | 38.3 | 65.5 | 41.8 | 64 | 71.6 | 84.5 | 72.1 | 79.7 |