andito HF staff commited on
Commit
c7ecde1
·
verified ·
1 Parent(s): 81ab8f4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -9
README.md CHANGED
@@ -170,12 +170,8 @@ The training data comes from [The Cauldron](https://huggingface.co/datasets/Hugg
170
 
171
  ## Evaluation
172
 
173
- | Model | MMMU (val) | MathVista (testmini) | MMStar (val) | DocVQA (test) | TextVQA (val) | Min GPU RAM required (GB) |
174
- |-------------------|------------|----------------------|--------------|---------------|---------------|---------------------------|
175
- | SmolVLM 2.2B | 38.8 | 44.6 | 42.1 | 81.6 | 72.7 | 5.02 |
176
- | Qwen-VL 2B | 41.1 | 47.8 | 47.5 | 90.1 | 79.7 | 13.70 |
177
- | InternVL2 2B | 34.3 | 46.3 | 49.8 | 86.9 | 73.4 | 10.52 |
178
- | PaliGemma 3B 448px| 34.9 | 28.7 | 48.3 | 32.2 | 56.0 | 6.72 |
179
- | moondream2 | 32.4 | 24.3 | 40.3 | 70.5 | 65.2 | 3.87 |
180
- | MiniCPM-V-2 | 38.2 | 39.8 | 39.1 | 71.9 | 74.1 | 7.88 |
181
- | MM1.5 1B | 35.8 | 37.2 | 0.0 | 81.0 | 72.5 | NaN |
 
170
 
171
  ## Evaluation
172
 
173
+ | Size | Mathvista | MMMU | OCRBench | MMStar | AI2D | ChartQA_Test | Science_QA | TextVQA Val | DocVQA Val |
174
+ |-------|-----------|------|----------|--------|-------|--------------|------------|-------------|------------|
175
+ | 256M | 35.9 | 28.3 | 52.6 | 34.6 | 47 | 55.8 | 73.6 | 49.9 | 58.3 |
176
+ | 500M | 40.1 | 33.7 | 61 | 38.3 | 59.5 | 63.2 | 79.7 | 60.5 | 70.5 |
177
+ | 2.2B | 43.9 | 38.3 | 65.5 | 41.8 | 64 | 71.6 | 84.5 | 72.1 | 79.7 |