40
VLM R1 Referral Expression
💬
Highlight described objects in images
Tony Zhao
tianchez
AI & ML interests
Multimodal Agent, Generative AI
Recent Activity
replied to
their
post
5 days ago
Introducing VLM-R1!
GRPO has helped DeepSeek R1 to learn reasoning. Can it also help VLMs perform stronger for general computer vision tasks?
The answer is YES and it generalizes better than SFT. We trained Qwen 2.5 VL 3B on RefCOCO (a visual grounding task) and eval on RefCOCO Val and RefGTA (an OOD task).
https://github.com/om-ai-lab/VLM-R1
reacted
to
their
post
with 👍
6 days ago
Introducing VLM-R1!
GRPO has helped DeepSeek R1 to learn reasoning. Can it also help VLMs perform stronger for general computer vision tasks?
The answer is YES and it generalizes better than SFT. We trained Qwen 2.5 VL 3B on RefCOCO (a visual grounding task) and eval on RefCOCO Val and RefGTA (an OOD task).
https://github.com/om-ai-lab/VLM-R1
new activity
7 days ago
omlab/VLM-R1-Referral-Expression:Fixes 500 error for some users
Organizations
tianchez's activity
liked
a
Space
11 days ago
liked
a
Space
about 2 months ago
liked
a
Space
2 months ago
liked
a
dataset
2 months ago
liked
a
model
4 months ago
liked
a
Space
6 months ago
liked
a
model
6 months ago
liked
2
models
7 months ago
liked
a
dataset
10 months ago
liked
a
dataset
about 1 year ago
liked
a
model
about 1 year ago
liked
a
dataset
about 1 year ago
liked
a
model
about 1 year ago
liked
2
datasets
about 1 year ago
liked
3
models
over 1 year ago
liked
a
Space
over 1 year ago