Does Daily Software Engineering Work Need Reasoning Models?
•
4
Yi Cui
onekq
AI & ML interests
Benchmark, Code Generation Model
Recent Activity
replied to
their
post
1 day ago
o3-mini is slightly better than R1, but lags behind Claude. Sorry folks, no new SOTA 😕
But OAI definitely owns the fashion of API. temperature and top_p are history now, reasoning_effort will be copied by other vendors.
https://huggingface.co./spaces/onekq-ai/WebApp1K-models-leaderboard
posted
an
update
2 days ago
o3-mini is slightly better than R1, but lags behind Claude. Sorry folks, no new SOTA 😕
But OAI definitely owns the fashion of API. temperature and top_p are history now, reasoning_effort will be copied by other vendors.
https://huggingface.co./spaces/onekq-ai/WebApp1K-models-leaderboard
updated
a Space
2 days ago
onekq-ai/WebApp1K-models-leaderboard
Articles
Organizations
Posts
13
Post
1260
o3-mini is slightly better than R1, but lags behind Claude. Sorry folks, no new SOTA 😕
But OAI definitely owns the fashion of API. temperature and top_p are history now, reasoning_effort will be copied by other vendors.
onekq-ai/WebApp1K-models-leaderboard
But OAI definitely owns the fashion of API. temperature and top_p are history now, reasoning_effort will be copied by other vendors.
onekq-ai/WebApp1K-models-leaderboard
Post
1174
Mistral Small 3 is SUPER fast, and highest score for 20+b model, but still 11 points below Qwen 2.5 coder 32b.
I believe specialty model is the future. The more you know what to do with the model, the better bang you can get for your buck. If Mistral scopes this small model to coding only, I'm confident they can beat Qwen.
One day my leaderboard will be dominated by smol models excellent on one thing, not monolithic ones costing $$$. And I'm looking forward to that.
onekq-ai/WebApp1K-models-leaderboard
I believe specialty model is the future. The more you know what to do with the model, the better bang you can get for your buck. If Mistral scopes this small model to coding only, I'm confident they can beat Qwen.
One day my leaderboard will be dominated by smol models excellent on one thing, not monolithic ones costing $$$. And I'm looking forward to that.
onekq-ai/WebApp1K-models-leaderboard
models
None public yet
datasets
None public yet