MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents
We introduce MM-ToolSandBox, a benchmark and evaluation framework for visually grounded tool-calling agents. The framework provides a stateful execution environment spanning 500+ tools across 16 application domains, supporting multi-image, multi-turn tasks where agents must ground progressively arriving visual inputs into executable tool calls while handling realistic conversational phenomena (goal revisions, error corrections, state mutations). An automated scenario generation pipeline produces diverse, visually grounded scenarios through information-flow-guided planning and multi-stage quali
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
- Linked via arxiv authorKaixin Ma →
MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents
- Linked via arxiv authorDi Feng →
MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents
- Linked via arxiv authorAlexander Metz →
MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents
- Linked via arxiv authorJiarui Lu →
MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents
- Linked via arxiv authorEshan Verma →
MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents
- Linked via arxiv authorAfshin Dehghan →
MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents