Plover: Steering GUI Agents through Plan-Centric Interaction
Graphical user interface (GUI) automation remains challenging in real-world environments, where dynamic layouts, unexpected dialogs, and evolving interface states can cause autonomous agents to drift from user intent. Recent vision-based multimodal agents improve flexibility by operating directly over screenshots and natural language instructions, but planning and adaptation often remain internal, limiting users' ability to inspect, supervise, or correct system behavior. We present Plover, a plan-centric vision-based GUI automation system that externalizes task plans and replanning as persiste
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 54%Agentic vision: Building visual intelligence with Amazon Bedrock and MCP servers →
- PossiblePossibly related (embedding) · 53%Build generative UI for AI agents on Amazon Bedrock AgentCore with the AG-UI protocol →
- FuzzySimilar title/name (fuzzy) · 87%NirDiamant/GenAI_Agents →
“Fuzzy title match (0.94): “Plover: Steering GUI Agents through Plan-Centric Interaction” ≈ “NirDiamant/GenAI_Agents””
- FuzzySimilar title/name (fuzzy) · 84%Unity-Technologies/ml-agents →
“Fuzzy title match (0.92): “Plover: Steering GUI Agents through Plan-Centric Interaction” ≈ “Unity-Technologies/ml-agents””
- FuzzyOverlapping authors or contributors · 62%modular/modular →
“Shared author/contributor keys: liu”
- FuzzyOverlapping authors or contributors · 62%mudler/LocalAI →
“Shared author/contributor keys: guo”
- FuzzySimilar title/name (fuzzy) · 59%datawhalechina/hello-agents →
“Fuzzy title match (0.73): “Plover: Steering GUI Agents through Plan-Centric Interaction” ≈ “datawhalechina/hello-agents””
- LinkedLinked via arxiv author · 85%Madhumitha Venkatesan →
“Plover: Steering GUI Agents through Plan-Centric Interaction”