Does Multi-Agent Debate Improve AI Feedback on Research Papers?
Probably not, at least for meta-analyses in economics. In a pre-registered, identity-masked, within-paper experiment, the authors of 44 meta-analyses ranked three AI reports on their own paper by usefulness for improving it: a single pass by a frontier model against two multi-agent debate tools we built and expected to win. All reports were held to a common length and template. The authors preferred the single pass, by 0.66 rank points over mad-research (95% CI 0.32 to 1.00) and 0.57 over paper-workshop (0.16 to 0.95), though paper-workshop spent roughly thirty times the tokens. Authors who re
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- FuzzySimilar title/name (fuzzy) · 59%AgentCore-8B →
“Fuzzy title match (0.73): “Does Multi-Agent Debate Improve AI Feedback on Research Pape” ≈ “AgentCore-8B””
- FuzzySimilar title/name (fuzzy) · 87%SWE-agent/SWE-agent →
“Fuzzy title match (0.94): “Does Multi-Agent Debate Improve AI Feedback on Research Pape” ≈ “SWE-agent/SWE-agent””
- FuzzySimilar title/name (fuzzy) · 87%zhayujie/CowAgent →
“Fuzzy title match (0.94): “Does Multi-Agent Debate Improve AI Feedback on Research Pape” ≈ “zhayujie/CowAgent””
- FuzzySimilar title/name (fuzzy) · 66%open-multi-agent/open-multi-agent →
“Fuzzy title match (0.78): “Does Multi-Agent Debate Improve AI Feedback on Research Pape” ≈ “open-multi-agent/open-multi-agent””
- FuzzySimilar title/name (fuzzy) · 59%NousResearch/hermes-agent →
“Fuzzy title match (0.73): “Does Multi-Agent Debate Improve AI Feedback on Research Pape” ≈ “NousResearch/hermes-agent””
- FuzzySimilar title/name (fuzzy) · 59%google-research/google-research →
“Fuzzy title match (0.73): “Does Multi-Agent Debate Improve AI Feedback on Research Pape” ≈ “google-research/google-research””
- LinkedLinked via arxiv author · 85%Tomas Havranek →
“Does Multi-Agent Debate Improve AI Feedback on Research Papers?”
- LinkedLinked via arxiv author · 85%Zuzana Irsova →
“Does Multi-Agent Debate Improve AI Feedback on Research Papers?”