Real-World Evaluation of an AI Agent Drafting Translational Impact Summaries
Introduction. Clinical and Translational Science Award (CTSA) programs must document their scholars' research impact, but assembling each scholar's record by hand takes staff an estimated 15 hours and does not scale to a full cohort. An artificial intelligence (AI) agent could serve as a tool to gather scholar data across platforms and disciplines. Methods. We built a human-in-the-loop AI agent that assembles a dossier of sourced evidence for each scholar and drafts one-sentence Translational Science Benefits Model (TSBM) impact summaries for staff review. We evaluated it in the impact-repor
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- FuzzySimilar title/name (fuzzy) · 59%AgentCore-8B →
“Fuzzy title match (0.73): “Real-World Evaluation of an AI Agent Drafting Translational ” ≈ “AgentCore-8B””
- PossiblePossibly related (embedding) · 50%AI for Scientific Literature Mining: PubMed, Semantic Scholar, and What Actually Works - Technology Networks →
- FuzzySimilar title/name (fuzzy) · 87%SWE-agent/SWE-agent →
“Fuzzy title match (0.94): “Real-World Evaluation of an AI Agent Drafting Translational ” ≈ “SWE-agent/SWE-agent””
- FuzzySimilar title/name (fuzzy) · 87%zhayujie/CowAgent →
“Fuzzy title match (0.94): “Real-World Evaluation of an AI Agent Drafting Translational ” ≈ “zhayujie/CowAgent””
- FuzzySimilar title/name (fuzzy) · 59%NousResearch/hermes-agent →
“Fuzzy title match (0.73): “Real-World Evaluation of an AI Agent Drafting Translational ” ≈ “NousResearch/hermes-agent””
- FuzzySimilar title/name (fuzzy) · 59%bojieli/ai-agent-book →
“Fuzzy title match (0.73): “Real-World Evaluation of an AI Agent Drafting Translational ” ≈ “bojieli/ai-agent-book””
- FuzzySimilar title/name (fuzzy) · 59%2FastLabs/agent-squad →
“Fuzzy title match (0.73): “Real-World Evaluation of an AI Agent Drafting Translational ” ≈ “2FastLabs/agent-squad””
- LinkedLinked via arxiv author · 85%Mohammad Arvan →
“Real-World Evaluation of an AI Agent Drafting Translational Impact Summaries”