HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?
As agents move from research prototypes to deployed tools, their capability increasingly depends on model-external execution infrastructure, commonly termed the agent harness. Changing this harness while holding model weights fixed can substantially alter task performance. Current agent evaluations typically report downstream performance under a chosen harness, leaving a model's ability to develop the harness itself comparatively underexplored. We introduce HarnessDev, a benchmark that shifts the unit of evaluation from task outputs to runnable infrastructure. HarnessDev covers two stages. In
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- FuzzySimilar title/name (fuzzy) · 59%AgentCore-8B →
“Fuzzy title match (0.73): “HarnessDev: Can LLMs Create and Evolve Their Own Agent Harne” ≈ “AgentCore-8B””
- PossiblePossibly related (embedding) · 64%Pluggable by design: An agent mesh for software modernization that adopts the next model release →
- FuzzySimilar title/name (fuzzy) · 87%strands-agents/harness-sdk →
“Fuzzy title match (0.94): “HarnessDev: Can LLMs Create and Evolve Their Own Agent Harne” ≈ “strands-agents/harness-sdk””
- FuzzySimilar title/name (fuzzy) · 87%SWE-agent/SWE-agent →
“Fuzzy title match (0.94): “HarnessDev: Can LLMs Create and Evolve Their Own Agent Harne” ≈ “SWE-agent/SWE-agent””
- FuzzySimilar title/name (fuzzy) · 87%zhayujie/CowAgent →
“Fuzzy title match (0.94): “HarnessDev: Can LLMs Create and Evolve Their Own Agent Harne” ≈ “zhayujie/CowAgent””
- FuzzyOverlapping authors or contributors · 62%ray-project/ray →
“Shared author/contributor keys: wang”
- FuzzyOverlapping authors or contributors · 62%modular/modular →
“Shared author/contributor keys: liu”
- LinkedLinked via arxiv author · 85%Yuhao Wu →
“HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?”