TestEvo-Bench: An Executable and Live Benchmark for Test and Code Co-Evolution
Software tests and code evolve together: a code change should be followed by new or updated tests that record the new software behavior. Yet existing test generation and update benchmarks often isolate the test from the code change, and rely on static metadata that does not verify whether a test is executable or semantically tied to the code change. This makes it difficult to evaluate whether a test automation agent understands how a code change should propagate into the test suite. We introduce TestEvo-Bench, a benchmark of test and code co-evolution tasks mined from software repositories,
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 57%ScarfBench: Benchmarking AI Agents for Enterprise Java Framework Migration →
- PossiblePossibly related (embedding) · 50%Introducing GeneBench-Pro →
- PossiblePossibly related (embedding) · 47%potpie-ai/potpie →
- PossiblePossibly related (embedding) · 46%Giskard-AI/giskard-oss →
- PossiblePossibly related (embedding) · 46%REAP: Automatic Curation of Coding Agent Benchmarks from Interactive Production Usage [R] →
- LinkedLinked via arxiv author · 85%Jiale Amber Wang →
“TestEvo-Bench: An Executable and Live Benchmark for Test and Code Co-Evolution”
- LinkedLinked via arxiv author · 85%Kaiyuan Wang →
“TestEvo-Bench: An Executable and Live Benchmark for Test and Code Co-Evolution”
- LinkedLinked via arxiv author · 85%Pengyu Nie →
“TestEvo-Bench: An Executable and Live Benchmark for Test and Code Co-Evolution”