BTS-AgentBench: A Deterministic, Replayable Pipeline from Read-Only Telemetry Logs to Agent Benchmarks
Industrial sites contain large volumes of read-only telemetry, but few benchmarks specify how to compile these records into executable multi-turn agent tasks. We present a telemetry-to-episode construction method instantiated as BTS-AgentBench. The pipeline normalizes BTS metadata and raw histories into a read-only tool store, compiles static tasks with tool-derived gold answers and evidence, and lifts retained tasks into typed, bounded operator-facing episodes. The 532-row release adds clarification, goal revision, timestamp policy, quality-gated reporting, and evidence attribution while pres
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- FuzzySimilar title/name (fuzzy) · 59%AgentCore-8B →
“Fuzzy title match (0.73): “BTS-AgentBench: A Deterministic, Replayable Pipeline from Re” ≈ “AgentCore-8B””
- PossiblePossibly related (embedding) · 55%Evaluating AI Agents: A production blueprint with Strands and AgentCore →
- PossiblePossibly related (embedding) · 52%Evolving from legacy BI to agentic AI at Tradeshift with Amazon Quick →
- FuzzySimilar title/name (fuzzy) · 87%SWE-agent/SWE-agent →
“Fuzzy title match (0.94): “BTS-AgentBench: A Deterministic, Replayable Pipeline from Re” ≈ “SWE-agent/SWE-agent””
- FuzzySimilar title/name (fuzzy) · 87%zhayujie/CowAgent →
“Fuzzy title match (0.94): “BTS-AgentBench: A Deterministic, Replayable Pipeline from Re” ≈ “zhayujie/CowAgent””
- FuzzySimilar title/name (fuzzy) · 59%NousResearch/hermes-agent →
“Fuzzy title match (0.73): “BTS-AgentBench: A Deterministic, Replayable Pipeline from Re” ≈ “NousResearch/hermes-agent””
- FuzzySimilar title/name (fuzzy) · 59%bojieli/ai-agent-book →
“Fuzzy title match (0.73): “BTS-AgentBench: A Deterministic, Replayable Pipeline from Re” ≈ “bojieli/ai-agent-book””
- FuzzySimilar title/name (fuzzy) · 59%iflytek/astron-agent →
“Fuzzy title match (0.73): “BTS-AgentBench: A Deterministic, Replayable Pipeline from Re” ≈ “iflytek/astron-agent””