EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazards
Earth-system analysis reconstructs changing physical processes from observations that differ in source, scale, timing, and modality. Natural hazards make this work consequential because incomplete evidence can change estimates of severity, exposure, and mechanism. We introduce EarthVerse, a benchmark that evaluates scientific agents through package-scoped investigations. Its 405 reproducible tasks are grounded in 199 documented events and 19 hazard families. Agents inspect heterogeneous event packages, choose compatible evidence, execute transparent calculations, reconcile source differences,
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- FuzzySimilar title/name (fuzzy) · 87%NirDiamant/GenAI_Agents →
“Fuzzy title match (0.94): “EarthVerse: Benchmarking Scientific Agents Across Dynamic Ea” ≈ “NirDiamant/GenAI_Agents””
- FuzzySimilar title/name (fuzzy) · 84%Unity-Technologies/ml-agents →
“Fuzzy title match (0.92): “EarthVerse: Benchmarking Scientific Agents Across Dynamic Ea” ≈ “Unity-Technologies/ml-agents””
- FuzzyOverlapping authors or contributors · 62%keras-team/keras →
“Shared author/contributor keys: jin”
- FuzzyOverlapping authors or contributors · 62%HKUDS/LightRAG →
“Shared author/contributor keys: jin”
- FuzzyOverlapping authors or contributors · 62%rasbt/LLMs-from-scratch →
“Shared author/contributor keys: yin”
- LinkedLinked via arxiv author · 85%Zhiqing Cui →
“EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazards”
- LinkedLinked via arxiv author · 85%Xinxiang Yin →
“EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazards”
- LinkedLinked via arxiv author · 85%Yihong Tang →
“EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazards”