Read original ↗
paperarXivTrust 82 · PrimaryPublished 5d agoLive · 4d ago

Game2World Engine: Unlocking In-the-Wild Gameplay Videos for World Model Training

Video games provide a scalable source of training data for video world models, offering diverse environments, complex interactions, and abundant in-the-wild gameplay videos. However, raw gameplay footage entangles the game world with screen-space interfaces, introducing game-specific biases and irrelevant dynamics that hinder world-model training. To address this problem, we introduce GameUI-Taxonomy and G2WEngine, a full-stack framework that formalizes gameplay UI grounding and removal. G2WEngine automatically extracts reusable UI assets from real gameplay videos and synthesizes temporally co

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

  • PossiblePossibly related (embedding) · 49%Flux 3 X Mimic: The Next Generation of Video-Action Models
  • FuzzyOverlapping authors or contributors · 62%HKUDS/LightRAG

    Shared author/contributor keys: jin

  • FuzzyOverlapping authors or contributors · 62%keras-team/keras

    Shared author/contributor keys: jin

  • LinkedLinked via arxiv author · 85%Wenxuan Shen

    Game2World Engine: Unlocking In-the-Wild Gameplay Videos for World Model Training

  • LinkedLinked via arxiv author · 85%Dongna Jin

    Game2World Engine: Unlocking In-the-Wild Gameplay Videos for World Model Training

  • LinkedLinked via arxiv author · 85%Dongping Chen

    Game2World Engine: Unlocking In-the-Wild Gameplay Videos for World Model Training

Covers

Implements (incoming)

authored (incoming)

Related across the graph

Topics