Read original ↗

paperarXivTrust 82 · PrimaryPublished 1mo agoLive · 1mo ago

VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes

Perception-based humanoid loco-manipulation requires connecting egocentric observations and task instructions to whole-body motion. Learning this mapping requires synchronized egocentric images, language commands, and robot-compatible kinematic trajectories, yet no existing data source provides this complete tuple at scale. We address this bottleneck by generating vision-language-kinematics (VLK) supervision synthetically in reconstructed scenes. Our pipeline leverages 3D Gaussian Splatting to reconstruct metric-scale indoor environments, synthesizes navigation and object-interaction trajector

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

LinkedLinked via unknownVideo Friday: Robotic Motion Discovery Reveals Unusual Behaviors →
LinkedLinked via unknownInto the Omniverse: Three Workflows for Improving Vision AI Agent Accuracy With Synthetic Data and Fine-Tuning →
PossiblePossibly related (embedding) · 47%roboflow/supervision →
PossiblePossibly related (embedding) · 45%Researchers Create Faster, Cheaper Way to Teach a Humanoid Robot to Walk Over Real-World Terrain - Georgia Institute of Technology →
PossiblePossibly related (embedding) · 52%Grabette: an open system to record robot-manipulation data →

Covers

newsVideo Friday: Robotic Motion Discovery Reveals Unusual Behaviors newsInto the Omniverse: Three Workflows for Improving Vision AI Agent Accuracy With Synthetic Data and Fine-Tuning

Implements (incoming)

reporoboflow/supervision

Covers (incoming)

newsResearchers Create Faster, Cheaper Way to Teach a Humanoid Robot to Walk Over Real-World Terrain - Georgia Institute of Technology newsGrabette: an open system to record robot-manipulation data

Related across the graph

newsGrabette: an open system to record robot-manipulation data newsInto the Omniverse: Three Workflows for Improving Vision AI Agent Accuracy With Synthetic Data and Fine-Tuning reporoboflow/supervision newsResearchers Create Faster, Cheaper Way to Teach a Humanoid Robot to Walk Over Real-World Terrain - Georgia Institute of Technology newsVideo Friday: Robotic Motion Discovery Reveals Unusual Behaviors

Topics