InteractGesture: Progressive Chunk Guidance for Continuous Streaming Co-Speech Gesture Control
Co-speech gesture generation has made significant progress toward realistic full-body motion from speaker audio, yet existing models lack fine-grained spatial controllability of individual joints. To address this, we introduce \emph{InteractGesture}, a model-agnostic, inference-time method for spatially controllable gesture generation. \emph{InteractGesture} guides target latent estimates of a diffusion sampler through a differentiable RVQ-VAE decoder, backpropagating spatial control gradients to adjust motion latents during sampling. A primary challenge in streaming co-speech generation is ch
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- FuzzySimilar title/name (fuzzy) · 87%lllyasviel/ControlNet-v1-1 →
“Fuzzy title match (0.94): “InteractGesture: Progressive Chunk Guidance for Continuous S” ≈ “lllyasviel/ControlNet-v1-1””
- FuzzySimilar title/name (fuzzy) · 87%lllyasviel/ControlNet →
“Fuzzy title match (0.94): “InteractGesture: Progressive Chunk Guidance for Continuous S” ≈ “lllyasviel/ControlNet””
- FuzzySimilar title/name (fuzzy) · 87%huggingface/speech-to-speech →
“Fuzzy title match (0.94): “InteractGesture: Progressive Chunk Guidance for Continuous S” ≈ “huggingface/speech-to-speech””
- FuzzyOverlapping authors or contributors · 62%bytedance/deer-flow →
“Shared author/contributor keys: wang”
- FuzzyOverlapping authors or contributors · 62%ray-project/ray →
“Shared author/contributor keys: wang”
- LinkedLinked via arxiv author · 85%Ekkasit Pinyoanuntapong →
“InteractGesture: Progressive Chunk Guidance for Continuous Streaming Co-Speech Gesture Control”
- LinkedLinked via arxiv author · 85%Ajinkya Deogade →
“InteractGesture: Progressive Chunk Guidance for Continuous Streaming Co-Speech Gesture Control”
- LinkedLinked via arxiv author · 85%Paul Streli →
“InteractGesture: Progressive Chunk Guidance for Continuous Streaming Co-Speech Gesture Control”