Closing the Affective Loop: Multimodal Speaker-Listener Emotion-Dynamics-Aware Empathetic Social Robots
Empathetic social robots should respond not only to what users say, but also to how their emotions dynamically evolve during interaction. However, existing empathetic dialogue systems are often text-centered and primarily model empathy as a one-way mapping from the user's emotion to the system response, limiting their ability to capture embodied speaker--listener affective exchange. We present AffectLoop, a multimodal speaker-listener emotion-dynamics-aware spoken dialogue system implemented on the Misty II robot. The system tracks the speaker's verbal and facial affective dynamics, estimates
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- FuzzySimilar title/name (fuzzy) · 59%pyannote/speaker-diarization-3.1 →
“Fuzzy title match (0.73): “Closing the Affective Loop: Multimodal Speaker-Listener Emot” ≈ “pyannote/speaker-diarization-3.1””
- PossiblePossibly related (embedding) · 53%Open-Source Software Is Starting to Help Robots Think →
- PossiblePossibly related (embedding) · 51%More people are turning to artificial intelligence for emotional support - WTVY →
- LinkedLinked via arxiv author · 85%Zi Haur Pang →
“Closing the Affective Loop: Multimodal Speaker-Listener Emotion-Dynamics-Aware Empathetic Social Robots”
- LinkedLinked via arxiv author · 85%Casey Kennington →
“Closing the Affective Loop: Multimodal Speaker-Listener Emotion-Dynamics-Aware Empathetic Social Robots”
- LinkedLinked via arxiv author · 85%Tatsuya Kawahara →
“Closing the Affective Loop: Multimodal Speaker-Listener Emotion-Dynamics-Aware Empathetic Social Robots”