BrainJanus: A Unified Model for Understanding and Generation across Brain, Vision, and Language
Modeling the bidirectional correspondence between external sensory stimuli and internal neural activity has emerged as a critical frontier in neuroscience. However, existing approaches predominantly treat brain encoding and decoding as isolated tasks, relying heavily on unimodal alignment and external priors while overlooking the brain's intrinsic nature as a multimodal integration system. To address these limitations, we propose BrainJanus, the first unified brain model that integrates brain, vision, and language within a single framework. Specifically, we introduce a Unified Brain Tokenizer
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- LinkedLinked via unknownIntroducing Gemma 4 12B: a unified, encoder-free multimodal model →
- FuzzySimilar title/name (fuzzy) · 87%deepseek-ai/Janus-Pro-7B →
“Fuzzy title match (0.94): “BrainJanus: A Unified Model for Understanding and Generation” ≈ “deepseek-ai/Janus-Pro-7B””
- FuzzySimilar title/name (fuzzy) · 59%VioletVision-3B →
“Fuzzy title match (0.73): “BrainJanus: A Unified Model for Understanding and Generation” ≈ “VioletVision-3B””
- LinkedLinked via unknownMeta's brain-scanning system reads sentences non-invasively, code open source →
- PossiblePossibly related (embedding) · 45%sonos/tract →
- FuzzySimilar title/name (fuzzy) · 84%pytorch/vision →
“Fuzzy title match (0.92): “BrainJanus: A Unified Model for Understanding and Generation” ≈ “pytorch/vision””
- PossiblePossibly related (embedding) · 46%EEG shows brain can simultaneous encode two speech streams →