Read original ↗
paperarXivTrust 82 · PrimaryPublished 25d agoLive · 23d ago

Appearance Pointers -- Multimodal Region Control of Diffusion Transformers

Controllable image generation remains challenging for creative professionals, who often require precise regional control over materials, object identities, and spatial arrangements that cannot be reliably achieved through text prompting alone. Diffusion Transformers (DiTs) can natively ingest heterogeneous tokens stemming from texts and images, but they lack mechanisms for determining where and how these tokens should influence the output. We introduce appearance pointers, compact tokens that guide DiTs toward the correct appearance cues at the correct spatial locations by aligning text or ima

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

  • FuzzySimilar title/name (fuzzy) · 87%lllyasviel/ControlNet-v1-1

    Fuzzy title match (0.94): “Appearance Pointers -- Multimodal Region Control of Diffusio” ≈ “lllyasviel/ControlNet-v1-1”

  • FuzzySimilar title/name (fuzzy) · 87%lllyasviel/ControlNet

    Fuzzy title match (0.94): “Appearance Pointers -- Multimodal Region Control of Diffusio” ≈ “lllyasviel/ControlNet”

  • FuzzySimilar title/name (fuzzy) · 59%CompVis/stable-diffusion-v1-4

    Fuzzy title match (0.73): “Appearance Pointers -- Multimodal Region Control of Diffusio” ≈ “CompVis/stable-diffusion-v1-4”

  • FuzzySimilar title/name (fuzzy) · 59%stabilityai/stable-diffusion-3.5-large

    Fuzzy title match (0.73): “Appearance Pointers -- Multimodal Region Control of Diffusio” ≈ “stabilityai/stable-diffusion-3.5-large”

  • PossiblePossibly related (embedding) · 52%DiffusionGemma: 4x faster text generation
  • FuzzySimilar title/name (fuzzy) · 87%lucidrains/x-transformers

    Fuzzy title match (0.94): “Appearance Pointers -- Multimodal Region Control of Diffusio” ≈ “lucidrains/x-transformers”

  • FuzzySimilar title/name (fuzzy) · 84%huggingface/transformers

    Fuzzy title match (0.92): “Appearance Pointers -- Multimodal Region Control of Diffusio” ≈ “huggingface/transformers”

  • FuzzySimilar title/name (fuzzy) · 59%builderz-labs/mission-control

    Fuzzy title match (0.73): “Appearance Pointers -- Multimodal Region Control of Diffusio” ≈ “builderz-labs/mission-control”

Has model

Covers

Implements (incoming)

authored (incoming)

Related across the graph

Topics