Read original ↗
newsReddit r/MachineLearningTrust 52 · CommunityPublished 1mo agoLive · 1mo ago

Proposal: Use semantic compression as input diffusion to read sessions larger than the context window [R]

I've been trying to come up with a solution for keeping extremely long ai sessions coherent. Sometimes there is too much substance to risk compaction. With so much buzz around diffusion going on it got me thinking, what if we treat the context like a progressive render, blurry>sharp. The practical way to make text "blurry" is compression. This is a "diffusion inspired" system which borrows the coarse-to-fine process, not the formal

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

Covers

Related across the graph