paperarXivTrust 82 · PrimaryPublished 5d agoLive · 3d ago
Manufactured Confidence: How Memory Consolidation Turns Hearsay into Confident Facts
LLM agents carry conclusions across steps and sessions in compressed memory, and memory products (e.g., mem0, LangMem) rewrite conversation into stored "facts" that later steps trust. We show this rewriting manufactures confidence: across our constructed agent settings, a casual, hedged remark becomes a confident, dated assertion the agent then obeys like a verified fact, granting every above-clearance request it faces. No attacker is needed: a role that was true once and never corrected is stored as a flat fact and acted on like a deliberate injection. We then isolate what the agent responds
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Covers
Implements
Covers (incoming)
Implements (incoming)
Related across the graph
repobasicmachines-co/basic-memorynewsI built an open-source memory governance layer for AI assistants - looking for technical feedback [P]repojoshuaswarren/remnicnewsPrompt injection is exploiting enterprise AI's biggest design flaws by targeting agents, RAG pipelines and model routersreporajkripal/cashewnewsEvaluating long-term memory limits in stateless LLM chatbots — feedback needed [D]newsAgents collapse "observed", "concluded", and "generated" into one confidence level. Is anyone modeling epistemic status directly instead of just improving retrieval? [D]repolas7/memharnessrepoMemTensor/MemOSrepoNoshkoto/Noshyrepoagent-tools
