newsReddit r/MachineLearningTrust 72 · CommunityPublished 2d agoLive · 2d ago

Agents collapse "observed", "concluded", and "generated" into one confidence level. Is anyone modeling epistemic status directly instead of just improving retrieval? [D]

Been chewing on this for a while and I honestly can't tell if it's genuinely open or if I'm just not googling the right terms, so I'll throw it out here. There's a paper by Roynard that put words to something I'd been vaguely bothered by for a while. He calls it a category error, the idea being that pretty much every memory system applies the same persistence model to everything it stores, usually some kind o

Covers

paperManufactured Confidence: How Memory Consolidation Turns Hearsay into Confident Facts paperEvidence-Informed LLM Beliefs for Continual Scientific Discovery paperSurprise as a Signal for Plasticity and Metacognition paperSelective Memory Retention for Long-Horizon LLM Agents modelRetrace-1.5B

Covers (incoming)

paperECHO: Prune to act, trace to learn with selective turn memory in agentic RL paperBayesian Uncertainty Propagation for Agentic RAG Pipelines: A Proof-of-Concept Study on Multi-Hop Question Answering paperConversable Complexity: Agentic LLM Collectives as Interpretable Substrates

Related across the graph

paperBayesian Uncertainty Propagation for Agentic RAG Pipelines: A Proof-of-Concept Study on Multi-Hop Question Answering paperEvidence-Informed LLM Beliefs for Continual Scientific Discovery paperManufactured Confidence: How Memory Consolidation Turns Hearsay into Confident Facts paperECHO: Prune to act, trace to learn with selective turn memory in agentic RL paperSurprise as a Signal for Plasticity and Metacognition modelRetrace-1.5B paperConversable Complexity: Agentic LLM Collectives as Interpretable Substrates paperSelective Memory Retention for Long-Horizon LLM Agents