newsReddit r/MachineLearningTrust 72 · CommunityPublished 5d agoLive · 5d ago
Evaluating long-term memory limits in stateless LLM chatbots — feedback needed [D]
Hi all, I’m working on a research project exploring how stateless LLM-based chatbots handle long conversations and whether important earlier information is still reliably retained over time. My idea is to: Run a chatbot using an LLM API without any external memory system Introduce key facts early in a long conversation Continue with many unrelated messages (hundreds of turns) Later test whether the model can
Covers
Covers (incoming)
paperSelective Memory Retention for Long-Horizon LLM AgentspaperManufactured Confidence: How Memory Consolidation Turns Hearsay into Confident FactspaperForensic Trajectory Signatures for Agent Memory Poisoning DetectionpaperWhen the Database Fails: Prompting LLM Dialogue Agents for Safe Recovery in Task-Oriented DialoguepaperECHO: Prune to act, trace to learn with selective turn memory in agentic RLpaperTheory of Mind and Persuasion Beyond Conversation: Assessing the Capacity of LLMs to Induce Belief States via Planning and ActionpaperMessage Passing Enables Efficient ReasoningpaperMemSyco-Bench: Benchmarking Sycophancy in Agent MemorypaperTowards Developing a Multimodal Chat Assistant for University Stakeholders: RAG-based Approachrepoplur-ai/plurrepoTeleAI-UAGI/Awesome-Agent-Memoryrepobasicmachines-co/basic-memoryrepoChatLunaLab/chatlunarepoplastic-labs/honchorepomjason/longpaperAgenticSTS: A Bounded-Memory Testbed for Long-Horizon LLM AgentsrepoMininglamp-OSS/octo-smart-summaryrepoicarito/gtk-llm-chat
Related across the graph
repobasicmachines-co/basic-memorypaperAgenticSTS: A Bounded-Memory Testbed for Long-Horizon LLM AgentsrepoMininglamp-OSS/octo-smart-summaryrepomjason/longrepoplastic-labs/honchopaperMessage Passing Enables Efficient Reasoningrepoicarito/gtk-llm-chatpaperManufactured Confidence: How Memory Consolidation Turns Hearsay into Confident FactspaperECHO: Prune to act, trace to learn with selective turn memory in agentic RLrepoChatLunaLab/chatlunapaperTowards Developing a Multimodal Chat Assistant for University Stakeholders: RAG-based ApproachpaperTheory of Mind and Persuasion Beyond Conversation: Assessing the Capacity of LLMs to Induce Belief States via Planning and ActionpaperSelective Memory Retention for Long-Horizon LLM Agentsrepolas7/memharnesspaperMemSyco-Bench: Benchmarking Sycophancy in Agent MemorypaperForensic Trajectory Signatures for Agent Memory Poisoning DetectionrepoTeleAI-UAGI/Awesome-Agent-Memoryrepoplur-ai/plurrepoNoshkoto/NoshypaperWhen the Database Fails: Prompting LLM Dialogue Agents for Safe Recovery in Task-Oriented Dialogue