LLMs as Operating Systems: Agent Memory

Learn how to build agentic memory into your applications in this short course, LLMs as Operating Systems: Agent Memory, created in partnership with Letta, and taught by its founders Charles Packer and Sarah Wooders. An LLM can use any information stored in its input context window but has limited space. Using a longer input context also costs more and causes slower processing. Managing this context window and what to input becomes very important. Based on the innovative approach in the MemGPT research paper “Towards LLMs as Operating Systems,” its authors, two of whom are Charles and Sarah, proposed using an LLM agent to manage this context window, building a management system that provides applications with managed, persistent memory. Examples of Managing Agent Memory are: 1. Control Conversation Memory. As conversations grow beyond defined limits, move information from context to a persistent searchable database. Summarize information to keep relevant facts in context memory. Restore relevant conversation elements as needed by conversation flow. 2. Persist and edit facts such as names, dates, and preferences, and make them available in context. 3. Persist and track ‘task’ specific information. For example, a research agent needs to keep research information in context memory, swapping the most relevant information from a searchable database with previous information. In this course, you’ll learn: 1. How to build an agent with self-editing memory, using tool-calling and multi-step reasoning, from scratch. 2. Letta, an open-source framework that adds memory to your LLM agents, giving them advanced reasoning capabilities and transparent long-term memory. 3. The key ideas behind the MemGPT paper, the two tiers of memory in and outside the context window, and how agent states comprised of memory, tools, and messages are turned into prompts. 4. How to create and interact with a MemGPT agent using the Letta framework, and how to build and edit its core and archival memory. 5. How core memory is designed and implemented with an example of how to customize it with blocks and memory tools. 6. How to implement multi-agent collaboration both by sending messages and by sharing memory blocks. By the end of this course, you will have the tools to build LLM applications that can leverage virtual context, extending memory beyond the finite context window of LLMs.