intermediate35 minutesLección 3 de 10

Memoria de Conversación

Implementa memoria de conversación en LangGraph usando el reductor add_messages, almacenando y gestionando el historial de conversación entre turnos.

Memoria de Conversación

Conversation memory is what enables a chatbot to remember what was said earlier in the conversation. LangGraph handles this naturally through persistent state and the add_messages reducer.


El Reductor add_messages

LangGraph provides a built-in add_messages reducer specifically designed for conversation message lists:

python
from langgraph.graph import add_messages from typing_extensions import TypedDict, Annotated from typing import List, Any class ConversationState(TypedDict): messages: Annotated[List[Any], add_messages] context: str

Unlike operator.add (which blindly concatenates), add_messages is smart:

  1. Appends new messages to the list
  2. Updates existing messages if a message with the same ID is added
  3. Preserves message ordering
python
from langchain_core.messages import AIMessage, HumanMessage, ToolMessage # add_messages handles these intelligently: updates = [ HumanMessage(content="Hello", id="1"), AIMessage(content="Hi!", id="2"), # If we add a message with the same ID, it updates in place: AIMessage(content="Hello there!", id="2") # Replaces previous AIMessage ]

[!NOTA] The add_messages reducer is preferred over operator.add for message lists because it handles deduplication and in-place updates correctly.


Agregando Mensajes al Estado

There are two patterns for updating messages in state:

Patrón 1: Anexar a la lista existente

python
def chat_node(state: ConversationState) -> dict: response = llm.invoke(state["messages"]) # Returns the new message(s) — add_messages handles appending return {"messages": [response]}

Patrón 2: Devolver todos los mensajes (también funciona)

python
def chat_node(state: ConversationState) -> dict: response = llm.invoke(state["messages"]) # The reducer concatenates these with existing messages return {"messages": state["messages"] + [response]} # Both patterns produce the same result with add_messages

[!CONSEJO] Pattern 1 is more efficient — you only return the new messages rather than the entire list. The reducer handles the concatenation.


Ejemplo Completo de Memoria de Conversación

python
from langgraph.graph import StateGraph, START, END, add_messages from langgraph.checkpoint.memory import MemorySaver from langchain_openai import ChatOpenAI from langchain_core.messages import HumanMessage from typing_extensions import TypedDict, Annotated from typing import List, Any llm = ChatOpenAI(model="gpt-4o-mini") class ChatState(TypedDict): messages: Annotated[List[Any], add_messages] user_name: str def chatbot(state: ChatState) -> dict: response = llm.invoke(state["messages"]) return {"messages": [response]} # Build with persistence checkpointer = MemorySaver() builder = StateGraph(ChatState) builder.add_node("chat", chatbot) builder.add_edge(START, "chat") builder.add_edge("chat", END) app = builder.compile(checkpointer=checkpointer) # Multi-turn conversation session = {"configurable": {"thread_id": "user-1"}} app.invoke({"messages": [HumanMessage("Hi, my name is Alice")]}, session) app.invoke({"messages": [HumanMessage("What's my name?")]}, session) # The bot remembers: "Your name is Alice"

[!ÉXITO] With persistence + add_messages, the conversation history grows across invocations. The LLM receives the full history and maintains context.


Recortando Historial de Conversación

Conversation history can grow beyond the LLM's context window. Trim messages before sending to the LLM:

python
from langchain_core.messages import trim_messages def chat_with_trimming(state: ChatState) -> dict: # Keep last 10 messages or 4000 tokens trimmed = trim_messages( state["messages"], strategy="last", max_tokens=4000, token_counter=len, # Use char count as proxy start_on="human", # Always start with a human message include_system=True ) response = llm.invoke(trimmed) return {"messages": [response]}

Estrategia de Recorte Personalizada

python
def trim_to_token_limit(messages: list, max_tokens: int = 4000) -> list: """Keep messages within token budget, preserving the most recent.""" import tiktoken enc = tiktoken.encoding_for_model("gpt-4o") total_tokens = 0 keep = [] for msg in reversed(messages): msg_tokens = len(enc.encode(msg.content)) if total_tokens + msg_tokens > max_tokens: break total_tokens += msg_tokens keep.insert(0, msg) # Always include the system message if present if messages and messages[0].type == "system": keep.insert(0, messages[0]) return keep

[!ADVERTENCIA] Trimming removes old context. The LLM will forget about early parts of the conversation. For very long conversations, use summary-based memory (Lesson 4).


Persistencia de Mensaje del Sistema

Keep a system message at the start of the conversation:

python
class ChatState(TypedDict): messages: Annotated[List[Any], add_messages] def ensure_system_message(state: ChatState) -> dict: """Ensure the system message is always first.""" messages = state["messages"] system_msg = SystemMessage( "You are a helpful assistant. The current date is 2024." ) if not messages or messages[0].type != "system": return {"messages": [system_msg] + messages} return {} # System message already present

Extracción Estructurada de Memoria

Extract and store structured information from conversations:

python
from pydantic import BaseModel, Field class UserProfile(BaseModel): name: str = Field(default="") preferences: list = Field(default_factory=list) pain_points: list = Field(default_factory=list) class MemoryState(TypedDict): messages: Annotated[List[Any], add_messages] profile: UserProfile def extract_profile(state: MemoryState) -> dict: prompt = ChatPromptTemplate.from_messages([ ("system", "Extract user info from the conversation. Update the profile:\n" "{current_profile}"), ("human", "{last_message}") ]) parser = PydanticOutputParser(pydantic_object=UserProfile) chain = prompt | llm | parser last_msg = state["messages"][-1].content profile = chain.invoke({ "current_profile": state["profile"].dict(), "last_message": last_msg }) return {"profile": profile}

Ejemplo Completo: Chatbot con Memoria Mejorada

python
from langgraph.graph import StateGraph, START, END, add_messages from langgraph.checkpoint.memory import MemorySaver from langchain_openai import ChatOpenAI from langchain_core.messages import HumanMessage, SystemMessage from typing_extensions import TypedDict, Annotated from typing import List, Any llm = ChatOpenAI(model="gpt-4o-mini") class State(TypedDict): messages: Annotated[List[Any], add_messages] summary: str # For long-term memory def call_model(state: State) -> dict: system_prompt = "You are a helpful assistant." if state.get("summary"): system_prompt += f"\nConversation summary: {state['summary']}" messages = [SystemMessage(system_prompt)] + state["messages"] response = llm.invoke(messages) return {"messages": [response]} checkpointer = MemorySaver() builder = StateGraph(State) builder.add_node("model", call_model) builder.add_edge(START, "model") builder.add_edge("model", END) app = builder.compile(checkpointer=checkpointer) session = {"configurable": {"thread_id": "memory-demo"}} app.invoke({"messages": [HumanMessage("I love Python!")]}, session) app.invoke({"messages": [HumanMessage("What do I love?")]}, session) # → "You said you love Python!"

Preguntas Prácticas

Practice Question

What reducer is specifically designed for conversation message lists?

Practice Question

What advantage does add_messages have over operator.add for message lists?

Practice Question

What happens to conversation state across invocations with persistence enabled?

Practice Question

Why is message trimming necessary for long conversations?

Practice Question

What strategy does trim_messages(strategy='last') use?

Practice Question

When returning messages from a node with add_messages reducer, what is the most efficient pattern?

Practice Question

What field in a message does add_messages use for deduplication?

Practice Question

What is the limitation of simple message trimming?

Practice Question

How do you ensure a system message stays at the beginning of the message list?

Practice Question

What is the 'start_on' parameter in trim_messages used for?


[!ÉXITO]

Conclusiones Clave

  • add_messages is the smart reducer for conversation history — append, dedupe, update
  • Persistence + add_messages enables multi-turn conversation memory
  • Trim messages to stay within LLM context windows
  • Use trim_messages() with strategy "last" for simple truncation
  • Efficient pattern: return only new messages, let the reducer append
  • Message IDs enable in-place updates via add_messages
  • System message preservation requires explicit logic
  • For very long conversations, consider summary-based memory (Lesson 4)
Progreso30%