GlossaryContext Window
Context Window
The maximum amount of text (measured in tokens) that an AI model can process and remember at once during a conversation or task. Larger context windows enable AI to handle longer, more complex interactions.
A context window defines how much information an AI model can actively process and retain during a single interaction. Think of it as the model's working memory—everything within the context window is immediately accessible, while information outside of it is forgotten.
In customer service AI, context window size directly impacts the agent's ability to handle complex queries. A larger context window allows the AI to reference earlier parts of long conversations, review multiple knowledge base articles simultaneously, and maintain coherent multi-step interactions without losing track of customer details.
Modern AI agents leverage expanding context windows to deliver more sophisticated support experiences. As context windows grow from thousands to millions of tokens, AI can process entire documentation libraries, conversation histories, and product catalogs within a single query—enabling more accurate, contextually relevant responses.
Related terms
Large Language Model (LLM)
Advanced AI system trained on vast amounts of text data to understand and generate human language. LLMs enable AI Agents to deeply understand customer intent, maintain context across conversations, and generate natural, accurate responses.
Retrieval-Augmented Generation
An AI technique where the system pulls relevant content from knowledge bases to craft precise, contextually accurate answers. RAG combines information retrieval with language generation to ensure responses are grounded in actual documentation rather than hallucinated.
Embeddings
Mathematical representations that convert text into numerical vectors, capturing semantic meaning so that similar concepts are positioned close together. The foundation behind semantic search and retrieval-augmented generation.
Short-Term Memory
The ability of an AI agent to retain and reference information from the current conversation session. This enables the AI to maintain context and continuity throughout a single customer interaction.
Long-Term Memory
The AI agent's ability to store and recall information across multiple conversation sessions over time. This enables personalized, context-aware experiences by remembering customer preferences, history, and previous interactions.
AI Tokens
AI tokens are the small units of text, such as words, word fragments, or punctuation, that a large language model reads and writes. Models count input and output in tokens, so tokens determine how much text fits in a context window, how fast a response arrives, and how much each AI interaction costs.
