What is a context window?
A context window is the maximum amount of text an AI model can hold in view at one time, covering the instructions, the conversation so far, and any documents it has been given.
The simple explanation.
Think of a desk. The context window is how much paper the model can have spread out in front of it while it works: your instructions, the conversation so far, and any documents you handed over. Everything on the desk influences the answer. Anything that does not fit is simply not seen. Modern models have very large desks, big enough for a long conversation and a few documents, but the desk is still finite and it is shared by all of those things.
Why it matters in a long conversation.
In a customer chat that runs across several days, older messages eventually fall off the desk. If nothing is done about it, the agent forgets that the customer already gave a delivery address. The fix is not a bigger desk, it is deciding what deserves to stay on it: a short running summary, the customer record, the current order. Well built agents write the important facts back into your CRM and reload only what is relevant to the message in front of them.
Bigger is not automatically better.
Filling a large context window with everything you own is a common and expensive mistake. Long inputs cost more per message, reply more slowly, and can make a model less accurate, because the one relevant line is buried among thousands of irrelevant ones. The better approach is to fetch only the passages that matter for this specific question, then hand the model a short, clean brief. That is exactly what retrieval does, and it is why a small, well chosen context usually beats a large, indiscriminate one.
The Voltade take
We design agents to carry the least context that still answers the question well. Facts that matter get written back into Envoy CRM as structured records instead of living inside a chat history, so the agent can retrieve precisely what it needs on the next message. Cheaper to run, faster to reply, and easier to audit when you want to know why an answer came out the way it did.
Want to see this in action?
Free scoping session. We'll tell you what's possible, what it costs, and whether a PSG or IMDA grant covers it.
SMEs are eligible for up to 50% Productivity Solutions Grant (PSG) support for the adoption of Voltade AI solutions, a Pre-Approved Solution under the IMDA SMEs Go Digital programme.