Relevant context is not necessarily sufficient context. A retrieved passage can discuss exactly the right topic and still omit the one fact needed to answer the question.
Context sufficiency is the discipline of asking whether the evidence currently available contains enough information to support a definitive answer—not merely whether the evidence looks related.
This article continues the eduKateSingapore Representation and Tokenisation series. It sits at the boundary between retrieval, memory and uncertainty: when is the representation of the world currently in context adequate for the receiver’s job?
The Sufficiency Route
QUESTION → RETRIEVAL → RELEVANT EVIDENCE → SUFFICIENCY TEST → [ENOUGH] ANSWER → [NOT ENOUGH] RETRIEVE / CLARIFY / ABSTAIN → VERIFY CLAIMS AGAINST EVIDENCE → WORLD RETURN
1. Relevance Asks Whether Evidence Is About the Question
A passage can mention the same company, disease, law or scientific concept as the user’s query.
That makes it relevant. It does not prove that the passage contains the answer.
2. Sufficiency Asks Whether the Necessary Information Is Present
Google Research’s Sufficient Context work formalises this distinction: context is sufficient when it contains the information needed to provide a definitive answer.
This gives retrieval systems a better target than topical similarity alone.
3. A Relevant Passage Can Still Be Insufficient
A query asks which laboratory originated a historical practice. The retrieved text explains the practice but not the laboratory.
The passage is relevant and insufficient.
4. Sufficiency Is Query-Specific
One passage can be sufficient for “What happened?” and insufficient for “Why did it happen?”
Evidence adequacy depends on the exact distinction the user asks the system to make.
5. Sufficiency Can Be Atomic
A one-fact question may need one explicit premise.
If that premise is present and trustworthy, additional retrieval can add cost without improving the answer.
6. Sufficiency Can Be Compositional
A multi-hop question may require several premises that live in different documents.
No individual chunk is sufficient even though the combined context can be.
7. Multi-Hop Retrieval Builds Sufficiency in Stages
An initial source may reveal a project ID; a second source maps the project to a server; a third source gives the server specification.
Google Research’s 2026 agentic RAG work explicitly frames iterative search as a route toward sufficient context for multi-source questions.
8. Retrieval Should Continue Until the Missing Premise Is Found—or Declared Missing
Repeatedly retrieving more of the same background does not create sufficiency.
The system should identify the missing premise and search for that premise specifically.
9. Missing Premise Detection Is Better Than Generic “Search More”
If the question asks for revenue growth, the system may need current and prior-period revenue. If one is missing, the gap can be named.
Gap-directed retrieval is more efficient than indiscriminate expansion.
10. Contradictory Context Can Be Insufficient
Two sources can provide incompatible dates, values or identities.
Having more information does not produce sufficiency if the conflict cannot be resolved.
11. Contradiction Needs Resolution Evidence
The system may need source authority, publication date, edition, jurisdiction or direct primary evidence to decide which claim governs.
Until then, the correct representation may be “contested” rather than one forced answer.
12. Incomplete Context Can Still Be Useful
Google’s sufficient-context research notes that insufficient context can still improve performance by narrowing possibilities or clarifying ambiguity.
Useful is not the same as sufficient.
13. Partial Evidence Should Produce Partial Claims
If the evidence supports only a range, trend or subset, the answer should not pretend to support an exact value or universal conclusion.
Claim scope should match evidence scope.
14. Answerability Is a Representation State
The system should be able to represent at least three conditions: answerable, partially answerable and not answerable from current evidence.
Collapsing all three into “generate something” invites hallucination.
15. Abstention Is a Valid Output
If decisive evidence is absent, saying “I don’t have enough information” can be more correct than completing the answer from model priors.
Sufficiency therefore connects directly to uncertainty and selective answering.
16. Large Models Can Still Answer When Context Is Insufficient
Google’s analysis found that strong models often answer correctly when context is sufficient yet can still produce incorrect answers instead of abstaining when it is not.
Capability and evidence discipline are separate properties.
17. Retrieval Can Increase Confidence Without Increasing Sufficiency
Seeing related passages can make a model more willing to answer even when the key premise remains absent.
This is why “RAG was used” is not a reliability guarantee.
18. Sufficiency Should Be Tested Before Generation
A dedicated sufficiency classifier, verifier or explicit reasoning step can ask whether the current query-context pair contains enough evidence.
This creates a gate between retrieval and answer generation.
19. Sufficiency Can Also Be Tested After Drafting
A draft answer can be decomposed into claims and each claim checked against retrieved evidence.
Post-generation verification catches cases where the answer expanded beyond what the context justified.
20. Pre-Generation and Post-Generation Tests Solve Different Failures
Before generation: “Do I have enough?” After generation: “Did I say more than the evidence supports?”
Strong systems use both gates for consequential tasks.
21. Chunk Context Can Destroy Sufficiency
Anthropic’s Contextual Retrieval highlights how ordinary chunking can remove surrounding information needed to interpret a passage correctly.
A retrieved chunk can be locally accurate and globally ambiguous.
22. Contextualisation Restores Missing Local Identity
Adding document title, section context, company identity or time period to a chunk can improve both retrieval and use.
The chunk becomes a more self-sufficient representation.
23. Too Much Context Can Reduce Practical Sufficiency
Adding large amounts of irrelevant material can bury the decisive evidence among distractors.
Evidence can be present and still hard for the model to use reliably.
24. Context Sufficiency Is Not Context Quantity
Ten thousand tokens of background can be insufficient. Two sentences can be sufficient.
Measure premise coverage, not prompt length.
25. Relevance Ranking Should Be Followed by Sufficiency Assembly
Top-k retrieval returns individually relevant chunks. The system then needs to ask whether the set of chunks jointly closes the information gap.
Ranking and evidence completion are different steps.
26. Evidence Diversity Can Matter More Than More of the Same
Five near-duplicate passages do not substitute for one missing premise.
Deduplication and source diversity can improve sufficiency per token.
27. Source Authority Is Part of Sufficiency
A definitive answer about current regulation may require the regulator, not a blog summarising last year’s rule.
Evidence can be topically complete and epistemically weak.
28. Freshness Is Part of Sufficiency for Time-Sensitive Questions
An old page can contain every field needed for an answer and still be insufficient for “what is true today?”
Sufficiency includes temporal validity.
29. Jurisdiction Is Part of Sufficiency for Rules
A correct legal rule from one country may be insufficient for a question about another.
Context must match the decision domain, not merely the vocabulary.
30. Personalised Questions Need Personal Evidence
A general medical article may be insufficient to answer a question about one person’s actual laboratory result. A generic schedule may be insufficient to answer whether one user’s meeting conflicts.
Receiver-specific questions require receiver-specific context.
31. Tool Results Can Complete Missing Context
A calculator can supply an exact derived value; a database can supply a current record; a search tool can locate a missing source.
Tool use is one route from insufficient context to sufficient context.
32. Clarifying Questions Can Complete User-Side Context
Sometimes the missing premise is not on the web. It is the user’s intended date, location, account, definition or goal.
Retrieval cannot replace missing task specification.
33. Context Sufficiency Can Be Model-Relative
Two models can receive the same sufficient context and differ in whether they successfully use it.
Sufficiency describes the evidence state; utilisation describes model competence.
34. Keep Evidence Failure Separate From Reasoning Failure
If the answer is wrong because retrieval omitted the key fact, changing the language model may not fix the system.
If context is sufficient and the model still fails, retrieval may already be doing its job.
35. Sufficiency Is the Gate Before Confidence
A model should not express high confidence about an answer whose required evidence is missing.
See Uncertainty Representation.
36. Memory and Sufficiency Are Coupled
The required evidence can exist in memory and still be unavailable if compression or retrieval fails.
37. The Context Sufficiency Audit
- What exact claim or decision must be supported?
- What premises are necessary?
- Which premises are currently present?
- Which are missing?
- Are the retrieved chunks merely relevant or jointly sufficient?
- Are sources authoritative enough?
- Are they fresh enough?
- Do they match the right jurisdiction, entity and timeframe?
- Does contradiction remain unresolved?
- Is more retrieval likely to close a named gap?
- Should a tool or clarification provide the missing premise?
- Should the system answer partially or abstain?
- Can each final claim be traced to evidence?
38. What Students Should Remember
- Relevant context is not necessarily sufficient context.
- Sufficiency means all necessary information for the requested answer is present.
- Multi-hop questions often need several sources.
- Contradiction can make a large context insufficient.
- More context is not the same as enough context.
- When evidence is insufficient, retrieve, clarify, answer partially or abstain.
- Separate retrieval failure from model reasoning failure.
39. The Deep Principle
An answer should be no stronger than the evidence state that produced it.
Context is sufficient when the missing questions have stopped being about the evidence and can finally become questions of reasoning. Until then, confidence is premature.