Three learners review open books together at a classroom table, with stacks of textbooks, stationery and a whiteboard in the bright room.

Why a High Percentage Can Still Come From Very Little Evidence | Small Samples and Unstable Rates

A high percentage can be mathematically correct and still rest on very little evidence. One success out of one attempt is 100 percent. Ninety successes out of one hundred attempts is 90 percent. The first percentage is higher, but it tells us much less about how the process will behave across future attempts.

Keep the numerator and denominator beside the percentage. Then ask how much the rate would change if one observation changed. Small denominators produce percentages that can move dramatically.

The perfect result built from one attempt

Imagine two fictional practice methods. Method A is tried once and succeeds once: 1/1 = 100 percent. Method B is tried one hundred times and succeeds ninety times: 90/100 = 90 percent.

Ranking the methods by percentage alone puts A first. But A’s evidence consists of a single observation. One failure on the next attempt would make its cumulative rate 1/2 = 50 percent.

For B, one additional failure would produce 90/101, approximately 89.1 percent. The same single new outcome has a much smaller effect because the denominator is larger.

Sensitivity to one observation is an immediate warning

Suppose a club survey reports 80 percent support based on four supporters among five respondents. If one response had been different, support would be 3/5 = 60 percent. One person’s answer moves the result by twenty percentage points.

With eighty supporters among one hundred respondents, one changed response would produce seventy-nine percent. The percentage is much less sensitive to a single observation.

This does not mean the larger sample is automatically representative. A hundred responses from a biased recruitment route can still misrepresent the population. Sample size and sampling quality are separate dimensions of evidence.

Always report the fraction behind the percentage

“Eighty percent agreed” sounds more substantial than “four of five respondents agreed”, although they are numerically the same result. Reporting both preserves the scale of the evidence.

For a small school project, write “4 of 5 respondents (80%)”. For a scientific table, include counts alongside rates where appropriate. A reader should not have to reverse-engineer the denominator from a footnote.

The denominator also exposes missing information. If five people answered but thirty were invited, the response process matters. Continue with Why a Class Poll Cannot Tell You What the Whole School Thinks.

Zero events do not prove zero risk

Suppose no failures occur in three trials. The observed failure rate is 0/3 = 0 percent. That does not establish that failure is impossible.

Likewise, three successes in three trials gives an observed success rate of 100 percent without proving guaranteed success. Future observations can differ.

Use language such as “no failures were observed in these three trials” rather than “the system cannot fail”. The first statement describes evidence; the second claims a property far beyond it.

More decimal places do not create more evidence

Two successes out of three attempts is 66.666… percent. Reporting 66.67 percent can be a convenient numerical representation. It does not mean the evidence supports hundredths-of-a-percentage-point precision about future performance.

Precision in the displayed arithmetic and uncertainty in the underlying estimate are different. A calculator can produce many digits from very few observations.

Choose displayed precision appropriate to the task, and keep the raw count available. The reader should be able to see that 66.7 percent came from three attempts rather than thousands.

Comparing small percentages can exaggerate a ranking

Suppose method A succeeds in 3 of 4 attempts, or 75 percent, while B succeeds in 7 of 10, or 70 percent. Declaring A definitively superior from the five-percentage-point difference would overstate this tiny descriptive comparison.

A single additional A failure would make A 3/5 = 60 percent. A single additional A success would make it 4/5 = 80 percent. The ranking is highly sensitive to the next observation.

Formal statistical inference can quantify uncertainty under stated assumptions, but a school project need not pretend to have performed it. A clear small-sample caveat is better than an invented confidence claim.

Large samples do not repair bad measurement

Ten thousand responses to a leading question can estimate the answers to that leading question very precisely while still failing to measure the intended opinion fairly.

A large dataset with systematically misclassified outcomes can also produce a stable percentage of the wrong quantity. More observations reduce some forms of random uncertainty; they do not automatically remove bias or definition errors.

This is why evidence quality cannot be reduced to sample size. The denominator matters, but so do sampling, measurement and design.

Repeated observations from one person are not many independent people

A learner answers one hundred questions and gets ninety correct. That provides one hundred item-level observations, but it does not tell us how ninety out of one hundred different learners would perform.

The observations share the same learner, preparation and context. They may still be valuable for analysing that learner’s performance across items. The unit of evidence must match the claim.

Similarly, ten measurements from one device are not ten independent devices. Keep “number of observations” separate from “number of independent units” when the distinction matters.

A percentage near 100 can hide rare but important failures

A system that succeeds 999 times in 1,000 has a 99.9 percent observed success rate. Whether that is adequate depends on the consequence of the one failure and the decision context.

For a low-stakes classroom routine, occasional failure may be acceptable and informative. For a safety-critical process, the required evidence and tolerance can be very different.

Do not let the emotional appeal of “over ninety-nine percent” replace analysis of what the failures are, how they occur and what they cost.

The repair routine

Whenever a percentage matters, write the numerator and denominator beside it. Ask how one additional success or failure would change the result. Check whether the observations come from the population, people or opportunities the conclusion names.

Then inspect sampling and measurement quality. A large denominator can stabilise a biased result; a tiny denominator can make an honest result unstable. Both problems deserve separate attention.

For denominator comparisons, continue with Why Comparing Rates With Different Denominators Can Mislead. For source-count inflation, see Why Counting Sources Does Not Make a School Project Reliable.

A percentage is compressed evidence. Before trusting the impressive number, expand it back into the observations that produced it.

Browse connected guides in the Parent Learning Support Directory.

Explore the connected learning guides

Choose the question that brought you here. Open one useful guide, try a small task, and stop when you have what you need.

Take one question further

The same learning habit can travel across subjects, while each subject keeps its own methods. These routes help you notice a difficulty, understand one part of it, and return to something you can do.

A word is familiar, but using it is difficult.

Move from recognising a word to retrieving it in a new context. Understand vocabulary plateaus.

Try it without the guide: Choose one word you already know. Close the guide and use it in a new sentence. Explain why it fits; try another context tomorrow.

A piece of writing has ideas, but the reader loses the thread.

Make the order of events and the links between sentences clear. Explore composition writing.

Try it without the guide: Choose one short paragraph. Read the relevant explanation, close it, and revise the paragraph. Ask someone to tell you what happened and why.

The Mathematics seems familiar, but marks still disappear.

Find the first point where the working stops being reliable. Find Secondary 4 A-Math mark leakage.

Try it without the guide: For a Secondary 4 A-Math question you have attempted, locate the first uncertain line. Repair that step, then try a comparable question without the worked answer.

A Science fact is remembered, but the explanation is incomplete.

Connect the evidence to a scientific idea and the resulting change. Follow the Primary Science learning route.

Try it without the guide: Choose a familiar Primary Science example. Explain the evidence, the idea and the result without notes. Then change one condition and explain your prediction.

Two accounts of the world seem to disagree.

Check the question, source, date and evidence before combining claims. Explore the World Knowledge research library.

Try it without the guide: Take one claim. Find the source best placed to support it, note its date, and state what remains uncertain. Return to your original question.

There is plenty of help, but independence is hard to see.

Check what the learner can understand and do after support is removed. Understand how education works.

Try it without the guide: Choose one small task the child has practised. Agree on a calm, brief attempt without prompts. Use what happens to choose one next step, then stop.

For the structure behind these connections, read the eduKateSingapore runtime manifest and the eduKate ecosystem boot contract. The reader map describes public navigation; those manifests preserve the wider ownership and return rules.

Discover more from eduKate SG

Subscribe now to keep reading and get access to the full archive.

Continue reading