Bayes Theorem / False Positive Explorer

how prevalence changes positive-test reliability

Loading interactive simulation...

why accuracy is only half the story 🖖

Sensitivity and specificity describe the test; prevalence describes the population before testing. Bayes theorem combines both. When prevalence is low, even a small false-positive rate can create many false alarms because most tested people do not have the condition. That is why a positive screening result often needs confirmation, while the same test can be highly persuasive in a high-risk group.

a test updates a belief, it doesn't replace it 🖖

Bayes theorem is a rule for changing your mind with evidence. You start with a prior — your best estimate before testing, which here is the prevalence — and the result nudges it up or down into a posterior. A single positive rarely jumps you straight to certainty; it multiplies your starting odds rather than overwriting them. The takeaway: before trusting any result, first ask how likely the thing was in the first place.

the same trap sent someone to prison 🖖

Confusing P(positive | disease) with P(disease | positive) has a courtroom name: the prosecutor's fallacy. In the 1999 trial of Sally Clark, a jury heard that two cot deaths in one family had a 1-in-73-million chance and treated it as the chance she was innocent. Those are different numbers — the second ignores how rare the alternative (a double murder) also is. Her conviction was overturned in 2003, and the Royal Statistical Society publicly condemned the misuse.

Example problems

  • rare, accurate test - prev=0.1%, 99%-accurate test -> PPV only 9%: most positives are false alarms
  • more common disease - prev=10% -> PPV rises to 51%; prevalence is the hidden lever
  • covid-like - COVID rapid test at 5% prevalence -> PPV ~ 60%
  • drug screening - Drug screening at 2% prevalence -> PPV ~ 29% despite 99% sensitivity