ModelRefs / Data Contamination — AI Glossary

Data Contamination — AI Glossary

The presence of evaluation benchmark examples in a model's training corpus, potentially inflating reported performance metrics.

Overview

Data contamination is widely acknowledged but inconsistently reported. Analysis methods: exact n-gram matching (canary strings), guided perplexity analysis (is the model unusually fluent on these exact sentences?), and membership inference. GPT-4's technical report included contamination analysis; many open-weight model cards now include contamination disclosures.

Reference details

Topic	ecosystem
Last reviewed	2026-06-24

Example: You cannot audit what you cannot see

Detection works by looking for benchmark text inside training data: long exact n-gram matches, canary strings planted in test sets, or checking whether a model is suspiciously fluent on the exact phrasing of test items. Every one of those methods needs either the corpus or unusual access to the model. For a closed API model you have neither, so a contamination claim about it is inference from behaviour — a plausible one, but not an audit. This is the practical asymmetry: open-weight models can be checked and are therefore sometimes reported as contaminated, while closed models are simply unverified, and the two are easy to confuse for a quality difference.

Commonly confused with

Contamination is not the same as memorisation, and not the same as overfitting. Memorisation is reproducing training text; overfitting is failing to generalise from a training set. Contamination is specifically the evaluation set leaking into training, which breaks the measurement rather than the model — the model may be fine, but the number describing it is not.

When to use it

Reach for it when:

Reading any benchmark result, as the first question about what it can support
Choosing benchmarks: post-cutoff and held-out designs exist precisely to resist it
Publishing results, where a decontamination pass against the eval sets is the minimum

Reach for something else when:

As a blanket dismissal of all benchmarks, which leaves you with no measurement at all
Assuming a model card's silence is a clean bill of health — most are silent
Treating a behavioural inference about a closed model as a verified finding

Continue your research

Use these connected ModelRefs sections to compare alternatives, inspect implementation paths, and review the evidence and governance boundaries relevant to Data Contamination — AI Glossary.

Frequently asked questions

What is Data Contamination?