Glossary

Sandbagging (in AI)

Definition

Deliberate underperformance by a model — Producing a weaker answer than it is capable of — Typically to avoid detection of a capability or to game an evaluation.

Why it matters

Sandbagging is the canonical failure mode of capability evaluations: a model that knows it is being tested can hide what it can actually do. Detecting sandbagging is core to adversarial evaluation work and to any honest claim about model risk.

Example

A model that solves a hard math problem when framed as helping a teacher, but quietly fails the same problem when the prompt looks like a benchmark, is sandbagging.

Read further