Released October 2024, SimpleQA questions are deliberately narrow and short-answer so correctness is unambiguous, isolating parametric factual recall from reasoning ability. Because it measures memorized knowledge, a reported score is only meaningful alongside the model's training data cutoff — a later cutoff can raise the score independent of any capability gain.