Released in June 2024, MMLU-Pro expands each question from four answer choices to ten and removes trivial or ambiguous items from the original MMLU, cutting the benefit of random guessing and reducing the ceiling effect that made MMLU scores cluster near the top. It is now more commonly cited on frontier model cards than the original MMLU.