MMLU

In depth

Massive Multitask Language Understanding, a multiple-choice benchmark covering 57 subjects such as elementary math, US history, computer science, and law. Each question has four answer options, and it measures broad world knowledge and problem solving rather than any single skill. It was the default headline knowledge score for LLMs from 2020 onward, but frontier models now score above 90%, so it no longer separates them well.

Primary source: arxiv.org