GSM8K

In depth

A dataset of 8,500 grade school math word problems from OpenAI that take several steps of basic arithmetic to solve. It was built to expose how weak language models were at multi-step reasoning even on simple problems, and the original paper used it to show that training a verifier to rank candidate answers works. Frontier models have saturated it, but it is still widely used as a training set and a quick sanity check, including in GRPO fine-tuning tutorials.

Primary source: arxiv.org