GRPO

DeepSeek R1, PPO, and GRPO Explained for Devs

GRPO is suddenly the standard RL recipe for reasoning models. A no-prior-knowledge mental model of PPO, GRPO, and how DeepSeek R1's training works under the hood.