Golden Dataset

In depth

A fixed, curated set of realistic inputs paired with expert-approved reference answers, used as the ground truth for evaluating an LLM application. It works like a unit test suite: every prompt, model, or retrieval change is run against the same questions and the outputs are compared to the reference answers. Microsoft's guidance for Copilot quality assurance recommends about 150 question and answer pairs and never fewer than 100, and treats sustained drift from the reference answers as a signal to investigate.

Primary source: github.com