Small Language Model (SLM)

Empirical relationships showing that a language model's loss falls as a predictable power law as you increase parameters, training data, and training compute.

A model card is a short document published with a trained machine learning model that explains its intended uses, its limitations, and how it performs across different conditions and groups.

Sycophancy is when a model tells users what they want to hear instead of the accurate answer, for example by agreeing with their stated views or backing down when they push back.