What is GRPO, and how do you run GRPO training on GPUs?

GRPO trains an LLM by scoring groups of sampled answers against each other, with no critic model. How it works, memory math for 8B, and how to run it.