Confidence and Calibration: Does the Model Know It's Wrong?

What calibration means precisely, what the published reliability diagrams show about pretraining versus RLHF, and the code to produce one from your own logprobs.