Silent NaN: the check that belongs in every diffusion pipeline

I generate 512x768 images on a 4GB GTX 1650. About 150 seconds per image in fp32 with model offload....