Coordinate Clicks Are a Trap: Driving a GUI Agent Without Pixel Guessing

The first version of my GUI agent clicked by pixel coordinates. It worked in demos and failed...