Can a coding agent implement a binary format from its spec alone?

Coding agents now write whole programs from a short description. Most of the tasks they are tested on...