AUTO_CDC: Turning an event log into current state with Spark Declarative Pipelines

Most data arrives as a record of what happened, and most questions are about what is true now. AUTO CDC, which shipped in Apache Spark 4.2, turns...