How Fast Can a 421M-Parameter Decision Model Run? I Benchmarked Laya Across NVIDIA GPUs

One H100 NVL. A 421M-parameter decision model. 15.1 million decisions per day while staying inside a...