Tokens per second is a memory bandwidth number. Measure it in 2 seconds.

I measured 9.0 GB/s of real read bandwidth on a 2011 i5 NAS, used it to predict tok/s for 7B/13B/40B models, and checked a 125 tok/s claim against arithmetic.