≈ the.bay.news

Inference on Google Cloud: Precision, Memory and Capacity on TPU, from v5e to Ironwood

DEV Community
Inference on Google Cloud: Precision, Memory and Capacity on TPU, from v5e to Ironwood
The companion to the talk: what the number format, memory bandwidth, slice shape and capacity rules do to Gemma 4 on Cloud TPU v5e and v6e, against the L4, Blackwell, MI300X and Inferentia, with the cost of each.

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.