Inference on Google Cloud: Precision, Memory and Capacity on TPU, from v5e to Ironwood
DEV Community
Inference on Google Cloud: Precision, Memory and Capacity on TPU, from v5e to Ironwood
The companion to the talk: what the number format, memory bandwidth, slice shape and capacity rules do to Gemma 4 on Cloud TPU v5e and v6e, against the L4, Blackwell, MI300X and Inferentia, with the cost of each.
0 comments
No comments yet.