kv-cache-size v0.1.0 — Exact KV-cache arithmetic for transformer inference: bytes per token, total cache bytes, and the context length that fits a memory budget.

Sign in to join the discussion — your thebay.events account works here.