batchinf v0.1.0 — A drop in harness for dynamic ML inference batching. This is useful to saturate a device (TPU/GPU) and increase throughput for expensive ML inference.

Sign in to join the discussion — your thebay.events account works here.