the.bay.news

Birds Don't Fly Like Planes. Neither Does AI.

Tomasz Tunguz
Birds Don't Fly Like Planes. Neither Does AI.
A local model that generates tokens 2.2x faster than the incumbent finished later in wall-clock, because it emitted 3.1x more tokens. Tokens per second is the wrong metric. Time to answer is the right one.

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.