What Actually Runs on a Phone: The Memory Arithmetic
DEV Community
What Actually Runs on a Phone: The Memory Arithmetic
Deriving the model size a phone can hold from parameters, bytes per weight, KV cache and the per-app allocation ceiling the OS enforces.
0 comments
No comments yet.