A 4 GB Laptop GPU Beats a 12-Core CPU by 4.3x on Gemma 4
DEV Community
A 4 GB Laptop GPU Beats a 12-Core CPU by 4.3x on Gemma 4
Serving Gemma 4 E2B q4_0 through llama.cpp on one laptop, twice: CPU-only and on a 2021-era 4 GB GTX 1650 Ti. Same GGUF, same binary, same prompts, one flag apart. The card takes decode by 4.3x, and needs only 1598 MiB to do it.
0 comments
No comments yet.