โ‰ˆ the.bay.news

An 8B SLM on a 4-core laptop CPU, no GPU: 6 tokens/sec

DEV Community
An 8B SLM on a 4-core laptop CPU, no GPU: 6 tokens/sec
Three counterintuitive results from running Llama-3-8B on an i7-1165G7 with llama.cpp.

0 comments

Sign in to join the discussion โ€” your thebay.events account works here.

No comments yet.