Run an LLM in the browser: WebGPU did 63 tokens/s, WASM did 1.6
DEV Community
Run an LLM in the browser: WebGPU did 63 tokens/s, WASM did 1.6
Originally published at tensorust.com. TL;DR: You can run a small language model entirely inside a...
0 comments
No comments yet.