AI enthusiast adds Nvidia Tesla V100 as loud as a lawnmower to gaming PC for $266 — 32GB of VRAM rig can run 27 billion parameter model at 32 tokens per second
Tom
AI enthusiast adds Nvidia Tesla V100 as loud as a lawnmower to gaming PC for $266 — 32GB of VRAM rig can run 27 billion parameter model at 32 tokens per second
Now they have a total 32GB VRAM system on a budget, for local LLM inference.
Now they have a total 32GB VRAM system on a budget, for local LLM inference.
0 comments
No comments yet.