Your 8GB GPU isn't the problem: 4 Ollama settings that stop the silent CPU fallback
DEV Community
Your 8GB GPU isn't the problem: 4 Ollama settings that stop the silent CPU fallback
You install Ollama, pull a 7B model, run it, and get 1.8 tokens/sec. Fans barely spin. nvidia-smi...
0 comments
No comments yet.