Running Local LLMs on Developer Hardware is Mostly a Distraction

Running a seven-billion parameter model on unified memory sounds great. You spend an afternoon...