When LLM Inference on CPU Beats Waiting for the GPU

mini-vllm-rs is a single-node LLM inference engine I built in Rust on top of Candle for macOS. It can...