vllm-cpp v0.0.1 — Safe model inference, streaming, chat, and concurrent requests for vllm.cpp

Sign in to join the discussion — your thebay.events account works here.