rvllm v0.1.0 — Small LLM inference engine in Rust: paged KV cache, continuous batching, CPU and CUDA backends, GGUF loading

Sign in to join the discussion — your thebay.events account works here.