quat_llm v0.1.0 — A high-performance, lightweight 2-bit quantized LLM inference engine in Rust

Sign in to join the discussion — your thebay.events account works here.