ramvamp v0.1.0 — Run 26-30B fine-grained MoE models in about 3 GB of RAM by streaming experts from NVMe. No GPU required.

Sign in to join the discussion — your thebay.events account works here.