simd-tokenizer v0.1.3 — Safe SWAR-accelerated whitespace token estimator with optional exact tiktoken backend

Sign in to join the discussion — your thebay.events account works here.