language-tokenizer v0.4.0 — Text tokenizer for linguistic purposes, such as text matching. Supports more than 40 languages, including English, French, Russian, Japanese, Thai etc. crates.io· crate · ▲ 0 points · Aug 21, 2026
0 comments
No comments yet.