language-tokenizer v0.4.2 — Text tokenizer for linguistic purposes, such as text matching. Supports more than 40 languages, including English, French, Russian, Japanese, Thai etc. crates.io· crate · ▲ 0 points · Oct 11, 2026
0 comments
No comments yet.