alyze

alyze is an open-source Rust tokenization and text-analysis library for full-text search. It provides UAX #29-compliant word/sentence tokenization using a hand-rolled DFA and an analyzer pipeline with lowercasing, ASCII case folding, stemming, and stopword removal.