@Aissen@social.treehouse.systems
Post #1333825
2026-03-27 12:18 UTC
Unicode has interestings consequences: for example, in some languages there are rules to do case change, depending on word boundary for example. The locale can influence the casing. The Segmentation of graphemes, word, sentences can be complex, In Rust, the standard library only does non-locale aware segmentation.
#RustInParis
Replies (1)
-
@Aissen@social.treehouse.systems 2026-03-27 12:18
Normalization is a way to determine equivalences between codepoint combinations. When comparing, Rust only compares the raw codepoints. Ditto for ordering, Rust only order by numerical values. #RustInParis