Comment by newpavlov

Comment by newpavlov 4 hours ago

>If they had invented a separate code point for I in Turkish, then when converting text from those existing ISO character encodings, you’d have to know whether the text is Turkish or English or something else, to know which Unicode code point to map the source “I” into. That’s exactly what Unicode was designed to avoid.

Great. So now we have to know locale for handling case conversion for probably centuries to come, but it was totally worth to save a bit of effort in the relatively short transition phase. /s

JuniperMesos 14 minutes ago

You always have to know locale to handle case conversion - this is not actually defined the same way in different human languages and it is a mistake to pretend it is.

Reply View 1 reply

newpavlov 8 minutes ago

In most cases locale is encoded in character itself, i.e. Latin "a" and Cyrillic "a" are two different characters, despite being visually indistinguishable in most cases.
The "language-sensitive" section of the special casing document [0] is extremely small and contains only the cases of stupid reuse of Latin I.
[0]: https://www.unicode.org/Public/UCD/latest/ucd/SpecialCasing....

Reply View | 0 replies

fhars 4 hours ago

Without it, there would not have been a transition phase.

Reply View 1 reply

newpavlov 3 hours ago

I call BS. Without a series of MAJOR blunders Unicode was destined to succeed. When the rest of the world has migrated to Unicode, I am more than certain that Turks would've migrated as well. Yes, they may have complained for several years and would've spent a minuscule amount of resources to adopt the conversion software, but that's it, a decade or two later everyone would've forgotten about it.
I believe that even addition of emojis was completely unnecessary despite the pressure from Japanese telecoms. Today's landscape of messengers only confirms that.

Reply View | 0 replies