C++ Identifier Security using Unicode Standard Annex 39 v2
Document #: D2538R1
Date: 2022-12-03
Project: Programming Language C++
Audience: SG-16 EWG CWG
Reply-to: Reini Urban <reini.urban@gmail.com>Adopt Unicode Annex 39 “Unicode Security Mechanisms” as part of C++26.
Unicode identifiers bury a small risk for homoglyph attacks getting into source code. Compilers are not confused, but reviewers and programmers are as it’s impossible to detect such attacks without special tooling, preferably the compiler as the source of truth. And essentially confusable identifiers are not identifiable anymore.
From R0:
Technical U+1C0..U+1C3In response to P1949R7, and in parallel to n2932 for C.
Adopt Unicode Annex 39 “Unicode Security Mechanisms” as part of C++26.
Optionally:
#pragma unicode <LongScript> that Excluded scripts
can be added to the allowed set of scripts per source file.Open points:
#pragma unicode extension.In addition adopt this proposal as a Defect Report against C++23 and earlier. The author provides the libu8ident library (Apache 2 licensed) and its generated tables to all implementors.
TR39 checks could be implemented as warnings, TR31 violations not. But note that even TR31 has bugs still, to be hopefully fixed in the next Unicode versions. (Unicode 15 did not). TR55 was adressed to fix some parts, but leaves many open points.
One driving factor for addressing this now is that GCC has fixed their long standing bug 67224 “UTF-8 support for identifier names in GCC”. Clang has always supported too many C++11 code points in source code. MSVC in its usual configuration defaults to code page 1252, but can be told to accept UTF-8 source. With GCC now allowing it, the barrier to use of Unicode characters outside the basic source character set has dropped considerably. Use of characters via universal character names was always possible, but never widely used. Examples found in the wild of use of UCNs in identifiers come from compiler and related tool test suites, but it’s trivial to come up with such spoofing attacks. There is no report yet from misuse in C ABI’s from linkers and binutils.
Restricting the profile of characters is much easier if no one is depending on them yet.
Some actual C++11 user-code representing the epsilon transport equation:
solve(div(U * ε) - div(νt * grad(ε)) / σε + C2 * ω * Sp(ε)
== C1 * ω * G, ε, α);From visual inspection you can not decide if the greek identifiers here are actual greek, latin or cyrillic.
Even worse is this, which writes an identifier in latin and then in cyrillic. These can be in different source files. The string also btw, but strings don’t need to be identifiable.
int CHECK (const char *arg) {
return strcmp(arg, "check") == 0;
}
int СНЕСК (const char *arg) {
return strcmp(arg, "сhесk") == 0;
}or from https://unicode.org/reports/tr55/#Spoofing-confusables:
void zero(double** matrix, int rows, int columns) {
for (int i = 0; i < rows; ++i) {
double* row = matrix[i];
for (int і = 0; і < columns; ++і) { // Cyrillic i
row[i] = 0.0;
}
}
}This program looks like it zeros a rows by columns rectangle, but it actually only zeros a diagonal, because the identifier і on line 4 is a Cyrillic letter, whereas i is the Latin letter everywhere else.
Adopting TR39 would fix all of the known security problems with C++/C identifiers. With C++ it is more severe as declarations are easily confusable with initializations. But not as severe as in unstrict dynamic languages.
The recent https://trojansource.codes effort caused gcc to emit a new bidi warning, and github to implement similar warnings. Note that secure identifiers don’t help against bidi overrides in strings or comments, these issues are orthogonal. The Unicode consortium implemented a unicode spoofing taskforce https://www.unicode.org/L2/L2022/22007-avoiding-spoof.pdf. Their ICU library would need an identifier check API at least.
There used to be no linter, but there is now one: My u8idlint from https://github.com/rurban/libu8ident, which can be used to check for ALLOWED,SAFEC26,C23,ID,XID,C11 or ALLUTF8 TR31 profiles, for various TR39 mixed script profile violations, confusables, invalid combining marks and TR15 normalization problems. Go also came up with a unicode spoofing linter lately: https://github.com/NebulousLabs/glyphcheck
So far only Rust, cperl and Java follow a TR39 Unicode security guideline for identifiers, zig and J refused to support non-ASCII identifiers. Everbody else is vulnerable to potential security attacks and does allow non-identifiable identifiers. They should rename their identifiers to “symbols”.
Links:
First we are discussing two different approaches found in praxis:
TR39 lists some options how to implement a security mechanism for identifiers. In praxis there are three successful usages of the mixed-script approach in java, cperl and rust, as specified here. No other language implemented TR39 since and uses it. Python tried the confusables approach optionally, and gcc and clang-tidy is trying it out now. See 12 Implementations and Strategies.
GCC has a new -Whomoglyph warning patch at PR 103027
(see also my github for an updated version). It implements the
“skeleton” algorithm from TR39#4
so that every new identifier is mapped to a “skeleton”, and if the
skeleton is already in use by a different identifier, issue a
-Whomoglyph diagnostic. It uses the
security/confusables.txt table to determine which
characters are confusable. It uses a NFD lookup and three hash lookups
per identifier. NFD is relatively cheap compared to NFC, mandatory since
C23 and C++23, but much more expensive than the mixed script approach
which uses only a single range-lookup in most cases.
clang-tidy https://reviews.llvm.org/D112916 was fairly unsucessful so far, and used the similar confusables approach.
Pros:
confusables need not to care about scripts, in which language, the document is written. The first variant of an identifier is the accepted one, and the subsequent ones with expanded confusable matches are invalid. First come, first serves.
Forbidding rarely used scripts can be seen as politically loaded.
Cons:
confusables.txt has much more bugs and oddities than
TR31, the should-be stable list of XID identifiers. So far I’ve found 3
bugs in TR31 for Unicode v14. In confusables.txt ASCII has 12 exceptions
to be ignored, Greek needs 12 exceptions out of 260, and I didn’t check
any other scripts.
Following TR39#5 Mixed Scripts would be easier to understand, as it is defined by simple rules, and not a hand-curated, buggy and unstable table. Even the first violation is an error, thus no surprises when code moves around.
Implementing the confusable.txt checks only (as
proposed in the two gcc and clang tickets) can be slow (as experienced
in clang-tidy), and led to a huge number of warnings (over 100.000). The
GCC implementation (see my github) is fast, but needs recursive dynamic
hash lookups. Whilst implementing the mixed-scripts strategy as laid out
here is extremely fast and led to no warnings so far in published
code.
Mixed scripts are already successfully used in praxis for several years, without any complaints.
There were a few more design decisions made, over TR39 recommendations:
TR39 recommends to forbid some sets of Limited Use scripts for identifiers, and recommends to only optionally allow some other Excluded scripts. See 7.2 Script restrictions.
Speed/Size summary:
The mixed-script approach was also sucessfully used in a dynamic language, with much stricter performance restrictions than offline compilers or linters. There was no noticable compile-time performance degradation, as unicode identifiers are extremely rare, and the NFC check is by far slower than the mixed script and illegal combining mark checks. NFC needs 183K alone, the mixed script check with the TR31, medial and mark tables 131K in my unoptimized, generic implementation. C++26 can do a bit better, but this is good enough.
P1949 correctly detected that Unicode identifiers are still not identifiable, and are prone to bidi- and homoglyph attacks. But it stated that implementing TR39 would be too hard. Having properly implemented the Unicode Security Guidelines for identifers for several years, plus pushed Rust to do so also, proves the contrary. TR39 would catch all known homoglyph and bidi identifier attacks.
Further restriction of the TR31 profile as recommended by TR39 to
only recommended scripts leads to smaller sets for identifiers, and
implementation of a proper TR39 mixed script profile and identifier
types fixes most of the known unicode security problems with
identifiers. The only remaining problems are bidi overrides in strings
or comments evading syntax, which cannot be handled with identifier
restrictions, but tokenizer or preprocessor warnings, as recently added
to gcc and clang. #include filename restrictions should be
done also, but that is also out of the scope of this document, as the
existing filesystems care much less about unicode security for
identifiers than programming languages. Spoofing attacks on filenames
are not yet seen in the wild, but will appear sooner or later, same as
they appeared in browsers and email. Also names in C/C++ object files:
linkers, .def files, ffi’s.
Implementing TR39 mixed script detection per document (C++ Header and Source file) forbids insecure mixes of Greek and Cyrillic, dangerous Arabic RTL bidi attacks and confusables. You can still write in your language, but then only in commonly written languages, and not mixed with others. Identifiers are still identifiable.
The question remains if TR39 security violations should be ill-formed
(throw an compilation error or warning), or not. Since we do have the
-std=c++26 option, and the issues are security relevant,
ill-formeded seems to be best. Implementations might choose to go for
compiler warnings or linters or just toolchain implementations, i.e.
editors and reviewer tools. The practical security problems are not
severe and are easy to fix, as we had none in the years clang allowed
insecure unicode, and there were no major known problems on the easier
to attack dynamic languages. But gcc just added it now with gcc-10, so
the impact might just come later. TR39 is considered stable and not a
moving target. There were no impactful changes in the last 10 years.
Restricting the Identifier Type plus the Recommended Scripts, will shrink the original XID set from 971267 codepoints to 99350 codepoints. The ranges expand from 36 to 426. (when split by scripts already, 25 splits happen). Additionally the Halfwidth and Fullwidth Forms, U+FF00..U+FFEF, the Arabic Presentation Forms-A: U+FB50–U+FDFF and Arabic Presentation Forms-B: U+FE70–U+FEFF are now forbidden.
ID_Start consists of Lu + Ll + Lt + Lm + Lo + Nl,
+Other_ID_Start, -Pattern_Syntax,
-Pattern_White_Space
131899 codepoints
ID_Continue consists of ID_Start, + Mn + Mc
+ Nd + Pc, +Other_ID_Continue,
-Pattern_Syntax, -Pattern_White_Space.
135072 codepoints (= ID_Start + 3173)
XID_Start and XID_Continue ensure that
isIdentifer(string) then
isIdentifier(NFKx(string)) (removing the NFKC
quirks)
XID_Start: 131876 codepoints, XID_Continue:
135053 codepoints (= XID_Start + 3173)
See Appendix A - C26XID_Start and Appendix B - C26XID_Continue.
For the medial positions see Section 19 Appendix G - Medial. They are not allowed as first nor as last character in a word, but this set of identifiers contain none, as we disallow the legacy Arabic Presentation forms.
P1949R7 for C++23 previously stated: “This paper also does not propose excluding any scripts categorically, regardless of their status as historic or obsolete. Characters from Anatolian Hieroglyphs would be available for use, to the extent that anyone wishes to do so.”
TR31#Table 4 states: “Some scripts are not in customary modern use, and thus implementations may want to exclude them from identifiers. These include historic and obsolete scripts, scripts used mostly liturgically, and regional scripts used only in very small communities or with very limited current usage. Some scripts also have unresolved architectural issues that make them currently unsuitable for identifiers. The scripts in Table 4, Excluded Scripts are recommended for exclusion from identifiers.”
These Excluded Scripts are initially disallowed TR31#Table_4
but can be optionally be allowed via a new
#pragma unicode ExcludedScript:
Ahom Anatolian_Hieroglyphs Avestan Bassa_Vah Bhaiksuki Brahmi
Braille Buginese Buhid Carian Caucasian_Albanian Chorasmian Coptic
Cuneiform Cypriot Cypro_Minoan Deseret Dives_Akuru Dogra Duployan
Egyptian_Hieroglyphs Elbasan Elymaic Glagolitic Gothic Grantha
Gunjala_Gondi Hanunoo Hatran Imperial_Aramaic
Inscriptional_Pahlavi Inscriptional_Parthian Kaithi Kawi Kharoshthi
Khitan_Small_Script Khojki Khudawadi Linear_A Linear_B Lycian
Lydian Mahajani Makasar Manichaean Marchen Masaram_Gondi
Medefaidrin Mende_Kikakui Meroitic_Cursive Meroitic_Hieroglyphs
Modi Mongolian Mro Multani Nabataean Nag Mundari Nandinagari Nushu
Ogham Old_Hungarian Old_Italic Old_North_Arabian Old_Permic Old_Persian
Old_Sogdian Old_South_Arabian Old_Turkic Old_Uyghur Osmanya
Pahawh_Hmong Palmyrene Pau_Cin_Hau Phags_Pa Phoenician
Psalter_Pahlavi Rejang Runic Samaritan Sharada Shavian Siddham
SignWriting Sogdian Sora_Sompeng Soyombo Tagalog Tagbanwa Takri
Tangsa Tangut Tirhuta Toto Ugaritic Vithkuqi Warang_Citi Yezidi
Zanabazar_Square“Modern scripts that are in more limited use are listed in Table 7, Limited Use Scripts. To avoid security issues, some implementations may wish to disallow the limited-use scripts in identifiers. For more information on usage, see the Unicode Locale project [CLDR].” These Limited Use Scripts are now disallowed TR31#Table_7:
Adlam Balinese Bamum Batak Canadian_Aboriginal Chakma Cham Cherokee
Hanifi_Rohingya Javanese Kayah_Li Lepcha Limbu Lisu Mandaic
Meetei_Mayek Miao New_Tai_Lue Newa Nko Nyiakeng_Puachue_Hmong Ol_Chiki
Osage Saurashtra Sundanese Syloti_Nagri Syriac Tai_Le Tai_Tham
Tai_Viet Tifinagh Vai Wancho Yi UnknownThis recommendation follows TR39, to recommended scripts only, Excluded and Limited Use not. For some years until Unicode 10 there was a “Aspirational Use Scripts” table, which included a subset of the optional Limited Use scripts to be allowed in identifiers. But “this has not proven to be productive for the derivation of identifier-related classes used in security profiles”.
Thus these scripts will stay allowed:
Common Inherited Latin Arabic Armenian Bengali Bopomofo Cyrillic
Devanagari Ethiopic Georgian Greek Gujarati Gurmukhi Hangul Han Hebrew
Hiragana Katakana Kannada Khmer Lao Malayalam Myanmar Oriya
Sinhala Tamil Telugu Thaana Thai TibetanStability:
Historically the most changes in latest unicode versions have been with adding to Emojis and Limited Use scripts. Thus the expected set of valid identifiers looks stable, when all the current TR31 bugs will be fixed. I have no idea about the TR39 confusables.txt bugs, as there is no categorization yet.
The script property and its name are defined in TR24. We use the long Unicode Script property value, not the abbrevated 4-letter short name, which maps somehow to the 4-letter ISO 15924 Codes.
C++26 (and C26) will follow the TR39 Security Profile 4 Moderately Restrictive, with an exception for Greek.
See Section 10 TR39 Mixed Scripts.
C++26 (and C26) will check for unlikely sequences of combining marks, and reject some. Combining Marks have no script property per se, but a variable list of allowed SCX scripts, which need to be checked against the base character. Also 4 Japanese KATAKANA-HIRAGANA PROLONGED SOUND MARK modifier letters.
This section is technically security-relevant, as over-long runs of combining marks may lead to overflow in sequences.
See 8.2 “SCX Extensions” and 8.3 “Combining marks script run detection for spoofing” below.
C++ only needs to map unicode characters to a script property via a single byte. There are currently 161 scripts assigned, 32 of them are in common use as identifiers, hence called Recommended scripts. The rest is split up into 127-31 Excluded scripts, which are not in common use, and 161-127 Limited_Use scripts, which are not to be used in identifiers at all.
Regarding the discriminatory aspect of Excluded Scripts from TR31#Table_4.
“Some scripts are not in customary modern use, and thus
implementations may want to exclude them from identifiers. These include
historic and obsolete scripts, scripts used mostly liturgically, and
regional scripts used only in very small communities or with very
limited current usage. Some scripts also have unresolved architectural
issues that make them currently unsuitable for identifiers. The scripts
in Table 4, Excluded Scripts are recommended for exclusion from
identifiers.” Nevertheless an implementation might choose to allow
some optionally via a new #pragma unicode Script.
Regarding Limited Use scripts: TR31#2.4: “Modern scripts that are in more limited use are listed in Table 7, Limited Use Scripts. To avoid security issues, some implementations may wish to disallow the limited-use scripts in identifiers. For more information on usage, see the Unicode Locale project CLDR.”
Regarding stability: New scripts are added on a yearly basis, but nothing was added to the stable set of recommended scripts. For a while there was a list of Aspirational scripts to be added eventually, but this list was abandoned with Unicode 10.0. Probably also because nobody but Java, cperl and Rust implemented its identifier profile by scripts, rather went with insecure identifiers.
For error messages and an optional pragma to allow certain Exluded scripts, we use the long Script property value. Do not use the term “script name”, as this is ambigious and misused. The Script Property Value is the titlecased name of the script from the UCD, with spaces replaced by underscores. They are defined in the yearly updated Scripts.
Not all characters are uniquely used in a single script only. Many are used in a variable numbers of scripts. These are assigned to the Common or Inherited script, and are exactly specified in the ScriptExtensions, aka SCX. The SCX property is a list of possible scripts per character. This list is using the short 4-letter script property, which needs to be resolved via the PropValue to its long script property value. (E.g. Syrc to Syriac)
# Script_Extensions=Arab Syrc
064B..0655 ; Arab Syrc # Mn [11] ARABIC FATHATAN..ARABIC HAMZA BELOW
# Script_Extensions=Adlm Arab Mand Mani Ougr Phlp Rohg Sogd Syrc
0640 ; Adlm Arab Mand Mani Ougr Phlp Rohg Sogd Syrc # Lm ARABIC TATWEELSome of the SCX scripts contain only a single script. These could be directly added to the list of SC scripts for the purpose of identifier security checks, but I advise against, for easier Combining Marks checks against the base character script. See below 8.3.
E.g.
3006 ; Hani # Lo IDEOGRAPHIC CLOSING MARKU+3006 with the Common script property is assigned to the Hani -> Han script.
Multiple SCX list entries can be resolved when the previous scripts in the identifier context are already resolved to one or the other possibility. Thus for SCX=(Arab Syrc) we need to check if Arabic or Syriac was already seen. If not, the new character with that SCX is illegal, violating our Mixed Script profile.
Check for unlikely sequences of combining marks:
Since we disallow already most combining marks (at least the Latin ones) with the requirement of NFC in P1949R7, this set of cases is quite small.
Special-cases:
Using the Script property alone will not detect that the U+30FC ( ー ) KATAKANA-HIRAGANA PROLONGED SOUND MARK (Script=Common, SCX=Hira Kana, gc=Lm) should not be mixed with Latin. See TR39#5.4 and TR46. We only have to check only 4 such explicitly japanese-only PROLONGED SOUND MARKs, all other Lm modifiers may mix with all SCX.
The list of allowed combining mark characters (with Common or
Inherited scripts) in the C++26 TR31 profile is: Lm
Modifier_Letter, Mc Spacing_Mark, Mn
Nonspacing_Mark, Me Enclosing_Mark. Sk and Cf
are not part of XIDs.
69 matches for “XID_Continue # Lm” in buffer: DerivedCoreProperties.txt See Appendix C for all.
02B0..02C1 ; XID_Continue # Lm [18] MODIFIER LETTER SMALL H..
MODIFIER LETTER REVERSED GLOTTAL STOP
02C6..02D1 ; XID_Continue # Lm [12] MODIFIER LETTER CIRCUMFLEX ACCENT..
MODIFIER LETTER HALF TRIANGULAR
...528 matches for “XID_Continue # M” in buffer: DerivedCoreProperties.txt See Appendix D for all.
0300..036F ; XID_Continue # Mn [112] COMBINING GRAVE ACCENT..
COMBINING LATIN SMALL LETTER X
0483..0487 ; XID_Continue # Mn [5] COMBINING CYRILLIC TITLO..
COMBINING CYRILLIC POKRYTIE
...From these 69 Lm plus 528 M[cn] ranges filtering out the non-C++26 XID candidates, only #8 Identifier_Type = Recommended, Inclusion, non-confusable Technical, plus only #4.2 Recommended Scripts, plus only codepoints with multiple SCX entries, plus only codepoints which don’t decompose to NFC, leads only to the Lm characters, which can mix with all scripts. Not a single Mn or Mc codepoints is left.
So some of the Common XID_Continue marks therefore
cannot be detected with the SCX logic. But all of them do not combine
with Latin and are already filtered by the C++26 Mixed Script
profile.
Most Lm Modifier Letters (besides the 4 Japanese PROLONGED SOUND MARKs) are freestanding base characters, which can be combined with any other letter.
See TR31#2.1 Combining_Marks and TR31#2.2 Modifier_Letters
Most of the Combining Marks are caught by the NFC requirement from C++23 (P1949r7), but some optional checks for gc=Mn against base chars still might be added:
Forbid U+0069 LOWERCASE LETTER I or the DOTLESS letters i and j combined with U+0307 COMBINING DOT ABOVE as special-cases.
Forbid non-spacing marks with base chars already including the non-spacing mark. They would be rendered either indistuinguishable or with the combining mark doubled. There are currently 82 non-spacing marks, e.g. GRAVE, DOT ABOVE, … most of them in the U+0300-U+0341 range, but some also in U+20D0-U+20E1 and U+3099-U+309A ranges. From these there exist 31 with a list of letters which already include those non-spacing marks. See Appendix H.
See also TR24#5.1 Handling Characters with the Common Script Property and TR24#5.2 Handling Combining Marks.
TR39 recommends to disable some characters from recommended scripts: “Some characters used with recommended scripts may still be problematic for identifiers, for example because they are part of extensions that are not in modern customary use, and thus implementations may want to exclude them from identifiers. These include characters for historic and obsolete orthographies, characters used mostly liturgically, and in orthographies for languages used only in very small communities or with very limited current or declining usage. Some characters also have architectural issues that may make them unsuitable for identifiers.”
The Identifier Type property TR39#Table 1 recommendation should be mandatory, with the addition of the non-confusable Technical Identifier Type to be allowed.
I.e.
Limited_Use, Obsolete, Exclusion, Not_XID, Not_NFKC, Default_Ignorable,
Deprecated, Not_Character are not part of identifiers.
Allowed are Recommended, Inclusion, and all non-confusable Technical TR39 Identifier Types.
Note that several Technical Identifier_Type are confusable, but not marked as such. So far only the Latin letters U+1C0 ǀ, U+1C1 ǁ, U+1C3 ǃ which are confusable with operators.
Additionally the Halfwidth and Fullwidth Forms, U+FF00..U+FFEF are forbidden, even if allowed in TR31. They are confusable with the Latin base alphabet A-Z.
Additionally the Arabic Presentation Forms-A: U+FB50–U+FDFF and Arabic Presentation Forms-B: U+FE70–U+FEFF are now forbidden. Forms-A contains a list of Arabic presentation forms encoded as characters primarily for compatibility reasons. Forms-B are for compatibility with preexisting standards and legacy implementations that use these forms as character. Instead of these, letters from the Arabic block (U+0600..U+06FF) should be used for identifiers. See https://www.unicode.org/versions/Unicode14.0.0/ch09.pdf#G37489 and https://www.unicode.org/reports/tr53/. The TR39 idtype of these should be changed to Obsolete.
There are 79 Technical ranges added to the original list of Recommended and Inclusion ID’s, with the confusables U+1C0..U+1C3 manually excluded.
grep ', U8ID_Technical' scripts.h | egrep -v 'Not_XID|U8ID_Obsolete|U8ID_Exclusion'See Appendix E - IDType Technical.
TR39#5.2 defines some security profiles for identifers to avoid the most common identifier insecurities, that identifiers will stay identifiable.
We want to choose a variant of the Moderately Restrictive profile, with an exception for non-confusable Greek. I called this profile C26_4 or SAFEC26 in libu8ident.
Greek alone is always allowed, as Cyrillic, but wherever we have a valid Latin letter which looks the same as the Greek counterpart, the Greek letter is forbidden, choose the Latin one instead. E.g. ( Α → A )GREEK CAPITAL LETTER ALPHA → LATIN CAPITAL LETTER A. See Appendix F for the generated list with 12 exceptions.
Thus it prevents Cyrillic mixed with Latin or any other script, but does allow any East-Asian CFK language, other common and widely used languages and Latin mixed with Greek, mainly used for its popular and actually used mathematical symbols. Many mathematical symbols already exists outside of Greek, but these are mainly used for operators in advanced programming languages, not as identifiers. See also http://xahlee.info/comp/unicode_math_operators.html for a nice overview.
E.g. here we have some:
And some actual C++ user-code representing the epsilon transport equation:
solve(div(U * ε) - div(νt * grad(ε)) / σε + C2 * ω * Sp(ε)
== C1 * ω * G, ε, α);TR39 also compiles a convenient IdentifierStatus
list. But all the math letters with Script=Common from U+2100 to U+2200
are restricted, as Greek is forbidden mixed with Latin in the original
TR39 Moderately Restrictive profile. Most are allowed according to the
TR31 and TR39 rules of SAFEC26, so we need to come up with our own list
of XID_Start/XID_Continue codepoints, excluding the Limited
Use and Excluded scripts. And if an implementation choses to allow
Excluded scripts with more logic to allow only this script.
Since the TR31 XID list also got the median positions wrong (for 98 Arabic codepoints), has some confusables with ops, and forgot about the Halfwidth and Fullwidth, U+FF00..U+FFEF confusables, we need to fixup and generate the XID lists by ourselves.
It is recommended to already exclude Limited Use and Excluded scripts
from the initial list of identifier ranges, as this is the most common
use-case, and shortens the common search paths. Only with the
#pragma Unicode ExcludedScript search the full XID lists
and the full scripts list.
The TR39 Mixed Scripts profile alone does not prevent from all spoofing attacks, but the additional rules from 8.3 “Combining marks script run detection for spoofing” are kept tiny.
This is not discussed in any of the unicode security guidelines for identifiers. One could argue that a mixed-script profile is valid only for a single identifier, or it is valid for the whole source file document. And there needs to be a definition if before or after the preprocessor, and if to treat names in private structs, classes and local names in functions as seperate contexts.
If valid for only a single identifier you could arbitralily mix up Cyrillic with Greek identifiers in a C++ namespace, and thus these identifiers would not be identifiable anymore, as both both can render to the very same glyphs. Thus we adopt the notion of identifier contexts.
With programming languages this is a source file, with objects files this is a module. For identifiers in object files there are open issues with binutils, linkers, exported identifiers, encodings. For filesystems this would be a directory.
For every source file we need to store a context with the list of
already seen scripts and how many. The maximal number of scripts is 4,
for the case of Japanese mixed with Latin.
(Katakana + Hiragana + Han + Latin), thus we
can save that list in a single 4-byte word, and the lookup and memory
management is trivial.
Since the compiler sees the identifiers after the preprocessor included all headers, the context definition is a bit blurry. Is the context for mixed scripts an original source file (before cpp) or the resulting file after inclusion of all files (after cpp). This is similar to the problem with lexical variables a couple of decades ago.
before-cpp: One could argue that the scope of a variable should be contained in a lexical block, which can be statically determined and safely enclosed. With identifiers that would mean that the preprocessor already should perform the TR31 lexer checks and TR39 security checks, and one could define Arabic headers using private arabic fields, and include another header with Cyrillic only names. This would allow confusables in the resulting object file, and source files would be easy to check with external tools.
private/scoped: Another argument would be that all exported names end up in the object files and library flat, which would support the seperation of private and public name contexts, where to perform the mixed-script checks. Private contexts (e.g. static structs, private class fields, local names in functions) should be seperated from the rest. This would prevent from confusables in struct/class fields/methods, and the rest is seperated by the checks for the public names. Jabuk Jelinek favored this approach to the GCC -Whomoglyph PR answer: https://gcc.gnu.org/pipermail/gcc-patches/2021-November/583080.html
after-cpp: The third, strictest variant would define the context in the file after cpp. You would not be able to include a Cyrillic-only header, and you would not be able to use Cyrillic private fields. This would be the least surprising and most secure option. As long as the security risk lies ahead of us, one should go for the strictest option. Cyrillic header projects should be isolated and not used at all outside of non-cyrillic projects. I’m pointing the fingers at Cyrillic because it has the biggest number of confusables with Latin. Arabic headers e.g. are not all confusable with Latin or CFK, but I doubt that any non Hebrew/Arabic speaker can identify and see differences in its names without long training. Same for CFK and the other recommended scripts.
I implemented for cperl, a fork of perl5, the General Security profile “Moderately restrictive” (4) for identifiers in 2017, together with transparent normalization of NFC. This is a dynamic language with the need for fast tokenizing, and compilation. Still I did not see a need to restrict all source code identifiers to be already in NFC. Even with the added unicode checks and dynamic normalization the tokenizer is still faster than the simplier perl5 tokenizer.
Then when GCC went to full insecure identifiers I implemented the more general libu8ident library, which can be used with all known TR39 identifier type profiles, the mixed-script security profiles, TR31 XID character sets and all TR15 normalizations. There I tested various performance strategies of the unicode lookups. Tested was CRoaring, which was only useful for sets of single codepoints, the list of confusables. Most of the needed lists were best structured as binary-search in range pairs. Most of them were fastest with special-casing the codepoints below U+128 with a simple linear search. Binary search in an Eytzinger layout was not convincibly faster, neither hybrid searches by 1. splitting up ranges from single codepoints, nor 2. seperating 16bit from 32bit codepoints. Perfect hashes for singular lookup are used in some similar implementations, esp. for confusables and the normalization check. I’m still working on the perfect hashes approach (the new perl5 unicode tables, PostgresQL PerfectHash.pm, nbperf, gperf).
Rust has a good implementation also.
ICU has no implementation for TR39 checks (yet).
gcc PR 103027 implements the “skeleton” algorithm from TR39#4 via a switch table (!) for all decomposables and confusables, and two extra dynamic hashtables for the NFD expanded identifiers. There’s a lot of room of improvement there, e.g. with perfect hashes instead of a switch table for the huge and sparse tables, but they had no complaints on speed and size yet. Implementing the mixed-scripts approach in C++26/C26 for their -Whomoglyph warnings would be much faster and smaller though.
Also gcc and all other major compilers don’t optimize large constant sparse case arrays to perfect hashes yet, so their switch/case lookups are linear, not constant. See e.g. https://programming.sirrida.de/hashsuper.pdf, which becomes a bottleneck just now with adopting large and sparse unicode switch statements, here with decompositions and confusables.
Created with mkc26 from libu8ident. The SCX is modelled as if your compiler would allow static initialization of strings as {char,…,0}.
struct sc {
uint32_t from;
uint32_t to;
enum u8id_sc sc; // Scripts
enum u8id_gc gc; // General Category. GC_L is L& (all letters)
// GC_V is varying
const char *scx; // List of ScriptExtensions, maxsize 8 for U+1CF2
};
// Filtering allowed scripts, XID_Start, safe IDTypes, NFC, !MEDIAL and !MARK
// Ranges split at GC and SCX changes
const struct sc safec_start_list[339] = {
{'$', '$', SC_Latin, GC_Sc, NULL},
{'A', 'Z', SC_Latin, GC_Lu, NULL},
{'_', '_', SC_Latin, GC_Pc, NULL},
{'a', 'z', SC_Latin, GC_Ll, NULL},
{0xC0, 0xD6, SC_Latin, GC_Lu, NULL}, // À..Ö
{0xD8, 0xF6, SC_Latin, GC_L, NULL}, // Ø..ö
{0xF8, 0x131, SC_Latin, GC_L, NULL}, // ø..ı
{0x134, 0x13E, SC_Latin, GC_L, NULL}, // Ĵ..ľ
{0x141, 0x148, SC_Latin, GC_L, NULL}, // Ł..ň
{0x14A, 0x17E, SC_Latin, GC_L, NULL}, // Ŋ..ž
{0x180, 0x180, SC_Latin, GC_Ll, NULL}, // ƀ
{0x18F, 0x18F, SC_Latin, GC_Lu, NULL}, // Ə
{0x1A0, 0x1A1, SC_Latin, GC_L, NULL}, // Ơ..ơ
{0x1AF, 0x1B0, SC_Latin, GC_L, NULL}, // Ư..ư
{0x1CD, 0x1DC, SC_Latin, GC_L, NULL}, // Ǎ..ǜ
{0x1DE, 0x1E3, SC_Latin, GC_L, NULL}, // Ǟ..ǣ
{0x1E6, 0x1F0, SC_Latin, GC_L, NULL}, // Ǧ..ǰ
{0x1F4, 0x1F5, SC_Latin, GC_L, NULL}, // Ǵ..ǵ
{0x1F8, 0x21B, SC_Latin, GC_L, NULL}, // Ǹ..ț
{0x21E, 0x21F, SC_Latin, GC_L, NULL}, // Ȟ..ȟ
{0x226, 0x236, SC_Latin, GC_L, NULL}, // Ȧ..ȶ
{0x250, 0x252, SC_Latin, GC_Ll, NULL}, // ɐ..ɒ
{0x255, 0x255, SC_Latin, GC_Ll, NULL}, // ɕ
{0x258, 0x25A, SC_Latin, GC_Ll, NULL}, // ɘ..ɚ
{0x25C, 0x262, SC_Latin, GC_Ll, NULL}, // ɜ..ɢ
{0x264, 0x267, SC_Latin, GC_Ll, NULL}, // ɤ..ɧ
{0x26A, 0x271, SC_Latin, GC_Ll, NULL}, // ɪ..ɱ
{0x273, 0x276, SC_Latin, GC_Ll, NULL}, // ɳ..ɶ
{0x278, 0x27B, SC_Latin, GC_Ll, NULL}, // ɸ..ɻ
{0x27D, 0x288, SC_Latin, GC_Ll, NULL}, // ɽ..ʈ
{0x28A, 0x291, SC_Latin, GC_Ll, NULL}, // ʊ..ʑ
{0x293, 0x29D, SC_Latin, GC_L, NULL}, // ʓ..ʝ
{0x29F, 0x2AF, SC_Latin, GC_Ll, NULL}, // ʟ..ʯ
{0x2B9, 0x2C1, SC_Common, GC_Lm, NULL}, // ʹ..ˁ
{0x2C6, 0x2D1, SC_Common, GC_Lm, NULL}, // ˆ..ˑ
{0x2EC, 0x2EC, SC_Common, GC_Lm, NULL}, // ˬ
{0x2EE, 0x2EE, SC_Common, GC_Lm, NULL}, // ˮ
{0x37B, 0x37D, SC_Greek, GC_Ll, NULL}, // ͻ..ͽ
{0x386, 0x386, SC_Greek, GC_Lu, NULL}, // Ά
{0x388, 0x38A, SC_Greek, GC_Lu, NULL}, // Έ..Ί
{0x38C, 0x38C, SC_Greek, GC_Lu, NULL}, // Ό
{0x38E, 0x3A1, SC_Greek, GC_L, NULL}, // Ύ..Ρ
{0x3A3, 0x3CF, SC_Greek, GC_L, NULL}, // Σ..Ϗ
{0x3D7, 0x3D7, SC_Greek, GC_Ll, NULL}, // ϗ
{0x3FC, 0x3FF, SC_Greek, GC_L, NULL}, // ϼ..Ͽ
{0x401, 0x45F, SC_Cyrillic, GC_L, NULL}, // Ё..џ
{0x48A, 0x4FF, SC_Cyrillic, GC_L, NULL}, // Ҋ..ӿ
{0x510, 0x529, SC_Cyrillic, GC_L, NULL}, // Ԑ..ԩ
{0x52E, 0x52F, SC_Cyrillic, GC_L, NULL}, // Ԯ..ԯ
{0x531, 0x556, SC_Armenian, GC_Lu, NULL}, // Ա..Ֆ
{0x559, 0x559, SC_Armenian, GC_Lm, NULL}, // ՙ
{0x560, 0x586, SC_Armenian, GC_Ll, NULL}, // ՠ..ֆ
{0x588, 0x588, SC_Armenian, GC_Ll, NULL}, // ֈ
{0x5D0, 0x5EA, SC_Hebrew, GC_Lo, NULL}, // א..ת
{0x5EF, 0x5F2, SC_Hebrew, GC_Lo, NULL}, // ׯ..ײ
{0x620, 0x63F, SC_Arabic, GC_Lo, NULL}, // ؠ..ؿ
{0x641, 0x64A, SC_Arabic, GC_Lo, NULL}, // ف..ي
{0x671, 0x672, SC_Arabic, GC_Lo, NULL}, // ٱ..ٲ
{0x674, 0x674, SC_Arabic, GC_Lo, NULL}, // ٴ
{0x679, 0x68D, SC_Arabic, GC_Lo, NULL}, // ٹ..ڍ
{0x68F, 0x6A0, SC_Arabic, GC_Lo, NULL}, // ڏ..ڠ
{0x6A2, 0x6D3, SC_Arabic, GC_Lo, NULL}, // ڢ..ۓ
{0x6D5, 0x6D5, SC_Arabic, GC_Lo, NULL}, // ە
{0x6E5, 0x6E6, SC_Arabic, GC_Lm, NULL}, // ۥ..ۦ
{0x6EE, 0x6EF, SC_Arabic, GC_Lo, NULL}, // ۮ..ۯ
{0x6FA, 0x6FC, SC_Arabic, GC_Lo, NULL}, // ۺ..ۼ
{0x6FF, 0x6FF, SC_Arabic, GC_Lo, NULL}, // ۿ
{0x750, 0x77F, SC_Arabic, GC_Lo, NULL}, // ݐ..ݿ
{0x781, 0x7A5, SC_Thaana, GC_Lo, NULL}, // ށ..ޥ
{0x7B1, 0x7B1, SC_Thaana, GC_Lo, NULL}, // ޱ
{0x870, 0x887, SC_Arabic, GC_Lo, NULL}, // ࡰ..ࢇ
{0x889, 0x88E, SC_Arabic, GC_Lo, NULL}, // ࢉ..ࢎ
{0x8A0, 0x8AC, SC_Arabic, GC_Lo, NULL}, // ࢠ..ࢬ
{0x8B2, 0x8B2, SC_Arabic, GC_Lo, NULL}, // ࢲ
{0x8B5, 0x8C9, SC_Arabic, GC_L, NULL}, // ࢵ..ࣉ
{0x904, 0x939, SC_Devanagari, GC_Lo, NULL}, // ऄ..ह
{0x93D, 0x93D, SC_Devanagari, GC_Lo, NULL}, // ऽ
{0x950, 0x950, SC_Devanagari, GC_Lo, NULL}, // ॐ
{0x960, 0x961, SC_Devanagari, GC_Lo, NULL}, // ॠ..ॡ
{0x971, 0x977, SC_Devanagari, GC_L, NULL}, // ॱ..ॷ
{0x979, 0x97F, SC_Devanagari, GC_Lo, NULL}, // ॹ..ॿ
{0x985, 0x98C, SC_Bengali, GC_Lo, NULL}, // অ..ঌ
{0x98F, 0x990, SC_Bengali, GC_Lo, NULL}, // এ..ঐ
{0x993, 0x9A8, SC_Bengali, GC_Lo, NULL}, // ও..ন
{0x9AA, 0x9B0, SC_Bengali, GC_Lo, NULL}, // প..র
{0x9B2, 0x9B2, SC_Bengali, GC_Lo, NULL}, // ল
{0x9B6, 0x9B9, SC_Bengali, GC_Lo, NULL}, // শ..হ
{0x9BD, 0x9BD, SC_Bengali, GC_Lo, NULL}, // ঽ
{0x9CE, 0x9CE, SC_Bengali, GC_Lo, NULL}, // ৎ
{0x9E0, 0x9E1, SC_Bengali, GC_Lo, NULL}, // ৠ..ৡ
{0x9F0, 0x9F1, SC_Bengali, GC_Lo, NULL}, // ৰ..ৱ
{0xA05, 0xA0A, SC_Gurmukhi, GC_Lo, NULL}, // ਅ..ਊ
{0xA0F, 0xA10, SC_Gurmukhi, GC_Lo, NULL}, // ਏ..ਐ
{0xA13, 0xA28, SC_Gurmukhi, GC_Lo, NULL}, // ਓ..ਨ
{0xA2A, 0xA30, SC_Gurmukhi, GC_Lo, NULL}, // ਪ..ਰ
{0xA32, 0xA32, SC_Gurmukhi, GC_Lo, NULL}, // ਲ
{0xA35, 0xA35, SC_Gurmukhi, GC_Lo, NULL}, // ਵ
{0xA38, 0xA39, SC_Gurmukhi, GC_Lo, NULL}, // ਸ..ਹ
{0xA5C, 0xA5C, SC_Gurmukhi, GC_Lo, NULL}, // ੜ
{0xA72, 0xA74, SC_Gurmukhi, GC_Lo, NULL}, // ੲ..ੴ
{0xA85, 0xA8D, SC_Gujarati, GC_Lo, NULL}, // અ..ઍ
{0xA8F, 0xA91, SC_Gujarati, GC_Lo, NULL}, // એ..ઑ
{0xA93, 0xAA8, SC_Gujarati, GC_Lo, NULL}, // ઓ..ન
{0xAAA, 0xAB0, SC_Gujarati, GC_Lo, NULL}, // પ..ર
{0xAB2, 0xAB3, SC_Gujarati, GC_Lo, NULL}, // લ..ળ
{0xAB5, 0xAB9, SC_Gujarati, GC_Lo, NULL}, // વ..હ
{0xABD, 0xABD, SC_Gujarati, GC_Lo, NULL}, // ઽ
{0xAD0, 0xAD0, SC_Gujarati, GC_Lo, NULL}, // ૐ
{0xAE0, 0xAE1, SC_Gujarati, GC_Lo, NULL}, // ૠ..ૡ
{0xB05, 0xB0C, SC_Oriya, GC_Lo, NULL}, // ଅ..ଌ
{0xB0F, 0xB10, SC_Oriya, GC_Lo, NULL}, // ଏ..ଐ
{0xB13, 0xB28, SC_Oriya, GC_Lo, NULL}, // ଓ..ନ
{0xB2A, 0xB30, SC_Oriya, GC_Lo, NULL}, // ପ..ର
{0xB32, 0xB33, SC_Oriya, GC_Lo, NULL}, // ଲ..ଳ
{0xB35, 0xB39, SC_Oriya, GC_Lo, NULL}, // ଵ..ହ
{0xB3D, 0xB3D, SC_Oriya, GC_Lo, NULL}, // ଽ
{0xB5F, 0xB61, SC_Oriya, GC_Lo, NULL}, // ୟ..ୡ
{0xB71, 0xB71, SC_Oriya, GC_Lo, NULL}, // ୱ
{0xB83, 0xB83, SC_Tamil, GC_Lo, NULL}, // ஃ
{0xB85, 0xB8A, SC_Tamil, GC_Lo, NULL}, // அ..ஊ
{0xB8E, 0xB90, SC_Tamil, GC_Lo, NULL}, // எ..ஐ
{0xB92, 0xB95, SC_Tamil, GC_Lo, NULL}, // ஒ..க
{0xB99, 0xB9A, SC_Tamil, GC_Lo, NULL}, // ங..ச
{0xB9C, 0xB9C, SC_Tamil, GC_Lo, NULL}, // ஜ
{0xB9E, 0xB9F, SC_Tamil, GC_Lo, NULL}, // ஞ..ட
{0xBA3, 0xBA4, SC_Tamil, GC_Lo, NULL}, // ண..த
{0xBA8, 0xBAA, SC_Tamil, GC_Lo, NULL}, // ந..ப
{0xBAE, 0xBB9, SC_Tamil, GC_Lo, NULL}, // ம..ஹ
{0xBD0, 0xBD0, SC_Tamil, GC_Lo, NULL}, // ௐ
{0xC05, 0xC0C, SC_Telugu, GC_Lo, NULL}, // అ..ఌ
{0xC0E, 0xC10, SC_Telugu, GC_Lo, NULL}, // ఎ..ఐ
{0xC12, 0xC28, SC_Telugu, GC_Lo, NULL}, // ఒ..న
{0xC2A, 0xC33, SC_Telugu, GC_Lo, NULL}, // ప..ళ
{0xC35, 0xC39, SC_Telugu, GC_Lo, NULL}, // వ..హ
{0xC3D, 0xC3D, SC_Telugu, GC_Lo, NULL}, // ఽ
{0xC5D, 0xC5D, SC_Telugu, GC_Lo, NULL}, // ౝ
{0xC60, 0xC61, SC_Telugu, GC_Lo, NULL}, // ౠ..ౡ
{0xC80, 0xC80, SC_Kannada, GC_Lo, NULL}, // ಀ
{0xC85, 0xC8C, SC_Kannada, GC_Lo, NULL}, // ಅ..ಌ
{0xC8E, 0xC90, SC_Kannada, GC_Lo, NULL}, // ಎ..ಐ
{0xC92, 0xCA8, SC_Kannada, GC_Lo, NULL}, // ಒ..ನ
{0xCAA, 0xCB3, SC_Kannada, GC_Lo, NULL}, // ಪ..ಳ
{0xCB5, 0xCB9, SC_Kannada, GC_Lo, NULL}, // ವ..ಹ
{0xCBD, 0xCBD, SC_Kannada, GC_Lo, NULL}, // ಽ
{0xCDD, 0xCDD, SC_Kannada, GC_Lo, NULL}, // ೝ
{0xCE0, 0xCE1, SC_Kannada, GC_Lo, NULL}, // ೠ..ೡ
{0xCF1, 0xCF2, SC_Kannada, GC_Lo, NULL}, // ೱ..ೲ
{0xD05, 0xD0C, SC_Malayalam, GC_Lo, NULL}, // അ..ഌ
{0xD0E, 0xD10, SC_Malayalam, GC_Lo, NULL}, // എ..ഐ
{0xD12, 0xD3A, SC_Malayalam, GC_Lo, NULL}, // ഒ..ഺ
{0xD3D, 0xD3D, SC_Malayalam, GC_Lo, NULL}, // ഽ
{0xD4E, 0xD4E, SC_Malayalam, GC_Lo, NULL}, // ൎ
{0xD54, 0xD56, SC_Malayalam, GC_Lo, NULL}, // ൔ..ൖ
{0xD60, 0xD61, SC_Malayalam, GC_Lo, NULL}, // ൠ..ൡ
{0xD7A, 0xD7F, SC_Malayalam, GC_Lo, NULL}, // ൺ..ൿ
{0xD85, 0xD8E, SC_Sinhala, GC_Lo, NULL}, // අ..ඎ
{0xD91, 0xD96, SC_Sinhala, GC_Lo, NULL}, // එ..ඖ
{0xD9A, 0xDA5, SC_Sinhala, GC_Lo, NULL}, // ක..ඥ
{0xDA7, 0xDB1, SC_Sinhala, GC_Lo, NULL}, // ට..න
{0xDB3, 0xDBB, SC_Sinhala, GC_Lo, NULL}, // ඳ..ර
{0xDBD, 0xDBD, SC_Sinhala, GC_Lo, NULL}, // ල
{0xDC0, 0xDC6, SC_Sinhala, GC_Lo, NULL}, // ව..ෆ
{0xE01, 0xE30, SC_Thai, GC_Lo, NULL}, // ก..ะ
{0xE32, 0xE32, SC_Thai, GC_Lo, NULL}, // า
{0xE40, 0xE46, SC_Thai, GC_L, NULL}, // เ..ๆ
{0xE81, 0xE82, SC_Lao, GC_Lo, NULL}, // ກ..ຂ
{0xE84, 0xE84, SC_Lao, GC_Lo, NULL}, // ຄ
{0xE86, 0xE8A, SC_Lao, GC_Lo, NULL}, // ຆ..ຊ
{0xE8C, 0xEA3, SC_Lao, GC_Lo, NULL}, // ຌ..ຣ
{0xEA5, 0xEA5, SC_Lao, GC_Lo, NULL}, // ລ
{0xEA7, 0xEB0, SC_Lao, GC_Lo, NULL}, // ວ..ະ
{0xEB2, 0xEB2, SC_Lao, GC_Lo, NULL}, // າ
{0xEBD, 0xEBD, SC_Lao, GC_Lo, NULL}, // ຽ
{0xEC0, 0xEC4, SC_Lao, GC_Lo, NULL}, // ເ..ໄ
{0xEC6, 0xEC6, SC_Lao, GC_Lm, NULL}, // ໆ
{0xEDE, 0xEDF, SC_Lao, GC_Lo, NULL}, // ໞ..ໟ
{0xF00, 0xF00, SC_Tibetan, GC_Lo, NULL}, // ༀ
{0xF40, 0xF42, SC_Tibetan, GC_Lo, NULL}, // ཀ..ག
{0xF44, 0xF47, SC_Tibetan, GC_Lo, NULL}, // ང..ཇ
{0xF49, 0xF4C, SC_Tibetan, GC_Lo, NULL}, // ཉ..ཌ
{0xF4E, 0xF51, SC_Tibetan, GC_Lo, NULL}, // ཎ..ད
{0xF53, 0xF56, SC_Tibetan, GC_Lo, NULL}, // ན..བ
{0xF58, 0xF5B, SC_Tibetan, GC_Lo, NULL}, // མ..ཛ
{0xF5D, 0xF68, SC_Tibetan, GC_Lo, NULL}, // ཝ..ཨ
{0xF6A, 0xF6C, SC_Tibetan, GC_Lo, NULL}, // ཪ..ཬ
{0xF88, 0xF8C, SC_Tibetan, GC_Lo, NULL}, // ྈ..ྌ
{0x1000, 0x102A, SC_Myanmar, GC_Lo, NULL}, // က..ဪ
{0x103F, 0x103F, SC_Myanmar, GC_Lo, NULL}, // ဿ
{0x1050, 0x1055, SC_Myanmar, GC_Lo, NULL}, // ၐ..ၕ
{0x105A, 0x105D, SC_Myanmar, GC_Lo, NULL}, // ၚ..ၝ
{0x1061, 0x1061, SC_Myanmar, GC_Lo, NULL}, // ၡ
{0x1065, 0x1066, SC_Myanmar, GC_Lo, NULL}, // ၥ..ၦ
{0x106E, 0x1070, SC_Myanmar, GC_Lo, NULL}, // ၮ..ၰ
{0x1075, 0x1081, SC_Myanmar, GC_Lo, NULL}, // ၵ..ႁ
{0x108E, 0x108E, SC_Myanmar, GC_Lo, NULL}, // ႎ
{0x10C7, 0x10C7, SC_Georgian, GC_Lu, NULL}, // Ⴧ
{0x10CD, 0x10CD, SC_Georgian, GC_Lu, NULL}, // Ⴭ
{0x10D0, 0x10F0, SC_Georgian, GC_Ll, NULL}, // ა..ჰ
{0x10F7, 0x10FA, SC_Georgian, GC_Ll, NULL}, // ჷ..ჺ
{0x10FD, 0x10FF, SC_Georgian, GC_Ll, NULL}, // ჽ..ჿ
{0x1200, 0x1248, SC_Ethiopic, GC_Lo, NULL}, // ሀ..ቈ
{0x124A, 0x124D, SC_Ethiopic, GC_Lo, NULL}, // ቊ..ቍ
{0x1250, 0x1256, SC_Ethiopic, GC_Lo, NULL}, // ቐ..ቖ
{0x1258, 0x1258, SC_Ethiopic, GC_Lo, NULL}, // ቘ
{0x125A, 0x125D, SC_Ethiopic, GC_Lo, NULL}, // ቚ..ቝ
{0x1260, 0x1288, SC_Ethiopic, GC_Lo, NULL}, // በ..ኈ
{0x128A, 0x128D, SC_Ethiopic, GC_Lo, NULL}, // ኊ..ኍ
{0x1290, 0x12B0, SC_Ethiopic, GC_Lo, NULL}, // ነ..ኰ
{0x12B2, 0x12B5, SC_Ethiopic, GC_Lo, NULL}, // ኲ..ኵ
{0x12B8, 0x12BE, SC_Ethiopic, GC_Lo, NULL}, // ኸ..ኾ
{0x12C0, 0x12C0, SC_Ethiopic, GC_Lo, NULL}, // ዀ
{0x12C2, 0x12C5, SC_Ethiopic, GC_Lo, NULL}, // ዂ..ዅ
{0x12C8, 0x12D6, SC_Ethiopic, GC_Lo, NULL}, // ወ..ዖ
{0x12D8, 0x1310, SC_Ethiopic, GC_Lo, NULL}, // ዘ..ጐ
{0x1312, 0x1315, SC_Ethiopic, GC_Lo, NULL}, // ጒ..ጕ
{0x1318, 0x135A, SC_Ethiopic, GC_Lo, NULL}, // ጘ..ፚ
{0x1380, 0x138F, SC_Ethiopic, GC_Lo, NULL}, // ᎀ..ᎏ
{0x1780, 0x17A2, SC_Khmer, GC_Lo, NULL}, // ក..អ
{0x17A5, 0x17A7, SC_Khmer, GC_Lo, NULL}, // ឥ..ឧ
{0x17A9, 0x17B3, SC_Khmer, GC_Lo, NULL}, // ឩ..ឳ
{0x17D7, 0x17D7, SC_Khmer, GC_Lm, NULL}, // ៗ
{0x17DC, 0x17DC, SC_Khmer, GC_Lo, NULL}, // ៜ
{0x1C90, 0x1CBA, SC_Georgian, GC_Lu, NULL}, // Ა..Ჺ
{0x1CBD, 0x1CBF, SC_Georgian, GC_Lu, NULL}, // Ჽ..Ჿ
{0x1D00, 0x1D25, SC_Latin, GC_Ll, NULL}, // ᴀ..ᴥ
{0x1D27, 0x1D2A, SC_Greek, GC_Ll, NULL}, // ᴧ..ᴪ
{0x1D2F, 0x1D2F, SC_Latin, GC_Lm, NULL}, // ᴯ
{0x1D3B, 0x1D3B, SC_Latin, GC_Lm, NULL}, // ᴻ
{0x1D4E, 0x1D4E, SC_Latin, GC_Lm, NULL}, // ᵎ
{0x1D6B, 0x1D77, SC_Latin, GC_Ll, NULL}, // ᵫ..ᵷ
{0x1D79, 0x1D9A, SC_Latin, GC_Ll, NULL}, // ᵹ..ᶚ
{0x1E00, 0x1E99, SC_Latin, GC_L, NULL}, // Ḁ..ẙ
{0x1E9C, 0x1EFF, SC_Latin, GC_L, NULL}, // ẜ..ỿ
{0x1F01, 0x1F15, SC_Greek, GC_L, NULL}, // ἁ..ἕ
{0x1F18, 0x1F1D, SC_Greek, GC_Lu, NULL}, // Ἐ..Ἕ
{0x1F20, 0x1F45, SC_Greek, GC_L, NULL}, // ἠ..ὅ
{0x1F48, 0x1F4D, SC_Greek, GC_Lu, NULL}, // Ὀ..Ὅ
{0x1F50, 0x1F57, SC_Greek, GC_Ll, NULL}, // ὐ..ὗ
{0x1F59, 0x1F59, SC_Greek, GC_Lu, NULL}, // Ὑ
{0x1F5B, 0x1F5B, SC_Greek, GC_Lu, NULL}, // Ὓ
{0x1F5D, 0x1F5D, SC_Greek, GC_Lu, NULL}, // Ὕ
{0x1F5F, 0x1F70, SC_Greek, GC_L, NULL}, // Ὗ..ὰ
{0x1F72, 0x1F72, SC_Greek, GC_Ll, NULL}, // ὲ
{0x1F74, 0x1F74, SC_Greek, GC_Ll, NULL}, // ὴ
{0x1F76, 0x1F76, SC_Greek, GC_Ll, NULL}, // ὶ
{0x1F78, 0x1F78, SC_Greek, GC_Ll, NULL}, // ὸ
{0x1F7A, 0x1F7A, SC_Greek, GC_Ll, NULL}, // ὺ
{0x1F7C, 0x1F7C, SC_Greek, GC_Ll, NULL}, // ὼ
{0x1F80, 0x1FB4, SC_Greek, GC_L, NULL}, // ᾀ..ᾴ
{0x1FB6, 0x1FBA, SC_Greek, GC_L, NULL}, // ᾶ..Ὰ
{0x1FBC, 0x1FBC, SC_Greek, GC_Lt, NULL}, // ᾼ
{0x1FC2, 0x1FC4, SC_Greek, GC_Ll, NULL}, // ῂ..ῄ
{0x1FC6, 0x1FC8, SC_Greek, GC_L, NULL}, // ῆ..Ὲ
{0x1FCA, 0x1FCA, SC_Greek, GC_Lu, NULL}, // Ὴ
{0x1FCC, 0x1FCC, SC_Greek, GC_Lt, NULL}, // ῌ
{0x1FD0, 0x1FD2, SC_Greek, GC_Ll, NULL}, // ῐ..ῒ
{0x1FD6, 0x1FDA, SC_Greek, GC_L, NULL}, // ῖ..Ὶ
{0x1FE0, 0x1FE2, SC_Greek, GC_Ll, NULL}, // ῠ..ῢ
{0x1FE4, 0x1FEA, SC_Greek, GC_L, NULL}, // ῤ..Ὺ
{0x1FEC, 0x1FEC, SC_Greek, GC_Lu, NULL}, // Ῥ
{0x1FF2, 0x1FF4, SC_Greek, GC_Ll, NULL}, // ῲ..ῴ
{0x1FF6, 0x1FF8, SC_Greek, GC_L, NULL}, // ῶ..Ὸ
{0x1FFA, 0x1FFA, SC_Greek, GC_Lu, NULL}, // Ὼ
{0x1FFC, 0x1FFC, SC_Greek, GC_Lt, NULL}, // ῼ
{0x2118, 0x2118, SC_Common, GC_Sm, NULL}, // ℘
{0x212E, 0x212E, SC_Common, GC_So, NULL}, // ℮
{0x2C60, 0x2C67, SC_Latin, GC_L, NULL}, // Ⱡ..Ⱨ
{0x2C77, 0x2C7B, SC_Latin, GC_Ll, NULL}, // ⱷ..ⱻ
{0x2D27, 0x2D27, SC_Georgian, GC_Ll, NULL}, // ⴧ
{0x2D2D, 0x2D2D, SC_Georgian, GC_Ll, NULL}, // ⴭ
{0x2D80, 0x2D96, SC_Ethiopic, GC_Lo, NULL}, // ⶀ..ⶖ
{0x2DA0, 0x2DA6, SC_Ethiopic, GC_Lo, NULL}, // ⶠ..ⶦ
{0x2DA8, 0x2DAE, SC_Ethiopic, GC_Lo, NULL}, // ⶨ..ⶮ
{0x2DB0, 0x2DB6, SC_Ethiopic, GC_Lo, NULL}, // ⶰ..ⶶ
{0x2DB8, 0x2DBE, SC_Ethiopic, GC_Lo, NULL}, // ⶸ..ⶾ
{0x2DC0, 0x2DC6, SC_Ethiopic, GC_Lo, NULL}, // ⷀ..ⷆ
{0x2DC8, 0x2DCE, SC_Ethiopic, GC_Lo, NULL}, // ⷈ..ⷎ
{0x2DD0, 0x2DD6, SC_Ethiopic, GC_Lo, NULL}, // ⷐ..ⷖ
{0x2DD8, 0x2DDE, SC_Ethiopic, GC_Lo, NULL}, // ⷘ..ⷞ
{0x3005, 0x3005, SC_Han, GC_Lm, NULL}, // 々
{0x3007, 0x3007, SC_Han, GC_Nl, NULL}, // 〇
{0x3021, 0x3029, SC_Han, GC_Nl, NULL}, // 〡..〩
{0x3031, 0x3035, SC_Common, GC_Lm, {SC_Hiragana,SC_Katakana,0}}, // 〱..〵
{0x303B, 0x303B, SC_Han, GC_Lm, NULL}, // 〻
{0x3041, 0x3096, SC_Hiragana, GC_Lo, NULL}, // ぁ..ゖ
{0x309D, 0x309E, SC_Hiragana, GC_Lm, NULL}, // ゝ..ゞ
{0x30A1, 0x30FA, SC_Katakana, GC_Lo, NULL}, // ァ..ヺ
{0x30FC, 0x30FC, SC_Common, GC_Lm, {SC_Hiragana,SC_Katakana,0}}, // ー
{0x30FE, 0x30FE, SC_Katakana, GC_Lm, NULL}, // ヾ
{0x3105, 0x312D, SC_Bopomofo, GC_Lo, NULL}, // ㄅ..ㄭ
{0x312F, 0x312F, SC_Bopomofo, GC_Lo, NULL}, // ㄯ
{0x31A0, 0x31BF, SC_Bopomofo, GC_Lo, NULL}, // ㆠ..ㆿ
{0x3400, 0x4DBF, SC_Han, GC_Lo, NULL}, // 㐀..䶿
{0x4E00, 0x9FFF, SC_Han, GC_Lo, NULL}, // 一..鿿
{0xA67F, 0xA67F, SC_Cyrillic, GC_Lm, NULL}, // ꙿ
{0xA717, 0xA71F, SC_Common, GC_Lm, NULL}, // ꜗ..ꜟ
{0xA788, 0xA788, SC_Common, GC_Lm, NULL}, // ꞈ
{0xA78D, 0xA78E, SC_Latin, GC_L, NULL}, // Ɥ..ꞎ
{0xA792, 0xA793, SC_Latin, GC_L, NULL}, // Ꞓ..ꞓ
{0xA7AA, 0xA7AA, SC_Latin, GC_Lu, NULL}, // Ɦ
{0xA7AE, 0xA7AF, SC_Latin, GC_L, NULL}, // Ɪ..ꞯ
{0xA7BA, 0xA7CA, SC_Latin, GC_L, NULL}, // Ꞻ..ꟊ
{0xA7D0, 0xA7D1, SC_Latin, GC_L, NULL}, // Ꟑ..ꟑ
{0xA7D3, 0xA7D3, SC_Latin, GC_Ll, NULL}, // ꟓ
{0xA7D5, 0xA7D9, SC_Latin, GC_L, NULL}, // ꟕ..ꟙ
{0xA7FA, 0xA7FA, SC_Latin, GC_Ll, NULL}, // ꟺ
{0xA9E7, 0xA9EF, SC_Myanmar, GC_Lo, NULL}, // ꧧ..ꧯ
{0xA9FA, 0xA9FE, SC_Myanmar, GC_Lo, NULL}, // ꧺ..ꧾ
{0xAA60, 0xAA76, SC_Myanmar, GC_L, NULL}, // ꩠ..ꩶ
{0xAA7A, 0xAA7A, SC_Myanmar, GC_Lo, NULL}, // ꩺ
{0xAA7E, 0xAA7F, SC_Myanmar, GC_Lo, NULL}, // ꩾ..ꩿ
{0xAB01, 0xAB06, SC_Ethiopic, GC_Lo, NULL}, // ꬁ..ꬆ
{0xAB09, 0xAB0E, SC_Ethiopic, GC_Lo, NULL}, // ꬉ..ꬎ
{0xAB11, 0xAB16, SC_Ethiopic, GC_Lo, NULL}, // ꬑ..ꬖ
{0xAB20, 0xAB26, SC_Ethiopic, GC_Lo, NULL}, // ꬠ..ꬦ
{0xAB28, 0xAB2E, SC_Ethiopic, GC_Lo, NULL}, // ꬨ..ꬮ
{0xAB66, 0xAB68, SC_Latin, GC_Ll, NULL}, // ꭦ..ꭨ
{0xFA0E, 0xFA0F, SC_Han, GC_Lo, NULL}, // 﨎..﨏
{0xFA11, 0xFA11, SC_Han, GC_Lo, NULL}, // 﨑
{0xFA13, 0xFA14, SC_Han, GC_Lo, NULL}, // 﨓..﨔
{0xFA1F, 0xFA1F, SC_Han, GC_Lo, NULL}, // 﨟
{0xFA21, 0xFA21, SC_Han, GC_Lo, NULL}, // 﨡
{0xFA23, 0xFA24, SC_Han, GC_Lo, NULL}, // 﨣..﨤
{0xFA27, 0xFA29, SC_Han, GC_Lo, NULL}, // 﨧..﨩
{0x1B11F, 0x1B11F, SC_Hiragana, GC_Lo, NULL}, // 𛄟
{0x1B121, 0x1B122, SC_Katakana, GC_Lo, NULL}, // 𛄡..𛄢
{0x1B132, 0x1B132, SC_Hiragana, GC_Lo, NULL}, // 𛄲
{0x1B150, 0x1B152, SC_Hiragana, GC_Lo, NULL}, // 𛅐..𛅒
{0x1B155, 0x1B155, SC_Katakana, GC_Lo, NULL}, // 𛅕
{0x1B164, 0x1B167, SC_Katakana, GC_Lo, NULL}, // 𛅤..𛅧
{0x1DF00, 0x1DF1E, SC_Latin, GC_L, NULL}, // 𝼀..𝼞
{0x1DF25, 0x1DF2A, SC_Latin, GC_Ll, NULL}, // 𝼥..𝼪
{0x1E7E0, 0x1E7E6, SC_Ethiopic, GC_Lo, NULL}, // 𞟠..𞟦
{0x1E7E8, 0x1E7EB, SC_Ethiopic, GC_Lo, NULL}, // 𞟨..𞟫
{0x1E7ED, 0x1E7EE, SC_Ethiopic, GC_Lo, NULL}, // 𞟭..𞟮
{0x1E7F0, 0x1E7FE, SC_Ethiopic, GC_Lo, NULL}, // 𞟰..𞟾
{0x20000, 0x2A6DF, SC_Han, GC_Lo, NULL}, // 𠀀..𪛟
{0x2A700, 0x2B739, SC_Han, GC_Lo, NULL}, // 𪜀..𫜹
{0x2B740, 0x2B81D, SC_Han, GC_Lo, NULL}, // 𫝀..𫠝
{0x2B820, 0x2CEA1, SC_Han, GC_Lo, NULL}, // 𫠠..𬺡
{0x2CEB0, 0x2EBE0, SC_Han, GC_Lo, NULL}, // 𬺰..𮯠
{0x30000, 0x3134A, SC_Han, GC_Lo, NULL}, // 𰀀..𱍊
{0x31350, 0x323AF, SC_Han, GC_Lo, NULL}, // 𱍐..𲎯
};
// 245 ranges, 94 singles, 100181 codepointsCreated with mkc26 from libu8ident. The SCX is modelled as if your compiler would allow static initialization of strings as {char,…,0}.
// Filtering allowed scripts, XID_Continue,!XID_Start, safe IDTypes, NFC,
// and !MARK. Split on GC and SCX
const struct sc safec_cont_list[21] = {
{0x30, 0x39, SC_Common, GC_Nd, NULL}, // 0..9
{0x5F, 0x5F, SC_Common, GC_Pc, NULL}, // _
{0xB7, 0xB7, SC_Common, GC_Po, NULL}, // ·
{0x660, 0x669, SC_Arabic, GC_Nd, {SC_Arabic,SC_Thaana,SC_Yezidi,0}}, // ٠..٩
{0x6F0, 0x6F9, SC_Arabic, GC_Nd, NULL}, // ۰..۹
{0x966, 0x96F, SC_Devanagari, GC_Nd, {SC_Devanagari,SC_Dogra,SC_Kaithi,
SC_Mahajani,0}}, // ०..९
{0x9E6, 0x9EF, SC_Bengali, GC_Nd, {SC_Bengali,SC_Chakma,SC_Syloti_Nagri,0}},
{0xA66, 0xA6F, SC_Gurmukhi, GC_Nd, {SC_Gurmukhi,SC_Multani,0}}, // ੦..੯
{0xAE6, 0xAEF, SC_Gujarati, GC_Nd, {SC_Gujarati,SC_Khojki,0}, // ૦..૯
{0xB66, 0xB6F, SC_Oriya, GC_Nd, NULL}, // ୦..୯
{0xBE6, 0xBEF, SC_Tamil, GC_Nd, {SC_Grantha,SC_Tamil,0}}, // ௦..௯
{0xC66, 0xC6F, SC_Telugu, GC_Nd, NULL}, // ౦..౯
{0xCE6, 0xCEF, SC_Kannada, GC_Nd, {SC_Kannada,SC_Nandinagari,0}}, // ೦..೯
{0xD66, 0xD6F, SC_Malayalam, GC_Nd, NULL}, // ൦..൯
{0xE50, 0xE59, SC_Thai, GC_Nd, NULL}, // ๐..๙
{0xED0, 0xED9, SC_Lao, GC_Nd, NULL}, // ໐..໙
{0xF20, 0xF29, SC_Tibetan, GC_Nd, NULL}, // ༠..༩
{0x1040, 0x1049, SC_Myanmar, GC_Nd, {SC_Chakma,SC_Myanmar,SC_Tai_Le,0}},
{0x1090, 0x1099, SC_Myanmar, GC_Nd, NULL}, // ႐..႙
{0x17E0, 0x17E9, SC_Khmer, GC_Nd, NULL}, // ០..៩
{0x203F, 0x2040, SC_Common, GC_Pc, NULL}, // ‿..⁀
{0xA9F0, 0xA9F9, SC_Myanmar, GC_Nd, NULL}, // ꧰..꧹
};
// 20 ranges, 1 singles, 172 codepointsNeeded for the combining marks special-cases in Section 8.3 8.3 Combining marks script run detection for spoofing, which is needed for TR39#5.4 and TR31#2.2 checks.
Practically this list is not needed, as only the 4 Japanese PROLONGED SOUND MARKs need to be checked. All other Lm Modifier Letters are freestanding base characters, which can be combined with any other letter.
69 matches for “XID_Continue # Lm” in buffer: DerivedCoreProperties.txt
02B0..02C1 ; XID_Continue # Lm [18] MODIFIER LETTER SMALL H..
MODIFIER LETTER REVERSED GLOTTAL STOP
02C6..02D1 ; XID_Continue # Lm [12] MODIFIER LETTER CIRCUMFLEX ACCENT..
MODIFIER LETTER HALF TRIANGULAR COLON
02E0..02E4 ; XID_Continue # Lm [5] MODIFIER LETTER SMALL GAMMA..
MODIFIER LETTER SMALL REVERSED GLOTTAL STOP
02EC ; XID_Continue # Lm MODIFIER LETTER VOICING
02EE ; XID_Continue # Lm MODIFIER LETTER DOUBLE APOSTROPHE
0374 ; XID_Continue # Lm GREEK NUMERAL SIGN
0559 ; XID_Continue # Lm ARMENIAN MODIFIER LETTER LEFT HALF RING
0640 ; XID_Continue # Lm ARABIC TATWEEL
06E5..06E6 ; XID_Continue # Lm [2] ARABIC SMALL WAW..
ARABIC SMALL YEH
07F4..07F5 ; XID_Continue # Lm [2] NKO HIGH TONE APOSTROPHE..
NKO LOW TONE APOSTROPHE
07FA ; XID_Continue # Lm NKO LAJANYALAN
081A ; XID_Continue # Lm SAMARITAN MODIFIER LETTER EPENTHETIC YUT
0824 ; XID_Continue # Lm SAMARITAN MODIFIER LETTER SHORT A
0828 ; XID_Continue # Lm SAMARITAN MODIFIER LETTER I
08C9 ; XID_Continue # Lm ARABIC SMALL FARSI YEH
0971 ; XID_Continue # Lm DEVANAGARI SIGN HIGH SPACING DOT
0E46 ; XID_Continue # Lm THAI CHARACTER MAIYAMOK
0EC6 ; XID_Continue # Lm LAO KO LA
10FC ; XID_Continue # Lm MODIFIER LETTER GEORGIAN NAR
17D7 ; XID_Continue # Lm KHMER SIGN LEK TOO
1843 ; XID_Continue # Lm MONGOLIAN LETTER TODO LONG VOWEL SIGN
1AA7 ; XID_Continue # Lm TAI THAM SIGN MAI YAMOK
1C78..1C7D ; XID_Continue # Lm [6] OL CHIKI MU TTUDDAG..OL CHIKI AHAD
1D2C..1D6A ; XID_Continue # Lm [63] MODIFIER LETTER CAPITAL A..
GREEK SUBSCRIPT SMALL LETTER CHI
1D78 ; XID_Continue # Lm MODIFIER LETTER CYRILLIC EN
1D9B..1DBF ; XID_Continue # Lm [37] MODIFIER LETTER SMALL TURNED ALPHA..
MODIFIER LETTER SMALL THETA
2071 ; XID_Continue # Lm SUPERSCRIPT LATIN SMALL LETTER I
207F ; XID_Continue # Lm SUPERSCRIPT LATIN SMALL LETTER N
2090..209C ; XID_Continue # Lm [13] LATIN SUBSCRIPT SMALL LETTER A..
LATIN SUBSCRIPT SMALL LETTER T
2C7C..2C7D ; XID_Continue # Lm [2] LATIN SUBSCRIPT SMALL LETTER J..
MODIFIER LETTER CAPITAL V
2D6F ; XID_Continue # Lm TIFINAGH MODIFIER LETTER LABIALIZATION MARK
3005 ; XID_Continue # Lm IDEOGRAPHIC ITERATION MARK
3031..3035 ; XID_Continue # Lm [5] VERTICAL KANA REPEAT MARK..
VERTICAL KANA REPEAT MARK LOWER HALF
303B ; XID_Continue # Lm VERTICAL IDEOGRAPHIC ITERATION MARK
309D..309E ; XID_Continue # Lm [2] HIRAGANA ITERATION MARK..
HIRAGANA VOICED ITERATION MARK
30FC..30FE ; XID_Continue # Lm [3] KATAKANA-HIRAGANA PROLONGED SOUND MARK..
KATAKANA VOICED ITERATION MARK
A015 ; XID_Continue # Lm YI SYLLABLE WU
A4F8..A4FD ; XID_Continue # Lm [6] LISU LETTER TONE MYA TI..
LISU LETTER TONE MYA JEU
A60C ; XID_Continue # Lm VAI SYLLABLE LENGTHENER
A67F ; XID_Continue # Lm CYRILLIC PAYEROK
A69C..A69D ; XID_Continue # Lm [2] MODIFIER LETTER CYRILLIC HARD SIGN..
MODIFIER LETTER CYRILLIC SOFT SIGN
A717..A71F ; XID_Continue # Lm [9] MODIFIER LETTER DOT VERTICAL BAR..
LOW INVERTED EXCLAMATION MARK
A770 ; XID_Continue # Lm MODIFIER LETTER US
A788 ; XID_Continue # Lm MODIFIER LETTER LOW CIRCUMFLEX ACCENT
A7F2..A7F4 ; XID_Continue # Lm [3] MODIFIER LETTER CAPITAL C..
MODIFIER LETTER CAPITAL Q
A7F8..A7F9 ; XID_Continue # Lm [2] MODIFIER LETTER CAPITAL H WITH STROKE..
MODIFIER LETTER SMALL LIGATURE OE
A9CF ; XID_Continue # Lm JAVANESE PANGRANGKEP
A9E6 ; XID_Continue # Lm MYANMAR MODIFIER LETTER SHAN REDUPLICATION
AA70 ; XID_Continue # Lm MYANMAR MODIFIER LETTER KHAMTI REDUPLICATION
AADD ; XID_Continue # Lm TAI VIET SYMBOL SAM
AAF3..AAF4 ; XID_Continue # Lm [2] MEETEI MAYEK SYLLABLE REPETITION MARK..
MEETEI MAYEK WORD REPETITION MARK
AB5C..AB5F ; XID_Continue # Lm [4] MODIFIER LETTER SMALL HENG..
MODIFIER LETTER SMALL U WITH LEFT HOOK
AB69 ; XID_Continue # Lm MODIFIER LETTER SMALL TURNED W
FF70 ; XID_Continue # Lm HALFWIDTH KATA-HIRA PROLONGED SOUND MARK
FF9E..FF9F ; XID_Continue # Lm [2] HALFWIDTH KATAKANA VOICED SOUND MARK..
SEMI-VOICED SOUND MARK
10780..10785 ; XID_Continue # Lm [6] MODIFIER LETTER SMALL CAPITAL AA..
MODIFIER LETTER SMALL B WITH HOOK
10787..107B0 ; XID_Continue # Lm [42] MODIFIER LETTER SMALL DZ DIGRAPH..
MODIFIER LETTER SMALL V WITH RIGHT HOOK
107B2..107BA ; XID_Continue # Lm [9] MODIFIER LETTER SMALL CAPITAL Y..
MODIFIER LETTER SMALL S WITH CURL
16B40..16B43 ; XID_Continue # Lm [4] PAHAWH HMONG SIGN VOS SEEV..
PAHAWH HMONG SIGN IB YAM
16F93..16F9F ; XID_Continue # Lm [13] MIAO LETTER TONE-2..
MIAO LETTER REFORMED TONE-8
16FE0..16FE1 ; XID_Continue # Lm [2] TANGUT ITERATION MARK..
NUSHU ITERATION MARK
16FE3 ; XID_Continue # Lm OLD CHINESE ITERATION MARK
1AFF0..1AFF3 ; XID_Continue # Lm [4] KATAKANA LETTER MINNAN TONE-2..
KATAKANA LETTER MINNAN TONE-5
1AFF5..1AFFB ; XID_Continue # Lm [7] KATAKANA LETTER MINNAN TONE-7..
KATAKANA LETTER MINNAN NASALIZED TONE-5
1AFFD..1AFFE ; XID_Continue # Lm [2] KATAKANA LETTER MINNAN NASALIZED TONE-7..
KATAKANA LETTER MINNAN NASALIZED TONE-8
1E030..1E06D ; XID_Continue # Lm [62] MODIFIER LETTER CYRILLIC SMALL A..
MODIFIER LETTER CYRILLIC SMALL STRAIGHT U
WITH STROKE
1E137..1E13D ; XID_Continue # Lm [7] NYIAKENG PUACHUE HMONG SIGN FOR PERSON..
NYIAKENG PUACHUE HMONG SYLLABLE LENGTHENER
1E4EB ; XID_Continue # Lm NAG MUNDARI SIGN OJOD
1E94B ; XID_Continue # Lm ADLAM NASALIZATION MARKNeeded for the combining marks checks in Section 8.3 8.3 Combining marks script run detection for spoofing.
528 matches for “XID_Continue # M” in buffer: DerivedCoreProperties.txt
0300..036F ; XID_Continue # Mn [112] COMBINING GRAVE ACCENT..
COMBINING LATIN SMALL LETTER X
0483..0487 ; XID_Continue # Mn [5] COMBINING CYRILLIC TITLO..
COMBINING CYRILLIC POKRYTIE
0591..05BD ; XID_Continue # Mn [45] HEBREW ACCENT ETNAHTA..
HEBREW POINT METEG
05BF ; XID_Continue # Mn HEBREW POINT RAFE
05C1..05C2 ; XID_Continue # Mn [2] HEBREW POINT SHIN DOT..
HEBREW POINT SIN DOT
05C4..05C5 ; XID_Continue # Mn [2] HEBREW MARK UPPER DOT..
HEBREW MARK LOWER DOT
05C7 ; XID_Continue # Mn HEBREW POINT QAMATS QATAN
0610..061A ; XID_Continue # Mn [11] ARABIC SIGN SALLALLAHOU ALAYHE WASSALLAM..
ARABIC SMALL KASRA
064B..065F ; XID_Continue # Mn [21] ARABIC FATHATAN..
ARABIC WAVY HAMZA BELOW
0670 ; XID_Continue # Mn ARABIC LETTER SUPERSCRIPT ALEF
06D6..06DC ; XID_Continue # Mn [7] ARABIC SMALL HIGH LIGATURE SAD WITH LAM
WITH ALEF MAKSURA..HIGH SEEN
06DF..06E4 ; XID_Continue # Mn [6] ARABIC SMALL HIGH ROUNDED ZERO..MADDA
06E7..06E8 ; XID_Continue # Mn [2] ARABIC SMALL HIGH YEH..NOON
06EA..06ED ; XID_Continue # Mn [4] ARABIC EMPTY CENTRE LOW STOP..MEEM
0711 ; XID_Continue # Mn SYRIAC LETTER SUPERSCRIPT ALAPH
0730..074A ; XID_Continue # Mn [27] SYRIAC PTHAHA ABOVE..BARREKH
07A6..07B0 ; XID_Continue # Mn [11] THAANA ABAFILI..THAANA SUKUN
07EB..07F3 ; XID_Continue # Mn [9] NKO COMBINING SHORT HIGH TONE..
NKO COMBINING DOUBLE DOT ABOVE
07FD ; XID_Continue # Mn NKO DANTAYALAN
0816..0819 ; XID_Continue # Mn [4] SAMARITAN MARK IN..
SAMARITAN MARK DAGESH
081B..0823 ; XID_Continue # Mn [9] SAMARITAN MARK EPENTHETIC YUT..
SAMARITAN VOWEL SIGN A
0825..0827 ; XID_Continue # Mn [3] SAMARITAN VOWEL SIGN SHORT A..SIGN U
0829..082D ; XID_Continue # Mn [5] SAMARITAN VOWEL SIGN LONG I..
SAMARITAN MARK NEQUDAA
0859..085B ; XID_Continue # Mn [3] MANDAIC AFFRICATION MARK..
MANDAIC GEMINATION MARK
0898..089F ; XID_Continue # Mn [8] ARABIC SMALL HIGH WORD AL-JUZ..
ARABIC HALF MADDA OVER MADDA
08CA..08E1 ; XID_Continue # Mn [24] ARABIC SMALL HIGH FARSI YEH..
ARABIC SMALL HIGH SIGN SAFHA
08E3..0902 ; XID_Continue # Mn [32] ARABIC TURNED DAMMA BELOW..
DEVANAGARI SIGN ANUSVARA
0903 ; XID_Continue # Mc DEVANAGARI SIGN VISARGA
093A ; XID_Continue # Mn DEVANAGARI VOWEL SIGN OE
093B ; XID_Continue # Mc DEVANAGARI VOWEL SIGN OOE
093C ; XID_Continue # Mn DEVANAGARI SIGN NUKTA
093E..0940 ; XID_Continue # Mc [3] DEVANAGARI VOWEL SIGN AA..II
0941..0948 ; XID_Continue # Mn [8] DEVANAGARI VOWEL SIGN U..AI
0949..094C ; XID_Continue # Mc [4] DEVANAGARI VOWEL SIGN CANDRA O..AU
094D ; XID_Continue # Mn DEVANAGARI SIGN VIRAMA
094E..094F ; XID_Continue # Mc [2] DEVANAGARI VOWEL SIGN PRISHTHAMATRA E..AW
0951..0957 ; XID_Continue # Mn [7] DEVANAGARI STRESS SIGN UDATTA..
DEVANAGARI VOWEL SIGN UUE
0962..0963 ; XID_Continue # Mn [2] DEVANAGARI VOWEL SIGN VOCALIC L..LL
0981 ; XID_Continue # Mn BENGALI SIGN CANDRABINDU
0982..0983 ; XID_Continue # Mc [2] BENGALI SIGN ANUSVARA..VISARGA
09BC ; XID_Continue # Mn BENGALI SIGN NUKTA
09BE..09C0 ; XID_Continue # Mc [3] BENGALI VOWEL SIGN AA..II
09C1..09C4 ; XID_Continue # Mn [4] BENGALI VOWEL SIGN U..VOCALIC RR
09C7..09C8 ; XID_Continue # Mc [2] BENGALI VOWEL SIGN E..AI
09CB..09CC ; XID_Continue # Mc [2] BENGALI VOWEL SIGN O..AU
09CD ; XID_Continue # Mn BENGALI SIGN VIRAMA
09D7 ; XID_Continue # Mc BENGALI AU LENGTH MARK
09E2..09E3 ; XID_Continue # Mn [2] BENGALI VOWEL SIGN VOCALIC L..LL
09FE ; XID_Continue # Mn BENGALI SANDHI MARK
0A01..0A02 ; XID_Continue # Mn [2] GURMUKHI SIGN ADAK BINDI..BINDI
0A03 ; XID_Continue # Mc GURMUKHI SIGN VISARGA
0A3C ; XID_Continue # Mn GURMUKHI SIGN NUKTA
0A3E..0A40 ; XID_Continue # Mc [3] GURMUKHI VOWEL SIGN AA..II
0A41..0A42 ; XID_Continue # Mn [2] GURMUKHI VOWEL SIGN U..UU
0A47..0A48 ; XID_Continue # Mn [2] GURMUKHI VOWEL SIGN EE..AI
0A4B..0A4D ; XID_Continue # Mn [3] GURMUKHI VOWEL SIGN OO..
GURMUKHI SIGN VIRAMA
0A51 ; XID_Continue # Mn GURMUKHI SIGN UDAAT
0A70..0A71 ; XID_Continue # Mn [2] GURMUKHI TIPPI..GURMUKHI ADDAK
0A75 ; XID_Continue # Mn GURMUKHI SIGN YAKASH
0A81..0A82 ; XID_Continue # Mn [2] GUJARATI SIGN CANDRABINDU..
GUJARATI SIGN ANUSVARA
0A83 ; XID_Continue # Mc GUJARATI SIGN VISARGA
0ABC ; XID_Continue # Mn GUJARATI SIGN NUKTA
0ABE..0AC0 ; XID_Continue # Mc [3] GUJARATI VOWEL SIGN AA..II
0AC1..0AC5 ; XID_Continue # Mn [5] GUJARATI VOWEL SIGN U..CANDRA E
0AC7..0AC8 ; XID_Continue # Mn [2] GUJARATI VOWEL SIGN E..AI
0AC9 ; XID_Continue # Mc GUJARATI VOWEL SIGN CANDRA O
0ACB..0ACC ; XID_Continue # Mc [2] GUJARATI VOWEL SIGN O..AU
0ACD ; XID_Continue # Mn GUJARATI SIGN VIRAMA
0AE2..0AE3 ; XID_Continue # Mn [2] GUJARATI VOWEL SIGN VOCALIC L..LL
0AFA..0AFF ; XID_Continue # Mn [6] GUJARATI SIGN SUKUN..
GUJARATI SIGN TWO-CIRCLE NUKTA ABOVE
0B01 ; XID_Continue # Mn ORIYA SIGN CANDRABINDU
0B02..0B03 ; XID_Continue # Mc [2] ORIYA SIGN ANUSVARA..
ORIYA SIGN VISARGA
0B3C ; XID_Continue # Mn ORIYA SIGN NUKTA
0B3E ; XID_Continue # Mc ORIYA VOWEL SIGN AA
0B3F ; XID_Continue # Mn ORIYA VOWEL SIGN I
0B40 ; XID_Continue # Mc ORIYA VOWEL SIGN II
0B41..0B44 ; XID_Continue # Mn [4] ORIYA VOWEL SIGN U..VOCALIC RR
0B47..0B48 ; XID_Continue # Mc [2] ORIYA VOWEL SIGN E..AI
0B4B..0B4C ; XID_Continue # Mc [2] ORIYA VOWEL SIGN O..AU
0B4D ; XID_Continue # Mn ORIYA SIGN VIRAMA
0B55..0B56 ; XID_Continue # Mn [2] ORIYA SIGN OVERLINE..
ORIYA AI LENGTH MARK
0B57 ; XID_Continue # Mc ORIYA AU LENGTH MARK
0B62..0B63 ; XID_Continue # Mn [2] ORIYA VOWEL SIGN VOCALIC L..LL
0B82 ; XID_Continue # Mn TAMIL SIGN ANUSVARA
0BBE..0BBF ; XID_Continue # Mc [2] TAMIL VOWEL SIGN AA..I
0BC0 ; XID_Continue # Mn TAMIL VOWEL SIGN II
0BC1..0BC2 ; XID_Continue # Mc [2] TAMIL VOWEL SIGN U..UU
0BC6..0BC8 ; XID_Continue # Mc [3] TAMIL VOWEL SIGN E..AI
0BCA..0BCC ; XID_Continue # Mc [3] TAMIL VOWEL SIGN O..AU
0BCD ; XID_Continue # Mn TAMIL SIGN VIRAMA
0BD7 ; XID_Continue # Mc TAMIL AU LENGTH MARK
0C00 ; XID_Continue # Mn TELUGU SIGN COMBINING CANDRABINDU ABOVE
0C01..0C03 ; XID_Continue # Mc [3] TELUGU SIGN CANDRABINDU..VISARGA
0C04 ; XID_Continue # Mn TELUGU SIGN COMBINING ANUSVARA ABOVE
0C3C ; XID_Continue # Mn TELUGU SIGN NUKTA
0C3E..0C40 ; XID_Continue # Mn [3] TELUGU VOWEL SIGN AA..II
0C41..0C44 ; XID_Continue # Mc [4] TELUGU VOWEL SIGN U..VOCALIC RR
0C46..0C48 ; XID_Continue # Mn [3] TELUGU VOWEL SIGN E..AI
0C4A..0C4D ; XID_Continue # Mn [4] TELUGU VOWEL SIGN O..SIGN VIRAMA
0C55..0C56 ; XID_Continue # Mn [2] TELUGU LENGTH MARK..AI LENGTH MARK
0C62..0C63 ; XID_Continue # Mn [2] TELUGU VOWEL SIGN VOCALIC L..LL
0C81 ; XID_Continue # Mn KANNADA SIGN CANDRABINDU
0C82..0C83 ; XID_Continue # Mc [2] KANNADA SIGN ANUSVARA..VISARGA
0CBC ; XID_Continue # Mn KANNADA SIGN NUKTA
0CBE ; XID_Continue # Mc KANNADA VOWEL SIGN AA
0CBF ; XID_Continue # Mn KANNADA VOWEL SIGN I
0CC0..0CC4 ; XID_Continue # Mc [5] KANNADA VOWEL SIGN II..VOCALIC RR
0CC6 ; XID_Continue # Mn KANNADA VOWEL SIGN E
0CC7..0CC8 ; XID_Continue # Mc [2] KANNADA VOWEL SIGN EE..AI
0CCA..0CCB ; XID_Continue # Mc [2] KANNADA VOWEL SIGN O..OO
0CCC..0CCD ; XID_Continue # Mn [2] KANNADA VOWEL SIGN AU..VIRAMA
0CD5..0CD6 ; XID_Continue # Mc [2] KANNADA LENGTH MARK..AI LENGTH MARK
0CE2..0CE3 ; XID_Continue # Mn [2] KANNADA VOWEL SIGN VOCALIC L..LL
0D00..0D01 ; XID_Continue # Mn [2] MALAYALAM SIGN COMBINING ANUSVARA ABOVE..
CANDRABINDU
0D02..0D03 ; XID_Continue # Mc [2] MALAYALAM SIGN ANUSVARA..VISARGA
0D3B..0D3C ; XID_Continue # Mn [2] MALAYALAM SIGN VERTICAL BAR VIRAMA..
CIRCULAR VIRAMA
0D3E..0D40 ; XID_Continue # Mc [3] MALAYALAM VOWEL SIGN AA..II
0D41..0D44 ; XID_Continue # Mn [4] MALAYALAM VOWEL SIGN U..VOCALIC RR
0D46..0D48 ; XID_Continue # Mc [3] MALAYALAM VOWEL SIGN E..AI
0D4A..0D4C ; XID_Continue # Mc [3] MALAYALAM VOWEL SIGN O..AU
0D4D ; XID_Continue # Mn MALAYALAM SIGN VIRAMA
0D57 ; XID_Continue # Mc MALAYALAM AU LENGTH MARK
0D62..0D63 ; XID_Continue # Mn [2] MALAYALAM VOWEL SIGN VOCALIC L..LL
0D81 ; XID_Continue # Mn SINHALA SIGN CANDRABINDU
0D82..0D83 ; XID_Continue # Mc [2] SINHALA SIGN ANUSVARAYA..VISARGAYA
0DCA ; XID_Continue # Mn SINHALA SIGN AL-LAKUNA
0DCF..0DD1 ; XID_Continue # Mc [3] SINHALA VOWEL SIGN AELA-PILLA..
DIGA AEDA-PILLA
0DD2..0DD4 ; XID_Continue # Mn [3] SINHALA VOWEL SIGN KETTI IS-PILLA..
PAA-PILLA
0DD6 ; XID_Continue # Mn SINHALA VOWEL SIGN DIGA PAA-PILLA
0DD8..0DDF ; XID_Continue # Mc [8] SINHALA VOWEL SIGN GAETTA-PILLA..
GAYANUKITTA
0DF2..0DF3 ; XID_Continue # Mc [2] SINHALA VOWEL SIGN DIGA GAETTA-PILLA..
GAYANUKITTA
0E31 ; XID_Continue # Mn THAI CHARACTER MAI HAN-AKAT
0E34..0E3A ; XID_Continue # Mn [7] THAI CHARACTER SARA I..PHINTHU
0E47..0E4E ; XID_Continue # Mn [8] THAI CHARACTER MAITAIKHU..YAMAKKAN
0EB1 ; XID_Continue # Mn LAO VOWEL SIGN MAI KAN
0EB4..0EBC ; XID_Continue # Mn [9] LAO VOWEL SIGN I..SEMIVOWEL SIGN LO
0EC8..0ECD ; XID_Continue # Mn [6] LAO TONE MAI EK..NIGGAHITA
0F18..0F19 ; XID_Continue # Mn [2] TIBETAN ASTROLOGICAL SIGN -KHYUD PA..
SDONG TSHUGS
0F35 ; XID_Continue # Mn TIBETAN MARK NGAS BZUNG NYI ZLA
0F37 ; XID_Continue # Mn TIBETAN MARK NGAS BZUNG SGOR RTAGS
0F39 ; XID_Continue # Mn TIBETAN MARK TSA -PHRU
0F3E..0F3F ; XID_Continue # Mc [2] TIBETAN SIGN YAR TSHES..MAR TSHES
0F71..0F7E ; XID_Continue # Mn [14] TIBETAN VOWEL SIGN AA..RJES SU NGA RO
0F7F ; XID_Continue # Mc TIBETAN SIGN RNAM BCAD
0F80..0F84 ; XID_Continue # Mn [5] TIBETAN VOWEL SIGN REVERSED I..
MARK HALANTA
0F86..0F87 ; XID_Continue # Mn [2] TIBETAN SIGN LCI RTAGS..YANG RTAGS
0F8D..0F97 ; XID_Continue # Mn [11] TIBETAN SUBJOINED SIGN LCE TSA CAN..
LETTER JA
0F99..0FBC ; XID_Continue # Mn [36] TIBETAN SUBJOINED LETTER NYA..
FIXED-FORM RA
0FC6 ; XID_Continue # Mn TIBETAN SYMBOL PADMA GDAN
102B..102C ; XID_Continue # Mc [2] MYANMAR VOWEL SIGN TALL AA..AA
102D..1030 ; XID_Continue # Mn [4] MYANMAR VOWEL SIGN I..UU
1031 ; XID_Continue # Mc MYANMAR VOWEL SIGN E
1032..1037 ; XID_Continue # Mn [6] MYANMAR VOWEL SIGN AI..DOT BELOW
1038 ; XID_Continue # Mc MYANMAR SIGN VISARGA
1039..103A ; XID_Continue # Mn [2] MYANMAR SIGN VIRAMA..ASAT
103B..103C ; XID_Continue # Mc [2] MYANMAR CONSONANT SIGN MEDIAL YA..RA
103D..103E ; XID_Continue # Mn [2] MYANMAR CONSONANT SIGN MEDIAL WA..HA
1056..1057 ; XID_Continue # Mc [2] MYANMAR VOWEL SIGN VOCALIC R..RR
1058..1059 ; XID_Continue # Mn [2] MYANMAR VOWEL SIGN VOCALIC L..LL
105E..1060 ; XID_Continue # Mn [3] MYANMAR CONSONANT SIGN MON MEDIAL NA..LA
1062..1064 ; XID_Continue # Mc [3] MYANMAR VOWEL SIGN SGAW KAREN EU..KE PHO
1067..106D ; XID_Continue # Mc [7] MYANMAR VOWEL SIGN WESTERN PWO KAREN EU..
TONE-5
1071..1074 ; XID_Continue # Mn [4] MYANMAR VOWEL SIGN GEBA KAREN I..KAYAH EE
1082 ; XID_Continue # Mn MYANMAR CONSONANT SIGN SHAN MEDIAL WA
1083..1084 ; XID_Continue # Mc [2] MYANMAR VOWEL SIGN SHAN AA..E
1085..1086 ; XID_Continue # Mn [2] MYANMAR VOWEL SIGN SHAN E ABOVE..FINAL Y
1087..108C ; XID_Continue # Mc [6] MYANMAR SIGN SHAN TONE-2..TONE-3
108D ; XID_Continue # Mn MYANMAR SIGN SHAN COUNCIL EMPHATIC TONE
108F ; XID_Continue # Mc MYANMAR SIGN RUMAI PALAUNG TONE-5
109A..109C ; XID_Continue # Mc [3] MYANMAR SIGN KHAMTI TONE-1..AITON A
109D ; XID_Continue # Mn MYANMAR VOWEL SIGN AITON AI
135D..135F ; XID_Continue # Mn [3] ETHIOPIC COMBINING GEMINATION AND
VOWEL LENGTH MARK..MARK
1712..1714 ; XID_Continue # Mn [3] TAGALOG VOWEL SIGN I..VIRAMA
1715 ; XID_Continue # Mc TAGALOG SIGN PAMUDPOD
1732..1733 ; XID_Continue # Mn [2] HANUNOO VOWEL SIGN I..U
1734 ; XID_Continue # Mc HANUNOO SIGN PAMUDPOD
1752..1753 ; XID_Continue # Mn [2] BUHID VOWEL SIGN I..U
1772..1773 ; XID_Continue # Mn [2] TAGBANWA VOWEL SIGN I..U
17B4..17B5 ; XID_Continue # Mn [2] KHMER VOWEL INHERENT AQ..AA
17B6 ; XID_Continue # Mc KHMER VOWEL SIGN AA
17B7..17BD ; XID_Continue # Mn [7] KHMER VOWEL SIGN I..UA
17BE..17C5 ; XID_Continue # Mc [8] KHMER VOWEL SIGN OE..AU
17C6 ; XID_Continue # Mn KHMER SIGN NIKAHIT
17C7..17C8 ; XID_Continue # Mc [2] KHMER SIGN REAHMUK..YUUKALEAPINTU
17C9..17D3 ; XID_Continue # Mn [11] KHMER SIGN MUUSIKATOAN..BATHAMASAT
17DD ; XID_Continue # Mn KHMER SIGN ATTHACAN
180B..180D ; XID_Continue # Mn [3] MONGOLIAN FREE VARIATION SELECTOR ONE..
THREE
180F ; XID_Continue # Mn MONGOLIAN FREE VARIATION SELECTOR FOUR
1885..1886 ; XID_Continue # Mn [2] MONGOLIAN LETTER ALI GALI BALUDA..
THREE BALUDA
18A9 ; XID_Continue # Mn MONGOLIAN LETTER ALI GALI DAGALGA
1920..1922 ; XID_Continue # Mn [3] LIMBU VOWEL SIGN A..U
1923..1926 ; XID_Continue # Mc [4] LIMBU VOWEL SIGN EE..AU
1927..1928 ; XID_Continue # Mn [2] LIMBU VOWEL SIGN E..O
1929..192B ; XID_Continue # Mc [3] LIMBU SUBJOINED LETTER YA..WA
1930..1931 ; XID_Continue # Mc [2] LIMBU SMALL LETTER KA..NGA
1932 ; XID_Continue # Mn LIMBU SMALL LETTER ANUSVARA
1933..1938 ; XID_Continue # Mc [6] LIMBU SMALL LETTER TA..LA
1939..193B ; XID_Continue # Mn [3] LIMBU SIGN MUKPHRENG..-I
1A17..1A18 ; XID_Continue # Mn [2] BUGINESE VOWEL SIGN I..U
1A19..1A1A ; XID_Continue # Mc [2] BUGINESE VOWEL SIGN E..O
1A1B ; XID_Continue # Mn BUGINESE VOWEL SIGN AE
1A55 ; XID_Continue # Mc TAI THAM CONSONANT SIGN MEDIAL RA
1A56 ; XID_Continue # Mn TAI THAM CONSONANT SIGN MEDIAL LA
1A57 ; XID_Continue # Mc TAI THAM CONSONANT SIGN LA TANG LAI
1A58..1A5E ; XID_Continue # Mn [7] TAI THAM SIGN MAI KANG LAI..
CONSONANT SIGN SA
1A60 ; XID_Continue # Mn TAI THAM SIGN SAKOT
1A61 ; XID_Continue # Mc TAI THAM VOWEL SIGN A
1A62 ; XID_Continue # Mn TAI THAM VOWEL SIGN MAI SAT
1A63..1A64 ; XID_Continue # Mc [2] TAI THAM VOWEL SIGN AA..TALL AA
1A65..1A6C ; XID_Continue # Mn [8] TAI THAM VOWEL SIGN I..OA BELOW
1A6D..1A72 ; XID_Continue # Mc [6] TAI THAM VOWEL SIGN OY..THAM AI
1A73..1A7C ; XID_Continue # Mn [10] TAI THAM VOWEL SIGN OA ABOVE..
KHUEN-LUE KARAN
1A7F ; XID_Continue # Mn TAI THAM COMBINING CRYPTOGRAMMIC DOT
1AB0..1ABD ; XID_Continue # Mn [14] COMBINING DOUBLED CIRCUMFLEX ACCENT..
COMBINING PARENTHESES BELOW
1ABF..1ACE ; XID_Continue # Mn [16] COMBINING LATIN SMALL LETTER W BELOW..
INSULAR T
1B00..1B03 ; XID_Continue # Mn [4] BALINESE SIGN ULU RICEM..SURANG
1B04 ; XID_Continue # Mc BALINESE SIGN BISAH
1B34 ; XID_Continue # Mn BALINESE SIGN REREKAN
1B35 ; XID_Continue # Mc BALINESE VOWEL SIGN TEDUNG
1B36..1B3A ; XID_Continue # Mn [5] BALINESE VOWEL SIGN ULU..RA REPA
1B3B ; XID_Continue # Mc BALINESE VOWEL SIGN RA REPA TEDUNG
1B3C ; XID_Continue # Mn BALINESE VOWEL SIGN LA LENGA
1B3D..1B41 ; XID_Continue # Mc [5] BALINESE VOWEL SIGN LA LENGA TEDUNG..
TALING REPA TEDUNG
1B42 ; XID_Continue # Mn BALINESE VOWEL SIGN PEPET
1B43..1B44 ; XID_Continue # Mc [2] BALINESE VOWEL SIGN PEPET TEDUNG..
BALINESE ADEG ADEG
1B6B..1B73 ; XID_Continue # Mn [9] BALINESE MUSICAL SYMBOL COMBINING TEGEH..
GONG
1B80..1B81 ; XID_Continue # Mn [2] SUNDANESE SIGN PANYECEK..PANGLAYAR
1B82 ; XID_Continue # Mc SUNDANESE SIGN PANGWISAD
1BA1 ; XID_Continue # Mc SUNDANESE CONSONANT SIGN PAMINGKAL
1BA2..1BA5 ; XID_Continue # Mn [4] SUNDANESE CONSONANT SIGN PANYAKRA..
SUNDANESE VOWEL SIGN PANYUKU
1BA6..1BA7 ; XID_Continue # Mc [2] SUNDANESE VOWEL SIGN PANAELAENG..PANOLONG
1BA8..1BA9 ; XID_Continue # Mn [2] SUNDANESE VOWEL SIGN PAMEPET..PANEULEUNG
1BAA ; XID_Continue # Mc SUNDANESE SIGN PAMAAEH
1BAB..1BAD ; XID_Continue # Mn [3] SUNDANESE SIGN VIRAMA..
CONSONANT SIGN PASANGAN WA
1BE6 ; XID_Continue # Mn BATAK SIGN TOMPI
1BE7 ; XID_Continue # Mc BATAK VOWEL SIGN E
1BE8..1BE9 ; XID_Continue # Mn [2] BATAK VOWEL SIGN PAKPAK E..EE
1BEA..1BEC ; XID_Continue # Mc [3] BATAK VOWEL SIGN I..O
1BED ; XID_Continue # Mn BATAK VOWEL SIGN KARO O
1BEE ; XID_Continue # Mc BATAK VOWEL SIGN U
1BEF..1BF1 ; XID_Continue # Mn [3] BATAK VOWEL SIGN U FOR SIMALUNGUN SA..
BATAK CONSONANT SIGN H
1BF2..1BF3 ; XID_Continue # Mc [2] BATAK PANGOLAT..BATAK PANONGONAN
1C24..1C2B ; XID_Continue # Mc [8] LEPCHA SUBJOINED LETTER YA..VOWEL SIGN UU
1C2C..1C33 ; XID_Continue # Mn [8] LEPCHA VOWEL SIGN E..CONSONANT SIGN T
1C34..1C35 ; XID_Continue # Mc [2] LEPCHA CONSONANT SIGN NYIN-DO..KANG
1C36..1C37 ; XID_Continue # Mn [2] LEPCHA SIGN RAN..NUKTA
1CD0..1CD2 ; XID_Continue # Mn [3] VEDIC TONE KARSHANA..PRENKHA
1CD4..1CE0 ; XID_Continue # Mn [13] VEDIC SIGN YAJURVEDIC MIDLINE SVARITA..
VEDIC TONE RIGVEDIC KASHMIRI INDEPENDENT
SVARITA
1CE1 ; XID_Continue # Mc VEDIC TONE ATHARVAVEDIC INDEPENDENT
SVARITA
1CE2..1CE8 ; XID_Continue # Mn [7] VEDIC SIGN VISARGA SVARITA..
VEDIC SIGN VISARGA ANUDATTA WITH TAIL
1CED ; XID_Continue # Mn VEDIC SIGN TIRYAK
1CF4 ; XID_Continue # Mn VEDIC TONE CANDRA ABOVE
1CF7 ; XID_Continue # Mc VEDIC SIGN ATIKRAMA
1CF8..1CF9 ; XID_Continue # Mn [2] VEDIC TONE RING ABOVE..DOUBLE RING ABOVE
1DC0..1DFF ; XID_Continue # Mn [64] COMBINING DOTTED GRAVE ACCENT..
RIGHT ARROWHEAD AND DOWN ARROWHEAD BELOW
20D0..20DC ; XID_Continue # Mn [13] COMBINING LEFT HARPOON ABOVE..
COMBINING FOUR DOTS ABOVE
20E1 ; XID_Continue # Mn COMBINING LEFT RIGHT ARROW ABOVE
20E5..20F0 ; XID_Continue # Mn [12] COMBINING REVERSE SOLIDUS OVERLAY..
COMBINING ASTERISK ABOVE
2CEF..2CF1 ; XID_Continue # Mn [3] COPTIC COMBINING NI ABOVE..SPIRITUS LENIS
2D7F ; XID_Continue # Mn TIFINAGH CONSONANT JOINER
2DE0..2DFF ; XID_Continue # Mn [32] COMBINING CYRILLIC LETTER BE..
IOTIFIED BIG YUS
302A..302D ; XID_Continue # Mn [4] IDEOGRAPHIC LEVEL TONE MARK..
IDEOGRAPHIC ENTERING TONE MARK
302E..302F ; XID_Continue # Mc [2] HANGUL SINGLE DOT TONE MARK..
HANGUL DOUBLE DOT TONE MARK
3099..309A ; XID_Continue # Mn [2] COMBINING KATAKANA-HIRAGANA VOICED
SOUND MARK..SEMI-VOICED SOUND MARK
A66F ; XID_Continue # Mn COMBINING CYRILLIC VZMET
A674..A67D ; XID_Continue # Mn [10] COMBINING CYRILLIC LETTER UKRAINIAN IE..
PAYEROK
A69E..A69F ; XID_Continue # Mn [2] COMBINING CYRILLIC LETTER EF..IOTIFIED E
A6F0..A6F1 ; XID_Continue # Mn [2] BAMUM COMBINING MARK KOQNDON..TUKWENTIS
A802 ; XID_Continue # Mn SYLOTI NAGRI SIGN DVISVARA
A806 ; XID_Continue # Mn SYLOTI NAGRI SIGN HASANTA
A80B ; XID_Continue # Mn SYLOTI NAGRI SIGN ANUSVARA
A823..A824 ; XID_Continue # Mc [2] SYLOTI NAGRI VOWEL SIGN A..I
A825..A826 ; XID_Continue # Mn [2] SYLOTI NAGRI VOWEL SIGN U..E
A827 ; XID_Continue # Mc SYLOTI NAGRI VOWEL SIGN OO
A82C ; XID_Continue # Mn SYLOTI NAGRI SIGN ALTERNATE HASANTA
A880..A881 ; XID_Continue # Mc [2] SAURASHTRA SIGN ANUSVARA..VISARGA
A8B4..A8C3 ; XID_Continue # Mc [16] SAURASHTRA CONSONANT SIGN HAARU..
SAURASHTRA VOWEL SIGN AU
A8C4..A8C5 ; XID_Continue # Mn [2] SAURASHTRA SIGN VIRAMA..CANDRABINDU
A8E0..A8F1 ; XID_Continue # Mn [18] COMBINING DEVANAGARI DIGIT ZERO..
SIGN AVAGRAHA
A8FF ; XID_Continue # Mn DEVANAGARI VOWEL SIGN AY
A926..A92D ; XID_Continue # Mn [8] KAYAH LI VOWEL UE..TONE CALYA PLOPHU
A947..A951 ; XID_Continue # Mn [11] REJANG VOWEL SIGN I..CONSONANT SIGN R
A952..A953 ; XID_Continue # Mc [2] REJANG CONSONANT SIGN H..REJANG VIRAMA
A980..A982 ; XID_Continue # Mn [3] JAVANESE SIGN PANYANGGA..LAYAR
A983 ; XID_Continue # Mc JAVANESE SIGN WIGNYAN
A9B3 ; XID_Continue # Mn JAVANESE SIGN CECAK TELU
A9B4..A9B5 ; XID_Continue # Mc [2] JAVANESE VOWEL SIGN TARUNG..TOLONG
A9B6..A9B9 ; XID_Continue # Mn [4] JAVANESE VOWEL SIGN WULU..SUKU MENDUT
A9BA..A9BB ; XID_Continue # Mc [2] JAVANESE VOWEL SIGN TALING..DIRGA MURE
A9BC..A9BD ; XID_Continue # Mn [2] JAVANESE VOWEL SIGN PEPET..KERET
A9BE..A9C0 ; XID_Continue # Mc [3] JAVANESE CONSONANT SIGN PENGKAL..PANGKON
A9E5 ; XID_Continue # Mn MYANMAR SIGN SHAN SAW
AA29..AA2E ; XID_Continue # Mn [6] CHAM VOWEL SIGN AA..OE
AA2F..AA30 ; XID_Continue # Mc [2] CHAM VOWEL SIGN O..AI
AA31..AA32 ; XID_Continue # Mn [2] CHAM VOWEL SIGN AU..UE
AA33..AA34 ; XID_Continue # Mc [2] CHAM CONSONANT SIGN YA..RA
AA35..AA36 ; XID_Continue # Mn [2] CHAM CONSONANT SIGN LA..WA
AA43 ; XID_Continue # Mn CHAM CONSONANT SIGN FINAL NG
AA4C ; XID_Continue # Mn CHAM CONSONANT SIGN FINAL M
AA4D ; XID_Continue # Mc CHAM CONSONANT SIGN FINAL H
AA7B ; XID_Continue # Mc MYANMAR SIGN PAO KAREN TONE
AA7C ; XID_Continue # Mn MYANMAR SIGN TAI LAING TONE-2
AA7D ; XID_Continue # Mc MYANMAR SIGN TAI LAING TONE-5
AAB0 ; XID_Continue # Mn TAI VIET MAI KANG
AAB2..AAB4 ; XID_Continue # Mn [3] TAI VIET VOWEL I..U
AAB7..AAB8 ; XID_Continue # Mn [2] TAI VIET MAI KHIT..VOWEL IA
AABE..AABF ; XID_Continue # Mn [2] TAI VIET VOWEL AM..TONE MAI EK
AAC1 ; XID_Continue # Mn TAI VIET TONE MAI THO
AAEB ; XID_Continue # Mc MEETEI MAYEK VOWEL SIGN II
AAEC..AAED ; XID_Continue # Mn [2] MEETEI MAYEK VOWEL SIGN UU..AAI
AAEE..AAEF ; XID_Continue # Mc [2] MEETEI MAYEK VOWEL SIGN AU..AAU
AAF5 ; XID_Continue # Mc MEETEI MAYEK VOWEL SIGN VISARGA
AAF6 ; XID_Continue # Mn MEETEI MAYEK VIRAMA
ABE3..ABE4 ; XID_Continue # Mc [2] MEETEI MAYEK VOWEL SIGN ONAP..INAP
ABE5 ; XID_Continue # Mn MEETEI MAYEK VOWEL SIGN ANAP
ABE6..ABE7 ; XID_Continue # Mc [2] MEETEI MAYEK VOWEL SIGN YENAP..SOUNAP
ABE8 ; XID_Continue # Mn MEETEI MAYEK VOWEL SIGN UNAP
ABE9..ABEA ; XID_Continue # Mc [2] MEETEI MAYEK VOWEL SIGN CHEINAP..NUNG
ABEC ; XID_Continue # Mc MEETEI MAYEK LUM IYEK
ABED ; XID_Continue # Mn MEETEI MAYEK APUN IYEK
FB1E ; XID_Continue # Mn HEBREW POINT JUDEO-SPANISH VARIKA
FE00..FE0F ; XID_Continue # Mn [16] VARIATION SELECTOR-1..-16
FE20..FE2F ; XID_Continue # Mn [16] COMBINING LIGATURE LEFT HALF..
COMBINING CYRILLIC TITLO RIGHT HALF
101FD ; XID_Continue # Mn PHAISTOS DISC SIGN COMBINING OBLIQUE
STROKE
102E0 ; XID_Continue # Mn COPTIC EPACT THOUSANDS MARK
10376..1037A ; XID_Continue # Mn [5] COMBINING OLD PERMIC LETTER AN..SII
10A01..10A03 ; XID_Continue # Mn [3] KHAROSHTHI VOWEL SIGN I..VOCALIC R
10A05..10A06 ; XID_Continue # Mn [2] KHAROSHTHI VOWEL SIGN E..O
10A0C..10A0F ; XID_Continue # Mn [4] KHAROSHTHI VOWEL LENGTH MARK..
SIGN VISARGA
10A38..10A3A ; XID_Continue # Mn [3] KHAROSHTHI SIGN BAR ABOVE..DOT BELOW
10A3F ; XID_Continue # Mn KHAROSHTHI VIRAMA
10AE5..10AE6 ; XID_Continue # Mn [2] MANICHAEAN ABBREVIATION MARK ABOVE..BELOW
10D24..10D27 ; XID_Continue # Mn [4] HANIFI ROHINGYA SIGN HARBAHAY..TASSI
10EAB..10EAC ; XID_Continue # Mn [2] YEZIDI COMBINING HAMZA MARK..MADDA MARK
10F46..10F50 ; XID_Continue # Mn [11] SOGDIAN COMBINING DOT BELOW..STROKE BELOW
10F82..10F85 ; XID_Continue # Mn [4] OLD UYGHUR COMBINING DOT ABOVE..
TWO DOTS BELOW
11000 ; XID_Continue # Mc BRAHMI SIGN CANDRABINDU
11001 ; XID_Continue # Mn BRAHMI SIGN ANUSVARA
11002 ; XID_Continue # Mc BRAHMI SIGN VISARGA
11038..11046 ; XID_Continue # Mn [15] BRAHMI VOWEL SIGN AA..BRAHMI VIRAMA
11070 ; XID_Continue # Mn BRAHMI SIGN OLD TAMIL VIRAMA
11073..11074 ; XID_Continue # Mn [2] BRAHMI VOWEL SIGN OLD TAMIL SHORT E..O
1107F..11081 ; XID_Continue # Mn [3] BRAHMI NUMBER JOINER..SIGN ANUSVARA
11082 ; XID_Continue # Mc KAITHI SIGN VISARGA
110B0..110B2 ; XID_Continue # Mc [3] KAITHI VOWEL SIGN AA..II
110B3..110B6 ; XID_Continue # Mn [4] KAITHI VOWEL SIGN U..AI
110B7..110B8 ; XID_Continue # Mc [2] KAITHI VOWEL SIGN O..AU
110B9..110BA ; XID_Continue # Mn [2] KAITHI SIGN VIRAMA..KAITHI SIGN NUKTA
110C2 ; XID_Continue # Mn KAITHI VOWEL SIGN VOCALIC R
11100..11102 ; XID_Continue # Mn [3] CHAKMA SIGN CANDRABINDU..VISARGA
11127..1112B ; XID_Continue # Mn [5] CHAKMA VOWEL SIGN A..UU
1112C ; XID_Continue # Mc CHAKMA VOWEL SIGN E
1112D..11134 ; XID_Continue # Mn [8] CHAKMA VOWEL SIGN AI..CHAKMA MAAYYAA
11145..11146 ; XID_Continue # Mc [2] CHAKMA VOWEL SIGN AA..EI
11173 ; XID_Continue # Mn MAHAJANI SIGN NUKTA
11180..11181 ; XID_Continue # Mn [2] SHARADA SIGN CANDRABINDU..ANUSVARA
11182 ; XID_Continue # Mc SHARADA SIGN VISARGA
111B3..111B5 ; XID_Continue # Mc [3] SHARADA VOWEL SIGN AA..II
111B6..111BE ; XID_Continue # Mn [9] SHARADA VOWEL SIGN U..O
111BF..111C0 ; XID_Continue # Mc [2] SHARADA VOWEL SIGN AU..VIRAMA
111C9..111CC ; XID_Continue # Mn [4] SHARADA SANDHI MARK..
EXTRA SHORT VOWEL MARK
111CE ; XID_Continue # Mc SHARADA VOWEL SIGN PRISHTHAMATRA E
111CF ; XID_Continue # Mn SHARADA SIGN INVERTED CANDRABINDU
1122C..1122E ; XID_Continue # Mc [3] KHOJKI VOWEL SIGN AA..II
1122F..11231 ; XID_Continue # Mn [3] KHOJKI VOWEL SIGN U..AI
11232..11233 ; XID_Continue # Mc [2] KHOJKI VOWEL SIGN O..AU
11234 ; XID_Continue # Mn KHOJKI SIGN ANUSVARA
11235 ; XID_Continue # Mc KHOJKI SIGN VIRAMA
11236..11237 ; XID_Continue # Mn [2] KHOJKI SIGN NUKTA..SHADDA
1123E ; XID_Continue # Mn KHOJKI SIGN SUKUN
112DF ; XID_Continue # Mn KHUDAWADI SIGN ANUSVARA
112E0..112E2 ; XID_Continue # Mc [3] KHUDAWADI VOWEL SIGN AA..II
112E3..112EA ; XID_Continue # Mn [8] KHUDAWADI VOWEL SIGN U..VIRAMA
11300..11301 ; XID_Continue # Mn [2] GRANTHA SIGN COMBINING ANUSVARA ABOVE..
GRANTHA SIGN CANDRABINDU
11302..11303 ; XID_Continue # Mc [2] GRANTHA SIGN ANUSVARA..VISARGA
1133B..1133C ; XID_Continue # Mn [2] COMBINING BINDU BELOW..GRANTHA SIGN NUKTA
1133E..1133F ; XID_Continue # Mc [2] GRANTHA VOWEL SIGN AA..I
11340 ; XID_Continue # Mn GRANTHA VOWEL SIGN II
11341..11344 ; XID_Continue # Mc [4] GRANTHA VOWEL SIGN U..VOCALIC RR
11347..11348 ; XID_Continue # Mc [2] GRANTHA VOWEL SIGN EE..AI
1134B..1134D ; XID_Continue # Mc [3] GRANTHA VOWEL SIGN OO..VIRAMA
11357 ; XID_Continue # Mc GRANTHA AU LENGTH MARK
11362..11363 ; XID_Continue # Mc [2] GRANTHA VOWEL SIGN VOCALIC L..LL
11366..1136C ; XID_Continue # Mn [7] COMBINING GRANTHA DIGIT ZERO..SIX
11370..11374 ; XID_Continue # Mn [5] COMBINING GRANTHA LETTER A..PA
11435..11437 ; XID_Continue # Mc [3] NEWA VOWEL SIGN AA..II
11438..1143F ; XID_Continue # Mn [8] NEWA VOWEL SIGN U..AI
11440..11441 ; XID_Continue # Mc [2] NEWA VOWEL SIGN O..AU
11442..11444 ; XID_Continue # Mn [3] NEWA SIGN VIRAMA..ANUSVARA
11445 ; XID_Continue # Mc NEWA SIGN VISARGA
11446 ; XID_Continue # Mn NEWA SIGN NUKTA
1145E ; XID_Continue # Mn NEWA SANDHI MARK
114B0..114B2 ; XID_Continue # Mc [3] TIRHUTA VOWEL SIGN AA..II
114B3..114B8 ; XID_Continue # Mn [6] TIRHUTA VOWEL SIGN U..VOCALIC LL
114B9 ; XID_Continue # Mc TIRHUTA VOWEL SIGN E
114BA ; XID_Continue # Mn TIRHUTA VOWEL SIGN SHORT E
114BB..114BE ; XID_Continue # Mc [4] TIRHUTA VOWEL SIGN AI..AU
114BF..114C0 ; XID_Continue # Mn [2] TIRHUTA SIGN CANDRABINDU..ANUSVARA
114C1 ; XID_Continue # Mc TIRHUTA SIGN VISARGA
114C2..114C3 ; XID_Continue # Mn [2] TIRHUTA SIGN VIRAMA..NUKTA
115AF..115B1 ; XID_Continue # Mc [3] SIDDHAM VOWEL SIGN AA..II
115B2..115B5 ; XID_Continue # Mn [4] SIDDHAM VOWEL SIGN U..VOCALIC RR
115B8..115BB ; XID_Continue # Mc [4] SIDDHAM VOWEL SIGN E..AU
115BC..115BD ; XID_Continue # Mn [2] SIDDHAM SIGN CANDRABINDU..ANUSVARA
115BE ; XID_Continue # Mc SIDDHAM SIGN VISARGA
115BF..115C0 ; XID_Continue # Mn [2] SIDDHAM SIGN VIRAMA..NUKTA
115DC..115DD ; XID_Continue # Mn [2] SIDDHAM VOWEL SIGN ALTERNATE U..UU
11630..11632 ; XID_Continue # Mc [3] MODI VOWEL SIGN AA..II
11633..1163A ; XID_Continue # Mn [8] MODI VOWEL SIGN U..AI
1163B..1163C ; XID_Continue # Mc [2] MODI VOWEL SIGN O..AU
1163D ; XID_Continue # Mn MODI SIGN ANUSVARA
1163E ; XID_Continue # Mc MODI SIGN VISARGA
1163F..11640 ; XID_Continue # Mn [2] MODI SIGN VIRAMA..ARDHACANDRA
116AB ; XID_Continue # Mn TAKRI SIGN ANUSVARA
116AC ; XID_Continue # Mc TAKRI SIGN VISARGA
116AD ; XID_Continue # Mn TAKRI VOWEL SIGN AA
116AE..116AF ; XID_Continue # Mc [2] TAKRI VOWEL SIGN I..II
116B0..116B5 ; XID_Continue # Mn [6] TAKRI VOWEL SIGN U..AU
116B6 ; XID_Continue # Mc TAKRI SIGN VIRAMA
116B7 ; XID_Continue # Mn TAKRI SIGN NUKTA
1171D..1171F ; XID_Continue # Mn [3] AHOM CONSONANT SIGN MEDIAL LA..
LIGATING RA
11720..11721 ; XID_Continue # Mc [2] AHOM VOWEL SIGN A..AA
11722..11725 ; XID_Continue # Mn [4] AHOM VOWEL SIGN I..UU
11726 ; XID_Continue # Mc AHOM VOWEL SIGN E
11727..1172B ; XID_Continue # Mn [5] AHOM VOWEL SIGN AW..KILLER
1182C..1182E ; XID_Continue # Mc [3] DOGRA VOWEL SIGN AA..II
1182F..11837 ; XID_Continue # Mn [9] DOGRA VOWEL SIGN U..ANUSVARA
11838 ; XID_Continue # Mc DOGRA SIGN VISARGA
11839..1183A ; XID_Continue # Mn [2] DOGRA SIGN VIRAMA..NUKTA
11930..11935 ; XID_Continue # Mc [6] DIVES AKURU VOWEL SIGN AA..E
11937..11938 ; XID_Continue # Mc [2] DIVES AKURU VOWEL SIGN AI..O
1193B..1193C ; XID_Continue # Mn [2] DIVES AKURU SIGN ANUSVARA..CANDRABINDU
1193D ; XID_Continue # Mc DIVES AKURU SIGN HALANTA
1193E ; XID_Continue # Mn DIVES AKURU VIRAMA
11940 ; XID_Continue # Mc DIVES AKURU MEDIAL YA
11942 ; XID_Continue # Mc DIVES AKURU MEDIAL RA
11943 ; XID_Continue # Mn DIVES AKURU SIGN NUKTA
119D1..119D3 ; XID_Continue # Mc [3] NANDINAGARI VOWEL SIGN AA..II
119D4..119D7 ; XID_Continue # Mn [4] NANDINAGARI VOWEL SIGN U..VOCALIC RR
119DA..119DB ; XID_Continue # Mn [2] NANDINAGARI VOWEL SIGN E..AI
119DC..119DF ; XID_Continue # Mc [4] NANDINAGARI VOWEL SIGN O..VISARGA
119E0 ; XID_Continue # Mn NANDINAGARI SIGN VIRAMA
119E4 ; XID_Continue # Mc NANDINAGARI VOWEL SIGN PRISHTHAMATRA E
11A01..11A0A ; XID_Continue # Mn [10] ZANABAZAR SQUARE VOWEL SIGN I..
LENGTH MARK
11A33..11A38 ; XID_Continue # Mn [6] ZANABAZAR SQUARE FINAL CONSONANT MARK..
ZANABAZAR SQUARE SIGN ANUSVARA
11A39 ; XID_Continue # Mc ZANABAZAR SQUARE SIGN VISARGA
11A3B..11A3E ; XID_Continue # Mn [4] ZANABAZAR SQUARE CLUSTER-FINAL LETTER YA..
ZANABAZAR SQUARE CLUSTER-FINAL LETTER VA
11A47 ; XID_Continue # Mn ZANABAZAR SQUARE SUBJOINER
11A51..11A56 ; XID_Continue # Mn [6] SOYOMBO VOWEL SIGN I..OE
11A57..11A58 ; XID_Continue # Mc [2] SOYOMBO VOWEL SIGN AI..AU
11A59..11A5B ; XID_Continue # Mn [3] SOYOMBO VOWEL SIGN VOCALIC R..
SOYOMBO VOWEL LENGTH MARK
11A8A..11A96 ; XID_Continue # Mn [13] SOYOMBO FINAL CONSONANT SIGN G..ANUSVARA
11A97 ; XID_Continue # Mc SOYOMBO SIGN VISARGA
11A98..11A99 ; XID_Continue # Mn [2] SOYOMBO GEMINATION MARK..SUBJOINER
11C2F ; XID_Continue # Mc BHAIKSUKI VOWEL SIGN AA
11C30..11C36 ; XID_Continue # Mn [7] BHAIKSUKI VOWEL SIGN I..VOCALIC L
11C38..11C3D ; XID_Continue # Mn [6] BHAIKSUKI VOWEL SIGN E..ANUSVARA
11C3E ; XID_Continue # Mc BHAIKSUKI SIGN VISARGA
11C3F ; XID_Continue # Mn BHAIKSUKI SIGN VIRAMA
11C92..11CA7 ; XID_Continue # Mn [22] MARCHEN SUBJOINED LETTER KA..ZA
11CA9 ; XID_Continue # Mc MARCHEN SUBJOINED LETTER YA
11CAA..11CB0 ; XID_Continue # Mn [7] MARCHEN SUBJOINED LETTER RA..
MARCHEN VOWEL SIGN AA
11CB1 ; XID_Continue # Mc MARCHEN VOWEL SIGN I
11CB2..11CB3 ; XID_Continue # Mn [2] MARCHEN VOWEL SIGN U..E
11CB4 ; XID_Continue # Mc MARCHEN VOWEL SIGN O
11CB5..11CB6 ; XID_Continue # Mn [2] MARCHEN SIGN ANUSVARA..CANDRABINDU
11D31..11D36 ; XID_Continue # Mn [6] MASARAM GONDI VOWEL SIGN AA..
MASARAM GONDI VOWEL SIGN VOCALIC R
11D3A ; XID_Continue # Mn MASARAM GONDI VOWEL SIGN E
11D3C..11D3D ; XID_Continue # Mn [2] MASARAM GONDI VOWEL SIGN AI..O
11D3F..11D45 ; XID_Continue # Mn [7] MASARAM GONDI VOWEL SIGN AU..
MASARAM GONDI VIRAMA
11D47 ; XID_Continue # Mn MASARAM GONDI RA-KARA
11D8A..11D8E ; XID_Continue # Mc [5] GUNJALA GONDI VOWEL SIGN AA..UU
11D90..11D91 ; XID_Continue # Mn [2] GUNJALA GONDI VOWEL SIGN EE..AI
11D93..11D94 ; XID_Continue # Mc [2] GUNJALA GONDI VOWEL SIGN OO..AU
11D95 ; XID_Continue # Mn GUNJALA GONDI SIGN ANUSVARA
11D96 ; XID_Continue # Mc GUNJALA GONDI SIGN VISARGA
11D97 ; XID_Continue # Mn GUNJALA GONDI VIRAMA
11EF3..11EF4 ; XID_Continue # Mn [2] MAKASAR VOWEL SIGN I..U
11EF5..11EF6 ; XID_Continue # Mc [2] MAKASAR VOWEL SIGN E..O
11F00..11F01 ; XID_Continue # Mn [2] KAWI SIGN CANDRABINDU..KAWI SIGN ANUSVARA
11F03 ; XID_Continue # Mc KAWI SIGN VISARGA
11F34..11F35 ; XID_Continue # Mc [2] KAWI VOWEL SIGN AA..
KAWI VOWEL SIGN ALTERNATE AA
11F36..11F3A ; XID_Continue # Mn [5] KAWI VOWEL SIGN I..
KAWI VOWEL SIGN VOCALIC R
11F3E..11F3F ; XID_Continue # Mc [2] KAWI VOWEL SIGN E..KAWI VOWEL SIGN AI
11F40 ; XID_Continue # Mn KAWI VOWEL SIGN EU
11F41 ; XID_Continue # Mc KAWI SIGN KILLER
11F42 ; XID_Continue # Mn KAWI CONJOINER
13440 ; XID_Continue # Mn EGYPTIAN HIEROGLYPH MIRROR HORIZONTALLY
13447..13455 ; XID_Continue # Mn [15] EGYPTIAN HIEROGLYPH MODIFIER DAMAGED AT
TOP START..EGYPTIAN HIEROGLYPH MODIFIER DAMAGED
16AF0..16AF4 ; XID_Continue # Mn [5] BASSA VAH COMBINING HIGH TONE..
BASSA VAH COMBINING HIGH-LOW TONE
16B30..16B36 ; XID_Continue # Mn [7] PAHAWH HMONG MARK CIM TUB..CIM TAUM
16F4F ; XID_Continue # Mn MIAO SIGN CONSONANT MODIFIER BAR
16F51..16F87 ; XID_Continue # Mc [55] MIAO SIGN ASPIRATION..MIAO VOWEL SIGN UI
16F8F..16F92 ; XID_Continue # Mn [4] MIAO TONE RIGHT..MIAO TONE BELOW
16FE4 ; XID_Continue # Mn KHITAN SMALL SCRIPT FILLER
16FF0..16FF1 ; XID_Continue # Mc [2] VIETNAMESE ALTERNATE READING MARK CA..
VIETNAMESE ALTERNATE READING MARK NHAY
1BC9D..1BC9E ; XID_Continue # Mn [2] DUPLOYAN THICK LETTER SELECTOR..
DUPLOYAN DOUBLE MARK
1CF00..1CF2D ; XID_Continue # Mn [46] ZNAMENNY COMBINING MARK GORAZDO NIZKO S
KRYZHEM ON LEFT..
ZNAMENNY COMBINING MARK KRYZH ON LEFT
1CF30..1CF46 ; XID_Continue # Mn [23] ZNAMENNY COMBINING TONAL RANGE MARK
MRACHNO..PRIZNAK MODIFIER ROG
1D165..1D166 ; XID_Continue # Mc [2] MUSICAL SYMBOL COMBINING STEM..
SPRECHGESANG STEM
1D167..1D169 ; XID_Continue # Mn [3] MUSICAL SYMBOL COMBINING TREMOLO-1..3
1D16D..1D172 ; XID_Continue # Mc [6] MUSICAL SYMBOL COMBINING AUGMENTATION
DOT..FLAG-5
1D17B..1D182 ; XID_Continue # Mn [8] MUSICAL SYMBOL COMBINING ACCENT..LOURE
1D185..1D18B ; XID_Continue # Mn [7] MUSICAL SYMBOL COMBINING DOIT..
MUSICAL SYMBOL COMBINING TRIPLE TONGUE
1D1AA..1D1AD ; XID_Continue # Mn [4] MUSICAL SYMBOL COMBINING DOWN BOW..
MUSICAL SYMBOL COMBINING SNAP PIZZICATO
1D242..1D244 ; XID_Continue # Mn [3] COMBINING GREEK MUSICAL TRISEME..
COMBINING GREEK MUSICAL PENTASEME
1DA00..1DA36 ; XID_Continue # Mn [55] SIGNWRITING HEAD RIM..
SIGNWRITING AIR SUCKING IN
1DA3B..1DA6C ; XID_Continue # Mn [50] SIGNWRITING MOUTH CLOSED NEUTRAL..
SIGNWRITING EXCITEMENT
1DA75 ; XID_Continue # Mn SIGNWRITING UPPER BODY TILTING FROM
HIP JOINTS
1DA84 ; XID_Continue # Mn SIGNWRITING LOCATION HEAD NECK
1DA9B..1DA9F ; XID_Continue # Mn [5] SIGNWRITING FILL MODIFIER-2..
SIGNWRITING FILL MODIFIER-6
1DAA1..1DAAF ; XID_Continue # Mn [15] SIGNWRITING ROTATION MODIFIER-2..-16
1E000..1E006 ; XID_Continue # Mn [7] COMBINING GLAGOLITIC LETTER AZU..ZHIVETE
1E008..1E018 ; XID_Continue # Mn [17] COMBINING GLAGOLITIC LETTER ZEMLJA..HERU
1E01B..1E021 ; XID_Continue # Mn [7] COMBINING GLAGOLITIC LETTER SHTA..YATI
1E023..1E024 ; XID_Continue # Mn [2] COMBINING GLAGOLITIC LETTER YU..SMALL YUS
1E026..1E02A ; XID_Continue # Mn [5] COMBINING GLAGOLITIC LETTER YO..FITA
1E08F ; XID_Continue # Mn COMBINING CYRILLIC SMALL LETTER
BYELORUSSIAN-UKRAINIAN I
1E130..1E136 ; XID_Continue # Mn [7] NYIAKENG PUACHUE HMONG TONE-B..-D
1E2AE ; XID_Continue # Mn TOTO SIGN RISING TONE
1E2EC..1E2EF ; XID_Continue # Mn [4] WANCHO TONE TUP..WANCHO TONE KOINI
1E4EC..1E4EF ; XID_Continue # Mn [4] NAG MUNDARI SIGN MUHOR..
NAG MUNDARI SIGN SUTUH
1E8D0..1E8D6 ; XID_Continue # Mn [7] MENDE KIKAKUI COMBINING NUMBER TEENS..
MENDE KIKAKUI COMBINING NUMBER MILLIONS
1E944..1E94A ; XID_Continue # Mn [7] ADLAM ALIF LENGTHENER..ADLAM NUKTA
E0100..E01EF ; XID_Continue # Mn [240] VARIATION SELECTOR-17..-256Needed for Section 9 TR39 Identifier Type. List of Technical ID characters, added to the TR39 Recommended and Inclusion IDTypes. TR39#Table 1 https://www.unicode.org/reports/tr39/#Identifier_Status_and_Type. In guidance with TR39.
The confusables
01C0..01C3 ; Technical # 1.1 [4] LATIN LETTER DENTAL CLICK..
RETROFLEX CLICKare excluded here.
grep ' Technical ' IdentifierType.txt |
egrep -v 'Not_XID|Obsolete|Exclusion|Uncommon_Use|Limited_Use'0180 ; Technical # 1.1 LATIN SMALL LETTER B WITH STROKE
0234..0236 ; Technical # 4.0 [3] LATIN SMALL LETTER L WITH CURL..
T WITH CURL
0250..0252 ; Technical # 1.1 [3] LATIN SMALL LETTER TURNED A..ALPHA
0255 ; Technical # 1.1 LATIN SMALL LETTER C WITH CURL
0258 ; Technical # 1.1 LATIN SMALL LETTER REVERSED E
025A ; Technical # 1.1 LATIN SMALL LETTER SCHWA WITH HOOK
025C..0262 ; Technical # 1.1 [7] LATIN SMALL LETTER REVERSED OPEN E..
LATIN LETTER SMALL CAPITAL G
0264..0267 ; Technical # 1.1 [4] LATIN SMALL LETTER RAMS HORN..
LATIN SMALL LETTER HENG WITH HOOK
026A..0271 ; Technical # 1.1 [8] LATIN LETTER SMALL CAPITAL I..
LATIN SMALL LETTER M WITH HOOK
0273..0276 ; Technical # 1.1 [4] LATIN SMALL LETTER N WITH RETROFLEX
HOOK..LATIN LETTER SMALL CAPITAL OE
0278..027B ; Technical # 1.1 [4] LATIN SMALL LETTER PHI..
LATIN SMALL LETTER TURNED R WITH HOOK
027D..0288 ; Technical # 1.1 [12] LATIN SMALL LETTER R WITH TAIL..
LATIN SMALL LETTER T WITH RETROFLEX HOOK
028A..0291 ; Technical # 1.1 [8] LATIN SMALL LETTER UPSILON..
LATIN SMALL LETTER Z WITH CURL
0293..029D ; Technical # 1.1 [11] LATIN SMALL LETTER EZH WITH CURL..
LATIN SMALL LETTER J WITH CROSSED-TAIL
029F..02A8 ; Technical # 1.1 [10] LATIN LETTER SMALL CAPITAL L..
LATIN SMALL LETTER TC DIGRAPH WITH CURL
02A9..02AD ; Technical # 3.0 [5] LATIN SMALL LETTER FENG DIGRAPH..
LATIN LETTER BIDENTAL PERCUSSIVE
02AE..02AF ; Technical # 4.0 [2] LATIN SMALL LETTER TURNED H WITH
FISHHOOK..AND TAIL
02B9..02BA ; Technical # 1.1 [2] MODIFIER LETTER PRIME..DOUBLE PRIME
02BD..02C1 ; Technical # 1.1 [5] MODIFIER LETTER REVERSED COMMA..
MODIFIER LETTER REVERSED GLOTTAL STOP
02C6..02D1 ; Technical # 1.1 [12] MODIFIER LETTER CIRCUMFLEX ACCENT..
MODIFIER LETTER HALF TRIANGULAR COLON
02EE ; Technical # 3.0 MODIFIER LETTER DOUBLE APOSTROPHE
030E ; Technical # 1.1 COMBINING DOUBLE VERTICAL LINE ABOVE
0312 ; Technical # 1.1 COMBINING TURNED COMMA ABOVE
0315 ; Technical # 1.1 COMBINING COMMA ABOVE RIGHT
0317..031A ; Technical # 1.1 [4] COMBINING ACUTE ACCENT BELOW..
COMBINING LEFT ANGLE ABOVE
031C..0320 ; Technical # 1.1 [5] COMBINING LEFT HALF RING BELOW..
COMBINING MINUS SIGN BELOW
0329..032C ; Technical # 1.1 [4] COMBINING VERTICAL LINE BELOW..
COMBINING CARON BELOW
032F ; Technical # 1.1 COMBINING INVERTED BREVE BELOW
0333 ; Technical # 1.1 COMBINING DOUBLE LOW LINE
0337 ; Technical # 1.1 COMBINING SHORT SOLIDUS OVERLAY
033A..033F ; Technical # 1.1 [6] COMBINING INVERTED BRIDGE BELOW..
COMBINING DOUBLE OVERLINE
0346..034E ; Technical # 3.0 [9] COMBINING BRIDGE ABOVE..
COMBINING UPWARDS ARROW BELOW
0350..0357 ; Technical # 4.0 [8] COMBINING RIGHT ARROWHEAD ABOVE..
HALF RING ABOVE
0359..035C ; Technical # 4.1 [4] COMBINING ASTERISK BELOW..
COMBINING DOUBLE BREVE BELOW
035D..035F ; Technical # 4.0 [3] COMBINING DOUBLE BREVE..MACRON BELOW
0360..0361 ; Technical # 1.1 [2] COMBINING DOUBLE TILDE..INVERTED BREVE
0362 ; Technical # 3.0 COMBINING DOUBLE RIGHTWARDS ARROW BELOW
03CF ; Technical # 5.1 GREEK CAPITAL KAI SYMBOL
03D7 ; Technical # 3.0 GREEK KAI SYMBOL
0560 ; Technical # 11.0 ARMENIAN SMALL LETTER TURNED AYB
0588 ; Technical # 11.0 ARMENIAN SMALL LETTER YI WITH STROKE
0953..0954 ; Technical # 1.1 [2] DEVANAGARI GRAVE ACCENT..
DEVANAGARI ACUTE ACCENT
0D81 ; Technical # 13.0 SINHALA SIGN CANDRABINDU
0F18..0F19 ; Technical # 2.0 [2] TIBETAN ASTROLOGICAL SIGN -KHYUD PA..
TIBETAN ASTROLOGICAL SIGN SDONG TSHUGS
17CE..17CF ; Technical # 3.0 [2] KHMER SIGN KAKABAT..
KHMER SIGN AHSDA
1ABF..1AC0 ; Technical # 13.0 [2] COMBINING LATIN SMALL LETTER W BELOW..
TURNED W BELOW
1D00..1D2B ; Technical # 4.0 [44] LATIN LETTER SMALL CAPITAL A..
CYRILLIC LETTER SMALL CAPITAL EL
1D2F ; Technical # 4.0 MODIFIER LETTER CAPITAL BARRED B
1D3B ; Technical # 4.0 MODIFIER LETTER CAPITAL REVERSED N
1D4E ; Technical # 4.0 MODIFIER LETTER SMALL TURNED I
1D6B ; Technical # 4.0 LATIN SMALL LETTER UE
1D6C..1D77 ; Technical # 4.1 [12] LATIN SMALL LETTER B WITH MIDDLE TILDE..
LATIN SMALL LETTER TURNED G
1D79..1D9A ; Technical # 4.1 [34] LATIN SMALL LETTER INSULAR G..
EZH WITH RETROFLEX HOOK
1DC4..1DCA ; Technical # 5.0 [7] COMBINING MACRON-ACUTE..
COMBINING LATIN SMALL LETTER R BELOW
1DCB..1DCD ; Technical # 5.1 [3] COMBINING BREVE-MACRON..
COMBINING DOUBLE CIRCUMFLEX ABOVE
1DCF..1DD0 ; Technical # 5.1 [2] COMBINING ZIGZAG BELOW..
COMBINING IS BELOW
1DE7..1DF5 ; Technical # 7.0 [15] COMBINING LATIN SMALL LETTER ALPHA..
COMBINING UP TACK ABOVE
1DF6..1DF9 ; Technical # 10.0 [4] COMBINING KAVYKA ABOVE RIGHT..
COMBINING WIDE INVERTED BRIDGE BELOW
1DFB ; Technical # 9.0 COMBINING DELETION MARK
1DFC ; Technical # 6.0 COMBINING DOUBLE INVERTED BREVE BELOW
1DFD ; Technical # 5.2 COMBINING ALMOST EQUAL TO BELOW
1DFE..1DFF ; Technical # 5.0 [2] COMBINING LEFT ARROWHEAD ABOVE..
COMBINING RIGHT ARROWHEAD AND DOWN
ARROWHEAD BELOW
1E9C..1E9D ; Technical # 5.1 [2] LATIN SMALL LETTER LONG S WITH DIAGONAL
STROKE..WITH HIGH STROKE
1E9F ; Technical # 5.1 LATIN SMALL LETTER DELTA
1EFA..1EFF ; Technical # 5.1 [6] LATIN CAPITAL LETTER MIDDLE-WELSH LL..
LATIN SMALL LETTER Y WITH LOOP
203F..2040 ; Technical # 1.1 [2] UNDERTIE..
CHARACTER TIE
20D0..20DC ; Technical # 1.1 [13] COMBINING LEFT HARPOON ABOVE..
COMBINING FOUR DOTS ABOVE
20E1 ; Technical # 1.1 COMBINING LEFT RIGHT ARROW ABOVE
20E5..20EA ; Technical # 3.2 [6] COMBINING REVERSE SOLIDUS OVERLAY..
COMBINING LEFTWARDS ARROW OVERLAY
20EB ; Technical # 4.1 COMBINING LONG DOUBLE SOLIDUS OVERLAY
20EC..20EF ; Technical # 5.0 [4] COMBINING RIGHTWARDS HARPOON WITH BARB
DOWNWARDS..COMBINING RIGHT ARROW BELOW
20F0 ; Technical # 5.1 COMBINING ASTERISK ABOVE
2118 ; Technical # 1.1 SCRIPT CAPITAL P
212E ; Technical # 1.1 ESTIMATED SYMBOL
2C60..2C67 ; Technical # 5.0 [8] LATIN CAPITAL LETTER L WITH DOUBLE BAR..
LATIN CAPITAL LETTER H WITH DESCENDER
2C77 ; Technical # 5.0 LATIN SMALL LETTER TAILLESS PHI
2C78..2C7B ; Technical # 5.1 [4] LATIN SMALL LETTER E WITH NOTCH..
LATIN LETTER SMALL CAPITAL TURNED E
3021..302D ; Technical # 1.1 [13] HANGZHOU NUMERAL ONE..
IDEOGRAPHIC ENTERING TONE MARK
3031..3035 ; Technical # 1.1 [5] VERTICAL KANA REPEAT MARK..
VERTICAL KANA REPEAT MARK LOWER HALF
303B..303C ; Technical # 3.2 [2] VERTICAL IDEOGRAPHIC ITERATION MARK..
MASU MARK
A78E ; Technical # 6.0 LATIN SMALL LETTER L WITH RETROFLEX HOOK
AND BELT
A7AF ; Technical # 11.0 LATIN LETTER SMALL CAPITAL Q
A7BA..A7BF ; Technical # 12.0 [6] LATIN CAPITAL LETTER GLOTTAL A..
LATIN SMALL LETTER GLOTTAL U
A7FA ; Technical # 6.0 LATIN LETTER SMALL CAPITAL TURNED M
AB68 ; Technical # 13.0 LATIN SMALL LETTER TURNED R WITH MIDDLE
TILDE
FE20..FE23 ; Technical # 1.1 [4] COMBINING LIGATURE LEFT HALF..
COMBINING DOUBLE TILDE RIGHT HALF
FE24..FE26 ; Technical # 5.1 [3] COMBINING MACRON LEFT HALF..
COMBINING CONJOINING MACRON
FE27..FE2D ; Technical # 7.0 [7] COMBINING LIGATURE LEFT HALF BELOW..
COMBINING CONJOINING MACRON BELOW
FE73 ; Technical # 3.2 ARABIC TAIL FRAGMENT
1CF00..1CF2D ; Technical # 14.0 [46] ZNAMENNY COMBINING MARK GORAZDO NIZKO S
KRYZHEM ON LEFT..KRYZH ON LEFT
1CF30..1CF46 ; Technical # 14.0 [23] ZNAMENNY COMBINING TONAL RANGE MARK
MRACHNO..PRIZNAK MODIFIER ROG
1D165..1D169 ; Technical # 3.1 [5] MUSICAL SYMBOL COMBINING STEM..TREMOLO-3
1D16D..1D172 ; Technical # 3.1 [6] MUSICAL SYMBOL COMBINING AUGMENTATION
DOT..MUSICAL SYMBOL COMBINING FLAG-5
1D17B..1D182 ; Technical # 3.1 [8] MUSICAL SYMBOL COMBINING ACCENT..LOURE
1D185..1D18B ; Technical # 3.1 [7] MUSICAL SYMBOL COMBINING DOIT..
MUSICAL SYMBOL COMBINING TRIPLE TONGUE
1D1AA..1D1AD ; Technical # 3.1 [4] MUSICAL SYMBOL COMBINING DOWN BOW..
MUSICAL SYMBOL COMBINING SNAP PIZZICATONeeded for exclusion in the Section 9 TR39 Mixed Scripts Greek rule. Where-ever we have a Greek letter confusable with Latin, and we already saw Latin, forbid the Greek letter in favor of the Latin letter. See TR39 confusables. Note that these confusables cannot be excluded upfront in the TR31 identifier parsing, as Greek alone is allowed.
Allow these 12 Greek letters and symbols to be confusable with Latin:
037A, 0381, 0398, 03B5, 03B7, 03B8, 03B9, 03BD, 03C3, 03D1, 03F1, 03F4.
The confusables.txt list is extremely buggy.
037A ; ( ͺ → i ) GREEK YPOGEGRAMMENI → LATIN SMALL LETTER I
0381 ; ( α → a ) GREEK SMALL LETTER ALPHA
0398 ; ( Θ → O̵ ) GREEK CAPITAL LETTER THETA → LATIN CAPITAL LETTER O, ...
03B5 ; ( ε → ꞓ ) GREEK SMALL LETTER EPSILON
03B7 ; ( η → n̩ ) GREEK SMALL LETTER ETA → LATIN SMALL LETTER N, COMBINING
VERTICAL LINE BELOW
03B8 ; ( θ → O̵ ) GREEK SMALL LETTER THETA → LATIN CAPITAL LETTER O, ...
03B9 ; ( ι → i ) GREEK SMALL LETTER IOTA → LATIN SMALL LETTER I
03BD ; ( ν → v ) GREEK SMALL LETTER NU → LATIN SMALL LETTER V
03C3 ; ( σ → o ) GREEK SMALL LETTER SIGMA → LATIN SMALL LETTER O
03D1 ; ( ϑ → O̵ ) GREEK THETA SYMBOL → LATIN CAPITAL LETTER O, ...
03F1 ; ( ϱ → p ) GREEK RHO SYMBOL → LATIN SMALL LETTER P
03F4 ; ( ϴ → O̵ ) GREEK CAPITAL THETA SYMBOL → LATIN CAPITAL LETTER O, ...List of all the 72 Greek-Latin confusables: Note, these still include the exceptions above.
grep GREEK confusables.txt | grep LETTER | grep LATIN03B1 ; ( α → a ) GREEK SMALL LETTER ALPHA → LATIN SMALL LETTER A
0391 ; ( Α → A ) GREEK CAPITAL LETTER ALPHA → LATIN CAPITAL LETTER A
1D217; ( 𝈗 → Ɐ ) GREEK VOCAL NOTATION SYMBOL-24 → LATIN CAPITAL LETTER TURNED A
0392 ; ( Β → B ) GREEK CAPITAL LETTER BETA → LATIN CAPITAL LETTER B
03F2 ; ( ϲ → c ) GREEK LUNATE SIGMA SYMBOL → LATIN SMALL LETTER C
03F9 ; ( Ϲ → C ) GREEK CAPITAL LUNATE SIGMA SYMBOL → LATIN CAPITAL LETTER C
03B5 ; ( ε → ꞓ ) GREEK SMALL LETTER EPSILON → LATIN SMALL LETTER C WITH BAR
03F5 ; ( ϵ → ꞓ ) GREEK LUNATE EPSILON SYMBOL → LATIN SMALL LETTER C WITH BAR
037D ; ( ͽ → ꜿ ) GREEK SMALL REVERSED DOTTED LUNATE SIGMA SYMBOL → LATIN SMALL
LETTER REVERSED C WITH DOT
03FF ; ( Ͽ → Ꜿ ) GREEK CAPITAL REVERSED DOTTED LUNATE SIGMA SYMBOL → LATIN CAPITAL
LETTER REVERSED C WITH DOT
03B4 ; ( δ → ẟ ) GREEK SMALL LETTER DELTA → LATIN SMALL LETTER DELTA
0395 ; ( Ε → E ) GREEK CAPITAL LETTER EPSILON → LATIN CAPITAL LETTER E
1D221; ( 𝈡 → Ɛ ) GREEK INSTRUMENTAL NOTATION SYMBOL-7 → LATIN CAPITAL LETTER
OPEN E
1D213; ( 𝈓 → F ) GREEK VOCAL NOTATION SYMBOL-20 → LATIN CAPITAL LETTER F
03DC ; ( Ϝ → F ) GREEK LETTER DIGAMMA → LATIN CAPITAL LETTER F
1D230; ( 𝈰 → ꟻ ) GREEK INSTRUMENTAL NOTATION SYMBOL-30 → LATIN EPIGRAPHIC
LETTER REVERSED F
0397 ; ( Η → H ) GREEK CAPITAL LETTER ETA → LATIN CAPITAL LETTER H
0370 ; ( Ͱ → Ⱶ ) GREEK CAPITAL LETTER HETA → LATIN CAPITAL LETTER HALF H
03B9 ; ( ι → i ) GREEK SMALL LETTER IOTA → LATIN SMALL LETTER I
1FBE ; ( ι → i ) GREEK PROSGEGRAMMENI → LATIN SMALL LETTER I
037A ; ( ͺ → i ) GREEK YPOGEGRAMMENI → LATIN SMALL LETTER I
03F3 ; ( ϳ → j ) GREEK LETTER YOT → LATIN SMALL LETTER J
037F ; ( Ϳ → J ) GREEK CAPITAL LETTER YOT → LATIN CAPITAL LETTER J
039A ; ( Κ → K ) GREEK CAPITAL LETTER KAPPA → LATIN CAPITAL LETTER K
0399 ; ( Ι → l ) GREEK CAPITAL LETTER IOTA → LATIN SMALL LETTER L
1D22A; ( 𝈪 → L ) GREEK INSTRUMENTAL NOTATION SYMBOL-23 → LATIN CAPITAL LETTER L
039C ; ( Μ → M ) GREEK CAPITAL LETTER MU → LATIN CAPITAL LETTER M
03FA ; ( Ϻ → M ) GREEK CAPITAL LETTER SAN → LATIN CAPITAL LETTER M
039D ; ( Ν → N ) GREEK CAPITAL LETTER NU → LATIN CAPITAL LETTER N
03B7 ; ( η → n̩ ) GREEK SMALL LETTER ETA → LATIN SMALL LETTER N, ...
0377 ; ( ͷ → ᴎ ) GREEK SMALL LETTER PAMPHYLIAN DIGAMMA → LATIN LETTER SMALL
CAPITAL REVERSED N
03BF ; ( ο → o ) GREEK SMALL LETTER OMICRON → LATIN SMALL LETTER O
039F ; ( Ο → O ) GREEK CAPITAL LETTER OMICRON → LATIN CAPITAL LETTER O
1D21A; ( 𝈚 → O̵ ) GREEK VOCAL NOTATION SYMBOL-52 → LATIN CAPITAL LETTER O, ...
03B8 ; ( θ → O̵ ) GREEK SMALL LETTER THETA → LATIN CAPITAL LETTER O, ...
03D1 ; ( ϑ → O̵ ) GREEK THETA SYMBOL → LATIN CAPITAL LETTER O, ...
0398 ; ( Θ → O̵ ) GREEK CAPITAL LETTER THETA → LATIN CAPITAL LETTER O, ...
03F4 ; ( ϴ → O̵ ) GREEK CAPITAL THETA SYMBOL → LATIN CAPITAL LETTER O, ...
037B ; ( ͻ → ɔ ) GREEK SMALL REVERSED LUNATE SIGMA SYMBOL → LATIN SMALL
LETTER OPEN O
03FD ; ( Ͻ → Ɔ ) GREEK CAPITAL REVERSED LUNATE SIGMA SYMBOL → LATIN CAPITAL
LETTER OPEN O
03C1 ; ( ρ → p ) GREEK SMALL LETTER RHO → LATIN SMALL LETTER P
03F1 ; ( ϱ → p ) GREEK RHO SYMBOL → LATIN SMALL LETTER P
03A1 ; ( Ρ → P ) GREEK CAPITAL LETTER RHO → LATIN CAPITAL LETTER P
1D29 ; ( ᴩ → ᴘ ) GREEK LETTER SMALL CAPITAL RHO → LATIN LETTER SMALL CAPITAL P
03C6 ; ( φ → ɸ ) GREEK SMALL LETTER PHI → LATIN SMALL LETTER PHI
03D5 ; ( ϕ → ɸ ) GREEK PHI SYMBOL → LATIN SMALL LETTER PHI
03BA ; ( κ → ĸ ) GREEK SMALL LETTER KAPPA → LATIN SMALL LETTER KRA
03F0 ; ( ϰ → ĸ ) GREEK KAPPA SYMBOL → LATIN SMALL LETTER KRA
1D26 ; ( ᴦ → r ) GREEK LETTER SMALL CAPITAL GAMMA → LATIN SMALL LETTER R
1D216; ( 𝈖 → R ) GREEK VOCAL NOTATION SYMBOL-23 → LATIN CAPITAL LETTER R
2129 ; ( ℩ → ɿ ) TURNED GREEK SMALL LETTER IOTA → LATIN SMALL LETTER
REVERSED R WITH FISHHOOK
03B2 ; ( β → ß ) GREEK SMALL LETTER BETA → LATIN SMALL LETTER SHARP S
03D0 ; ( ϐ → ß ) GREEK BETA SYMBOL → LATIN SMALL LETTER SHARP S
03A3 ; ( Σ → Ʃ ) GREEK CAPITAL LETTER SIGMA → LATIN CAPITAL LETTER ESH
03A4 ; ( Τ → T ) GREEK CAPITAL LETTER TAU → LATIN CAPITAL LETTER T
03C4 ; ( τ → ᴛ ) GREEK SMALL LETTER TAU → LATIN LETTER SMALL CAPITAL T
03C5 ; ( υ → u ) GREEK SMALL LETTER UPSILON → LATIN SMALL LETTER U
1D20D; ( 𝈍 → V ) GREEK VOCAL NOTATION SYMBOL-14 → LATIN CAPITAL LETTER V
1D27 ; ( ᴧ → ʌ ) GREEK LETTER SMALL CAPITAL LAMDA → LATIN SMALL LETTER TURNED V
039B ; ( Λ → Ʌ ) GREEK CAPITAL LETTER LAMDA → LATIN CAPITAL LETTER TURNED V
03A7 ; ( Χ → X ) GREEK CAPITAL LETTER CHI → LATIN CAPITAL LETTER X
03B3 ; ( γ → y ) GREEK SMALL LETTER GAMMA → LATIN SMALL LETTER Y
03A5 ; ( Υ → Y ) GREEK CAPITAL LETTER UPSILON → LATIN CAPITAL LETTER Y
03D2 ; ( ϒ → Y ) GREEK UPSILON WITH HOOK SYMBOL → LATIN CAPITAL LETTER Y
0396 ; ( Ζ → Z ) GREEK CAPITAL LETTER ZETA → LATIN CAPITAL LETTER Z
03F8 ; ( ϸ → þ ) GREEK SMALL LETTER SHO → LATIN SMALL LETTER THORN
03F7 ; ( Ϸ → Þ ) GREEK CAPITAL LETTER SHO → LATIN CAPITAL LETTER THORN
03C7 ; ( ꭓ → χ ) LATIN SMALL LETTER CHI → GREEK SMALL LETTER CHI
03C9 ; ( ꞷ → ω ) LATIN SMALL LETTER OMEGA → GREEK SMALL LETTER OMEGAList of all the medial letter and mark ranges. These characters are
treated wrongly in all programming languages I checked. In the UCD
Standard some are wrongly in XID_Start, but must be treated
as XID_Continue, with a special check that they must not be
in the final position of an identifier. Here we prove that for C++26 we
don’t need to check for medial positions, because we restrict our TR31
set.
grep "; XID_Start " DerivedCoreProperties.txt | grep MEDIALFE77 ; XID_Start # Lo ARABIC FATHA MEDIAL FORM
FE79 ; XID_Start # Lo ARABIC DAMMA MEDIAL FORM
FE7B ; XID_Start # Lo ARABIC KASRA MEDIAL FORM
FE7D ; XID_Start # Lo ARABIC SHADDA MEDIAL FORM
FE7F..FEFC ; XID_Start # Lo [126] ARABIC SUKUN MEDIAL FORM
..ARABIC LIGATURE LAM WITH ALEF FINAL FORMAll these are in the excluded Arabic Presentation Forms-B: U+FE70–U+FEFF block.
The ones which are correctly in XID_Continue:
grep "; XID_Continue " DerivedCoreProperties.txt | grep MEDIAL103B..103C ; XID_Continue # Mc [2] MYANMAR CONSONANT SIGN MEDIAL YA
..MYANMAR CONSONANT SIGN MEDIAL RA
103D..103E ; XID_Continue # Mn [2] MYANMAR CONSONANT SIGN MEDIAL WA
..MYANMAR CONSONANT SIGN MEDIAL HA
105E..1060 ; XID_Continue # Mn [3] MYANMAR CONSONANT SIGN MON MEDIAL NA
..MYANMAR CONSONANT SIGN MON MEDIAL LA
1082 ; XID_Continue # Mn MYANMAR CONSONANT SIGN SHAN MEDIAL WA
1A55 ; XID_Continue # Mc TAI THAM CONSONANT SIGN MEDIAL RA
1A56 ; XID_Continue # Mn TAI THAM CONSONANT SIGN MEDIAL LA
FE77 ; XID_Continue # Lo ARABIC FATHA MEDIAL FORM
FE79 ; XID_Continue # Lo ARABIC DAMMA MEDIAL FORM
FE7B ; XID_Continue # Lo ARABIC KASRA MEDIAL FORM
FE7D ; XID_Continue # Lo ARABIC SHADDA MEDIAL FORM
FE7F..FEFC ; XID_Continue # Lo [126] ARABIC SUKUN MEDIAL FORM
..ARABIC LIGATURE LAM WITH ALEF FINAL FORM
1171D..1171F ; XID_Continue # Mn [3] AHOM CONSONANT SIGN MEDIAL LA
..AHOM CONSONANT SIGN MEDIAL LIGATING RA
11940 ; XID_Continue # Mc DIVES AKURU MEDIAL YA
11942 ; XID_Continue # Mc DIVES AKURU MEDIAL RAAll these are either combining marks or in the excluded Arabic Presentation Forms-B: U+FE70–U+FEFF block.
Then see also https://www.unicode.org/reports/tr31/#Table_Optional_Medial, even they are mostly not part of any TR31 XID set. For us relevant is only the Catalan U+B7 MIDDLE DOT, which is an identifier in the Latin script. There is no Catalan script (yet), so we cannot disallow that via our mixed script check. Hence we explicitly disallow the ‘·’ U+B7 MIDDLE DOT and punish all our Catalan programmers for security reasons. Usage of the special Catalan characters ‘Ŀ’ (U+013F) and ‘ŀ’ (U+0140) for this usecase is also disallowed as they are not NFKC. See https://en.wikipedia.org/wiki/Catalan_orthography#Punt_volat_(middot) and https://en.wikipedia.org/wiki/Interpunct. If this turns out too strict add a NFKC exception to allow ‘Ŀ’ (U+013F) and ‘ŀ’ (U+0140).
Other middle dot usages have their own codepoints and their own scripts, such as Chinese U+2027, Katakana U+30FB and U+FF65 (Not NFKC), Hangul U+318D, Canadian Aboriginal Syllabics U+1427 (Limited Use Script), and the Latin U+A78F (Uncommon Use).
00B7 ; XID_Continue # Po MIDDLE DOTSo there is no medial character to consider, also no initial, isolated, nor final positions in the Arabic presentation forms.
From all 82 non-spacing marks, the list of letters already including its 31 non-spacing marks:
NSM: GRAVE 0300
00C0, 00C8, 00CC, 00D2, 00D9, 00E0, 00E8, 00EC 00F2, 00F9, 01DB, 01DC, 01F8, 01F9, 0400, 040D 0450, 045D, 1E14, 1E15, 1E50, 1E51, 1E80, 1E81 1EA6, 1EA7, 1EB0, 1EB1, 1EC0, 1EC1, 1ED2, 1ED3 1EDC, 1EDD, 1EEA, 1EEB, 1EF2, 1EF3, 1F02, 1F03 1F0A, 1F0B, 1F12, 1F13, 1F1A, 1F1B, 1F22, 1F23 1F2A, 1F2B, 1F32, 1F33, 1F3A, 1F3B, 1F42, 1F43 1F4A, 1F4B, 1F52, 1F53, 1F5B, 1F62, 1F63, 1F6A 1F6B, 1F70, 1F72, 1F74, 1F76, 1F78, 1F7A, 1F7C 1FBA, 1FC8, 1FCA, 1FD2, 1FDA, 1FE2, 1FEA, 1FF8 1FFA
“ÀÈÌÒÙàèìòùǛǜǸǹЀЍѐѝḔḕṐṑẀẁẦầẰằỀềỒồỜờỪừỲỳἂἃἊἋἒἓἚἛἢἣἪἫἲἳἺἻὂὃὊὋὒὓὛὢὣὪὫὰὲὴὶὸὺὼᾺῈῊῒῚῢῪῸῺ”
NSM: ACUTE 0301
00C1, 00C9, 00CD, 00D3, 00DA, 00DD, 00E1, 00E9 00ED, 00F3, 00FA, 00FD, 0106, 0107, 0139, 013A 0143, 0144, 0154, 0155, 015A, 015B, 0179, 017A 01D7, 01D8, 01F4, 01F5, 01FA, 01FB, 01FC, 01FD 01FE, 01FF, 0386, 0388, 0389, 038A, 038C, 038E 038F, 0390, 03AC, 03AD, 03AE, 03AF, 03B0, 03CC 03CD, 03CE, 03D3, 0403, 040C, 0453, 045C, 1E08 1E09, 1E16, 1E17, 1E2E, 1E2F, 1E30, 1E31, 1E3E 1E3F, 1E4C, 1E4D, 1E52, 1E53, 1E54, 1E55, 1E78 1E79, 1E82, 1E83, 1EA4, 1EA5, 1EAE, 1EAF, 1EBE 1EBF, 1ED0, 1ED1, 1EDA, 1EDB, 1EE8, 1EE9, 1F04 1F05, 1F0C, 1F0D, 1F14, 1F15, 1F1C, 1F1D, 1F24 1F25, 1F2C, 1F2D, 1F34, 1F35, 1F3C, 1F3D, 1F44 1F45, 1F4C, 1F4D, 1F54, 1F55, 1F5D, 1F64, 1F65 1F6C, 1F6D
“ÁÉÍÓÚÝáéíóúýĆćĹĺŃńŔশŹźǗǘǴǵǺǻǼǽǾǿΆΈΉΊΌΎΏΐάέήίΰόύώϓЃЌѓќḈḉḖḗḮḯḰḱḾḿṌṍṒṓṔṕṸṹẂẃẤấẮắẾếỐốỚớỨứἄἅἌἍἔἕἜἝἤἥἬἭἴἵἼἽὄὅὌὍὔὕὝὤὥὬὭ”
NSM: CIRCUMFLEX 0302
00C2, 00CA, 00CE, 00D4, 00DB, 00E2, 00EA, 00EE 00F4, 00FB, 0108, 0109, 011C, 011D, 0124, 0125 0134, 0135, 015C, 015D, 0174, 0175, 0176, 0177 1E90, 1E91, 1EAC, 1EAD, 1EC6, 1EC7, 1ED8, 1ED9
“ÂÊÎÔÛâêîôûĈĉĜĝĤĥĴĵŜŝŴŵŶŷẐẑẬậỆệỘộ”
NSM: TILDE 0303
00C3, 00D1, 00D5, 00E3, 00F1, 00F5, 0128, 0129 0168, 0169, 1E7C, 1E7D, 1EAA, 1EAB, 1EB4, 1EB5 1EBC, 1EBD, 1EC4, 1EC5, 1ED6, 1ED7, 1EE0, 1EE1 1EEE, 1EEF, 1EF8, 1EF9
“ÃÑÕãñõĨĩŨũṼṽẪẫẴẵẼẽỄễỖỗỠỡỮữỸỹ”
NSM: MACRON 0304
0100, 0101, 0112, 0113, 012A, 012B, 014C, 014D 016A, 016B, 01D5, 01D6, 01DE, 01DF, 01E0, 01E1 01E2, 01E3, 01EC, 01ED, 022A, 022B, 022C, 022D 0230, 0231, 0232, 0233, 04E2, 04E3, 04EE, 04EF 1E20, 1E21, 1E38, 1E39, 1E5C, 1E5D, 1FB1, 1FB9 1FD1, 1FD9, 1FE1, 1FE9
“ĀāĒēĪīŌōŪūǕǖǞǟǠǡǢǣǬǭȪȫȬȭȰȱȲȳӢӣӮӯḠḡḸḹṜṝᾱᾹῑῙῡῩ”
NSM: BREVE 0306
0102, 0103, 0114, 0115, 011E, 011F, 012C, 012D 014E, 014F, 016C, 016D, 040E, 0419, 0439, 045E 04C1, 04C2, 04D0, 04D1, 04D6, 04D7, 1E1C, 1E1D 1EB6, 1EB7, 1FB0, 1FB8, 1FD0, 1FD8, 1FE0, 1FE8
“ĂăĔĕĞğĬĭŎŏŬŭЎЙйўӁӂӐӑӖӗḜḝẶặᾰᾸῐῘῠῨ”
NSM: DOT ABOVE 0307
010A, 010B, 0116, 0117, 0120, 0121, 0130, 017B 017C, 0226, 0227, 022E, 022F, 06A7, 06AC, 06B6 06BF, 06CF, 0762, 0765, 087A, 1DA1, 1E02, 1E03 1E0A, 1E0B, 1E1E, 1E1F, 1E22, 1E23, 1E40, 1E41 1E44, 1E45, 1E56, 1E57, 1E58, 1E59, 1E60, 1E61 1E64, 1E65, 1E66, 1E67, 1E68, 1E69, 1E6A, 1E6B 1E86, 1E87, 1E8A, 1E8B, 1E8E, 1E8F, 1E9B, 312E 10798, 10EB0
“ĊċĖėĠġİŻżȦȧȮȯڧڬڶڿۏݢݥࡺᶡḂḃḊḋḞḟḢḣṀṁṄṅṖṗṘṙṠṡṤṥṦṧṨṩṪṫẆẇẊẋẎẏẛㄮ𐞘𐺰”
NSM: DIAERESIS 0308
00C4, 00CB, 00CF, 00D6, 00DC, 00E4, 00EB, 00EF 00F6, 00FC, 00FF, 0178, 03AA, 03AB, 03CA, 03CB 03D4, 0401, 0407, 0451, 0457, 04D2, 04D3, 04DA 04DB, 04DC, 04DD, 04DE, 04DF, 04E4, 04E5, 04E6 04E7, 04EA, 04EB, 04EC, 04ED, 04F0, 04F1, 04F4 04F5, 04F8, 04F9, 1DF2, 1DF3, 1DF4, 1E26, 1E27 1E4E, 1E4F, 1E7A, 1E7B, 1E84, 1E85, 1E8C, 1E8D 1E97
“ÄËÏÖÜäëïöüÿŸΪΫϊϋϔЁЇёїӒӓӚӛӜӝӞӟӤӥӦӧӪӫӬӭӰӱӴӵӸӹᷲᷳᷴḦḧṎṏṺṻẄẅẌẍẗ”
NSM: HOOK ABOVE 0309
1EA2, 1EA3, 1EA8, 1EA9, 1EB2, 1EB3, 1EBA, 1EBB 1EC2, 1EC3, 1EC8, 1EC9, 1ECE, 1ECF, 1ED4, 1ED5 1EDE, 1EDF, 1EE6, 1EE7, 1EEC, 1EED, 1EF6, 1EF7
“ẢảẨẩẲẳẺẻỂểỈỉỎỏỔổỞởỦủỬửỶỷ”
NSM: RING ABOVE 030A
00C5, 00E5, 016E, 016F, 1E98, 1E99
“ÅåŮůẘẙ”
NSM: DOUBLE ACUTE 030B
0150, 0151, 0170, 0171, 04F2, 04F3
“ŐőŰűӲӳ”
NSM: HACEK 030C
010C, 010D, 010E, 010F, 011A, 011B, 013D, 013E 0147, 0148, 0158, 0159, 0160, 0161, 0164, 0165 017D, 017E, 01CD, 01CE, 01CF, 01D0, 01D1, 01D2 01D3, 01D4, 01D9, 01DA, 01E6, 01E7, 01E8, 01E9 01EE, 01EF, 01F0, 021E, 021F
“ČčĎďĚ켾ŇňŘřŠšŤťŽžǍǎǏǐǑǒǓǔǙǚǦǧǨǩǮǯǰȞȟ”
NSM: DOUBLE GRAVE 030F
0200, 0201, 0204, 0205, 0208, 0209, 020C, 020D 0210, 0211, 0214, 0215, 0476, 0477
“ȀȁȄȅȈȉȌȍȐȑȔȕѶѷ”
NSM: INVERTED BREVE 0311
0202, 0203, 0206, 0207, 020A, 020B, 020E, 020F 0212, 0213, 0216, 0217
“ȂȃȆȇȊȋȎȏȒȓȖȗ”
NSM: COMMA ABOVE 0313
1F00, 1F08, 1F10, 1F18, 1F20, 1F28, 1F30, 1F38 1F40, 1F48, 1F50, 1F60, 1F68, 1FE4
“ἀἈἐἘἠἨἰἸὀὈὐὠὨῤ”
NSM: REVERSED COMMA ABOVE 0314
1F01, 1F09, 1F11, 1F19, 1F21, 1F29, 1F31, 1F39 1F41, 1F49, 1F51, 1F59, 1F61, 1F69, 1FE5, 1FEC
“ἁἉἑἙἡἩἱἹὁὉὑὙὡὩῥῬ”
NSM: HORN 031B
01A0, 01A1, 01AF, 01B0
“ƠơƯư”
NSM: DOT BELOW 0323
068A, 0694, 06A3, 06B9, 06FA, 06FB, 06FC, 0766 088B, 08A5, 08B4, 1E04, 1E05, 1E0C, 1E0D, 1E24 1E25, 1E32, 1E33, 1E36, 1E37, 1E42, 1E43, 1E46 1E47, 1E5A, 1E5B, 1E62, 1E63, 1E6C, 1E6D, 1E7E 1E7F, 1E88, 1E89, 1E92, 1E93, 1EA0, 1EA1, 1EB8 1EB9, 1ECA, 1ECB, 1ECC, 1ECD, 1EE2, 1EE3, 1EE4 1EE5, 1EF0, 1EF1, 1EF4, 1EF5, 1BC26
“ڊڔڣڹۺۻۼݦࢋࢥࢴḄḅḌḍḤḥḲḳḶḷṂṃṆṇṚṛṢṣṬṭṾṿẈẉẒẓẠạẸẹỊịỌọỢợỤụỰựỴỵ𛰦”
NSM: DOUBLE DOT BELOW 0324
1E72, 1E73
“Ṳṳ”
NSM: RING BELOW 0325
1E00, 1E01
“Ḁḁ”
NSM: COMMA BELOW 0326
0218, 0219, 021A, 021B
“ȘșȚț”
NSM: CEDILLA 0327
00C7, 00E7, 0122, 0123, 0136, 0137, 013B, 013C 0145, 0146, 0156, 0157, 015E, 015F, 0162, 0163 0228, 0229, 1E10, 1E11, 1E28, 1E29
“ÇçĢģĶķĻļŅņŖŗŞşŢţȨȩḐḑḨḩ”
NSM: OGONEK 0328
0104, 0105, 0118, 0119, 012E, 012F, 0172, 0173 01EA, 01EB
“ĄąĘęĮįŲųǪǫ”
NSM: CIRCUMFLEX BELOW 032D
1E12, 1E13, 1E18, 1E19, 1E3C, 1E3D, 1E4A, 1E4B 1E70, 1E71, 1E76, 1E77
“ḒḓḘḙḼḽṊṋṰṱṶṷ”
NSM: BREVE BELOW 032E
1E2A, 1E2B
“Ḫḫ”
NSM: TILDE BELOW 0330
1E1A, 1E1B, 1E2C, 1E2D, 1E74, 1E75
“ḚḛḬḭṴṵ”
NSM: MACRON BELOW 0331
1E06, 1E07, 1E0E, 1E0F, 1E34, 1E35, 1E3A, 1E3B 1E48, 1E49, 1E5E, 1E5F, 1E6E, 1E6F, 1E94, 1E95 1E96
“ḆḇḎḏḴḵḺḻṈṉṞṟṮṯẔẕẖ”
NSM: THREE DOTS ABOVE 20DB
063F, 0685, 069E, 069F, 06A0, 06A8, 06B4, 06B7 06BD, 0763, 08A7, 08C3, 08C4, 08C5
“ؿڅڞڟڠڨڴڷڽݣࢧࣃࣄࣅ”
NSM: FOUR DOTS ABOVE 20DC
0690, 0699, 075C
“ڐڙݜ”
NSM: KATAKANA-HIRAGANA VOICED SOUND MARK 3099
304C, 304E, 3050, 3052, 3054, 3056, 3058, 305A 305C, 305E, 3060, 3062, 3065, 3067, 3069, 3070 3073, 3076, 3079, 307C, 3094, 309E, 30AC, 30AE 30B0, 30B2, 30B4, 30B6, 30B8, 30BA, 30BC, 30BE 30C0, 30C2, 30C5, 30C7, 30C9, 30D0, 30D3, 30D6 30D9, 30DC, 30F4, 30F7, 30F8, 30F9, 30FA, 30FE FF9E
“がぎぐげござじずぜぞだぢづでどばびぶべぼゔゞガギグゲゴザジズゼゾダヂヅデドバビブベボヴヷヸヹヺヾﾞ”
NSM: KATAKANA-HIRAGANA SEMI-VOICED SOUND MARK 309A
3071, 3074, 3077, 307A, 307D, 30D1, 30D4, 30D7 30DA, 30DD, FF9F
“ぱぴぷぺぽパピプペポﾟ”
http://www.unicode.org/reports/tr31/tr31-11.html#Alternative_Identifier_Syntax
http://www.unicode.org/reports/tr31/tr31-11.html#Default_Identifier_Syntax
[N3146] Clark Nelson. 2010. Recommendations for extended identifier characters for C and C++.
[P1949] Steve Downey et al. 2021. C++ Identifier Syntax using Unicode Standard Annex 31.
: http://www.open-std.org/jtc1/sc22/wg21/docs/papers/2021/p1949r7.html
https://www.unicode.org/reports/tr31/#Table_Candidate_Characters_for_Exclusion_from_Identifiers
http://www.unicode.org/reports/tr31/#Table_Limited_Use_Scripts
[TR39#Table 1] Identifier Status and Type Table 1.
https://www.unicode.org/reports/tr39/#Identifier_Status_and_Type
<https://www.unicode.org/reports/tr39/#Confusable Detection>
https://www.unicode.org/reports/tr39/#Restriction_Level_Detection
https://unicode.org/reports/tr55/#Identifier-Chunks (Proposed Draft 2022-11-18)