Reece H. Dunn
b716b95feb
mkencodingtable: support mapping ISO 8859 encoding tables
2017-03-28 07:48:52 +01:00
Reece H. Dunn
6346ede604
isalnum: use the Alphabetic derived core property to check that the character is in the alpha class.
2017-02-12 21:22:01 +00:00
Reece H. Dunn
cbddf092c9
isalpha: use the Alphabetic derived core property to check that the character is in the alpha class.
2017-02-12 21:20:03 +00:00
Reece H. Dunn
b38659582f
islower: include the Other_Lowercase characters.
2017-02-12 17:28:22 +00:00
Reece H. Dunn
9d1469b956
printdata: use the Uppercase property from DerivedCoreProperties.
2017-02-12 16:03:55 +00:00
Reece H. Dunn
1fc20f39f5
isupper: include the Other_Uppercase characters.
2017-02-12 14:51:24 +00:00
Reece H. Dunn
d956501863
printdata: load all the properties from the PropList data.
2017-02-12 14:26:09 +00:00
Reece H. Dunn
ac082c9400
Add tests for the remaining is* APIs.
2017-02-12 13:19:43 +00:00
Reece H. Dunn
eb08dc422d
Update the copyright dates.
2017-02-12 12:24:18 +00:00
Reece H. Dunn
c9f2940373
isblank: don't include <noBreak> characters, and add tests for this API.
2017-02-12 11:47:30 +00:00
Reece H. Dunn
f109bb918f
isspace: don't include <noBreak> characters.
2017-02-12 11:11:52 +00:00
Reece H. Dunn
5f9dc111cf
Add tests for the isdigit and isxdigit ctype APIs.
2017-02-12 09:53:43 +00:00
Reece H. Dunn
bd71fed013
ctype: return true in isupper/islower if there is a simple case mapping present
2017-02-12 09:22:25 +00:00
Reece H. Dunn
e77b7c7b49
printdata: create an isspace helper function
2017-02-12 08:48:40 +00:00
Reece H. Dunn
ceda811b12
printdata: add the properties to the primary data map
2017-02-12 08:16:23 +00:00
Reece H. Dunn
a2193799e4
printdata: use get to return a default value if the map key is not present
2017-02-12 08:03:15 +00:00
Reece H. Dunn
cd9cc8e6e2
Unicode Character Data 9.0.0
2016-12-28 20:16:35 +00:00
Reece H. Dunn
a83ce9ee8e
Python 3 compatibility fixes.
2016-12-28 19:42:36 +00:00
Reece H. Dunn
7201a1a150
Convert scripts.cpp from C++ to C.
2016-05-31 00:07:30 +01:00
Reece H. Dunn
707998940d
Convert categories.cpp from C++ to C.
2016-05-31 00:00:41 +01:00
Reece H. Dunn
0afcb3f89f
Convert case.cpp from C++ to C.
2016-05-30 23:59:17 +01:00
Reece H. Dunn
454038dbfa
Create a C-based API in addition to the C++-based API in <ucd/ucd.h>.
2016-05-30 22:29:04 +01:00
Reece H. Dunn
bcf8be59b3
Support enabling the CSUR data.
2014-11-08 11:11:19 +00:00
Reece H. Dunn
28baabf72a
Remove the IANA subtag registry parser
...
This is not needed now that PropertyValueAliases is used for script
mapping.
2014-11-08 10:22:37 +00:00
Reece H. Dunn
1154409393
Use PropertyValueAliases for the script mapping.
...
The mapping of the script labels in the UCD data to ISO 15924
script tags is now done using the sc property map in the
PropertyValueAliases data.
This has the following benefits:
1. It removes the dependency on the IANA subtag registry.
2. It ensures the scripts are correct as specified in the
UCD data files.
2014-11-08 10:08:04 +00:00
Reece H. Dunn
8a8f021a2c
ucd: support parsing PropertyValueAliases data
2014-11-08 09:33:43 +00:00
Reece H. Dunn
9589e27f0f
tools/printdata.py: don't include CSUR data in the tests
2014-07-14 13:30:32 +01:00
Reece H. Dunn
ced06ed0f4
Do not include supplementary data in the UCD APIs.
...
This removes support for the CSUR (ConScript Unicode Registry) data
in the main Unicode APIs. This data should be accessed through a
different API.
2014-07-14 13:12:22 +01:00
Reece H. Dunn
b757f60c63
Unicode Character Data 7.0.0
2014-06-28 11:33:59 +01:00
Reece H. Dunn
4747999f57
tools/iana.py: read_data is not used, so remove it
2013-10-17 09:20:41 +01:00
Reece H. Dunn
88e72aeb0a
tools/ucd.py: support printing out the data as CSV with specified columns from the command-line
2013-02-11 12:40:52 +00:00
Reece H. Dunn
7e411b34e9
F8D0-D8FF: Klingon
2012-12-24 22:37:18 +00:00
Reece H. Dunn
c06f296d87
tools/scripts.py: merge some script set ranges
2012-12-24 21:34:34 +00:00
Reece H. Dunn
65f95033c8
Add support for querying the Script property.
2012-12-24 21:32:22 +00:00
Reece H. Dunn
349e225aae
Support mapping a General Category to a General Category Group.
2012-12-24 15:55:23 +00:00
Reece H. Dunn
6e15fd6d9b
Add tests for ucd::lookup_category_group.
2012-12-24 15:38:39 +00:00
Reece H. Dunn
3f9f6c0623
Add tests for ucd::isspace.
2012-12-24 15:26:36 +00:00
Reece H. Dunn
cc9abdff12
Fetch UnicodeData.txt from unicode.org if not present to make the build fully automated.
2012-12-24 14:47:06 +00:00
Reece H. Dunn
2d982956a5
Store the category data in uint8_t arrays to minimize their compiled size.
2012-12-22 13:05:09 +00:00
Reece H. Dunn
2df0e6abdb
Factor out the remaining single category tables.
2012-12-22 12:55:23 +00:00
Reece H. Dunn
7f1dd9cc96
Avoid duplicating Lo only tables.
2012-12-22 12:49:55 +00:00
Reece H. Dunn
ea09eb5c45
Add tests for querying UCD properties; fix discovered issues.
2012-12-22 12:18:49 +00:00
Reece H. Dunn
9c3a87dbeb
Add toupper, tolower and totitle case-conversion APIs.
2012-12-22 09:57:21 +00:00
Reece H. Dunn
e3e85d33f2
Rename Ci to Ii and move it to an I/Invalid category group as it is not part of the UCD C/Other category group.
2012-12-22 01:27:18 +00:00
Reece H. Dunn
bc6a5c23cc
Remove the Zc class as it is not part of the UCD; special case Cc-based whitespace instead.
2012-12-22 01:19:03 +00:00
Reece H. Dunn
ff7a5e0209
Add support for looking up the general category group for a codepoint.
2012-12-22 01:09:49 +00:00
Reece H. Dunn
a416b4090c
Display the Unicode Character Database version in the generated file.
2012-12-22 00:08:38 +00:00
Reece H. Dunn
12bafa6b4d
tools/categories.py: generate category lookup tables for the full unicode range.
2012-12-21 23:55:27 +00:00
Reece H. Dunn
e6133fcafd
tools/ucd.py: fixup the codepoint ranges when processing the UnicodeData file.
2012-12-21 21:04:17 +00:00
Reece H. Dunn
a77e5a142c
tools/ucd.py: parse CodePoint/CodeRange entries to their numerical values.
2012-12-21 20:53:33 +00:00
Reece H. Dunn