Reece H. Dunn
bcf8be59b3
Support enabling the CSUR data.
2014-11-08 11:11:19 +00:00
Reece H. Dunn
28baabf72a
Remove the IANA subtag registry parser
...
This is not needed now that PropertyValueAliases is used for script
mapping.
2014-11-08 10:22:37 +00:00
Reece H. Dunn
1154409393
Use PropertyValueAliases for the script mapping.
...
The mapping of the script labels in the UCD data to ISO 15924
script tags is now done using the sc property map in the
PropertyValueAliases data.
This has the following benefits:
1. It removes the dependency on the IANA subtag registry.
2. It ensures the scripts are correct as specified in the
UCD data files.
2014-11-08 10:08:04 +00:00
Reece H. Dunn
8a8f021a2c
ucd: support parsing PropertyValueAliases data
2014-11-08 09:33:43 +00:00
Reece H. Dunn
9589e27f0f
tools/printdata.py: don't include CSUR data in the tests
2014-07-14 13:30:32 +01:00
Reece H. Dunn
ced06ed0f4
Do not include supplementary data in the UCD APIs.
...
This removes support for the CSUR (ConScript Unicode Registry) data
in the main Unicode APIs. This data should be accessed through a
different API.
2014-07-14 13:12:22 +01:00
Reece H. Dunn
b757f60c63
Unicode Character Data 7.0.0
2014-06-28 11:33:59 +01:00
Reece H. Dunn
4747999f57
tools/iana.py: read_data is not used, so remove it
2013-10-17 09:20:41 +01:00
Reece H. Dunn
88e72aeb0a
tools/ucd.py: support printing out the data as CSV with specified columns from the command-line
2013-02-11 12:40:52 +00:00
Reece H. Dunn
7e411b34e9
F8D0-D8FF: Klingon
2012-12-24 22:37:18 +00:00
Reece H. Dunn
c06f296d87
tools/scripts.py: merge some script set ranges
2012-12-24 21:34:34 +00:00
Reece H. Dunn
65f95033c8
Add support for querying the Script property.
2012-12-24 21:32:22 +00:00
Reece H. Dunn
349e225aae
Support mapping a General Category to a General Category Group.
2012-12-24 15:55:23 +00:00
Reece H. Dunn
6e15fd6d9b
Add tests for ucd::lookup_category_group.
2012-12-24 15:38:39 +00:00
Reece H. Dunn
3f9f6c0623
Add tests for ucd::isspace.
2012-12-24 15:26:36 +00:00
Reece H. Dunn
cc9abdff12
Fetch UnicodeData.txt from unicode.org if not present to make the build fully automated.
2012-12-24 14:47:06 +00:00
Reece H. Dunn
2d982956a5
Store the category data in uint8_t arrays to minimize their compiled size.
2012-12-22 13:05:09 +00:00
Reece H. Dunn
2df0e6abdb
Factor out the remaining single category tables.
2012-12-22 12:55:23 +00:00
Reece H. Dunn
7f1dd9cc96
Avoid duplicating Lo only tables.
2012-12-22 12:49:55 +00:00
Reece H. Dunn
ea09eb5c45
Add tests for querying UCD properties; fix discovered issues.
2012-12-22 12:18:49 +00:00
Reece H. Dunn
9c3a87dbeb
Add toupper, tolower and totitle case-conversion APIs.
2012-12-22 09:57:21 +00:00
Reece H. Dunn
e3e85d33f2
Rename Ci to Ii and move it to an I/Invalid category group as it is not part of the UCD C/Other category group.
2012-12-22 01:27:18 +00:00
Reece H. Dunn
bc6a5c23cc
Remove the Zc class as it is not part of the UCD; special case Cc-based whitespace instead.
2012-12-22 01:19:03 +00:00
Reece H. Dunn
ff7a5e0209
Add support for looking up the general category group for a codepoint.
2012-12-22 01:09:49 +00:00
Reece H. Dunn
a416b4090c
Display the Unicode Character Database version in the generated file.
2012-12-22 00:08:38 +00:00
Reece H. Dunn
12bafa6b4d
tools/categories.py: generate category lookup tables for the full unicode range.
2012-12-21 23:55:27 +00:00
Reece H. Dunn
e6133fcafd
tools/ucd.py: fixup the codepoint ranges when processing the UnicodeData file.
2012-12-21 21:04:17 +00:00
Reece H. Dunn
a77e5a142c
tools/ucd.py: parse CodePoint/CodeRange entries to their numerical values.
2012-12-21 20:53:33 +00:00
Reece H. Dunn
2813950acc
Infrastructure for building libucd.a.
2012-12-21 19:41:33 +00:00
Reece H. Dunn
1b24e604ed
Parse the UCD data files.
2012-12-21 15:37:22 +00:00
Reece H. Dunn