I18n:Updating Unicode version: Difference between revisions
(Document the update-JS's-Unicode-version process) |
|||
| Line 35: | Line 35: | ||
#Copy this file to intl/unicharutil/tools/UnicodeData-Latest.txt in the mozilla source tree | #Copy this file to intl/unicharutil/tools/UnicodeData-Latest.txt in the mozilla source tree | ||
#Run <tt>perl gentransliterate.pl</tt> in intl/unichar/tools. This creates a new version of intl/unicharutil/tables/transliterate.properties | #Run <tt>perl gentransliterate.pl</tt> in intl/unichar/tools. This creates a new version of intl/unicharutil/tables/transliterate.properties | ||
== JavaScript Unicode support == | |||
To update SpiderMonkey's Unicode support: | |||
* move into <code>js/src/vm/</code> | |||
* run <code>python ./make_unicode.py</code> | |||
* verify that <code>UnicodeData.txt</code> and the derived files were correctly updated | |||
Note that running <code>python ./make_unicode.py FILENAME</code> instead uses <code>FILENAME</code> as a <code>UnicodeData.txt</code>, if you ever want to generate new data without overwriting the current <code>js/src/vm/UnicodeData.txt</code>. | |||
Revision as of 20:17, 9 October 2012
This document describes the process of updating the files in the Mozilla codebase that are generated from Unicode data files.
Unicode properties
To regenerate the tables in nsUnicodePropertyData.cpp:
Download the current Unicode data files from http://www.unicode.org/Public/UNIDATA/
NB: not all the files are actually needed; currently, we require
- UnicodeData.txt
- Scripts.txt
- EastAsianWidth.txt
- BidiMirroring.txt
- HangulSyllableType.txt
- ReadMe.txt (to record version/date of the UCD)
- Unihan_Variants.txt (from Unihan.zip)
though this may change if we find a need for additional properties.
The Unicode data files listed above should be together in one directory.
We also require the file http://www.unicode.org/Public/security/latest/xidmodifications.txt
This file should be in a sub-directory "security" immediately below the directory containing the other Unicode data files.
From intl/unicharutil/util, run the command:
perl ../tools/genUnicodePropertyData.pl /path/to/hb-common.h /path/to/UCD-directory
(where hb-common.h is found in the gfx/harfbuzz/src directory).
This will generate (or overwrite!) the files
- nsUnicodePropertyData.cpp
- nsUnicodeScriptCodes.h
in the current directory.
Normalization
Transliteration
- Download the latest version of UnicodeData.txt from the Unicode website. The current version can be found at http://www.unicode.org/Public/UNIDATA/UnicodeData.txt.
- Copy this file to intl/unicharutil/tools/UnicodeData-Latest.txt in the mozilla source tree
- Run perl gentransliterate.pl in intl/unichar/tools. This creates a new version of intl/unicharutil/tables/transliterate.properties
JavaScript Unicode support
To update SpiderMonkey's Unicode support:
- move into
js/src/vm/ - run
python ./make_unicode.py - verify that
UnicodeData.txtand the derived files were correctly updated
Note that running python ./make_unicode.py FILENAME instead uses FILENAME as a UnicodeData.txt, if you ever want to generate new data without overwriting the current js/src/vm/UnicodeData.txt.