Cross Reference: /external/icu/icu4c/source/data/mappings/

== Notes on {kddi,docomo,softbank}-*.ucm mappings.

kddi-jisx-208 is a variant of JIS X 208 used by KDDI, a Japanese cell
phone carrier.

kddi-shift_jis, docomo-shift_jis, and softbank-shift_jis are variants
of Shift_JIS used by KDDI, DoCoMo and SoftBank.

  - kddi-jisx-208 contains Emoji (emoticon) code points in
    0x75xx, 0x76xx, 0x77xx, 0x78xx, 0x79xx, 0x7Axx, 0x7Bxx,
    where xx means 21-7E.

  - kddi-shift_jis contains Emoji code points in
    0xEBxx, 0xECxx, 0xEDxx, and 0xEExx, 0xF3xx, 0xF4xx, 0xF6xx, 0xF7xx,
    where xx means 40-7E, 80-FC.

  - docomo-shift_jis contains Emoji code points in
    0xF8xx, and 0xF9xx, where xx means 40-7E, 80-FC.

  - softbank-shift_jis contains Emoji code points in
    0xF7xx, 0xF9xx, and 0xFBxx, where xx means 40-7E, 80-FC.

  - softbank-jisx-208 contains Emoji code points in
    0x75xx, 0x76xx, 0x77xx, 0x78xx, 0x79xx, 0x7Axx, 0x7Bxx, 0x7Dxx
    where xx means 21-7E.


== How the -2012.ucm tables were modified in April 2013

The -2012 versions were created by
    http://code.google.com/p/emoji4unicode/source/browse/trunk/src/gen_conversion_files.py

using each of the older 2012 versions as the base table files
to avoid non-Emoji changes:

# gen_google_ucm.sh
icu_mappings=/google/src/cloud/mscherer/icubranch/google_vendor_src_branch/icu/source/data/mappings
dest=/home/mscherer/www/no_crawl/emoji
./gen_conversion_files.py $icu_mappings/docomo-shift_jis-2012.ucm
cp ../generated/docomo-shift_jis-2012.ucm $dest
./gen_conversion_files.py $icu_mappings/kddi-shift_jis-2012.ucm
cp ../generated/kddi-shift_jis-2012.ucm $dest
./gen_conversion_files.py $icu_mappings/softbank-shift_jis-2012.ucm
cp ../generated/softbank-shift_jis-2012.ucm $dest
./gen_conversion_files.py

The only differences from 2012-sep are in mappings for symbols
that have Unicode Variation Selector (VS) sequences.

The older tables relied on a hack in the ICU conversion code that
ignored the "use fallback" flag for fallbacks from sequences with VS.

The new tables rely on a new feature in ICU4C 51:
For the relevant symbols that have roundtrip mappings,
- the mappings with Emoji Variation Selector
  use the |0 roundtrip precision
- the other mappings (no VS & text VS)
  use the |4 "good one-way" precision

See http://bugs.icu-project.org/trac/ticket/9602

== How the -2012.ucm tables were created in September 2012

The 2012 versions were created by
    http://code.google.com/p/emoji4unicode/source/browse/trunk/src/gen_conversion_files.py

using each of the 2007 versions as the base table files
to avoid non-Emoji changes:

icu_mappings=~/p4/emoji/google_vendor_src_branch/icu/source/data/mappings
dest=~/www/no_crawl/emoji
./gen_conversion_files.py $icu_mappings/docomo-shift_jis-2007.ucm
cp ../generated/docomo-shift_jis-2012.ucm $dest
./gen_conversion_files.py $icu_mappings/kddi-shift_jis-2007.ucm
cp ../generated/kddi-shift_jis-2012.ucm $dest
./gen_conversion_files.py $icu_mappings/softbank-shift_jis-2007.ucm
cp ../generated/softbank-shift_jis-2012.ucm $dest
./gen_conversion_files.py

The emoji4unicode code uses the mappings that were established during the
Unicode Emoji standardization process.
The new conversion tables round-trip carrier Emoji symbol codes
to and from Unicode 6 standard code points
and also include fallback mappings from the Google PUA code points
to the carrier codes.

The trailing "|0" etc. on the mapping table lines specify the mapping type:
    |0  round-trip              Unicode <-> charset
    |1  fallback                Unicode  -> charset
    |3  "reverse fallback"      Unicode <-  charset

For details about the .ucm file format see
http://userguide.icu-project.org/conversion/data#TOC-.ucm-File-Format

== How the -2007.ucm tables were created

So far, we haven't obtained "official" conversion tables from the cell
phone carriers.  However, we empirically know their clients support
VDCs in MS932, like U2460 (CIRCLED DIGIT ONE), etc.  Hence we use
MS932 as the base table for them.

kddi-jisx-208-2007.ucm is based on jisx-208.ucm in this directory.
The original table's mappings to codes 0x75xx to 0x7Bxx are excluded
to avoid collisions with emoji.

kddi-shift_jis-2007.ucm is based on windows-932-2000.ucm.
The original table's mappings to codes 0xEBxx to 0xEExx, and 0xF0xx to
0xF90xx (EUDC block), are excluded to avoid collisions with emoji.

docomo-shift_jis-2007.ucm is based on windows-932-2000.ucm.
The original table's mappings to codes 0xF0xx to 0xF90xx (EUDC block)
are excluded to avoid collisions with emoji.

softbank-shift_jis-2007.ucm is based on windows-932-2000.ucm.
The original table's mappings to codes 0xF0xx to 0xF90xx (EUDC block),
and 0xFBxx, are excluded to avoid collisions with emoji.

softbank-jisx-208-2007.ucm is based on jisx-208.ucm in this directory.
The original table's mappings to codes 0x75xx to 0x7Bxx, and 0x7Dxx
are excluded to avoid collisions with emoji.

== Google Standard Emoji Unicode Mapping

The Google standard emoji Unicode mapping can be found at:

  /home/build/google3/i18n/encodings/emoji/emoji_unicode_mapping.txt


TODO(mscherer): Use <icu:base> to share most standard JIS mappings
among *-shift_jis-2007.ucm files.
Name	Date	Size
..	12-Mar-2015	4 KiB
cns-11643-1992.ucm	12-Mar-2015	318.7 KiB
convrtrs.txt	12-Mar-2015	78.6 KiB
docomo-shift_jis-2012.ucm	12-Mar-2015	173.8 KiB
ebcdic-xml-us.ucm	12-Mar-2015	6.6 KiB
euc-jp-2007.ucm	12-Mar-2015	291.1 KiB
gb18030.ucm	12-Mar-2015	657.6 KiB
gsm-03.38-2000.ucm	12-Mar-2015	4.7 KiB
ibm-1006_P100-1995.ucm	12-Mar-2015	7.5 KiB
ibm-1025_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-1026_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-1047_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-1051_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-1089_P100-1995.ucm	12-Mar-2015	7.7 KiB
ibm-1097_P100-1995.ucm	12-Mar-2015	7.5 KiB
ibm-1098_P100-1995.ucm	12-Mar-2015	8.1 KiB
ibm-1112_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-1122_P100-1999.ucm	12-Mar-2015	6.2 KiB
ibm-1123_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-1124_P100-1996.ucm	12-Mar-2015	6.2 KiB
ibm-1125_P100-1997.ucm	12-Mar-2015	6.8 KiB
ibm-1129_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1130_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1131_P100-1997.ucm	12-Mar-2015	6.8 KiB
ibm-1132_P100-1998.ucm	12-Mar-2015	5.8 KiB
ibm-1133_P100-1997.ucm	12-Mar-2015	5.8 KiB
ibm-1137_P100-1999.ucm	12-Mar-2015	6.1 KiB
ibm-1140_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1141_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1142_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1143_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1144_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1145_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1146_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1147_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1148_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1149_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-1153_P100-1999.ucm	12-Mar-2015	6.2 KiB
ibm-1154_P100-1999.ucm	12-Mar-2015	6.2 KiB
ibm-1155_P100-1999.ucm	12-Mar-2015	6.2 KiB
ibm-1156_P100-1999.ucm	12-Mar-2015	6.2 KiB
ibm-1157_P100-1999.ucm	12-Mar-2015	6.2 KiB
ibm-1158_P100-1999.ucm	12-Mar-2015	6.2 KiB
ibm-1160_P100-1999.ucm	12-Mar-2015	6.2 KiB
ibm-1162_P100-1999.ucm	12-Mar-2015	6.1 KiB
ibm-1164_P100-1999.ucm	12-Mar-2015	6.2 KiB
ibm-1168_P100-2002.ucm	12-Mar-2015	6.2 KiB
ibm-1250_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-1251_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-1252_P100-2000.ucm	12-Mar-2015	6.2 KiB
ibm-1253_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-1254_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-1255_P100-1995.ucm	12-Mar-2015	5.9 KiB
ibm-1256_P110-1997.ucm	12-Mar-2015	8.6 KiB
ibm-1257_P100-1995.ucm	12-Mar-2015	6.1 KiB
ibm-1258_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-12712_P100-1998.ucm	12-Mar-2015	5.7 KiB
ibm-1276_P100-1995.ucm	12-Mar-2015	5.5 KiB
ibm-1363_P110-1997.ucm	12-Mar-2015	342.3 KiB
ibm-1363_P11B-1998.ucm	12-Mar-2015	342 KiB
ibm-1364_P110-2007.ucm	12-Mar-2015	386.3 KiB
ibm-1371_P100-1999.ucm	12-Mar-2015	400.5 KiB
ibm-1373_P100-2002.ucm	12-Mar-2015	388.1 KiB
ibm-1375_P100-2007.ucm	12-Mar-2015	420.9 KiB
ibm-1383_P110-1999.ucm	12-Mar-2015	177.1 KiB
ibm-1386_P100-2001.ucm	12-Mar-2015	472.6 KiB
ibm-1388_P103-2001.ucm	12-Mar-2015	637.4 KiB
ibm-1390_P110-2003.ucm	12-Mar-2015	437.1 KiB
ibm-1399_P110-2003.ucm	12-Mar-2015	437.3 KiB
ibm-16684_P110-2003.ucm	12-Mar-2015	433.4 KiB
ibm-16804_X110-1999.ucm	12-Mar-2015	7.4 KiB
ibm-273_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-277_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-278_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-280_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-284_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-285_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-290_P100-1995.ucm	12-Mar-2015	5.7 KiB
ibm-297_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-33722_P120-1999.ucm	12-Mar-2015	191.3 KiB
ibm-33722_P12A_P12A-2004_U2.ucm	12-Mar-2015	191.2 KiB
ibm-33722_P12A_P12A-2009_U2.ucm	12-Mar-2015	192.9 KiB
ibm-37_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-420_X120-1999.ucm	12-Mar-2015	7.6 KiB
ibm-424_P100-1995.ucm	12-Mar-2015	5.6 KiB
ibm-437_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-4517_P100-2005.ucm	12-Mar-2015	7.7 KiB
ibm-4899_P100-1998.ucm	12-Mar-2015	4.2 KiB
ibm-4909_P100-1999.ucm	12-Mar-2015	6.1 KiB
ibm-4971_P100-1999.ucm	12-Mar-2015	6.1 KiB
ibm-500_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-5012_P100-1999.ucm	12-Mar-2015	5.6 KiB
ibm-5123_P100-1999.ucm	12-Mar-2015	5.8 KiB
ibm-5346_P100-1998.ucm	12-Mar-2015	6.2 KiB
ibm-5347_P100-1998.ucm	12-Mar-2015	6.2 KiB
ibm-5348_P100-1997.ucm	12-Mar-2015	6.2 KiB
ibm-5349_P100-1998.ucm	12-Mar-2015	6.2 KiB
ibm-5350_P100-1998.ucm	12-Mar-2015	6.2 KiB
ibm-5351_P100-1998.ucm	12-Mar-2015	5.9 KiB
ibm-5352_P100-1998.ucm	12-Mar-2015	8.6 KiB
ibm-5353_P100-1998.ucm	12-Mar-2015	6.1 KiB
ibm-5354_P100-1998.ucm	12-Mar-2015	6.2 KiB
ibm-5471_P100-2006.ucm	12-Mar-2015	382.7 KiB
ibm-5478_P100-1995.ucm	12-Mar-2015	146.2 KiB
ibm-720_P100-1997.ucm	12-Mar-2015	6.1 KiB
ibm-737_P100-1997.ucm	12-Mar-2015	6.8 KiB
ibm-775_P100-1996.ucm	12-Mar-2015	6.8 KiB
ibm-803_P100-1999.ucm	12-Mar-2015	4 KiB
ibm-813_P100-1995.ucm	12-Mar-2015	6.1 KiB
ibm-838_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-8482_P100-1999.ucm	12-Mar-2015	5.8 KiB
ibm-850_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-851_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-852_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-855_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-856_P100-1995.ucm	12-Mar-2015	6.1 KiB
ibm-857_P100-1995.ucm	12-Mar-2015	6.7 KiB
ibm-858_P100-1997.ucm	12-Mar-2015	6.8 KiB
ibm-860_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-861_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-862_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-863_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-864_X110-1999.ucm	12-Mar-2015	8.2 KiB
ibm-865_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-866_P100-1995.ucm	12-Mar-2015	6.8 KiB
ibm-867_P100-1998.ucm	12-Mar-2015	6.7 KiB
ibm-868_P100-1995.ucm	12-Mar-2015	8.1 KiB
ibm-869_P100-1995.ucm	12-Mar-2015	6.7 KiB
ibm-870_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-871_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-874_P100-1995.ucm	12-Mar-2015	5.7 KiB
ibm-875_P100-1995.ucm	12-Mar-2015	6.1 KiB
ibm-878_P100-1996.ucm	12-Mar-2015	6.2 KiB
ibm-9005_X110-2007.ucm	12-Mar-2015	6.2 KiB
ibm-901_P100-1999.ucm	12-Mar-2015	7.2 KiB
ibm-902_P100-1999.ucm	12-Mar-2015	7.3 KiB
ibm-9067_X100-2005.ucm	12-Mar-2015	6.2 KiB
ibm-912_P100-1995.ucm	12-Mar-2015	7.3 KiB
ibm-913_P100-2000.ucm	12-Mar-2015	6.1 KiB
ibm-914_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-915_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-916_P100-1995.ucm	12-Mar-2015	5.6 KiB
ibm-918_P100-1995.ucm	12-Mar-2015	7.5 KiB
ibm-920_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-921_P100-1995.ucm	12-Mar-2015	6.2 KiB
ibm-922_P100-1999.ucm	12-Mar-2015	7.3 KiB
ibm-923_P100-1998.ucm	12-Mar-2015	6.2 KiB
ibm-930_P120-1999.ucm	12-Mar-2015	234.1 KiB
ibm-933_P110-1995.ucm	12-Mar-2015	215.3 KiB
ibm-935_P110-1999.ucm	12-Mar-2015	187.2 KiB
ibm-937_P110-1999.ucm	12-Mar-2015	400.6 KiB
ibm-939_P120-1999.ucm	12-Mar-2015	234.2 KiB
ibm-942_P12A-1999.ucm	12-Mar-2015	185.4 KiB
ibm-943_P130-1999.ucm	12-Mar-2015	194.3 KiB
ibm-943_P15A-2003.ucm	12-Mar-2015	192.4 KiB
ibm-9447_P100-2002.ucm	12-Mar-2015	6 KiB
ibm-9448_X100-2005.ucm	12-Mar-2015	9.2 KiB
ibm-9449_P100-2002.ucm	12-Mar-2015	6.1 KiB
ibm-949_P110-1999.ucm	12-Mar-2015	203 KiB
ibm-949_P11A-1999.ucm	12-Mar-2015	202.7 KiB
ibm-950_P110-1999.ucm	12-Mar-2015	401.1 KiB
ibm-954_P101-2007.ucm	12-Mar-2015	324.9 KiB
ibm-964_P110-1999.ucm	12-Mar-2015	512.4 KiB
ibm-970_P110_P110-2006_U2.ucm	12-Mar-2015	169.6 KiB
ibm-971_P100-1995.ucm	12-Mar-2015	165.2 KiB
icu-internal-25546.ucm	12-Mar-2015	169 KiB
icu-internal-compound-d1.ucm	12-Mar-2015	71.1 KiB
icu-internal-compound-d2.ucm	12-Mar-2015	132.6 KiB
icu-internal-compound-d3.ucm	12-Mar-2015	66.4 KiB
icu-internal-compound-d4.ucm	12-Mar-2015	88 KiB
icu-internal-compound-d5.ucm	12-Mar-2015	5 KiB
icu-internal-compound-d6.ucm	12-Mar-2015	67.8 KiB
icu-internal-compound-d7.ucm	12-Mar-2015	41.8 KiB
icu-internal-compound-s1.ucm	12-Mar-2015	656
icu-internal-compound-s2.ucm	12-Mar-2015	1.7 KiB
icu-internal-compound-s3.ucm	12-Mar-2015	3.5 KiB
icu-internal-compound-t.ucm	12-Mar-2015	898.8 KiB
iso-8859_10-1998.ucm	12-Mar-2015	5.8 KiB
iso-8859_11-2001.ucm	12-Mar-2015	5.7 KiB
iso-8859_14-1998.ucm	12-Mar-2015	5.8 KiB
iso-ir-165.ucm	12-Mar-2015	164.8 KiB
jisx-208.ucm	12-Mar-2015	146.9 KiB
jisx-212.ucm	12-Mar-2015	119.6 KiB
kddi-jisx-208-2007.ucm	12-Mar-2015	155.5 KiB
kddi-shift_jis-2012.ucm	12-Mar-2015	191.2 KiB
lmb-excp.ucm	12-Mar-2015	9.2 KiB
macos-0_2-10.2.ucm	12-Mar-2015	5.9 KiB
macos-29-10.2.ucm	12-Mar-2015	5.6 KiB
macos-35-10.2.ucm	12-Mar-2015	5.8 KiB
macos-6_2-10.4.ucm	12-Mar-2015	5.8 KiB
macos-7_3-10.2.ucm	12-Mar-2015	5.6 KiB
noop-cns-11643.ucm	12-Mar-2015	1.1 KiB
noop-gb2312_gl.ucm	12-Mar-2015	1.2 KiB
noop-iso-ir-165.ucm	12-Mar-2015	1 KiB
README.emoji	12-Mar-2015	5 KiB
softbank-jisx-208-2007.ucm	12-Mar-2015	153.2 KiB
softbank-shift_jis-2012.ucm	12-Mar-2015	177 KiB
ucmcore.mk	12-Mar-2015	1.1 KiB
ucmebcdic.mk	12-Mar-2015	1.7 KiB
ucmfiles.mk	12-Mar-2015	3.7 KiB
ucmlocal.mk	12-Mar-2015	507
windows-874-2000.ucm	12-Mar-2015	7.4 KiB
windows-936-2000.ucm	12-Mar-2015	479.3 KiB
windows-949-2000.ucm	12-Mar-2015	347.8 KiB
windows-950-2000.ucm	12-Mar-2015	397.9 KiB