Cross Reference: /external/icu/icu4c/source/data/mappings/

== Notes on {kddi,docomo,softbank}-*.ucm mappings.

kddi-jisx-208 is a variant of JIS X 208 used by KDDI, a Japanese cell
phone carrier.

kddi-shift_jis, docomo-shift_jis, and softbank-shift_jis are variants
of Shift_JIS used by KDDI, DoCoMo and SoftBank.

  - kddi-jisx-208 contains Emoji (emoticon) code points in
    0x75xx, 0x76xx, 0x77xx, 0x78xx, 0x79xx, 0x7Axx, 0x7Bxx,
    where xx means 21-7E.

  - kddi-shift_jis contains Emoji code points in
    0xEBxx, 0xECxx, 0xEDxx, and 0xEExx, 0xF3xx, 0xF4xx, 0xF6xx, 0xF7xx,
    where xx means 40-7E, 80-FC.

  - docomo-shift_jis contains Emoji code points in
    0xF8xx, and 0xF9xx, where xx means 40-7E, 80-FC.

  - softbank-shift_jis contains Emoji code points in
    0xF7xx, 0xF9xx, and 0xFBxx, where xx means 40-7E, 80-FC.

  - softbank-jisx-208 contains Emoji code points in
    0x75xx, 0x76xx, 0x77xx, 0x78xx, 0x79xx, 0x7Axx, 0x7Bxx, 0x7Dxx
    where xx means 21-7E.


== How the -2012.ucm tables were modified in April 2013

The -2012 versions were created by
    http://code.google.com/p/emoji4unicode/source/browse/trunk/src/gen_conversion_files.py

using each of the older 2012 versions as the base table files
to avoid non-Emoji changes:

# gen_google_ucm.sh
icu_mappings=/google/src/cloud/mscherer/icubranch/google_vendor_src_branch/icu/source/data/mappings
dest=/home/mscherer/www/no_crawl/emoji
./gen_conversion_files.py $icu_mappings/docomo-shift_jis-2012.ucm
cp ../generated/docomo-shift_jis-2012.ucm $dest
./gen_conversion_files.py $icu_mappings/kddi-shift_jis-2012.ucm
cp ../generated/kddi-shift_jis-2012.ucm $dest
./gen_conversion_files.py $icu_mappings/softbank-shift_jis-2012.ucm
cp ../generated/softbank-shift_jis-2012.ucm $dest
./gen_conversion_files.py

The only differences from 2012-sep are in mappings for symbols
that have Unicode Variation Selector (VS) sequences.

The older tables relied on a hack in the ICU conversion code that
ignored the "use fallback" flag for fallbacks from sequences with VS.

The new tables rely on a new feature in ICU4C 51:
For the relevant symbols that have roundtrip mappings,
- the mappings with Emoji Variation Selector
  use the |0 roundtrip precision
- the other mappings (no VS & text VS)
  use the |4 "good one-way" precision

See http://bugs.icu-project.org/trac/ticket/9602

== How the -2012.ucm tables were created in September 2012

The 2012 versions were created by
    http://code.google.com/p/emoji4unicode/source/browse/trunk/src/gen_conversion_files.py

using each of the 2007 versions as the base table files
to avoid non-Emoji changes:

icu_mappings=~/p4/emoji/google_vendor_src_branch/icu/source/data/mappings
dest=~/www/no_crawl/emoji
./gen_conversion_files.py $icu_mappings/docomo-shift_jis-2007.ucm
cp ../generated/docomo-shift_jis-2012.ucm $dest
./gen_conversion_files.py $icu_mappings/kddi-shift_jis-2007.ucm
cp ../generated/kddi-shift_jis-2012.ucm $dest
./gen_conversion_files.py $icu_mappings/softbank-shift_jis-2007.ucm
cp ../generated/softbank-shift_jis-2012.ucm $dest
./gen_conversion_files.py

The emoji4unicode code uses the mappings that were established during the
Unicode Emoji standardization process.
The new conversion tables round-trip carrier Emoji symbol codes
to and from Unicode 6 standard code points
and also include fallback mappings from the Google PUA code points
to the carrier codes.

The trailing "|0" etc. on the mapping table lines specify the mapping type:
    |0  round-trip              Unicode <-> charset
    |1  fallback                Unicode  -> charset
    |3  "reverse fallback"      Unicode <-  charset

For details about the .ucm file format see
http://userguide.icu-project.org/conversion/data#TOC-.ucm-File-Format

== How the -2007.ucm tables were created

So far, we haven't obtained "official" conversion tables from the cell
phone carriers.  However, we empirically know their clients support
VDCs in MS932, like U2460 (CIRCLED DIGIT ONE), etc.  Hence we use
MS932 as the base table for them.

kddi-jisx-208-2007.ucm is based on jisx-208.ucm in this directory.
The original table's mappings to codes 0x75xx to 0x7Bxx are excluded
to avoid collisions with emoji.

kddi-shift_jis-2007.ucm is based on windows-932-2000.ucm.
The original table's mappings to codes 0xEBxx to 0xEExx, and 0xF0xx to
0xF90xx (EUDC block), are excluded to avoid collisions with emoji.

docomo-shift_jis-2007.ucm is based on windows-932-2000.ucm.
The original table's mappings to codes 0xF0xx to 0xF90xx (EUDC block)
are excluded to avoid collisions with emoji.

softbank-shift_jis-2007.ucm is based on windows-932-2000.ucm.
The original table's mappings to codes 0xF0xx to 0xF90xx (EUDC block),
and 0xFBxx, are excluded to avoid collisions with emoji.

softbank-jisx-208-2007.ucm is based on jisx-208.ucm in this directory.
The original table's mappings to codes 0x75xx to 0x7Bxx, and 0x7Dxx
are excluded to avoid collisions with emoji.

== Google Standard Emoji Unicode Mapping

The Google standard emoji Unicode mapping can be found at:

  /home/build/google3/i18n/encodings/emoji/emoji_unicode_mapping.txt


TODO(mscherer): Use <icu:base> to share most standard JIS mappings
among *-shift_jis-2007.ucm files.
Name	Date	Size
..	07-Jan-2016	4 KiB
cns-11643-1992.ucm	07-Jan-2016	318.7 KiB
convrtrs.txt	07-Jan-2016	78.7 KiB
docomo-shift_jis-2012.ucm	07-Jan-2016	173.8 KiB
ebcdic-xml-us.ucm	07-Jan-2016	6.6 KiB
euc-jp-2007.ucm	07-Jan-2016	291.1 KiB
euc-tw-2014.ucm	07-Jan-2016	1.6 MiB
gb18030.ucm	07-Jan-2016	657.6 KiB
gsm-03.38-2000.ucm	07-Jan-2016	4.7 KiB
ibm-1006_P100-1995.ucm	07-Jan-2016	7.5 KiB
ibm-1025_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-1026_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-1047_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-1051_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-1089_P100-1995.ucm	07-Jan-2016	7.7 KiB
ibm-1097_P100-1995.ucm	07-Jan-2016	7.5 KiB
ibm-1098_P100-1995.ucm	07-Jan-2016	8.1 KiB
ibm-1112_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-1122_P100-1999.ucm	07-Jan-2016	6.2 KiB
ibm-1123_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-1124_P100-1996.ucm	07-Jan-2016	6.2 KiB
ibm-1125_P100-1997.ucm	07-Jan-2016	6.8 KiB
ibm-1129_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1130_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1131_P100-1997.ucm	07-Jan-2016	6.8 KiB
ibm-1132_P100-1998.ucm	07-Jan-2016	5.8 KiB
ibm-1133_P100-1997.ucm	07-Jan-2016	5.8 KiB
ibm-1137_P100-1999.ucm	07-Jan-2016	6.1 KiB
ibm-1140_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1141_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1142_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1143_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1144_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1145_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1146_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1147_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1148_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1149_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-1153_P100-1999.ucm	07-Jan-2016	6.2 KiB
ibm-1154_P100-1999.ucm	07-Jan-2016	6.2 KiB
ibm-1155_P100-1999.ucm	07-Jan-2016	6.2 KiB
ibm-1156_P100-1999.ucm	07-Jan-2016	6.2 KiB
ibm-1157_P100-1999.ucm	07-Jan-2016	6.2 KiB
ibm-1158_P100-1999.ucm	07-Jan-2016	6.2 KiB
ibm-1160_P100-1999.ucm	07-Jan-2016	6.2 KiB
ibm-1162_P100-1999.ucm	07-Jan-2016	6.1 KiB
ibm-1164_P100-1999.ucm	07-Jan-2016	6.2 KiB
ibm-1168_P100-2002.ucm	07-Jan-2016	6.2 KiB
ibm-1250_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-1251_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-1252_P100-2000.ucm	07-Jan-2016	6.2 KiB
ibm-1253_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-1254_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-1255_P100-1995.ucm	07-Jan-2016	5.9 KiB
ibm-1256_P110-1997.ucm	07-Jan-2016	8.6 KiB
ibm-1257_P100-1995.ucm	07-Jan-2016	6.1 KiB
ibm-1258_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-12712_P100-1998.ucm	07-Jan-2016	5.7 KiB
ibm-1276_P100-1995.ucm	07-Jan-2016	5.5 KiB
ibm-1363_P110-1997.ucm	07-Jan-2016	342.3 KiB
ibm-1363_P11B-1998.ucm	07-Jan-2016	342 KiB
ibm-1364_P110-2007.ucm	07-Jan-2016	386.3 KiB
ibm-1371_P100-1999.ucm	07-Jan-2016	400.5 KiB
ibm-1373_P100-2002.ucm	07-Jan-2016	388.1 KiB
ibm-1375_P100-2008.ucm	07-Jan-2016	422.9 KiB
ibm-1383_P110-1999.ucm	07-Jan-2016	177.1 KiB
ibm-1386_P100-2001.ucm	07-Jan-2016	472.6 KiB
ibm-1388_P103-2001.ucm	07-Jan-2016	637.4 KiB
ibm-1390_P110-2003.ucm	07-Jan-2016	437.1 KiB
ibm-1399_P110-2003.ucm	07-Jan-2016	437.3 KiB
ibm-16684_P110-2003.ucm	07-Jan-2016	433.4 KiB
ibm-16804_X110-1999.ucm	07-Jan-2016	7.4 KiB
ibm-273_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-277_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-278_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-280_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-284_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-285_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-290_P100-1995.ucm	07-Jan-2016	5.7 KiB
ibm-297_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-33722_P120-1999.ucm	07-Jan-2016	191.3 KiB
ibm-33722_P12A_P12A-2004_U2.ucm	07-Jan-2016	191.2 KiB
ibm-33722_P12A_P12A-2009_U2.ucm	07-Jan-2016	192.9 KiB
ibm-37_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-420_X120-1999.ucm	07-Jan-2016	7.6 KiB
ibm-424_P100-1995.ucm	07-Jan-2016	5.6 KiB
ibm-437_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-4517_P100-2005.ucm	07-Jan-2016	7.7 KiB
ibm-4899_P100-1998.ucm	07-Jan-2016	4.2 KiB
ibm-4909_P100-1999.ucm	07-Jan-2016	6.1 KiB
ibm-4971_P100-1999.ucm	07-Jan-2016	6.1 KiB
ibm-500_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-5012_P100-1999.ucm	07-Jan-2016	5.6 KiB
ibm-5123_P100-1999.ucm	07-Jan-2016	5.8 KiB
ibm-5346_P100-1998.ucm	07-Jan-2016	6.2 KiB
ibm-5347_P100-1998.ucm	07-Jan-2016	6.2 KiB
ibm-5348_P100-1997.ucm	07-Jan-2016	6.2 KiB
ibm-5349_P100-1998.ucm	07-Jan-2016	6.2 KiB
ibm-5350_P100-1998.ucm	07-Jan-2016	6.2 KiB
ibm-5351_P100-1998.ucm	07-Jan-2016	5.9 KiB
ibm-5352_P100-1998.ucm	07-Jan-2016	8.6 KiB
ibm-5353_P100-1998.ucm	07-Jan-2016	6.1 KiB
ibm-5354_P100-1998.ucm	07-Jan-2016	6.2 KiB
ibm-5471_P100-2006.ucm	07-Jan-2016	382.7 KiB
ibm-5478_P100-1995.ucm	07-Jan-2016	146.2 KiB
ibm-720_P100-1997.ucm	07-Jan-2016	6.1 KiB
ibm-737_P100-1997.ucm	07-Jan-2016	6.8 KiB
ibm-775_P100-1996.ucm	07-Jan-2016	6.8 KiB
ibm-803_P100-1999.ucm	07-Jan-2016	4 KiB
ibm-813_P100-1995.ucm	07-Jan-2016	6.1 KiB
ibm-838_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-8482_P100-1999.ucm	07-Jan-2016	5.8 KiB
ibm-850_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-851_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-852_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-855_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-856_P100-1995.ucm	07-Jan-2016	6.1 KiB
ibm-857_P100-1995.ucm	07-Jan-2016	6.7 KiB
ibm-858_P100-1997.ucm	07-Jan-2016	6.8 KiB
ibm-860_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-861_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-862_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-863_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-864_X110-1999.ucm	07-Jan-2016	8.2 KiB
ibm-865_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-866_P100-1995.ucm	07-Jan-2016	6.8 KiB
ibm-867_P100-1998.ucm	07-Jan-2016	6.7 KiB
ibm-868_P100-1995.ucm	07-Jan-2016	8.1 KiB
ibm-869_P100-1995.ucm	07-Jan-2016	6.7 KiB
ibm-870_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-871_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-874_P100-1995.ucm	07-Jan-2016	5.7 KiB
ibm-875_P100-1995.ucm	07-Jan-2016	6.1 KiB
ibm-878_P100-1996.ucm	07-Jan-2016	6.2 KiB
ibm-9005_X110-2007.ucm	07-Jan-2016	6.2 KiB
ibm-901_P100-1999.ucm	07-Jan-2016	7.2 KiB
ibm-902_P100-1999.ucm	07-Jan-2016	7.3 KiB
ibm-9067_X100-2005.ucm	07-Jan-2016	6.2 KiB
ibm-912_P100-1995.ucm	07-Jan-2016	7.3 KiB
ibm-913_P100-2000.ucm	07-Jan-2016	6.1 KiB
ibm-914_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-915_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-916_P100-1995.ucm	07-Jan-2016	5.6 KiB
ibm-918_P100-1995.ucm	07-Jan-2016	7.5 KiB
ibm-920_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-921_P100-1995.ucm	07-Jan-2016	6.2 KiB
ibm-922_P100-1999.ucm	07-Jan-2016	7.3 KiB
ibm-923_P100-1998.ucm	07-Jan-2016	6.2 KiB
ibm-930_P120-1999.ucm	07-Jan-2016	234.1 KiB
ibm-933_P110-1995.ucm	07-Jan-2016	215.3 KiB
ibm-935_P110-1999.ucm	07-Jan-2016	187.2 KiB
ibm-937_P110-1999.ucm	07-Jan-2016	400.6 KiB
ibm-939_P120-1999.ucm	07-Jan-2016	234.2 KiB
ibm-942_P12A-1999.ucm	07-Jan-2016	185.4 KiB
ibm-943_P130-1999.ucm	07-Jan-2016	194.3 KiB
ibm-943_P15A-2003.ucm	07-Jan-2016	192.4 KiB
ibm-9447_P100-2002.ucm	07-Jan-2016	6 KiB
ibm-9448_X100-2005.ucm	07-Jan-2016	9.2 KiB
ibm-9449_P100-2002.ucm	07-Jan-2016	6.1 KiB
ibm-949_P110-1999.ucm	07-Jan-2016	203 KiB
ibm-949_P11A-1999.ucm	07-Jan-2016	202.7 KiB
ibm-950_P110-1999.ucm	07-Jan-2016	401.1 KiB
ibm-954_P101-2007.ucm	07-Jan-2016	324.9 KiB
ibm-964_P110-1999.ucm	07-Jan-2016	512.4 KiB
ibm-970_P110_P110-2006_U2.ucm	07-Jan-2016	169.6 KiB
ibm-971_P100-1995.ucm	07-Jan-2016	165.2 KiB
icu-internal-25546.ucm	07-Jan-2016	169 KiB
icu-internal-compound-d1.ucm	07-Jan-2016	71.1 KiB
icu-internal-compound-d2.ucm	07-Jan-2016	132.6 KiB
icu-internal-compound-d3.ucm	07-Jan-2016	66.4 KiB
icu-internal-compound-d4.ucm	07-Jan-2016	88 KiB
icu-internal-compound-d5.ucm	07-Jan-2016	5 KiB
icu-internal-compound-d6.ucm	07-Jan-2016	67.8 KiB
icu-internal-compound-d7.ucm	07-Jan-2016	41.8 KiB
icu-internal-compound-s1.ucm	07-Jan-2016	656
icu-internal-compound-s2.ucm	07-Jan-2016	1.7 KiB
icu-internal-compound-s3.ucm	07-Jan-2016	3.5 KiB
icu-internal-compound-t.ucm	07-Jan-2016	898.8 KiB
iso-8859_10-1998.ucm	07-Jan-2016	5.8 KiB
iso-8859_11-2001.ucm	07-Jan-2016	5.7 KiB
iso-8859_14-1998.ucm	07-Jan-2016	5.8 KiB
iso-ir-165.ucm	07-Jan-2016	164.8 KiB
jisx-208.ucm	07-Jan-2016	146.9 KiB
jisx-212.ucm	07-Jan-2016	119.6 KiB
kddi-jisx-208-2007.ucm	07-Jan-2016	155.5 KiB
kddi-shift_jis-2012.ucm	07-Jan-2016	191.2 KiB
lmb-excp.ucm	07-Jan-2016	9.2 KiB
macos-0_2-10.2.ucm	07-Jan-2016	5.9 KiB
macos-29-10.2.ucm	07-Jan-2016	5.6 KiB
macos-35-10.2.ucm	07-Jan-2016	5.8 KiB
macos-6_2-10.4.ucm	07-Jan-2016	5.8 KiB
macos-7_3-10.2.ucm	07-Jan-2016	5.6 KiB
noop-cns-11643.ucm	07-Jan-2016	1.1 KiB
noop-gb2312_gl.ucm	07-Jan-2016	1.2 KiB
noop-iso-ir-165.ucm	07-Jan-2016	1 KiB
README.emoji	07-Jan-2016	5 KiB
softbank-jisx-208-2007.ucm	07-Jan-2016	153.2 KiB
softbank-shift_jis-2012.ucm	07-Jan-2016	177 KiB
ucmcore.mk	07-Jan-2016	1.1 KiB
ucmebcdic.mk	07-Jan-2016	1.7 KiB
ucmfiles.mk	07-Jan-2016	3.7 KiB
ucmlocal.mk	07-Jan-2016	507
windows-874-2000.ucm	07-Jan-2016	7.4 KiB
windows-936-2000.ucm	07-Jan-2016	479.3 KiB
windows-949-2000.ucm	07-Jan-2016	347.8 KiB
windows-950-2000.ucm	07-Jan-2016	397.9 KiB