| 22b243809eea5f4f504f9a7ac157539adde6b3f7 |
|
30-Mar-2010 |
Florent Xicluna <florent.xicluna@gmail.com> |
#7643: Unicode codepoints VT (0x0B) and FF (0x0C) are linebreaks according to Unicode Standard Annex #14.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 2e0a53fdf6dd84ab5418ae4faec330eaed443bd6 |
|
18-Mar-2010 |
Florent Xicluna <florent.xicluna@gmail.com> |
Issue #8024: Update the Unicode database to 5.2
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| dc36472472361d8a360d97adbc7f1a3a8fce4493 |
|
15-Mar-2010 |
Florent Xicluna <florent.xicluna@gmail.com> |
Remove py3k deprecation warnings from these Unicode tools.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 5c92d4301dae4ffa970ddc9e5064d88062c4a900 |
|
13-Oct-2009 |
Amaury Forgeot d'Arc <amauryfa@gmail.com> |
#7112: Fix compilation warning in unicodetype_db.h
makeunicodedata now generates double literals
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| d0052d17b1a067e4aa8a69f5564a4b94e0c00502 |
|
06-Oct-2009 |
Amaury Forgeot d'Arc <amauryfa@gmail.com> |
#1571184: makeunicodedata.py now generates the functions _PyUnicode_ToNumeric,
_PyUnicode_IsLinebreak and _PyUnicode_IsWhitespace.
It now also parses the Unihan.txt for numeric values.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| e988e286b2831382deb7c69b26c74ed185f51696 |
|
27-Apr-2009 |
Antoine Pitrou <solipsis@pitrou.net> |
Issue #1734234: Massively speedup `unicodedata.normalize()` when the
string is already in normalized form, by performing a quick check beforehand.
Original patch by Rauli Ruohonen.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 5d98ec76bb548ef65b6943c6eefd48eaabdbed90 |
|
25-Apr-2009 |
Walter Dörwald <walter@livinglogic.de> |
Issue #5828 (Invalid behavior of unicode.lower): Fixed bogus logic in
makeunicodedata.py and regenerated the Unicode database (This fixes
u'\u1d79'.lower() == '\x00').
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 24329ba1762688f78ff589d0243683c4afafe096 |
|
10-Sep-2008 |
Martin v. Löwis <martin@v.loewis.de> |
Issue #3811: The Unicode database was updated to 5.1.
Reviewed by Fredrik Lundh and Marc-Andre Lemburg.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 111c180674379950f65113db8076919b2353f5ab |
|
13-Jun-2008 |
Martin v. Löwis <martin@v.loewis.de> |
Make more symbols static.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 43179c8e6fa2679e17da2eeab36cdc6d91560477 |
|
11-Mar-2006 |
Martin v. Löwis <martin@v.loewis.de> |
Add changelog entry.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 88ca467ca4b1f13a9fb172712cf25eeae94e3095 |
|
11-Mar-2006 |
Tim Peters <tim.peters@gmail.com> |
Whitespace normalization.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 480f1bb67ba8d2857d87921391df278c5569774c |
|
10-Mar-2006 |
Martin v. Löwis <martin@v.loewis.de> |
Update Unicode database to Unicode 4.1.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| e9ddfbb41207328d5c89061067f3431e00711fda |
|
04-Aug-2004 |
Hye-Shik Chang <hyeshik@gmail.com> |
SF #989185: Drop unicode.iswide() and unicode.width() and add
unicodedata.east_asian_width(). You can still implement your own
simple width() function using it like this:
def width(u):
w = 0
for c in unicodedata.normalize('NFC', u):
cwidth = unicodedata.east_asian_width(c)
if cwidth in ('W', 'F'): w += 2
else: w += 1
return w
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 974ed7cfa50b666c9ab91f7a3f8f26049d387107 |
|
02-Jun-2004 |
Hye-Shik Chang <hyeshik@gmail.com> |
- SF #962502: Add two more methods for unicode type; width() and
iswide() for east asian width manipulation. (Inspired by David
Goodger, Reviewed by Martin v. Loewis)
- Move _PyUnicode_TypeRecord.flags to the end of the struct so that
no padding is added for UCS-4 builds. (Suggested by Martin v. Loewis)
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| b5c980b8028af0876e40f71c94b82cd02e327bf0 |
|
25-Nov-2002 |
Martin v. Löwis <martin@v.loewis.de> |
Add unidata_version. Bump generator version number.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 97225da29afabd4f5421f649257c3c9b088ccdd0 |
|
25-Nov-2002 |
Martin v. Löwis <martin@v.loewis.de> |
Sort names independent of the Python version. Fix hex constant warning.
Include all First/Last blocks.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 677bde2dd14ac2c8f170779adcc732f991db8bd6 |
|
23-Nov-2002 |
Martin v. Löwis <martin@v.loewis.de> |
Patch #626485: Support Unicode normalization.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 99ac3283e74d8d33479f9ef58a018b0d9a25e3b3 |
|
18-Oct-2002 |
Martin v. Löwis <martin@v.loewis.de> |
Verify that lower-higher case delta are 16-bit.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 9def6a3a77569214b49d1b54ef138b0e4985a6bd |
|
18-Oct-2002 |
Martin v. Löwis <martin@v.loewis.de> |
Update to Unicode 3.2 database.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| aaab30e00cc3e8d90c71b8657c284feeb4ac1413 |
|
11-Sep-2002 |
Walter Dörwald <walter@livinglogic.de> |
Apply diff2.txt from SF patch http://www.python.org/sf/572113
(with one small bugfix in bgen/bgen/scantools.py)
This replaces string module functions with string methods
for the stuff in the Tools directory. Several uses of
string.letters etc. are still remaining.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| b2dfd73bdce7552e671520a14e4b5a72dc02ce12 |
|
22-Jan-2001 |
Fredrik Lundh <fredrik@pythonware.com> |
Unicode nits: Don't include unicodedatabase.h no more. And make sure
to build *all* tables in makeunicodedata.py.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 7b7dd107b3654926fb75215805d6c0c8a15bf89e |
|
21-Jan-2001 |
Fredrik Lundh <fredrik@pythonware.com> |
compress unicode decomposition tables (this saves another 55k)
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 9e9bcda547340a47b5f82d0463f4cdc29bd3b143 |
|
21-Jan-2001 |
Fredrik Lundh <fredrik@pythonware.com> |
forgot to check in the new makeunicodedata.py script
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| fad27aee11e8ece649b72c8ad9513f46882d23ba |
|
03-Nov-2000 |
Fredrik Lundh <fredrik@pythonware.com> |
Added 38,642 missing characters to the Unicode database (first-last
ranges) -- but thanks to the 2.0 compression scheme, this doesn't add
a single byte to the resulting binaries (!)
Closes bug #117524
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 9c6850510c814dea4c4f5a5c7ff63c5e8ad3976b |
|
26-Oct-2000 |
Fred Drake <fdrake@acm.org> |
Remove bogus stdout redirection and use of sys.__stdout__; use
augmented print statement instead.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 375732cd41326fd81c5bc15d7c0e0945992b1939 |
|
26-Sep-2000 |
Fredrik Lundh <fredrik@pythonware.com> |
- don't set the titlecase flag for uppercase letters (sorry, tim)
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 0f8fad4969630cde85d84059fb85f4756f000c46 |
|
25-Sep-2000 |
Fredrik Lundh <fredrik@pythonware.com> |
unicode database compression, step 3:
- added decimal digit and digit properties to the unidb tables
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| e9133f7e2efbe68f89cb35cbc6a8bcc8bf389ad1 |
|
25-Sep-2000 |
Fredrik Lundh <fredrik@pythonware.com> |
unicode database compression, step 3:
- use unidb compression for the unicodectype module. smaller,
faster, and slightly more portable...
- also mention the unicode directory in Tools/README
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| cfcea4921865a922744dc168dde5eaccde8fe50b |
|
25-Sep-2000 |
Fredrik Lundh <fredrik@pythonware.com> |
unicode database compression, step 2:
- fixed attributions
- moved decomposition data to a separate table, in preparation
for step 3 (which won't happen before 2.0 final, promise!)
- use relative paths in the generator script
I have a lot more stuff in the works for 2.1, but let's leave
that for another day...
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| 2101348830ff0d65cebd4caf886011f45bcc7618 |
|
25-Sep-2000 |
Tim Peters <tim.peters@gmail.com> |
Fiddled w/ /F's cool new splitbins function: documented it, generalized it
a bit, sped it a lot primarily by removing the unused assumption that None was
a legit bin entry (the function doesn't really need to assume that there's
anything special about 0), added an optional "trace" argument, and in __debug__
mode added exhaustive verification that the decomposition is both correct and
doesn't overstep any array bounds (which wasn't obvious to me from staring at the
generated C code -- now I feel safe!). Did not commit a new unicodedata_db.h, as
the one produced by this version is identical to the one already checked in.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|
| f367cacb98ce3fcd1653546835dff3c3cbf5216a |
|
25-Sep-2000 |
Fredrik Lundh <fredrik@pythonware.com> |
unicode database compression, step 1:
- use unidb compression for the unicodedata module. on Windows,
the new unidatabase module is 120k, down from nearly 600k.
/external/python/cpython2/Tools/unicode/makeunicodedata.py
|