History log of /external/libtextclassifier/smartselect/tokenizer.h
Revision Date Author Comments (<<< Hide modified files) (Show modified files >>>)
91f068673f5915dd4c12fac026e4a043e4a063a0 19-Apr-2017 Matt Sharifi <mns@google.com> Import latest version of libtextclassifier.

This fixes a couple of bugs and includes some code cleanup.

Bug: 37261597
Bug: 35796788

Test: Unit tests pass.
Change-Id: Iec6aa9adcbbe652ce1e3e71bb1661529ed64bf4c
/external/libtextclassifier/smartselect/tokenizer.h
26e8c2edb55f8c4efc47bc586edd5f9506e281a7 06-Apr-2017 Lukas Zilka <zilka@google.com> Sync google3 changes.

- fixes unicode feature computation
- adds accepted configuration to the model to avoid running on unsupported
text script
- uses StringPiece for feature computation to improve effectivity

Test: Built and tested on device. Google3 unit and regression tests passing.

Bug: 36885478
Bug: 36886053
Change-Id: I3626831617b2480500e61c6951c2ee3e3c1b381d
/external/libtextclassifier/smartselect/tokenizer.h
bda09f1da39ce38a5ece4757b82a64776e53214c 10-Mar-2017 Matt Sharifi <mns@google.com> Initial checkin of libtextclassifier.

Test: libtextclassifier_tests pass in google3 repository.

Change-Id: I2aac5b12b8810c2ec1c1aa27238cb8aa8430f403
/external/libtextclassifier/smartselect/tokenizer.h