| da754e01b78a20ba119ed59a55ee63619dbc1732 |
|
17-Apr-2018 |
Mika Raento <mikie@google.com> |
Fix slicing.sh for new directory structure
Fix path handling in slicing.sh and helpers to work with versioned test
directories.
Added "set -eu" and a number of other checks to scripts to make them
easier to debug in the future.
Renegerated CTS tests with new scripts. The changes were not due to
script changes in this CL, but due to not always running the scripts
when changing models.
TODO: set up a continuous build for slicing.
Bug: 73560182
Test: ./slicing.sh 2 V1_0/mobilenet_quantized.mod.py
Test: ./runtime/test/specs/generate_test.sh and NeuralNetworksTest_static
Change-Id: I9cc00df1c10fc369410388d63c34689647c5c56b
/frameworks/ml/nn/runtime/test/specs/generate_test.sh
|
| b69da689183dd8258461d3c4326ddfa2d12cdc07 |
|
21-Feb-2018 |
I-Jui (Ray) Sung <ijsung@google.com> |
Fixed a hardcoded path that breaks vendor tests
Recent changes to the test generator introduced a hardcoded path that
breaks external users; this CL fixed that.
Also added handling of TENSOR_OEM_BYTE in the test generator.
Test: re-generate tests and diff
Bug: 71364578
Change-Id: I6e8fa8f19989e8c1834290c7f4120d07c3d0f59c
/frameworks/ml/nn/runtime/test/specs/generate_test.sh
|
| 5b0a7d939acba4c70027ea2798e7bbe054e77707 |
|
06-Feb-2018 |
Miao Wang <miaowang@google.com> |
Create NNAPI v1.1 VTS tests.
- Split specs files into corresponding subfolders with versioning.
- Update scripts to be able to handle versioned specs.
- Generate all_generated_$VER_vts_tests.cpp for VTS.
- Generate V1_1 op tests for VTS.
Bug: 63911257
Test: mm
Test: NNAPI VTS tests pass on v1.0 and v1.1 sample devices.
Change-Id: I1980561b69a463f4284f539cc252d298aa99a34c
/frameworks/ml/nn/runtime/test/specs/generate_test.sh
|
| ca4d8687cf8efd62aa50e9800c5c006673bf6e87 |
|
28-Dec-2017 |
I-Jui (Ray) Sung <ijsung@google.com> |
Make unit test framework friendly to vendor drivers
Allow including generate_test.sh as a library outside NNAPI. Also
export generated test harness in NNAPI Android.bp
This CL enables vendor driver tests to use the NNAPI unit test generator
framework.
Test: re-generate and run unit tests
Bug: 71364578
Change-Id: Iaac5e9afdf8241f5d78393aa441c5a7d2439cde4
/frameworks/ml/nn/runtime/test/specs/generate_test.sh
|
| 4062279c74f2c995349b7ff04f22feb89eb81e47 |
|
19-Oct-2017 |
I-Jui (Ray) Sung <ijsung@google.com> |
Slicing a given model up to the given first N operations
Also regenerated all CTS, VTS and unit tests, as a test harness function
is renamed.
Test: test.py and sliced mobilenet_quantized up to first 20 ops
Test: unit tests and VTS on Sailfish
Bug: 67781676
Change-Id: I68dcdbda17f8bedc98b1da573a8f884da0d5722d
/frameworks/ml/nn/runtime/test/specs/generate_test.sh
|
| 9b8ba9d9e398b8448a1e6af568fd1195bc035deb |
|
24-Oct-2017 |
I-Jui (Ray) Sung <ijsung@google.com> |
Include a full example into mobilenet_quantized spec
Manually merge the generated example file into the spec and convert it
into a properly defined Example. Updated generate_test.sh as the hack to
workaround b/67394906 is no longer needed.
This change is also required by the slicing tool.
Bug: 67781676
Bug: 67394906
Test: NeuralNetworkTest on Sailfish
Change-Id: I95b8718e3dab876eb0bb93a1d40f486c5473017f
/frameworks/ml/nn/runtime/test/specs/generate_test.sh
|
| 3c6328ec1ce3e2dc25e1c5cb934df8baa657992d |
|
13-Oct-2017 |
I-Jui (Ray) Sung <ijsung@google.com> |
Generate MobilNet quantized in the test generation script
Generate MobileNet quantized and prevent the test from being
overwritten. It was with a different suffix from the one recognized by
the test geneartor script, and thus effectively it was ignored.
This CL updates the suffix of the test spec for MobileNet. Also, since
the example file is generated elsewhere, we want the generator script
not to overwrite it.
Also, skip MobileNet quantized entirely in VTS as it is known to fail
at this moment.
Test: NeuralNetworkTest on Angler
Test: VtsHalNeuralnetworksV1_0TargetTest on CPU sample driver
Bug: 67394906
Change-Id: Ia944aeaa74e9318014f34cfc2fea6dcbf3f0f1ba
/frameworks/ml/nn/runtime/test/specs/generate_test.sh
|
| ec8e1c71d11f7b5abe306e0c9c6af7da755bd46b |
|
13-Sep-2017 |
I-Jui (Ray) Sung <ijsung@google.com> |
Support ignored output in test generator
Added a new construct IgnoredOutput for specifying outputs that are
excluded from comparing against golden, required by ops like SVDF.
Also regenerated CTS tests since a test now has one more generated
function bool is_ignored(int);
In addition, updated test generator regression suite accordingly.
Bug: 63905942
Test: NeuralNetworkTest on Angler
Test: VtsHalNeuralnetworksV1_0TargetTest on Angler
Test: tools/test_generator/tests/test.py on host
Change-Id: I99a438400c264cd3b4a12014e1cc473a7d324df6
/frameworks/ml/nn/runtime/test/specs/generate_test.sh
|
| 6a0d306cf902e13ab147c7533b2cb02540ee66d5 |
|
08-Sep-2017 |
I-Jui (Ray) Sung <ijsung@google.com> |
Support example that has tensors of different types
Operations like LSH_PROJECTION requires tensors of different types. This
CL adds support to the generator and harness (for native tests).
Revised:
- Test generator
- Test harness
- Existing examples
Also regenerated examples from testcases.
Bug: 63905942
Test: tools/test_generator/test.py
Test: NeuralNetworkTest on angler
Test: cts-tradefed run commandAndExit cts -m CtsNNAPITestCases
Change-Id: I000cdac92468659709be18599a425ef82695011a
/frameworks/ml/nn/runtime/test/specs/generate_test.sh
|