| 4ebdc233d4e16e360b3e4790cf9cdfbfbb7e6f10 |
|
24-May-2016 |
David Sodman <dsodman@google.com> |
Improve resiliency of message parser in the case that events are missing
BUG: 28860167
Change-Id: I3a1b501a671f6f13ec842533988810a747b791a1
|
| eb68333ae91eb7abd8c9aec1d8044cd114b270b9 |
|
15-Feb-2016 |
Kalle Raita <kraita@google.com> |
Handle output parsing errors in DeqpTestRunner
Handle errors caused by interrupted ADB connection in the
instrumentation parser of the DeqpTestRunner. Prior to the fix the
errors were likely silently ignored first, which lead to corrupted
internal state.
Also added unit tests covering a couple of classes of errors.
Tested with unit tests.
Bug: 25815311
Change-Id: Ifed2bb3bde9aee5361b834b72b027a96ebc0ceda
|
| a41d49723a200eec6af9c9504a961cb2df306295 |
|
20-Oct-2015 |
Daniel Xie <dxie@google.com> |
Squashed mnc-dev changes:
This contains all of the changes from b54aa51 to
791e51a on mnc-dev, except the changes
to tests/tests/security.
Bug: 24846656
Change-Id: I01f53a1a238ac49f86928e0e22796dc73e0e34af
|
| 5964127d16289c609fca4831258c700ff90152bd |
|
21-Sep-2015 |
Kalle Raita <kraita@google.com> |
Increase deqp inactivity timeout to 10 mins
Increase the deqp command stdout inactivity timeout from 1 min to 10
min.
Add logging to various abnormal situations to detect them earlier in the
future.
Bug: 23287994
Change-Id: Ibf69790972563214922c79c81b23462c44634444
|
| 84d67ea320b2ca5458c020bf2d68833b44f01e6b |
|
27-Jul-2015 |
Pyry Haulos <phaulos@google.com> |
Revert "Work around deqp log file creation issues."
This reverts commit b107f79e3b190540cee21986d458226d3e2f338c.
Bug: 22630974
Bug: 22328970
Change-Id: Ic2399ec77d000c42ada20a0dc778b911af80dd38
|
| b107f79e3b190540cee21986d458226d3e2f338c |
|
07-Jul-2015 |
Jarkko Pöyry <jpoyry@google.com> |
Work around deqp log file creation issues.
Work around log file creation spuriously failing by creating and making sure
the log file exists in the host-side test runner.
Bug: 22328970
Change-Id: I92d167ae169da617acd515b666c5336e8c43acd5
|
| 92423df543c8e11070c57585a6450e7f4e9a1a42 |
|
08-Jul-2015 |
Stuart Scott <stuartscott@google.com> |
Revert "Revert "Moving to common compatibility utils.""
This reverts commit 992b459293c4dcae2a12cdf5923e3e26a476bd1a.
This change includes the fix which caused the build breakage which
caused the revert this is reverting.
bug: 21762834
Change-Id: I1df495ba219208b07a7d7c8ac99d2890052caf69
|
| 992b459293c4dcae2a12cdf5923e3e26a476bd1a |
|
08-Jul-2015 |
Ian Pedowitz <ijpedowitz@google.com> |
Revert "Moving to common compatibility utils."
This reverts commit b054026b4d0347f958de7c4b3eaa6a52ff3d20cd.
Master is red, fixing the build by reverting all CL's merged from
b/21762834 today.
Bug: 21762834
Change-Id: Ibe31d8b615e55387ebbbd953f793f491ee30a2e8
|
| b054026b4d0347f958de7c4b3eaa6a52ff3d20cd |
|
06-Jul-2015 |
Stuart Scott <stuartscott@google.com> |
Moving to common compatibility utils.
bug:21762834
Change-Id: Ie0bf75bb1621308118633f41e063df40b529478d
|
| 35d54ee5d7c93c8e27027f105ee1429275216077 |
|
13-May-2015 |
Jarkko Pöyry <jpoyry@google.com> |
Listen and handle external interruption requests in deqp runner.
- Check for interruption in deqp runner between batches.
- Forward RunInterruptedException generated by the supplied
ITestRunListener.
- Add unit tests.
Bug: 21071283
Change-Id: I2d107a016c4ef73249e137b23395a414985f4b3b
|
| 0b10cb3bb4eb918b270edacbe6b43f9aac283a89 |
|
02-May-2015 |
Jarkko Pöyry <jpoyry@google.com> |
Do not report Deqp results as failures if device is disconnected.
- When encountering unrecoverable DNRE, do not mark tests in current
working set as failures. This was done to prevent external recovery
(re-exec until all done) from causing a non-terminating loop if one
of test reliably killed the device. With improved scheduling and
recovery, this is no longer necessary.
- Improve test instance scheduler. Maintain a record of unstable
(process-killing, device-killing, not executable) tests and avoid
scheduling unstable and stable tests in the same batch. Run
potentially unstable tests with smaller batch sizes. This also
fixes bug 19440384.
- Add tests for non-executable tests.
Change-Id: Ie53b977e7806bd4f74207ce2cc44e82083d1ad07
|
| 41c41d5d3d501f716954c8f4001c92000411ae34 |
|
13-Apr-2015 |
Jarkko Pöyry <jpoyry@google.com> |
Detect and recover from unkillable deqp tester process.
Change-Id: I7b72e2a68583b0fdb26730ea57f921c37bcb8a27
|
| 3327b9f28d7411f81113f664c677474331fdf792 |
|
10-Apr-2015 |
Jarkko Pöyry <jpoyry@google.com> |
Cache configuration capability query results.
Capability queries and test execution have separate recovery methods and
having them both trying to recover from the same event could lead to
unnecessary recovery effort before just giving up, such as multiple
consecutive reboots.
This change just removes unneeded capability queries and as such removes
the possibility of attempting a capability query recover after a failed
test execution recovery. This change should have no other effect than to
reduce the time required to run both successful or failing test batches.
Change-Id: Id6fe0ee6aea9c970d6f10e081994b784f3828153
|
| 4eab57a8aa91c30c8f112a294392b427494902a4 |
|
03-Apr-2015 |
Pyry Haulos <phaulos@google.com> |
Fix NPE in DeqpTestRunner if duplicate results are reported
Test hang can currently cause framework to silently re-execute
instrumentation command, which will lead to already executed tests to be
ran and reported again. DeqpTestRunner didn't take that well and ended
up throwing NullPointerException. This CL makes runner to simply ignore
duplicate results.
Bug: 20054115
Bug: 20055035
Change-Id: Id00a968b82c42ee68ae556cd29a912a7a865b3d6
|
| 97a49bcdbe4c90a5914b2d6545189eb40461b836 |
|
03-Apr-2015 |
Pyry Haulos <phaulos@google.com> |
Enable --deqp-watchdog in DeqpTestRunner
Watchdog provided by CTS framework appears to abort test execution if
instrumentation command gets stuck, which can be caused by driver hang
in deqp tests. This CL enables deqp built-in watchdog to migitate the
issue.
Change-Id: I60a5102e2ee86a1e5da5d9ea89c34bf847770251
|
| b5b4cfd76d5c3325e584fed6f24474346c8e2603 |
|
04-Apr-2015 |
Jarkko Pöyry <jpoyry@google.com> |
Send adb commands directly to IDevice in DeqpTestRunner.
- Avoid using TestDevice.executeShellCommand since its silent
retry attempt mangles instrumentation logs. Instead, use
IDevice directly.
- Detect and attempt to recover if command via IDevice fails.
Bug: 20054115
Change-Id: I4c1a4ba72bb73873ffc9f8015c87b803c01e0070
|
| 81decdeb496ccc94794a9a0ac350d832dea60340 |
|
19-Feb-2015 |
Kalle Raita <kraita@google.com> |
Use --deqp-log-images=disable for execution speed.
Bug: 19265247
Change-Id: I0e2a00f22931715e3d29a7c6ce9411ec5151d486
|
| 91d00e01781647af001a034d95b81da1d574bdc0 |
|
16-Jan-2015 |
Jarkko Pöyry <jpoyry@google.com> |
Support test instancing in DeqpTestRunner.
* Add support for test instances with different render target
configurations. A test case will be reported as a failure if any of
its instances reports a failure or terminates unexpectedly.
* Check support for orientation and pixel format before attempting to
run test instances. Report unsupported instances as passes.
* Update dEQP test package XML abi attribute injector regex to support
subelements within Test-elements.
Bug: 18982383
Change-Id: I67c65caabef8e1c0ecc9dccfb409a3a19bcff4e3
|
| a8fe8f8bed94e10af6071c823c3dac99c957bda3 |
|
08-Oct-2014 |
Jarkko Pöyry <jpoyry@google.com> |
Fix DeqpTestRunnerTest tests.
* Update tests to expect package installation and uninstallation.
* Fix various whitespace errors in test expectations.
Change-Id: I2d70ba205b2d3c9f2e7d03d747d1f2a0448f99de
|
| 7cc94442a3229874bb7aa036a15266e4c5bbad54 |
|
02-Oct-2014 |
Pyry Haulos <phaulos@google.com> |
Fix dEQP test status msg translation inconsistencies
* Report incomplete logs correctly as crashes
* Add missing space after colon in the regular case
Change-Id: I3dbf9208ccf227e573104a6d784c2906e029ce25
|
| a4b51ad7db98f45d578b5f86650c6452e79c15aa |
|
02-Oct-2014 |
Jarkko Pöyry <jpoyry@google.com> |
Install dEQP OnDevice package explicitly in DeqpTestRunner.
Previously DeqpTestRunner expected test package to have been installed before
DeqpTestRunner was called. This change makes DeqpTestRunner to explicitly
install the OnDevice package with the test runner's current ABI setting.
Change-Id: Ic38bc0c22157ec95de3111d9d0fe214a236eff1e
|
| a86997b941052b71fb26358503bb5b988890d054 |
|
24-Sep-2014 |
Mika Isojärvi <misojarvi@google.com> |
Multi ABI support for dEQP tests.
Add support for running dEQP tests with different ABIs by passing
correct --abi argument to instrumentation command.
Bug: 17458531
Change-Id: I041d0715a8fabee18454e7105ecabd9ca1efb3f0
|
| a4e46484cb5df4323bc8a3b76dee9a95de3c34c9 |
|
24-Sep-2014 |
Brett Chabot <brettchabot@google.com> |
Adjust cts-tradefed to JUnit4 test listener changes
Bug: 16684768
Change-Id: Icfff630f95bd59469490b13da1807878ee17b155
|
| e00a2b8d92832236fc647d74acf21b7f4b35677b |
|
06-Sep-2014 |
Stuart Scott <stuartscott@google.com> |
Add 64bit support to CTS Tradefed
Change-Id: I836fb8c1608f8d632243f4897b7bf720db573762
|
| fef5e2c93f8f4371d52eec56dd8da7012e970da5 |
|
06-Sep-2014 |
Stuart Scott <stuartscott@google.com> |
Add 64bit support to tests and runners in CTS
Change-Id: I9a676e19d3ef88f76d8cd862b6fb78917a227159
|