| 5cf8f7dbe912ca3d4b88fe4e599e4268668c43c3 |
23-Jun-2016 |
Gaurav Mishra <mishragaurav@google.com> |
CTS: Replace deviceSerial with startTime as MetricsStore key.
Bug:2953947
Change-Id: I94bdf95c8f363962d6f5b437a862efab1433f408
estPackageResult.java
|
| f0906377f83bc0e83433492775a39673f2150aa3 |
22-Dec-2015 |
Daniel Xie <dxie@google.com> |
Merge "resolve merge conflicts of 715ecdadb1 to lollipop-cts-dev." into lollipop-cts-dev am: c6ffd4b897 am: 9f19e07a44 am: 8a775a6080 am: 0dcb774cd2 am: a39240cf8f am: 91025eb383 am: dcef84ff74 am: 968e61d9f9
am: 61116fb24c
* commit '61116fb24ccb77bf88660321f0fd52aeec725da2':
collect memory properties in CTS
|
| 8a775a6080144d5d667f43a5c576cc1ae4908b38 |
22-Dec-2015 |
Daniel Xie <dxie@google.com> |
Merge "resolve merge conflicts of 715ecdadb1 to lollipop-cts-dev." into lollipop-cts-dev am: c6ffd4b897
am: 9f19e07a44
* commit '9f19e07a44f77a3f083012366de15e66c5ee61ca':
collect memory properties in CTS
|
| 1517d2ba63b5bc0f79567b5d1820e7e657f9439e |
22-Dec-2015 |
Nash Lincoln <nashira@google.com> |
resolve merge conflicts of 715ecdadb1 to lollipop-cts-dev.
Change-Id: I9d2bd1dbb5fe317233d2d3fc2f704aa4e8295977
|
| c549ac351e038223c659c66485c30b7d1eb24158 |
15-Dec-2015 |
Agatha Man <agathaman@google.com> |
EDI: CTS - Tradefed should report errors from extended device info runs
- DeviceInfo - catch exceptions from collectDeviceInfo() and add
DEVICE_INFO_ERROR_ message to instrumentation status.
- GenericDeviceInfo - do not collect fields that does not exist
prior to L on devices running a prior build.
- CtsTestLogReporter - throw runtime error if edi results with an error.
bug: 26189624
Change-Id: If851deb2346d60872b655b6bd72c9a6073ffb97d
tsTestLogReporter.java
|
| 224beaca4388e3c15404b09476f91e469efde09f |
06-Nov-2015 |
Nicholas Sauer <nicksauer@google.com> |
Merge "Add reference url to XML reports" into marshmallow-cts-dev am: 4318078f65 am: 889cea6c52 am: 989dc34697 am: eba9aacf98 am: 817ddc6bea
am: 8f0e99b17e
* commit '8f0e99b17e515bc79776fb392d6e620aae00afa5':
Add reference url to XML reports
|
| 5a5a2bbae67bb399ff38861d6cb397009746bea3 |
04-Nov-2015 |
Nicholas Sauer <nicksauer@google.com> |
Add reference url to XML reports
bug: 25452494
Change-Id: I9e927da45183c2518594b8aa7432416c644abec0
tsXmlResultReporter.java
|
| a41d49723a200eec6af9c9504a961cb2df306295 |
20-Oct-2015 |
Daniel Xie <dxie@google.com> |
Squashed mnc-dev changes:
This contains all of the changes from b54aa51 to
791e51a on mnc-dev, except the changes
to tests/tests/security.
Bug: 24846656
Change-Id: I01f53a1a238ac49f86928e0e22796dc73e0e34af
estPackageResult.java
|
| 71ba78d1aa3f3f9ff87ba98f1534a375fafa2eb4 |
06-Oct-2015 |
Agatha Man <agathaman@google.com> |
DeviceInfoActivity for CTSv2
Renamed DeviceInfoActivity to DeviceInfo. DeviceInfo extends
InstrumentationTestCase and will run automatically by ctsv2.
Bug: 23488971
Change-Id: Ie991bbf9eac85b4af132b845779d330101b7000a
tsTestLogReporter.java
|
| a953f6bd12a960a43e7401c842f391d32ff93a59 |
17-Sep-2015 |
Stuart Scott <stuartscott@google.com> |
Dont report EDI results as errors.
bug:24155088
Change-Id: I669baa49bdb5fa2dfea4e8ab8f708ddbbe86fb54
tsXmlResultReporter.java
|
| 9129f97d7c870e2df68aaed1ad3e4297c5400280 |
31-Aug-2015 |
Nash Lincoln <nashira@google.com> |
collect memory properties in CTS
collect ActivityManager.isLowRamDevice, ActivityManager.getMemoryClass,
ActivityManager.getLargeMemoryClass and ActivityManager.MemoryInfo.totalMem
Bug: 22974298
Change-Id: I7ef4ca9b218b9e06bf7f3abaff2d99573099119f
eviceInfoResult.java
|
| 581fa33fceb85b8b22080f91d188a13a534ca0af |
21-Aug-2015 |
Stuart Scott <stuartscott@google.com> |
Add bugreport-, logcat- and screenshot-on-failure
bug:21762834
Change-Id: Ieaf51bc194dcb9dd78a26b500b13bcdfb21ff358
tsXmlResultReporter.java
|
| 235b71c32fd466cf829dc716b02e31a52eb17460 |
18-Aug-2015 |
Nicholas Sauer <nicksauer@google.com> |
am 98d31fd5: am e0c5c0eb: am 5b377a9a: am 23df7e67: am 02ab6ae1: am a3424d92: am e29a533f: am d4a47ebd: am 848062b6: Merge "Collect smallestScreenWidthDp in CTS" into kitkat-cts-dev automerge: 0dfe152 automerge: db124f7
* commit '98d31fd5620d5d50e2d1e6826cad8da069812f8a':
Collect smallestScreenWidthDp in CTS
|
| 02ab6ae100e6e63b851739ea6f2fc42e599bfbe2 |
18-Aug-2015 |
Nicholas Sauer <nicksauer@google.com> |
am a3424d92: am e29a533f: am d4a47ebd: am 848062b6: Merge "Collect smallestScreenWidthDp in CTS" into kitkat-cts-dev automerge: 0dfe152 automerge: db124f7
* commit 'a3424d92c637c00a3c7abde83a925eef99f48354':
Collect smallestScreenWidthDp in CTS
|
| db124f73d6b7eb2135abb0e3d1b5e894c7ffe48e |
17-Aug-2015 |
Nicholas Sauer <nicksauer@google.com> |
Merge "Collect smallestScreenWidthDp in CTS" into kitkat-cts-dev
automerge: 0dfe152
* commit '0dfe1521fa1edf330d0cfd4d7da503d852f7561b':
Collect smallestScreenWidthDp in CTS
|
| 4162419797975a7d2bee14d014fb7c74a4151100 |
30-Jul-2015 |
Nicholas Sauer <nicksauer@google.com> |
Collect smallestScreenWidthDp in CTS
bug:19113953
Change-Id: I84a1a434b290f877686ec496e54e4a7c463d33c4
eviceInfoResult.java
|
| 5b07ac49758fd5935c61928fd75c116a2944f6e1 |
13-Aug-2015 |
Guang Zhu <guangzhu@google.com> |
am c919d4cd: am 291e38d7: am 68b3f732: am 22f4746f: am 542a7387: Merge "Add an option to use log saver for generated XML report" into mnc-dev
* commit 'c919d4cd70ce15467862237de3b8fa7c11b30eaf':
Add an option to use log saver for generated XML report
|
| 61a2db66a43beff5c71548639a38eac825a301b6 |
12-Aug-2015 |
Guang Zhu <guangzhu@google.com> |
Add an option to use log saver for generated XML report
Bug: 23105178
Change-Id: I9f352d51aafb3ab524b1a1311e25439a789ed4a3
tsXmlResultReporter.java
|
| f617a65e84275577280cc99311c27e32a5814f9b |
04-Aug-2015 |
Stuart Scott <stuartscott@google.com> |
resolved conflicts for merge of 22deb52d to master
Change-Id: I273e96b9e13870ca7666c140377064ece4c58f63
|
| b95b1c8df98f41407cb7167fe81dc72fab696e3c |
31-Jul-2015 |
Stuart Scott <stuartscott@google.com> |
Revert "Revert "Store result directory in build attributes.""
This reverts commit 256566a683e35959684674bcc13743548ebd20e3.
The original CL broken the build because the tests were not updated. This CL reinstates the original CL including the test changes
Change-Id: Ia6a63a28e55832d4d9692d52b2e9ab19eac96d88
tsXmlResultReporter.java
estResults.java
|
| 256566a683e35959684674bcc13743548ebd20e3 |
31-Jul-2015 |
Bart Sears <bsears@google.com> |
Revert "Store result directory in build attributes."
This reverts commit 7ea5a7d821686983442ed2d4a655d44632e2197d.
Change-Id: I2b53961b52f257c0b6effce997c61a607a663f56
tsXmlResultReporter.java
estResults.java
|
| 7ea5a7d821686983442ed2d4a655d44632e2197d |
31-Jul-2015 |
Stuart Scott <stuartscott@google.com> |
Store result directory in build attributes.
bug:22830394
Change-Id: I7066e70e58f3f9a8962425c615c65140f23d25e7
tsXmlResultReporter.java
estResults.java
|
| 38806a81a80a707c55401122a8e490e2e8063f33 |
10-Jul-2015 |
Agatha Man <agathaman@google.com> |
DO NOT MERGE Append .deviceinfo to extended device info json file names
Change-Id: If42bc6691854a6f976faeacdcabf39481c48ebef
tsXmlResultReporter.java
|
| 2285129a84365c777d47e57da4bac4cee52ea67b |
30-Jun-2015 |
Agatha Man <agathaman@google.com> |
DO NOT MERGE Add preparer for cts extended device info
Change-Id: I38297f32749eeaa816332f7e3d8fba18c12c29c6
tsTestLogReporter.java
tsXmlResultReporter.java
|
| 4d36ad06fceb8a5cbfc4c976f1286277e27638df |
16-Jul-2015 |
Stuart Scott <stuartscott@google.com> |
Only persist metrics reports if test has not failed.
bug:22504716
bug:21762834
Change-Id: I94bcfe81bbe0d195dc5dab9a74fac8d00aad4c2c
estPackageResult.java
|
| 932dde426376b2d1df657d00ec8acd06dd5687f0 |
10-Jul-2015 |
Agatha Man <agathaman@google.com> |
Append .deviceinfo to extended device info json file names
Bug: 22305795
Change-Id: I521ca11b6c1a4be613571060cc88c3f7b0e03267
tsXmlResultReporter.java
|
| 707b5430004bfc7e59cd418262196a88754f7114 |
30-Jun-2015 |
Stuart Scott <stuartscott@google.com> |
Remove target from ReportLog and handle serializing/parsing with XML.
bug:21762834
Change-Id: Ia686cfb4df0d315f965c1f8e46d790cd2841da19
estPackageResult.java
|
| 92423df543c8e11070c57585a6450e7f4e9a1a42 |
08-Jul-2015 |
Stuart Scott <stuartscott@google.com> |
Revert "Revert "Moving to common compatibility utils.""
This reverts commit 992b459293c4dcae2a12cdf5923e3e26a476bd1a.
This change includes the fix which caused the build breakage which
caused the revert this is reverting.
bug: 21762834
Change-Id: I1df495ba219208b07a7d7c8ac99d2890052caf69
tsTestLogReporter.java
tsXmlResultReporter.java
lanCreator.java
est.java
estPackageResult.java
estResults.java
|
| 992b459293c4dcae2a12cdf5923e3e26a476bd1a |
08-Jul-2015 |
Ian Pedowitz <ijpedowitz@google.com> |
Revert "Moving to common compatibility utils."
This reverts commit b054026b4d0347f958de7c4b3eaa6a52ff3d20cd.
Master is red, fixing the build by reverting all CL's merged from
b/21762834 today.
Bug: 21762834
Change-Id: Ibe31d8b615e55387ebbbd953f793f491ee30a2e8
tsTestLogReporter.java
tsXmlResultReporter.java
lanCreator.java
est.java
estPackageResult.java
estResults.java
|
| b054026b4d0347f958de7c4b3eaa6a52ff3d20cd |
06-Jul-2015 |
Stuart Scott <stuartscott@google.com> |
Moving to common compatibility utils.
bug:21762834
Change-Id: Ie0bf75bb1621308118633f41e063df40b529478d
tsTestLogReporter.java
tsXmlResultReporter.java
lanCreator.java
est.java
estPackageResult.java
estResults.java
|
| cd29a3fc5e584c3bd62cb96a34d655fdf0e2d5dc |
30-Jun-2015 |
Agatha Man <agathaman@google.com> |
Add preparer for cts extended device info
Bug: 22305795
Change-Id: If22085d3e8aae29f097f10e9d427a384e945b6f3
tsTestLogReporter.java
tsXmlResultReporter.java
|
| e42ea3fba9247c25c4960d4d2ef6766a025fabb6 |
24-May-2015 |
leozwang <leozwang@google.com> |
Add build number into CTS report.
Bug: 21375692
Change-Id: I9de1df943a0b8693af49cdcd41cd0aa192ded582
estResults.java
|
| d350695f559933c4a2688621e46783ba988cbdee |
10-Nov-2014 |
Agatha Man <agathaman@google.com> |
Merge "cts: add TestLog tags to XML report" into lmp-dev
|
| 6396d2134c42d1841031a1ad40c1408d98494d03 |
06-Nov-2014 |
Nicholas Sauer <nicksauer@google.com> |
Fix derived plan.
-Remove all ABI based test filtering from TestPackageDef and TestPlan.
-TestPackageDef and TestPlan represent exactly what exists in the corresponding XML files
-All ABI filtering happens in CtsTest.
-Minor cleanup
Change-Id: If9bc2ef31d70409f01bb098f4a1642be490bcb4c
lanCreator.java
|
| 254030fbcaae52d9fb8927075a83e855253bc6af |
04-Nov-2014 |
Agatha Man <agathaman@google.com> |
cts: add TestLog tags to XML report
b/16959454
- When configured properly, TF can store logs and report the URLs where
they are stored back to the test runner. So capture those URLs and
write them to the XML report for future processing.
- CtsXmlResultReporter implements ILogSaver, which has a testLogSaved callback
that gives the URL of the test log file. The URL to the test log is included
in the test result XML when the test fails and when the feature is enabled.
- Add a new tag <TestLog> to represent selected logs that testLogSaved
tells us about. Put all logic regarding this tag into the TestLog
class. TestLogType is an enum that defines what specific logs we are
interested in and how to identify them by examining the data name
passed by the testLogSaved callback.
- Finally, add a "include-test-log-tags" flag to control whether these
tags are enabled in the XML. This has the possibility of doubling the
size of reports, so we will only enable this feature in the lab
setting.
Change-Id: Iecfa26abeee3a4d4d36dc95e5d0bfb5cac411236
tsXmlResultReporter.java
est.java
estLog.java
|
| b41400ac5e27562387bc19f8a8c110d82319e0bf |
21-Oct-2014 |
Nicholas Sauer <nicksauer@google.com> |
Fix broken PTS result collection.
DeviceSerial is null when TestPackageResult attempts to serialize
PTS test results. To fix, set deviceSerial on the TestPackageResult
that is created when a test run is started.
bug:18054390
bug:18056020
Change-Id: Ice9d9be7f76b0d848c580709113350f82fee05c3
tsXmlResultReporter.java
|
| a27d89a5e5ff1539a835cd00c6ee6935b73a73c5 |
14-Oct-2014 |
Chenjie Luo <cjluo@google.com> |
Exclude DeviceSetup in the report as a TestPackage
Bug: 17424218
Change-Id: I03b59967ecc9a0d7d7289d6c65875990eca35a16
tsXmlResultReporter.java
|
| a4e46484cb5df4323bc8a3b76dee9a95de3c34c9 |
24-Sep-2014 |
Brett Chabot <brettchabot@google.com> |
Adjust cts-tradefed to JUnit4 test listener changes
Bug: 16684768
Change-Id: Icfff630f95bd59469490b13da1807878ee17b155
tsTestLogReporter.java
tsXmlResultReporter.java
ssueReporter.java
est.java
estSuite.java
|
| 78227665cbb060414e45f8f61de02ac496f05f8b |
24-Sep-2014 |
Stuart Scott <stuartscott@google.com> |
Clean up
Change-Id: I5334d75bf9661b681ac3541121f471e3463f8ed3
estPackageResult.java
estResults.java
|
| 084bd252873c70ca2d7e0d98c97ab96f598c50aa |
22-Sep-2014 |
Stuart Scott <stuartscott@google.com> |
Fixes metrics reporting
Change-Id: I691414d4ded032175af3fea74616af7874f23074
estPackageResult.java
|
| e00a2b8d92832236fc647d74acf21b7f4b35677b |
06-Sep-2014 |
Stuart Scott <stuartscott@google.com> |
Add 64bit support to CTS Tradefed
Change-Id: I836fb8c1608f8d632243f4897b7bf720db573762
tsReportUtil.java
tsTestLogReporter.java
tsXmlResultReporter.java
eviceInfoResult.java
TestResultRepo.java
TestSummary.java
ssueReporter.java
lanCreator.java
estPackageResult.java
estResults.java
|
| fef5e2c93f8f4371d52eec56dd8da7012e970da5 |
06-Sep-2014 |
Stuart Scott <stuartscott@google.com> |
Add 64bit support to tests and runners in CTS
Change-Id: I9a676e19d3ef88f76d8cd862b6fb78917a227159
tsXmlResultReporter.java
|
| 27484532f14e2e44f899982263489a5467d45956 |
31-Jul-2014 |
Nicholas Sauer <nicksauer@google.com> |
Add an optional external reference URL to result reporter.
bug:16680794
Change-Id: I417c3853eb485e3a1073fa3c07604527d3b44598
tsXmlResultReporter.java
esultReporter.java
|
| e83c5f23298cd21cc44e188de1f3ca43f5b79e12 |
03-Jun-2014 |
wsmlby <wsmlby@google.com> |
Cts add force_abi support
Change-Id: I2c411cde8abbb4f6d5de0cd7f907948e17d7ee52
tsXmlResultReporter.java
|
| 504fc8769168ed9519f5752748e50df4ecc2c885 |
07-May-2014 |
Nicholas Sauer <nicksauer@google.com> |
Add the include attribute to test plan Entry element.
Bug:14568468
Change-Id: I56a49a8fbd381b03fcf263d4b72c8039976ca9e2
(cherry picked from commit 26eab6438226eeb4af8377e0c9fd6f631f1b150c)
tsXmlResultReporter.java
|
| 26eab6438226eeb4af8377e0c9fd6f631f1b150c |
07-May-2014 |
Nicholas Sauer <nicksauer@google.com> |
Add the include attribute to test plan Entry element.
Bug:14568468
Change-Id: I56a49a8fbd381b03fcf263d4b72c8039976ca9e2
tsXmlResultReporter.java
|
| 3827e567b821a128e27a49ae55ba30fd73093647 |
24-Apr-2014 |
Tsu Chiang Chuang <tsu@google.com> |
Fix for logging device build info.
Bug: 14278655
Change-Id: Iaaf8e7de78cfceeac5a4739924526f5f68907b22
tsXmlResultReporter.java
|
| f515419d988ba348a9406723e0037fcd432874b3 |
07-Mar-2014 |
Brett Chabot <brettchabot@google.com> |
Report test status and fix options when sharding.
Previously there was a single test listener that would both save
results to XML and report execution status to stdout. This means
when sharding, results wouldn't be displayed until all shards
complete.
This CL takes advantage of the new IShardableListener to split
test status reporting to another listener, which can report status
for each shard.
Also ensure options are copied to each shard.
Change-Id: I269415220185ba655e1f63a89403ca5c037e58ac
tsTestLogReporter.java
tsXmlResultReporter.java
|
| e350b3b0138582f353ae90d7f748efd097c31ebf |
15-Feb-2014 |
Nicholas Sauer <nicksauer@google.com> |
DO NOT MERGE Add opengl extensions to cts device info report output.
Change-Id: I74d0f41a4aec5ffc5148275139f99654b9d0d4a7
(cherry picked from commit 4c07af9a80a7d37698b6d4d15fc036a4f4be5e13)
eviceInfoResult.java
|
| 4c07af9a80a7d37698b6d4d15fc036a4f4be5e13 |
15-Feb-2014 |
Nicholas Sauer <nicksauer@google.com> |
Add opengl extensions to cts device info report output.
Change-Id: I74d0f41a4aec5ffc5148275139f99654b9d0d4a7
eviceInfoResult.java
|
| 152f90915fd93e07a0cdce8a8009419f017eb7a3 |
20-Nov-2013 |
Unsuk Jung <unsuk@google.com> |
Bump CTS/CTS-verifier version to 4.4_r1.9 and report version to 4.4
Bug: 11777491
Change-Id: Iff4cd82b268a50fd06911246e9afd173b6b0117f
tsXmlResultReporter.java
|
| a1f2d058abad4484f485c6c7fa7bcc940005e8b9 |
13-Nov-2013 |
Stuart Scott <stuartscott@google.com> |
Refactoring util libraries in CTS.
Change-Id: I6e5daaab4c6124e751b19e50e03ef569e01c6828
tsXmlResultReporter.java
|
| 7ac297440fa312bdbddfa3d225c2a998ee7205d0 |
11-Nov-2013 |
Stuart Scott <stuartscott@google.com> |
Fixing build and continuing refactor
bug: 11561456
Change-Id: I30d63d6f761d31625c9ec18c200e9d73545db035
tsHostStore.java
tsXmlResultReporter.java
|
| 16be4106cf187c1a9002023b65ff653823c1c668 |
08-Nov-2013 |
Stuart Scott <stuartscott@google.com> |
Merge "Refactoring CTS to remove PTS references." into klp-dev
|
| a132af6f95074f34298384b7b217afc42d76b30b |
07-Nov-2013 |
Stuart Scott <stuartscott@google.com> |
Refactoring CTS to remove PTS references.
PTS is now a part of CTS
bug: 11561456
Change-Id: I577296fe7735790e285aa4747dc7832bc8ae5b6d
tsHostStore.java
tsReportUtil.java
tsXmlResultReporter.java
tsHostStore.java
tsReportUtil.java
est.java
|
| 57e02bbe0b0a1d08dd4fb65e1efe224402bbb0df |
09-Aug-2013 |
Brett Chabot <brettchabot@google.com> |
Update to TF logfilesaver API change
Bug: 11544667
Change-Id: Ic5156cbae41de5fbceb861c52ff19be44c95562f
(cherry picked from commit 3e2244f4d2bf5ee8df79ce490d9c6f2119d46d07)
tsXmlResultReporter.java
|
| 047585f9cb44e362d0871fa9c89360cc53365136 |
16-Jun-2013 |
Brett Chabot <brettchabot@google.com> |
Ensure CTS result directories are unique.
Bug 9447824
Change-Id: I521073f95373dc24fa518aed2531bf124b24e6fc
tsXmlResultReporter.java
|
| efa794f8232040c17318d07eec6c1ed0fac1739e |
27-Mar-2013 |
keunyoung <keunyoung@google.com> |
change mechanism to report performance results
- For device side, use Instrumentation.sendStatus instead of exception
- Because of it, all tests need Instrumentation, and PtsAndroidTestCase is
actually an ActivityInstrumentationTestCase with DummyActicity.
- In TF side, the result is passed as a test metrics.
- Host side tests uses static HashMap to store the result and retrieve it
as the current stack does not have test metrics in host side.
- Key used is device_serial#class_name#method_name to make the storing unique to
individual test case, and should be safe for concurrent runs
Change-Id: I254d72f2250d751f8e1e676e6dfe28837b4cd507
tsXmlResultReporter.java
tsHostStore.java
tsReportUtil.java
|
| b88600e548957f5a59501c7e383a6f15a98ed100 |
15-Dec-2012 |
Keun young Park <keunyoung@google.com> |
add optional target attribute to Summary
- example:
<Summary message="memcpy in fps" target="10.0" scoreType="higherBetter" unit="fps">491.68865488998546</Summary>
- Each test should set its target performance value with printSummaryWithTarget()
- The function will fail (= test fails) if the result does not meet the target.
- target attribute is optional. There can be a performance test without target,
and such test will always pass as long as the test finishes in time.
Change-Id: Idd7977020fe3b19c36369882ffe2bfa4994574a5
est.java
|
| d5b84bc0372514f255fff761713fe9203430b8db |
11-Dec-2012 |
Keun young Park <keunyoung@google.com> |
change XML format to accomodate both CTS and PTS
- example:
<Test name="testMemcpyK004" result="pass" starttime="Tue Nov 27 17:03:09 PST 2012" endtime="Tue Nov 27 17:03:09 PST 2012">
<Summary message = "screen copies per sec" scoretype="higherBetter" unit="fps">23938.82978723404</Summary>
<Details>
<ValueArray source=”com.android.pts.dram.BandwidthTest#doRunMemcpy:98” message=”measure1” unit="ms" scoretype="higherBetter">
<Value>0.0</Value>
<Value>0.1</Value>
</ValueArray>
</Details>
</Test>
- data pass from test is in more compressed format (still text) and XML
generator parses the result and expand it into XML format.
- The change involved API change for report, and thus all tests are affected.
- For CTS, the output will be the same as before.
- For PTS, when a test fails, there will be failure information under
FailedScene tag ( = same as CTS).
- For PTS, when a test passes, it will have Summary and Details tags.
Change-Id: Ie0ec3aa24962eabad87a4032efc71e887b9a3eae
est.java
estPackageResult.java
|
| de672f1afb7893586b241be9ad7a6f9cf4f3dcc2 |
28-Nov-2012 |
Keun young Park <keunyoung@google.com> |
add suite attribute to TestResult
- This makes handling easier in back-end
Change-Id: Id991d90ef05cf727ede29107b0674c366c6b5ed4
tsXmlResultReporter.java
|
| 5573a4d2061c85342197ce535f5e6bc5a7c22472 |
09-Nov-2012 |
Brian Muramatsu <btmura@google.com> |
Report suite name to result server
Send an additional form value indicating what test suite the XML is for.
The test plan name could suffice, but it could get confusing if we run
shorter plans that aren't called CTS. Thus, send an additional parameter
that is separate from the XML.
Change-Id: Iade46dbbf8a16c4883cee9fee434bf296bab8bef
tsXmlResultReporter.java
esultReporter.java
|
| 3e0a637b38b46d5710dca68f1ab180e0db1fe829 |
19-Sep-2012 |
Keun young Park <keunyoung@google.com> |
separate summary from details in report
- only summary shown while details kept in xml
- summary has two values: worst and average.
- The worst can be the single performance matrix.
Change-Id: Ibd564eeabad656af9a1f3484149628af358e2834
tsXmlResultReporter.java
est.java
estPackageResult.java
|
| 3769d33a2a5facc0caf497718b2730e16bf47ba2 |
29-Aug-2012 |
Keun young Park <keunyoung@google.com> |
performance test initial work
- pts build added (not yet pulled by cts)
- cts-tradefed has PTS mode where binary is under android-pts
- performance measurement is delivered to host by throwing exception!
: This can reduce the amount of code duplication as all existing
instrumentation test code can be re-used.
When performance test throws PtsException, it is treated as PASS and
the message is stored to the xml.
- UI scrolling performance
: scroll 10k list from top to bottom and measure time
- File system performance
: sequential write, sequential read, update
update with almost full disk
actural disk I/O can be checked by monitoring /proc/self/io
if kernel supports it. But it is only for debugging
Change-Id: Id83988fe34b6040bc20c98061a2b4f3d2f878b86
tsXmlResultReporter.java
est.java
estPackageResult.java
|
| 50455b3f14f3cd835150e63bea640cb76c7c2cb4 |
13-Sep-2012 |
Keun-young Park <keunyoung@google.com> |
Revert "performace test initial work"
This reverts commit b6ea46e3f074720ddae5e018b80e616f72272ed0
Change-Id: I2becc16ff320bed2174582df0ca79dcc01067e4a
tsXmlResultReporter.java
est.java
estPackageResult.java
|
| b6ea46e3f074720ddae5e018b80e616f72272ed0 |
29-Aug-2012 |
Keun young Park <keunyoung@google.com> |
performace test initial work
- pts build added (not yet pulled by cts)
- cts-tradefed has PTS mode where binary is under android-pts
- performance measurement is delivered to host by throwing exception!
: This can reduce the amount of code duplication as all existing
instrumentation test code can be re-used.
When performance test throws PtsException, it is treated as PASS and
the message is stored to the xml.
- UI scrolling performance
: scroll 10k list from top to bottom and measure time
- File system performance
: sequential write, sequential read, update
update with almost full disk
actural disk I/O can be checked by monitoring /proc/self/io
if kernel supports it. But it is only for debugging
Change-Id: Ice908d72c9ebb381c7e8e644d859904b17b7ef2a
tsXmlResultReporter.java
est.java
estPackageResult.java
|
| 23b5e895727bd9950f82b34a84ab234e94396453 |
30-Jan-2012 |
Brett Chabot <brettchabot@android.com> |
am ee161c64: am d4d204f3: Merge "Add \'device serials\' to output of \'list results\'" into ics-mr1
* commit 'ee161c641ae8cbac5477a3bbc084c439f652d8f1':
Add 'device serials' to output of 'list results'
|
| 41bef2476ef7dbf3fb573ddb1ed7aa468d52e392 |
29-Jan-2012 |
Brett Chabot <brettchabot@android.com> |
Add 'device serials' to output of 'list results'
Bug 5924016
Change-Id: I54dc0612f96fb156461b3eb2bccacead9f7d188c
eviceInfoResult.java
TestSummary.java
estSummaryXml.java
|
| df9378aa97f09d5b44a63e9e92069d63e5aab77a |
20-Jan-2012 |
Brian Muramatsu <btmura@google.com> |
Don't Report Installed Apps and Properties
Bug 5875919
Keep the refactoring that was done though and redistribute the data
across the columns.
Change-Id: Ibeda4337afb8e7e1660be1f1b5effab3d045c5c9
tsXmlResultReporter.java
eviceInfoResult.java
|
| 1d67e1910954f77786396111cb4c1aebf9799d08 |
19-Jan-2012 |
Brian Muramatsu <btmura@google.com> |
Report Installed Apps and Properties
Bug 5875919
Add a list of installed packages and properties to the report.
There are a lot of packages and properties, so I restructured the
device information section to be four columns wide and split apart
the test summary into its own area. The device information is
no longer shown by default, since it is so long and wide. However,
there is now a link at the top that allows you to toggle it.
Refactor DeviceInfoResult to utilize common functions for
serializing and parsing. Make sure it all works by adding tests
for it in DeviceInfoResultTest. The tests weren't running,
because they were not part of UnitTests. Finally, fix the
existing CtsXmlResultReporterTest failures. The mock was not
being setup properly.
Change-Id: If8f909444785267806d1e52f5270146962255271
tsXmlResultReporter.java
eviceInfoResult.java
|
| 066fb2833351636637a680f087d42006ea50d5cc |
13-Jan-2012 |
Brian Muramatsu <btmura@google.com> |
Option for Running Known Failures
Since knownfailures.txt is required by the build system, we cannot
simply delete the file to run known failures. Therefore add a
"run-known-failures" option to run even known failures.
The XML Generator now writes even known failures but adds
expectation="failure" to indicate that the test is expected to fail.
Then TestPackageXmlParser will only include these tests like a
normal test if "run-known-failures" has been set.
CtsConsole builds a TestPackageRepo but doesn't have simple
access to the flag value, so just assume known failures are not
included. This should be ok, because it only uses a TestPackageRepo
to list the packages.
Change-Id: Ie77c8b3f69c2164cffa7d231e357e52338b21dad
lanCreator.java
|
| b1a9891a0b2109a7fba9c900f68ee90f62aa843e |
20-Dec-2011 |
Brian Muramatsu <btmura@google.com> |
Result XML Reporter
- Adds another flag called "result-server" where results
will be posted to using a HTTP POST request.
- Extracts the multipart form handling code into a separate
MultipartForm data class.
- Fix a bug in the copying code where the code was writing
the full buffer all the time rather than how many bytes
were read.
Change-Id: Ic7a857653b3af7028abc2d564667185e1818904c
tsXmlResultReporter.java
ssueReporter.java
ultipartForm.java
esultReporter.java
|
| 77976b6f6ed3b7617de983ef3d4acdfd90c4f10f |
16-Dec-2011 |
Brian Muramatsu <btmura@google.com> |
Merge "DO NOT MERGE Fix IssueReporter Bugs" into ics-mr1
|
| 51dfeda725260dd437074539ffabe69447fd1fb3 |
10-Dec-2011 |
Brian Muramatsu <btmura@google.com> |
DO NOT MERGE Fix IssueReporter Bugs
The previous code only worked when testing a
single test :-P
Change-Id: I5bfa80cfb568df89d4bb6b3d47f7b383f31bffa9
ssueReporter.java
|
| 63a917bdcde962862b5471939e5397ac3636d46e |
16-Dec-2011 |
Brian Muramatsu <btmura@google.com> |
Merge "DO NOT MERGE Report Test Failures to Remote Server" into ics-mr1
|
| c43a7c46d8acf98365689d8a69232ca8adad651b |
07-Dec-2011 |
Brian Muramatsu <btmura@google.com> |
DO NOT MERGE Report Test Failures to Remote Server
Adds an "--issue-server" flag to specify a server that can
receive a form multipart/form-data request that contains
device information and an optional bugreport.
Change-Id: I6836c19623894c0ec861c7994c3d5b64879e80c9
ssueReporter.java
|
| 88e5d1fe2a37c5355cd7f64c8d02bba2cdbdeb49 |
14-Dec-2011 |
Keun young Park <keunyoung@google.com> |
Add OpenGL compressed texture format list to the test result.
- For device supporting ES 2.0, 2.0 API is used, but for 1.1 only device,
1.1 API is used.
- re-organized XML parsing / writing in host side to re-use the same code.
- update version to 1.13
Change-Id: I482deef34227c555e928bb9b65ff81a49620499d
tsXmlResultReporter.java
eviceInfoResult.java
|
| abed8866b4f47469cbae01b917d3dab973f657fd |
09-Dec-2011 |
Keun young Park <keunyoung@google.com> |
add listing of system libraries to testResult in the following format
<SystemLibrariesInfo>
<Library name="a.b.c" />
...
</SystemLibrariesInfo>
Change-Id: Ic5440e92000d5b3abdcac2234e7aeb9a8580f649
tsXmlResultReporter.java
eviceInfoResult.java
|
| 441ce455f60ef3cfaba718f50367b227e3f973cd |
19-Nov-2011 |
Brett Chabot <brettchabot@android.com> |
Better error handling when CTS build is not valid.
Change-Id: I02868b41b43220c559613c9164153fc562535142
tsXmlResultReporter.java
|
| 36d4da20ca84a24d2d655b6b49bcca5ca973b73c |
15-Nov-2011 |
Brett Chabot <brettchabot@android.com> |
Display two lines of failure stack in xml report, instead of one.
Change-Id: I8405fd832dc235883c7105f31ee0959d9cc8da82
est.java
|
| cee799cad841f8b53b2b9847f18bd870fdc9148b |
15-Nov-2011 |
Brett Chabot <brettchabot@android.com> |
am 87618b6c: Merge "Fix CTS XML logs and start time." into ics-mr0
* commit '87618b6caa18c33c06f16f7450ea26ffdc50d34c':
Fix CTS XML logs and start time.
|
| 8243ca2ba76bbf7663db8bd92d88bc4ab4fc43aa |
12-Nov-2011 |
Brett Chabot <brettchabot@android.com> |
Fix CTS XML logs and start time.
Create a separate repository/logs directory for storing logs. Don't
bundle them in the result.zip.
Correctly set startTime in XM when continuing a session.
Fix help text for --continue-session.
Bug 5608398
Change-Id: Id31bd1ba95f3397caf10cfe3e2efe152934400e8
tsXmlResultReporter.java
TestSummary.java
estSummaryXml.java
|
| e7cc8fd94d5bc32f5f70aa71aa8792376fd90b1f |
07-Nov-2011 |
Brian Muramatsu <btmura@google.com> |
Delete Old Test Runner
Bug 5563917
Change-Id: I4ed2cde974eee53b90f231a26a2947222aff5415
tsXmlResultReporter.java
|
| 770358ebdbafa73653cced292f5f77cdccfbe2aa |
29-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Support merging device info metrics.
Add support to read in previous device metrics from XML, and add logic to
combine values. ie when running on multiple devices, we want the report to
show: serial1,serial2 etc
Also cleanup a few constants for consistency.
Bug 5171702
Change-Id: I53a1d82b78fde7795f72015c289baa28c7b8472e
tsXmlResultReporter.java
eviceInfoResult.java
estResults.java
estSummaryXml.java
|
| 291adc99f2f6ed18f814048adad46f2d358a3c0f |
28-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Merge "Add --bugreport option." into ics-mr0
|
| f8b02e43adf39c4bcd0d237701302585834fde86 |
28-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Add --bugreport option.
Add ability to generate a bugreport after each failed test.
Also compress each generated log file.
Change-Id: I1e960b0caa69511fdc163057250d537add6579ae
tsXmlResultReporter.java
|
| 4c4e1b6390fc4d1f30380b8d2a4f9324f828086f |
28-Oct-2011 |
Brian Muramatsu <btmura@google.com> |
Merge "Show Path to Generated Report" into ics-mr0
|
| 98e9f2ce6c8d34b99242c237cdeb3cdb42b3f924 |
28-Oct-2011 |
Brian Muramatsu <btmura@google.com> |
Show Path to Generated Report
This makes it easier to view the report after a CTS run.
Added "file://" so it is clickable in my terminal..
Change-Id: I752713faae0873dfc77dc74871957f5626bf14cc
tsXmlResultReporter.java
|
| 03396dad98f31d445b20abe421669cc7516b15c7 |
27-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Add device info consistency check.
Bug 5171702
Change-Id: Icbdeec5ac910c705d7da9db5bb964067fb423775
estPackageResult.java
|
| 1569c2021bb6328de6a21bacfad3941789c49deb |
21-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Complete 'continue-session' support
Change the CTS xml generator to read in results from a previous XML file.
The XML generator has also been changed to store results in its own
data structure, rather than reusing CollectingTestListener.
Bug 5171576
Change-Id: Ie4d2aaca47bfb01a7203e9227d4506e2f9a2abd2
tsXmlResultReporter.java
TestResultRepo.java
est.java
estCase.java
estPackageResult.java
estResultRepo.java
estResults.java
estSuite.java
|
| dc612d65bdd40b8f206b78cfe758b8496391d674 |
20-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Merge "Handle missing device serial in CtsXmlResultReporter." into ics-mr0
|
| 7db0ce8be1dee3038f8f0f1dc722da9f4bc8f055 |
20-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Handle missing device serial in CtsXmlResultReporter.
Change-Id: Ie45a538d25717e822ac9612bbba7528e48277e1a
tsXmlResultReporter.java
|
| 817c153b0f1b3d313e25ad80942c7a1cbf7e33de |
20-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Add a --continue-session option.
Bug 5171576
Change-Id: Ic3b3509c38921ad952b8f87c990f2250ac73983d
tsTestStatus.java
lanCreator.java
|
| 22e35bc2390591549aca4286b018b36aab4b2851 |
20-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Fix xml generation.
Change-Id: I5bd63fbba838c3459111119001cef5cf7fe8fd3b
tsXmlResultReporter.java
|
| 04e211dd38156143a6bbde249de3324c01aea820 |
20-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Merge "Add 'add derivedplan' console command." into ics-mr0
|
| 676ec5e743b8d169db97ad6df599c12459549313 |
20-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Merge "Test summary cleanup." into ics-mr0
|
| 00921c0892b32f5d80cc692d3a75d868715f6c7e |
20-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Add ability to retrieve test results with given status.
Bug 5171576
Change-Id: Id38a03d9208e442cfeae2f458248f0914b2691dd
estCase.java
estPackageResult.java
estSuite.java
|
| 303242dd6675eb7e4f82c0309576faffb48ba921 |
20-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Add 'add derivedplan' console command.
Also add display of plan name to 'list results'
Bug 5171576
Change-Id: I4092dbd4177e8fea99e307e1c205255bea9075e1
TestResultRepo.java
lanCreator.java
estResultRepo.java
|
| c51a350bf01d6880e70b4381eaa82fec3c72975e |
20-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Test summary cleanup.
Add support for parsing plan name for test summaries.
Store cts build id in the buildinfo.
Bug 5171576
Change-Id: I315d0f551676a2ba2f471826635e3fd2a95bc83e
tsXmlResultReporter.java
TestSummary.java
estSummaryXml.java
|
| e7fc9eef5c176703a8e5f03f43a3bbd43a752b2f |
19-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Merge "Add more logs when generating CTS results." into ics-mr0
|
| 857fdce96c39d6eb360f5c307b373d8fa7bb06e4 |
19-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Add more logs when generating CTS results.
Bug 5376438
Change-Id: Iccaecbf2cdb34c20957d6d07edf0a9fda1a2bd75
tsXmlResultReporter.java
|
| 65cd6eff9303eebf0a57c68b42e8a9e44b8771ae |
18-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Add ability to parse test package results from xml.
Also fix xml generation for stack traces.
Bug 5171576
Change-Id: I3cbcdb69c6887bace2b1bd0610aeba7f1f8b8884
bstractXmlPullParser.java
est.java
estCase.java
estPackageResult.java
estResults.java
estSuite.java
|
| 3c64686bc8fe2d681500c432ae1a6b4602c83f77 |
18-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Refactor CTS xml creation.
Break out creation of package and test elements into separate classes.
Bug 5171576
Change-Id: I57a26075294393169b0902339295c49597be781f
tsTestStatus.java
tsXmlResultReporter.java
est.java
estCase.java
estPackageResult.java
estSuite.java
estSuiteRoot.java
estSummaryXml.java
|
| 156b3c75c4be7be45b1a221ce38f0710c900515c |
17-Oct-2011 |
Brian Muramatsu <btmura@google.com> |
Merge "Log Test Class + Name + Result" into ics-mr0
|
| 13638abcc3bea5bdd4ef04491311a6a7b3c43eef |
16-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
cts-tradefed: cleanup signature test and option reporting.
Bug 5264339
Change-Id: I3fee64b7f5e6855e7457389522dac4e68a230143
tsXmlResultReporter.java
|
| 62b0d44828b1e54394f4e461466961dd90bb7e66 |
15-Oct-2011 |
Brian Muramatsu <btmura@google.com> |
Log Test Class + Name + Result
Bug 5411733
Change-Id: I7305ac01d00aba4f9088ba552237ab48de4f1435
tsXmlResultReporter.java
|
| 53e68a3707bd017f69eec7a75c1cbd5513cb96ef |
05-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Run plan with excluded tests.
Also add support for excluded class names, and stop running extra tesst when
--class and --method are specified.
Bug 5412014,5171576
Change-Id: I1f76b206d6b6487dfb3711433d2ab27fdd6f247e
estResultRepo.java
|
| c289464a34080a3ea1ef9679c3873a6a818dcb66 |
05-Oct-2011 |
Brett Chabot <brettchabot@android.com> |
Add 'list results' command to cts-tradefed.
Change-Id: Ic108832cd8df09a5eb07e23f3f719eec491aa3c9
TestResultRepo.java
TestSummary.java
estResultRepo.java
estSummaryXml.java
|
| cbf4ad2e4c3433e6c67f81a3f755a73258c8da1c |
28-Sep-2011 |
Brett Chabot <brettchabot@android.com> |
Support tracking not executed cts tests.
Also fix issue in InstrumentationApkTest where it attempts to communicate with
device after its already deemed not available.
Bug 5376439
Change-Id: I1619586629d27e80be7586ece37908dc0e50be1c
tsXmlResultReporter.java
estCase.java
|
| ce31a10279f42d04b0b0d7b986b21d85f92a4fbd |
25-Sep-2011 |
Brett Chabot <brettchabot@android.com> |
Add zip of results dir to cts-tradefed.
Change-Id: I0440213e5c2e12b8b6a8dfde8b031a8fb3499ba6
tsXmlResultReporter.java
|
| 58c43a865d7f7763dfe83507dbbea99e772128b1 |
13-Sep-2011 |
Brett Chabot <brettchabot@android.com> |
Round 2 of cts-tradefed XML tweaks
- add deviceID
- add TestPackage name and digest
- remove erroneous extra TestCase result
- default testPlan to 'NA' instead of 'unknown'
Change-Id: I20acde9654ba61a488b17248713d3bb592692c70
tsXmlResultReporter.java
estCase.java
|
| 51b9caaebb4a732bed435f69cfbc6b617bf0dff2 |
08-Sep-2011 |
Brett Chabot <brettchabot@android.com> |
Round 1 of cts-tradefed XML tweaks.
Bug 5264339
Change-Id: I8e4cd92cced94c7ff3be106b04923b47f0345d8e
tsXmlResultReporter.java
estCase.java
imeUtil.java
|
| bb4477250c01c8bc9268ca2de09d947aa24dab96 |
23-Mar-2011 |
Tsu Chiang Chuang <tsu@google.com> |
Extending cts test creation timeout and fix compile error.
Change-Id: Id0ad2a770b643128e8d961d15c39cad9c1aecf63
tsXmlResultReporter.java
|
| 3fc406b283b622a22fff58666e0a8d7936434fd9 |
15-Feb-2011 |
Brett Chabot <brettchabot@android.com> |
Support sharding cts runs across multiple devices.
Change-Id: I958a3cafdd48c0d619c934620aeed85abc7c0608
tsXmlResultReporter.java
|
| 7cc0e25c71a73993738ba290ca74a620ee1f10f2 |
10-Feb-2011 |
Brett Chabot <brettchabot@android.com> |
Adjust cts-tradefed to the latest tradefed API.
Bug 3403768
Change-Id: Ia6c41117b7ce1f9431c86a312e1d5ae5a6ffa18a
tsXmlResultReporter.java
|
| cdb404daccfdb0b498d5b325916e351bd082e499 |
28-Jan-2011 |
Brett Chabot <brettchabot@android.com> |
Modify cts-tradefed xml generator to match current schema.
Bug 3403768
Change-Id: I5b01c081fdde563a1e2bdf5dc5b894e6befd665b
tsXmlResultReporter.java
estCase.java
estSuite.java
estSuiteRoot.java
|
| 82d9daf8b1800ef1c7897f2cd3167b6b1920b9fa |
21-Oct-2010 |
Brett Chabot <brettchabot@android.com> |
Add host tests support to cts-tradefed.
Change-Id: Ic54e067831e64bdf6efbb14476d07caa4bf35fc9
tsXmlResultReporter.java
|
| 56ac786a7d7045be43f3a7cf31de7ee19af810cf |
11-Oct-2010 |
Brett Chabot <brettchabot@android.com> |
Add device info data to Cts tradefed xml.
This changes attempts to simplify on the related implementation in the previous
CTS harness. Instead of using an intermediatary data structure to hold info collected
from device, this implementation simply passes the data from the device
to the CTS XML result reporter using the existing 'run metrics' mechanism.
Change-Id: I780655e08cfc984ff2c0e07dc62273000eecdd33
tsXmlResultReporter.java
|
| 2511767349dc95964cad3034c826e2fd142bb197 |
07-Oct-2010 |
Brett Chabot <brettchabot@android.com> |
Initial cts tradefed xml result reporter.
Change-Id: Ibdb5714d908dc2fd7a1a308576524482089a24fb
tsXmlResultReporter.java
|