History log of /frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
Revision Date Author Comments (<<< Hide modified files) (Show modified files >>>)
183c3c9ca20f55703f31e3610bca72682f6355db 23-May-2011 Steve Block <steveblock@google.com> Update DRT2 to reflect WebKit code movement

See http://trac.webkit.org/changeset/74301

Change-Id: Ibe495cdc1f50f65db5663dbb63af9b9c2db050d0
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
cda9448206494b67c0812b9591cc066ca070a7a6 09-Nov-2010 Steve Block <steveblock@google.com> Fix FsUtils.readDataFromUrl() to do the network request on a background thread

This is required now that doing network requests on the main thread
throws NetworkOnMainThreadException.

Also updates TestsListPreloaderThread to create the FileFilter lazily
and removes a superfluous FileFilter param from the Summarizer
constructor.

Change-Id: If15fddac934cd8be611f6693b25837657abbddc3
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
24652bc958997dc32d5c8275f2f2ce38daf6e106 18-Oct-2010 Steve Block <steveblock@google.com> Fix DumpRenderTree2 to correctly handle crashed tests

Change-Id: I894987d5b8f24ea31893aefe3cb6450c2736aa90
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
f460dd42190ada4a2c147db5127a9d7870fe0101 29-Sep-2010 Steve Block <steveblock@google.com> Fix a bug with the expected result path in DumpRenderTree2

If we fail to read from any of the possible expected result paths, we should
not record an expected result path.

Change-Id: Ica96b791c14a7755154be4ec9480be4d13f47a19
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
394e0fb84996f5f5ee9e33c9e2f0e11066e6f943 17-Sep-2010 Maksymilian Osowski <maxosowski@google.com> Updated Summarizer to use SQLite DB.

It avoids OOM issues by dumping the memory to the DB every
few hundred tests and then reading them in chunks when
generating summaries, etc.

Change-Id: I5f63d960d456f17e9f2189230a7ae0ca5607ce51
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
fadb0de33d3d4b0da765e2d3f60b895016b89c4f 17-Sep-2010 Maksymilian Osowski <maxosowski@google.com> Changed Summarizer to dump generated html code to file every few hundred tests to avoid OOM errors.

Change-Id: Id0917d45ffab2e47d67d17d629f342add5292d4e
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
9893d96d1231235f3d984e9dc751f08409a5f873 17-Sep-2010 Maksymilian Osowski <maxosowski@google.com> Updated ManagerService to call Summarizer.summarize() in a separate thread.

This could potentially take a long time and result in ANR.

Change-Id: Ib8b246e627e841217b68c955d92c97801e93d923
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
8a6def02473ee4fbffcd1b34173daf751d316202 17-Sep-2010 Steve Block <steveblock@google.com> Update DumpRenderTree2 to handle failing tests where no meaningful diff is available

Currently, DumpRenderTree2 asigns the following result codes
{PASS, FAIL_RESULT_DIFFERS, FAIL_NO_EXPECTED_RESULT, FAIL_TIMED_OUT,
FAIL_CRASHED}

This is not strictly correct, as a test may fail for any of three
reasons - crashing, timing out, or the the result not being as
expected. Therefore, it's possible for a test to fail even if the
result is as expected.

This patch updates AbstractResult to handle each of the three reasons
for failure separately. We then test all three to determine if the
test has passed.

This allows us to correctly report whether or not the result differs
from expected for a failing test.

Change-Id: I7adcfe72c4dd0bd3de2e1b868d9807be6eb5bddf
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
c0847c55eaef5b91d91abfdcfee5650eb22866eb 17-Sep-2010 Steve Block <steveblock@google.com> Remove superfluous CSS from DumpRenderTree2's Summarizer

Change-Id: Ifc3764ec3cf7bd5ee412abaf45112eed22083456
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
75aa0d382844dbee2d7931f21245112c27dd3d64 14-Sep-2010 Maksymilian Osowski <maxosowski@google.com> Changed Summarizer to add header before printing the path in summary.txt and details.html

Change-Id: I6413e1871ede077793d49b7d4732f90d0aea352f
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
ab87db4ad8e16e36f99303933db5267946e7bb34 13-Sep-2010 Steve Block <steveblock@google.com> Update DumpRenderTree2 to only calculate the WebKit revision once per test run

This is obtained by a HTTP request to ThirdPartyProject.prop

Change-Id: I34e310cf52fbcef24bb2a76e64aab5263b3052f1
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
7438b53487cb21f261eac4396aba0dbaa16ee015 13-Sep-2010 Steve Block <steveblock@google.com> Update DumpRenderTree2 text results output to better match HTML version

Always print number of crashes and line things up nicely.

Change-Id: I79a72056ba5ce007fdd4154f1518b9535b595317
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
0e2bae14b408d001fea84c0cbdb7348c3ec611a3 07-Sep-2010 Steve Block <steveblock@google.com> Update DumpRenderTree2 to reflect removal of WEBKIT_MERGE_REVISION

We now use ThirdPartyProject.prop
See https://android-git.corp.google.com/g/#change,64831

Change-Id: Ib52fdd93ac08fb19ec8b7f539eb084c0b668e01b
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
2ca8acdb5622b03a4ef56159477087adcf87db62 02-Sep-2010 Maksymilian Osowski <maxosowski@google.com> Adds webkit revision to the summary and details.

The revision number is taken from external/webkit/WEBKIT_MERGE_REVISION and is served to the java code by apache server. To be able to do that, the new alias directive had to be
added to the run_apache2.py script.

Bug: 2889572
Change-Id: Ie3d147e4d8ea9edd0144b819152121563b8bd759
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
01c1f9d9e9e7ab3a40a9bf27195a434eb0c9bb9b 02-Sep-2010 Maksymilian Osowski <maxosowski@google.com> The results now show which expected result was used.

Bug: 2889857
Change-Id: If2b7e6e6a22ddb5db6c6a50a358e8f263914e6c0
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
1b034781f4c45608e4d57e46cd46dfab9fc64746 01-Sep-2010 Maksymilian Osowski <maxosowski@google.com> Shows the details when all the tests finish and fixes the orientation issue.

The tests no longer restart when orientation changes.

Bug: 2904456
Change-Id: Ie1ee463dbd63fb1a2ad2e9c28bf5989002f22215
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
6ae5ce4b409759d36f2350e96ff2242e1385b147 01-Sep-2010 Maksymilian Osowski <maxosowski@google.com> Updated Summarizer to report tests under all 4 possible categories now.

Categories: ((un)expected passes/failures).
Also, FileFilter uses FAIL instead of IGNORE_RESULTS now.

Bug: 2899965
Change-Id: I06835b3d5cea84cbc92225a940bf7361cf832f59
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
603b70dd8b1ef8acabf71c52089c6cd5396fe931 27-Aug-2010 Maksymilian Osowski <maxosowski@google.com> Updated the Summarizer to link to the source of the tests.

Change-Id: I90018898c627b99f5a49c301e87593b52cd18ce4
Bug-Id: 2889573
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
2e64bb7afdd97c954491877306ccb8318f8ec3ce 10-Aug-2010 Maksymilian Osowski <maxosowski@google.com> Added more info to the Summarizer.

Bug: 2889572
Change-Id: If02dbdf90e8b8717370b5586cc72be235c93db79
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
5fb9ff420d378c5c83e116efadefb669791098d5 09-Aug-2010 Maksymilian Osowski <maxosowski@google.com> Added a basic version of python script and supporting code in DumpRenderTree.

Change-Id: Ic60ef9b89f74a3a36a4c31765f99c8de08dce911
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
ea46f2595a8718d4478e016fd40b2d57658289cf 10-Aug-2010 Maksymilian Osowski <maxosowski@google.com> Resets Summarizer after everything's finished.

Bug: 2903641
Change-Id: I7cecd454fe726a1527999259d37bd51ea2785116
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
3df4eab3de243d3e9a68d2554eeaed3b1bb4d69d 09-Aug-2010 Maksymilian Osowski <maxosowski@google.com> Added generating text summary to Summarizer.

Change-Id: I8768403b0e4edd46132018c9da6de54b218fb594
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
7e2a39b5985a1449588a397195c178bfef9421db 04-Aug-2010 Maksymilian Osowski <maxosowski@google.com> Added detection of missing EventSender functions.

Change-Id: I5268a66089d5e29a9ae5e496d05f3c79465771f5
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
4a9e3a6dc3bfbc885730cfec7b2f1c147d179cc1 30-Jul-2010 Maksymilian Osowski <maxosowski@google.com> Added detecting unimplemented layoutTestController functions and green squares.

Change-Id: Iaa7bbdb83a074a874a210f7975c6c3b731e0a924
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
6d0dae6a6534a01ee4c58d4f4ee1bf115c82319c 27-Jul-2010 Maksymilian Osowski <maxosowski@google.com> Upgraded DRT2 to generate nice HTML summaries of the tests.

Change-Id: Ibe4ee3af30fe20aeab2f3fed9c4c5693c9a0f268
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
5f0ccd76a88586ce85c17cb4db058934e693a4fc 23-Jul-2010 Maksymilian Osowski <maxosowski@google.com> Moved practically all of the prerefactoring functionality to the new design.

Renamed LayoutTestsRunner activity to TestsListActivity. It will be responsible for restrating the Executer after the crash. Now it only starts
it.
Renamed LayoutTestsRunnerThread to TestsListPreloaderThread. It only preloads tests now.
LayoutTest class is no longer needed, its functionality is in LayoutTestsExecuter.
Most of the functionality from LayoutTestsRunnerThread is now in ManagerService.

Change-Id: I08924d949ceb9f8816888bc8e795256d0542fa99
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
4ee7f4b19489f4dc9b87e90d1e5c7742cfa7ebe0 16-Jul-2010 Maksymilian Osowski <maxosowski@google.com> LayoutTest class with supporting classes (AbstractResult, TextResult).

These classes are responsible for actually running the tests, checking the results, generating visual diffs, etc.

Change-Id: I9b7f554409db1c97ac086c456db3aea3b993b5c6
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java
3c8ccb384513dd9bae0f98ac516ea36fbaa3173b 12-Jul-2010 Maksymilian Osowski <maxosowski@google.com> Added the LayoutTestsRunner class that is responsible for running the tests. Also, added some methods to FileFilter.

It preloads the tests from the given path, runs them and asks for dumps and diffs. It will also prepare summaries in the future. It delegates
most of the work of actually running the individual tests to LayoutTest class and AbstractResult (and its subclasses in the future).

Change-Id: I483bf26a380b539e4769e61b4a09fa270ab0e8e9
/frameworks/base/tests/DumpRenderTree2/src/com/android/dumprendertree2/Summarizer.java