History log of /external/autotest/client/cros/ui/ui_test_base.py
Revision Date Author Comments (<<< Hide modified files) (Show modified files >>>)
313f06f4ba1c3dc732959c42f694422305ef488e 15-Dec-2015 David Haddock <dhaddock@chromium.org> Remove mentions of Biopic in the image comparison code.

Biopic is depreacted and we have switched to using pdiff and a generated
report over the biopic tool. This CL removes the biopic code and
references to it.

BUG=None
TEST=None

Change-Id: I8748ccb25c37eb63f4ea8d72987ea9d926702060
Reviewed-on: https://chromium-review.googlesource.com/317984
Commit-Ready: David Haddock <dhaddock@chromium.org>
Tested-by: David Haddock <dhaddock@chromium.org>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Reviewed-by: Rohit Makasana <rohitbm@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
3ea31ea7ed802ad963135576e3b12be6c48dee84 02-Dec-2015 David Haddock <dhaddock@chromium.org> Image comparison results page for video runs.

This change generates an html page that allows you to flick through an
array of paths.

Example here:
https://pantheon.corp.google.com/m/cloudstorage/b/chromiumos-test-assets-public/o/dhaddock/Test/slideshow.html

BUG=None
TEST=test_that -b <board> <ip> video_GltichDetection*

Change-Id: If424c178c5dae990056a01b1a7d2dd593a5f295f
Reviewed-on: https://chromium-review.googlesource.com/311805
Commit-Ready: David Haddock <dhaddock@chromium.org>
Tested-by: David Haddock <dhaddock@chromium.org>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
ed7559ef8174565357583f1bea1cfdfcd354a2e8 27-Aug-2015 David Haddock <dhaddock@chromium.org> Image Diff Viewer version 1

This CL:
Gets perceptualdiff to return a diff image
Adds the publisher class to create an HTML page containing the images
Adds the publisher to the image_comparison_factory
Writes the tags with run information to the HTML file
Creates the HTML/CSS/JS for viewer v1

BUG=None
TEST=test_that -b link <ip> ui_*

Change-Id: Iedbcf75d61fc9884c686144aaa47d1a9be40c570
Reviewed-on: https://chromium-review.googlesource.com/292942
Commit-Ready: David Haddock <dhaddock@chromium.org>
Tested-by: David Haddock <dhaddock@chromium.org>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
2a0a1ff986fc4fe0e817e2ce5745b4997b5eac27 05-Mar-2015 David Haddock <dhaddock@chromium.org> Update for image comparison tests

The initial checkin didn't have version control. This adds it.
A folder structure like <milestone>/<golden image> is now on Google Storage.

The Roboto font change broke everything so we need versioning.

This also adds a bigger timeout as the lab takes longer than my local testing.
This also adds a few fixes due to accessibility fixes in ChromeOS.

BUG=None
TEST=None

Change-Id: I33d994122bebe413344c8cb18d6341e3975a5747
Reviewed-on: https://chromium-review.googlesource.com/255751
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Reviewed-by: Kris Rambish <krisr@chromium.org>
Commit-Queue: David Haddock <dhaddock@chromium.org>
Tested-by: David Haddock <dhaddock@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
ecef2f38ec267877f9b24a389ee9aa1435151dba 05-Feb-2015 David Haddock <dhaddock@chromium.org> CrOS Test: UI testing with image comparison

This CL adds image comparison tests for several parts of the UI. These are the
system tray, settings page and app launcher.

The SystemTray area had existing tests. This CL adds a new test for when a
user is logged in and updates an existing guest test to wait for the
animation effect to stop before continuing with the test. The logged in users
profile picture is randomly generated as part of telemetry autotests
so I've written a mask function to hide that so as not to interfere with
the comparison.

The SettingsPage test was broken and needed to be updated to cater for the
new way tab.screenshot returns its image data. There are two implementations
of image_util so calling WritePngFile from the base class will do the
checking for NumPy itself. This also makes use of the image mask to hide
the profile picture.

I've written a test for the new App Launcher (Ares) that will be shipping in
M42.

The tests are to be used by the test team as part of their daily build
qualification.

BUG=chromium:374994,chromium:374986,chromium:374981

TEST=This

Change-Id: I052d951c3713a6e5ef92ce1d3f265a41576b0ba9
Reviewed-on: https://chromium-review.googlesource.com/245680
Tested-by: David Haddock <dhaddock@chromium.org>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Commit-Queue: David Haddock <dhaddock@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
f690bea78f0528ed05757e2b2ddc51e32518b44f 23-Oct-2014 David Haddock <dhaddock@chromium.org> Updating ui_SystemTray to support guest login.

BUG=chromium:374981
TEST=ran locally against a link device

Change-Id: Ic7e97342eae1c0c1800c72564e4fac6506455b0a
Reviewed-on: https://chromium-review.googlesource.com/225203
Reviewed-by: David Haddock <dhaddock@chromium.org>
Commit-Queue: David Haddock <dhaddock@chromium.org>
Tested-by: David Haddock <dhaddock@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
5f938c237602fe3d2f427d95f5311c4e22eb4408 05-Sep-2014 Mussa <mussa@chromium.org> Create ImageComparison Factory.

Fall back to rgb comparison when bp is not available.

Video tests have longed used image comparison to detect glitches.
Recently we brought image comparison logic to ui/SystemTray. The
factory logic that was once used in video tests was coupled with
responsibilites that were specific to video tests. We couldn't
reuse the factory to create just image comparison objects in ui
tests.

This change extracts the image comparison object making
responsibility of the video test factory to its own factory:
image_comparison_factory.

We also modify the clients, both video and ui tests to use this
new lightweight image comparison factory.

Also, we have noticed that sometimes bp service is not available.
This causes the test to fail because when it tries to create the
bp_comparer an exception is thrown.

Add logic to the image comparison factory that returns an rgb
comparer when an attempt to create a bp_comparer fails.

BUG=chromium:410890
TEST=Ran video_GlitchDetection test on link, verify they passed.
Ran ui_SystemTray test on link, verify they also passed.
Made bp_comparer raise an exception in its __init__
(simulating what would happen if bp service were not available).
Ensured rgb_comparer was used although the test had asked
for bp_comparer.

Change-Id: I08a9a1d5b6a7fc25b2013ecc95204910f8871267
Reviewed-on: https://chromium-review.googlesource.com/216773
Commit-Queue: Mussa Kiroga <mussa@chromium.org>
Tested-by: Mussa Kiroga <mussa@chromium.org>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
45745d81cc3c2c403092d1c320356fb47f660365 27-Aug-2014 Mussa <mussa@chromium.org> Add verification to ui_SystemTray tests.

Initially, we had the 'test' only collect screenshots of the
system tray with the intent to watch how the tray varies and
assess the general viability of image comparison based tests
in this area.

After watching the screenshots for a number of builds, it makes
sense to start with just the language indicator portion of the
tray.

This change collects this particular portion of the system tray,
pulls down a golden version of it and runs the comparison.

Comparisons are done locally first with a simple pixel by pixel
array walk. Failures are uploaded to bp for later viewing.

BUG=chromium:374981
TEST=Ran tests against a local link.
TEST=Ran video glitch detection tests also.

Change-Id: Ic5316d4d17a125b878c3c22b86568c554cf41186
Reviewed-on: https://chromium-review.googlesource.com/214380
Reviewed-by: Tracy Turchetto <tturchetto@chromium.org>
Tested-by: Mussa Kiroga <mussa@chromium.org>
Commit-Queue: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
6f61259448c2ff25b9055607f5888aca6f85ca4d 20-Jun-2014 mussa <mussa@google.com> Collect Settings Page screenshots.

We wish collect images for the settings page as we did for system tray.

Because the logic to collect these images is the same we pulled it up
to a parent class ui_test_base.

We applied the template pattern to define the screenshot collection
as the template method.

BUG=chromium:374994
TEST=Ran tests locally. Results can be seen at:
http://biopic.sandbox.google.com/5268094821859328/

Change-Id: Id421d15b06c37fb4b79babe2362a2f7a911b7890
Reviewed-on: https://chromium-review.googlesource.com/204800
Commit-Queue: Mussa Kiroga <mussa@google.com>
Tested-by: Mussa Kiroga <mussa@google.com>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Commit-Queue: Mussa Kiroga <mussa@chromium.org>
Tested-by: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py