313f06f4ba1c3dc732959c42f694422305ef488e |
|
15-Dec-2015 |
David Haddock <dhaddock@chromium.org> |
Remove mentions of Biopic in the image comparison code. Biopic is depreacted and we have switched to using pdiff and a generated report over the biopic tool. This CL removes the biopic code and references to it. BUG=None TEST=None Change-Id: I8748ccb25c37eb63f4ea8d72987ea9d926702060 Reviewed-on: https://chromium-review.googlesource.com/317984 Commit-Ready: David Haddock <dhaddock@chromium.org> Tested-by: David Haddock <dhaddock@chromium.org> Reviewed-by: Mussa Kiroga <mussa@chromium.org> Reviewed-by: Rohit Makasana <rohitbm@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
|
3ea31ea7ed802ad963135576e3b12be6c48dee84 |
|
02-Dec-2015 |
David Haddock <dhaddock@chromium.org> |
Image comparison results page for video runs. This change generates an html page that allows you to flick through an array of paths. Example here: https://pantheon.corp.google.com/m/cloudstorage/b/chromiumos-test-assets-public/o/dhaddock/Test/slideshow.html BUG=None TEST=test_that -b <board> <ip> video_GltichDetection* Change-Id: If424c178c5dae990056a01b1a7d2dd593a5f295f Reviewed-on: https://chromium-review.googlesource.com/311805 Commit-Ready: David Haddock <dhaddock@chromium.org> Tested-by: David Haddock <dhaddock@chromium.org> Reviewed-by: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
|
ed7559ef8174565357583f1bea1cfdfcd354a2e8 |
|
27-Aug-2015 |
David Haddock <dhaddock@chromium.org> |
Image Diff Viewer version 1 This CL: Gets perceptualdiff to return a diff image Adds the publisher class to create an HTML page containing the images Adds the publisher to the image_comparison_factory Writes the tags with run information to the HTML file Creates the HTML/CSS/JS for viewer v1 BUG=None TEST=test_that -b link <ip> ui_* Change-Id: Iedbcf75d61fc9884c686144aaa47d1a9be40c570 Reviewed-on: https://chromium-review.googlesource.com/292942 Commit-Ready: David Haddock <dhaddock@chromium.org> Tested-by: David Haddock <dhaddock@chromium.org> Reviewed-by: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
|
2a0a1ff986fc4fe0e817e2ce5745b4997b5eac27 |
|
05-Mar-2015 |
David Haddock <dhaddock@chromium.org> |
Update for image comparison tests The initial checkin didn't have version control. This adds it. A folder structure like <milestone>/<golden image> is now on Google Storage. The Roboto font change broke everything so we need versioning. This also adds a bigger timeout as the lab takes longer than my local testing. This also adds a few fixes due to accessibility fixes in ChromeOS. BUG=None TEST=None Change-Id: I33d994122bebe413344c8cb18d6341e3975a5747 Reviewed-on: https://chromium-review.googlesource.com/255751 Reviewed-by: Mussa Kiroga <mussa@chromium.org> Reviewed-by: Kris Rambish <krisr@chromium.org> Commit-Queue: David Haddock <dhaddock@chromium.org> Tested-by: David Haddock <dhaddock@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
|
ecef2f38ec267877f9b24a389ee9aa1435151dba |
|
05-Feb-2015 |
David Haddock <dhaddock@chromium.org> |
CrOS Test: UI testing with image comparison This CL adds image comparison tests for several parts of the UI. These are the system tray, settings page and app launcher. The SystemTray area had existing tests. This CL adds a new test for when a user is logged in and updates an existing guest test to wait for the animation effect to stop before continuing with the test. The logged in users profile picture is randomly generated as part of telemetry autotests so I've written a mask function to hide that so as not to interfere with the comparison. The SettingsPage test was broken and needed to be updated to cater for the new way tab.screenshot returns its image data. There are two implementations of image_util so calling WritePngFile from the base class will do the checking for NumPy itself. This also makes use of the image mask to hide the profile picture. I've written a test for the new App Launcher (Ares) that will be shipping in M42. The tests are to be used by the test team as part of their daily build qualification. BUG=chromium:374994,chromium:374986,chromium:374981 TEST=This Change-Id: I052d951c3713a6e5ef92ce1d3f265a41576b0ba9 Reviewed-on: https://chromium-review.googlesource.com/245680 Tested-by: David Haddock <dhaddock@chromium.org> Reviewed-by: Mussa Kiroga <mussa@chromium.org> Commit-Queue: David Haddock <dhaddock@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
|
f690bea78f0528ed05757e2b2ddc51e32518b44f |
|
23-Oct-2014 |
David Haddock <dhaddock@chromium.org> |
Updating ui_SystemTray to support guest login. BUG=chromium:374981 TEST=ran locally against a link device Change-Id: Ic7e97342eae1c0c1800c72564e4fac6506455b0a Reviewed-on: https://chromium-review.googlesource.com/225203 Reviewed-by: David Haddock <dhaddock@chromium.org> Commit-Queue: David Haddock <dhaddock@chromium.org> Tested-by: David Haddock <dhaddock@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
|
5f938c237602fe3d2f427d95f5311c4e22eb4408 |
|
05-Sep-2014 |
Mussa <mussa@chromium.org> |
Create ImageComparison Factory. Fall back to rgb comparison when bp is not available. Video tests have longed used image comparison to detect glitches. Recently we brought image comparison logic to ui/SystemTray. The factory logic that was once used in video tests was coupled with responsibilites that were specific to video tests. We couldn't reuse the factory to create just image comparison objects in ui tests. This change extracts the image comparison object making responsibility of the video test factory to its own factory: image_comparison_factory. We also modify the clients, both video and ui tests to use this new lightweight image comparison factory. Also, we have noticed that sometimes bp service is not available. This causes the test to fail because when it tries to create the bp_comparer an exception is thrown. Add logic to the image comparison factory that returns an rgb comparer when an attempt to create a bp_comparer fails. BUG=chromium:410890 TEST=Ran video_GlitchDetection test on link, verify they passed. Ran ui_SystemTray test on link, verify they also passed. Made bp_comparer raise an exception in its __init__ (simulating what would happen if bp service were not available). Ensured rgb_comparer was used although the test had asked for bp_comparer. Change-Id: I08a9a1d5b6a7fc25b2013ecc95204910f8871267 Reviewed-on: https://chromium-review.googlesource.com/216773 Commit-Queue: Mussa Kiroga <mussa@chromium.org> Tested-by: Mussa Kiroga <mussa@chromium.org> Reviewed-by: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
|
45745d81cc3c2c403092d1c320356fb47f660365 |
|
27-Aug-2014 |
Mussa <mussa@chromium.org> |
Add verification to ui_SystemTray tests. Initially, we had the 'test' only collect screenshots of the system tray with the intent to watch how the tray varies and assess the general viability of image comparison based tests in this area. After watching the screenshots for a number of builds, it makes sense to start with just the language indicator portion of the tray. This change collects this particular portion of the system tray, pulls down a golden version of it and runs the comparison. Comparisons are done locally first with a simple pixel by pixel array walk. Failures are uploaded to bp for later viewing. BUG=chromium:374981 TEST=Ran tests against a local link. TEST=Ran video glitch detection tests also. Change-Id: Ic5316d4d17a125b878c3c22b86568c554cf41186 Reviewed-on: https://chromium-review.googlesource.com/214380 Reviewed-by: Tracy Turchetto <tturchetto@chromium.org> Tested-by: Mussa Kiroga <mussa@chromium.org> Commit-Queue: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
|
6f61259448c2ff25b9055607f5888aca6f85ca4d |
|
20-Jun-2014 |
mussa <mussa@google.com> |
Collect Settings Page screenshots. We wish collect images for the settings page as we did for system tray. Because the logic to collect these images is the same we pulled it up to a parent class ui_test_base. We applied the template pattern to define the screenshot collection as the template method. BUG=chromium:374994 TEST=Ran tests locally. Results can be seen at: http://biopic.sandbox.google.com/5268094821859328/ Change-Id: Id421d15b06c37fb4b79babe2362a2f7a911b7890 Reviewed-on: https://chromium-review.googlesource.com/204800 Commit-Queue: Mussa Kiroga <mussa@google.com> Tested-by: Mussa Kiroga <mussa@google.com> Reviewed-by: Mussa Kiroga <mussa@chromium.org> Commit-Queue: Mussa Kiroga <mussa@chromium.org> Tested-by: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/ui/ui_test_base.py
|