| 313f06f4ba1c3dc732959c42f694422305ef488e |
15-Dec-2015 |
David Haddock <dhaddock@chromium.org> |
Remove mentions of Biopic in the image comparison code.
Biopic is depreacted and we have switched to using pdiff and a generated
report over the biopic tool. This CL removes the biopic code and
references to it.
BUG=None
TEST=None
Change-Id: I8748ccb25c37eb63f4ea8d72987ea9d926702060
Reviewed-on: https://chromium-review.googlesource.com/317984
Commit-Ready: David Haddock <dhaddock@chromium.org>
Tested-by: David Haddock <dhaddock@chromium.org>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Reviewed-by: Rohit Makasana <rohitbm@chromium.org>
ontrol.guest.link
ontrol.link
ontrol.user.link
|
| 395b44e0762ee1181301ebcff54616903f0e8096 |
19-Aug-2015 |
David Haddock <dhaddock@chromium.org> |
Fix for failing image comparison tests
Some of my tests were failing due to crbug.com/476791. This adds a workaround.
I have also updated the dependencies line that caused the tests to run on too
many boards.
BUG=chromium:476791
TEST=test_that -b link <ip> ui_SystemTray_guest
Change-Id: Id4ad2a5c48390d970d63e8cd35c565a087870a97
Reviewed-on: https://chromium-review.googlesource.com/294194
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Commit-Queue: David Haddock <dhaddock@chromium.org>
Tested-by: David Haddock <dhaddock@chromium.org>
i_SystemTray.py
|
| 58c7537a883f29260b117e13e9dc06bdf3db91bf |
24-Jun-2015 |
David Haddock <dhaddock@chromium.org> |
Add a check to ui_SystemTray test to make sure it is only being run on link
A few people have being getting failures for this test by running it on
invalid boards. This makes sure that the test exists if not run on link.
BUG=chrome-os-partner:41512
TEST=test_that -b <notlink> ip ui_SystemTray
Change-Id: I97098adc8043fda8d95c2f0ae6b96476f4d7bf48
Reviewed-on: https://chromium-review.googlesource.com/281398
Tested-by: David Haddock <dhaddock@chromium.org>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Commit-Queue: David Haddock <dhaddock@chromium.org>
i_SystemTray.py
|
| aa7ec8c17b2c52168ec212b926de38de40f04e5c |
06-May-2015 |
Shuqian Zhao <shuqianz@chromium.org> |
[autotest] Seed ATTRIBUTES in all control files in autotest
The SUITE tag in the control files is being phased out and replaced by
ATTRIBUTES. During the transition period, both SUITE and ATTRIBUTES tags
will coexist, and a pre-upload hook will enforce that they agree with each
other and also ATTRIBUTES are in the attribute whitelist.
BUG=chromium:482749
TEST=Test with the pre-upload hook
Change-Id: I58288ff97c37af0b356115899b0d98e4052bc725
Reviewed-on: https://chromium-review.googlesource.com/269667
Reviewed-by: Shuqian Zhao <shuqianz@chromium.org>
Commit-Queue: Shuqian Zhao <shuqianz@chromium.org>
Trybot-Ready: Shuqian Zhao <shuqianz@chromium.org>
Tested-by: Shuqian Zhao <shuqianz@chromium.org>
ontrol.guest.link
ontrol.link
ontrol.user.link
|
| 8957ec818a3fe50e93e56357a15b58b22a54614d |
13-Mar-2015 |
Ilja H. Friedel <ihf@chromium.org> |
Don't switch off screen before capture.
Currently the screenshot utility is unable to capture screenshots when
the screen switches off. Prevent this.
Also get_display_resolution() should be public as it is used here.
BUG=chromium:465590
TEST=test_that <ip> ui_SystemTray video_GlitchDetection.webm.480p passes
Change-Id: I009901a9e3a6eccb504feaf862128bd7db5210ca
Reviewed-on: https://chromium-review.googlesource.com/260052
Trybot-Ready: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Haixia Shi <hshi@chromium.org>
Reviewed-by: Ilja Friedel <ihf@chromium.org>
i_SystemTray.py
|
| 2a0a1ff986fc4fe0e817e2ce5745b4997b5eac27 |
05-Mar-2015 |
David Haddock <dhaddock@chromium.org> |
Update for image comparison tests
The initial checkin didn't have version control. This adds it.
A folder structure like <milestone>/<golden image> is now on Google Storage.
The Roboto font change broke everything so we need versioning.
This also adds a bigger timeout as the lab takes longer than my local testing.
This also adds a few fixes due to accessibility fixes in ChromeOS.
BUG=None
TEST=None
Change-Id: I33d994122bebe413344c8cb18d6341e3975a5747
Reviewed-on: https://chromium-review.googlesource.com/255751
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Reviewed-by: Kris Rambish <krisr@chromium.org>
Commit-Queue: David Haddock <dhaddock@chromium.org>
Tested-by: David Haddock <dhaddock@chromium.org>
i_SystemTray.py
|
| ecef2f38ec267877f9b24a389ee9aa1435151dba |
05-Feb-2015 |
David Haddock <dhaddock@chromium.org> |
CrOS Test: UI testing with image comparison
This CL adds image comparison tests for several parts of the UI. These are the
system tray, settings page and app launcher.
The SystemTray area had existing tests. This CL adds a new test for when a
user is logged in and updates an existing guest test to wait for the
animation effect to stop before continuing with the test. The logged in users
profile picture is randomly generated as part of telemetry autotests
so I've written a mask function to hide that so as not to interfere with
the comparison.
The SettingsPage test was broken and needed to be updated to cater for the
new way tab.screenshot returns its image data. There are two implementations
of image_util so calling WritePngFile from the base class will do the
checking for NumPy itself. This also makes use of the image mask to hide
the profile picture.
I've written a test for the new App Launcher (Ares) that will be shipping in
M42.
The tests are to be used by the test team as part of their daily build
qualification.
BUG=chromium:374994,chromium:374986,chromium:374981
TEST=This
Change-Id: I052d951c3713a6e5ef92ce1d3f265a41576b0ba9
Reviewed-on: https://chromium-review.googlesource.com/245680
Tested-by: David Haddock <dhaddock@chromium.org>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Commit-Queue: David Haddock <dhaddock@chromium.org>
ontrol.guest.link
ontrol.user.link
i_SystemTray.py
|
| f690bea78f0528ed05757e2b2ddc51e32518b44f |
23-Oct-2014 |
David Haddock <dhaddock@chromium.org> |
Updating ui_SystemTray to support guest login.
BUG=chromium:374981
TEST=ran locally against a link device
Change-Id: Ic7e97342eae1c0c1800c72564e4fac6506455b0a
Reviewed-on: https://chromium-review.googlesource.com/225203
Reviewed-by: David Haddock <dhaddock@chromium.org>
Commit-Queue: David Haddock <dhaddock@chromium.org>
Tested-by: David Haddock <dhaddock@chromium.org>
ontrol.guest.link
i_SystemTray.py
|
| 119df1ea059f8f6c8068f01417e401272b388c88 |
10-Oct-2014 |
Mussa Kiroga <mussa@google.com> |
Add ui_SystemTray test into bvt-perbuild test.
Test is ready to be onboarded into bvt-perbuild. That will also give us
more test results.
BUG=None.
TEST=None.
Change-Id: I40b6f12ed8784f02f760634080ce1362f56f9ff0
Reviewed-on: https://chromium-review.googlesource.com/222712
Reviewed-by: Tracy Turchetto <tturchetto@chromium.org>
Tested-by: Mussa Kiroga <mussa@chromium.org>
Commit-Queue: Mussa Kiroga <mussa@chromium.org>
ontrol.link
|
| 8753d83937751e6d2eb2646ea5af68979bb76312 |
08-Oct-2014 |
Ilja H. Friedel <ihf@chromium.org> |
autotest: refactor graphics_utils.
Move screenshot code to graphics_utils.
Move xsystem et al to cros_ui.py.
Fail if X is used under freon.
Make pylint happy.
TODO: write a (unit/auto)test for graphics_utils.
BUG=chromium:422414
TEST=Ran graphics_GLMark2 power_Consumption power_Backlight ui_SystemTray
on nyan_big, verified that code got exercised and is not broken.
Ran camera_V4L2 desktopui_GmailLatency graphics_GLAPICheck graphics_Gbm
graphics_Piglit graphics_SanAngeles hardware_VideoOutSemiAuto on
link_freon and nyan_big and made sure we got reasonable pass/fail.
Change-Id: I31f49d8c7b7a4e899bf47ba0b3543fc8755eecb8
Reviewed-on: https://chromium-review.googlesource.com/222990
Reviewed-by: Haixia Shi <hshi@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
i_SystemTray.py
|
| 45745d81cc3c2c403092d1c320356fb47f660365 |
27-Aug-2014 |
Mussa <mussa@chromium.org> |
Add verification to ui_SystemTray tests.
Initially, we had the 'test' only collect screenshots of the
system tray with the intent to watch how the tray varies and
assess the general viability of image comparison based tests
in this area.
After watching the screenshots for a number of builds, it makes
sense to start with just the language indicator portion of the
tray.
This change collects this particular portion of the system tray,
pulls down a golden version of it and runs the comparison.
Comparisons are done locally first with a simple pixel by pixel
array walk. Failures are uploaded to bp for later viewing.
BUG=chromium:374981
TEST=Ran tests against a local link.
TEST=Ran video glitch detection tests also.
Change-Id: Ic5316d4d17a125b878c3c22b86568c554cf41186
Reviewed-on: https://chromium-review.googlesource.com/214380
Reviewed-by: Tracy Turchetto <tturchetto@chromium.org>
Tested-by: Mussa Kiroga <mussa@chromium.org>
Commit-Queue: Mussa Kiroga <mussa@chromium.org>
ontrol.link
i_SystemTray.py
|
| 6f61259448c2ff25b9055607f5888aca6f85ca4d |
20-Jun-2014 |
mussa <mussa@google.com> |
Collect Settings Page screenshots.
We wish collect images for the settings page as we did for system tray.
Because the logic to collect these images is the same we pulled it up
to a parent class ui_test_base.
We applied the template pattern to define the screenshot collection
as the template method.
BUG=chromium:374994
TEST=Ran tests locally. Results can be seen at:
http://biopic.sandbox.google.com/5268094821859328/
Change-Id: Id421d15b06c37fb4b79babe2362a2f7a911b7890
Reviewed-on: https://chromium-review.googlesource.com/204800
Commit-Queue: Mussa Kiroga <mussa@google.com>
Tested-by: Mussa Kiroga <mussa@google.com>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Commit-Queue: Mussa Kiroga <mussa@chromium.org>
Tested-by: Mussa Kiroga <mussa@chromium.org>
i_SystemTray.py
|
| 9e6c2cd537a5edee3e82e42190999d03ee95d294 |
06-Jun-2014 |
mussa <mussa@google.com> |
Collect system tray screenshots.
We are collecting system tray screenshots so that we can observe
how the system tray looks like in the lab.
We eventually intend to use image comparison based to tests to detect
basic rendering flaws in the system tray.
However, it is difficult to establish a baseline with tray as we don't
know a good state that the tray starts in.
This test won't fail, but it will give us the ability to look at the system
tray across many builds.
** Moved pixel measurements to be inputs from control file. Renamed control file accordingly.
** capitalized and moved out of class declaration variables that are meant
to be constants indicating that they are not meant to be changed.
** Added dependencies flag in the control file to point to the link board.
Consequently, removed code to throw on other boards.
** We will only run this test on link for now. But we need to investigate
the possibility of specifying exactly which boards we are interested in.
BUG=chromium:374981
TEST=ran a local test on link and opened biopic link to see the image.
Change-Id: Ifa2591604d019efe8539c061a32d4a0b24505f8a
Reviewed-on: https://chromium-review.googlesource.com/202825
Reviewed-by: Kris Rambish <krisr@chromium.org>
Reviewed-by: Rohit Makasana <rohitbm@chromium.org>
Commit-Queue: Rohit Makasana <rohitbm@chromium.org>
Tested-by: Rohit Makasana <rohitbm@chromium.org>
ontrol.link
i_SystemTray.py
|