History log of /external/autotest/client/cros/image_comparison/upload_on_fail_comparer.py
Revision Date Author Comments (<<< Hide modified files) (Show modified files >>>)
36aaa77cb66b9250d1da2759aa29ddb1bfcb07ab 09-Sep-2014 Mussa <mussa@chromium.org> Improve test failure reporting.

For our video tests we use image comparison to compare several images
captured during a test run with golden images captured ahead of time.

Currently, if such a comparison fails, testers have to go dig out
comparison links in a series of clicks/logs scouring to examine the
failed comparison.

This CL puts comparison links and other comparison test results right on
the failure message so that it is visible in wmatrix for faster
triaging.

BUG=None.
TEST=Ran video_GlitchDetection.mp4.480p tests on link and observed the
report on failure.

Change-Id: I1aa038272b2dff6cd5b9724a6a45d34f18ef096f
Reviewed-on: https://chromium-review.googlesource.com/217163
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
Tested-by: Mussa Kiroga <mussa@chromium.org>
Commit-Queue: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/image_comparison/upload_on_fail_comparer.py
5f938c237602fe3d2f427d95f5311c4e22eb4408 05-Sep-2014 Mussa <mussa@chromium.org> Create ImageComparison Factory.

Fall back to rgb comparison when bp is not available.

Video tests have longed used image comparison to detect glitches.
Recently we brought image comparison logic to ui/SystemTray. The
factory logic that was once used in video tests was coupled with
responsibilites that were specific to video tests. We couldn't
reuse the factory to create just image comparison objects in ui
tests.

This change extracts the image comparison object making
responsibility of the video test factory to its own factory:
image_comparison_factory.

We also modify the clients, both video and ui tests to use this
new lightweight image comparison factory.

Also, we have noticed that sometimes bp service is not available.
This causes the test to fail because when it tries to create the
bp_comparer an exception is thrown.

Add logic to the image comparison factory that returns an rgb
comparer when an attempt to create a bp_comparer fails.

BUG=chromium:410890
TEST=Ran video_GlitchDetection test on link, verify they passed.
Ran ui_SystemTray test on link, verify they also passed.
Made bp_comparer raise an exception in its __init__
(simulating what would happen if bp service were not available).
Ensured rgb_comparer was used although the test had asked
for bp_comparer.

Change-Id: I08a9a1d5b6a7fc25b2013ecc95204910f8871267
Reviewed-on: https://chromium-review.googlesource.com/216773
Commit-Queue: Mussa Kiroga <mussa@chromium.org>
Tested-by: Mussa Kiroga <mussa@chromium.org>
Reviewed-by: Mussa Kiroga <mussa@chromium.org>
/external/autotest/client/cros/image_comparison/upload_on_fail_comparer.py