| f444234190b9b2c06d0079cb1583545723104738 |
|
13-Nov-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Dump useful system data in webrtc perf tests.
Dump info from top, iostat, and netstat.
Initial version to verify the approach works. The dump logic
should probably be in a separate util so that it can be reused by our
CfM perf tests as well.
TEST=Local DUT and checked generated files.
BUG=chromium:784365
pre-cq-configs: bluestreak-pre-cq
Change-Id: I49dc0105f907f71b583ae3b5492d6932df6415fc
Reviewed-on: https://chromium-review.googlesource.com/767387
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Claes Malmnäs <malmnas@google.com>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| a69288546513f3166bd22d7aacebea410e44501a |
|
09-Nov-2017 |
Kristoffer Erlandsson <kerl@google.com> |
system_metrics_collector now uses system_facade.
Preparation to re-use this in server perf tests.
Added unit tests for system_metrics_collector.
Also removed assert_is_close from utils_unittest since I discovered
there is a built-in method for that.
BUG=chromium:783085
TEST=Unit tests and webrtc perf test on local DUT.
pre-cq-configs: bluestreak-pre-cq
Change-Id: Ie1c6785646db063a4f3fe7efd4c1012279d2e2a0
Reviewed-on: https://chromium-review.googlesource.com/758766
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Claes Malmnäs <malmnas@google.com>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| e2000a906fb636de130ca955e74f155b26f35605 |
|
28-Sep-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Fix incorrect directory for screenshots.
TEST=No test, minor fix
BUG=None
pre-cq-configs: bluestreak-pre-cq
Change-Id: I8dab0d987c1847e4dab25dae30c5e4b2a7a702c1
Reviewed-on: https://chromium-review.googlesource.com/689516
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Denis Tosic <dtosic@chromium.org>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| 2ff7edce3d89ed4d4bdca7046225f8ad9f3fc126 |
|
13-Sep-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Disable googCpuOveruseDetection for perf tests.
To ensure there is no CPU adaption that disrupts the performance stats
we want to disable CPU overuse detection.
BUG=chromium:764229
TEST=Ran effected tests against local DUT. Verified cpu overuse flag was
picked up for performance tests on chrome://webrtc-internals.
pre-cq-configs: bluestreak-pre-cq
Change-Id: I2b87484592b693bdef3a0973ea3a7c035d2de717
Reviewed-on: https://chromium-review.googlesource.com/678874
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Denis Tosic <dtosic@chromium.org>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| a2cd7fc631121df38d2b362c9bce62ddac51501a |
|
18-Sep-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Store screenshots in debugdir.
Resultsdir as was previously used does not seem to be persisted in
google cloud in case a test fails. The debugdir is persisted in google
cloud.
BUG=chromium:760676
TEST=Existing tests against local DUT, verifed screenshots in debugdir
both on success and failure
Change-Id: I41ae873e4d6f8c4d043aa7f92009863fde402754
Reviewed-on: https://chromium-review.googlesource.com/671368
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Kristoffer Erlandsson <kerl@google.com>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| caef7f9de426c2c78e71d44562241e4d56e26efd |
|
19-Sep-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Ensure the status check always returns something.
This should fix tests failing with Unhandled EvaluateException:
UncaughtReferenceError, although it is hard to verify since it is not
consistenly reproducable.
We seem to have a race condition where the startCall (which initializes
the testRunner) has not fully completed before the first
testRunner.getStatus() call. This leads to testRunner being undefined
when the status check is made which leads to test failure. See for
example
https://wmatrix.googleplex.com/testrun/unfiltered?test_ids=557813387.
BUG=chromium:766769
TEST=Affected tests against local DUT
pre-cq-configs: bluestreak-pre-cq
Change-Id: I2b321bbdfe204b1f3f8a7e815e2d6e0475af6f4c
Reviewed-on: https://chromium-review.googlesource.com/673445
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Claes Malmnäs <malmnas@google.com>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| 348be63c534709884183aa098d465e32f9563741 |
|
18-Sep-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Catch wider range of exceptions on screenshot.
The graphics utils screenshot funcionality seems really flaky. In
https://wmatrix.googleplex.com/testrun/unfiltered?test_ids=556844689 we
got a ValueError. Hence, catch a wider range of exceptions to avoid
screenshot errors shadowing real failurs or failing tests.
BUG=chromium:760676
TEST=Ran tests using the screenshots against local DUT.
Change-Id: Ib426296e8f4c26349cac4abee0e64cc58634099e
Reviewed-on: https://chromium-review.googlesource.com/670264
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Denis Tosic <dtosic@chromium.org>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| 464d00794fe192245c87877515d642244a182111 |
|
11-Sep-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Add performance versions of WebRTC Autotests.
These versions run the same code as the functional tests but collect
system metrics during the run. Currently only memory and cpu usage is
collected but we intend to add more.
BUG=chromium:764229
TEST=Ran all affected test against local DUT
pre-cq-configs: bluestreak-pre-cq
Change-Id: Ibdfbe05205c071c573a29cdea8d6fe23c6f27dca
Reviewed-on: https://chromium-review.googlesource.com/663157
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Denis Tosic <dtosic@chromium.org>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| e865e1c93741f4d250808fc9b512ffb97fe00a29 |
|
12-Sep-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Handle screenshot exceptions.
Handle screenshot exceptions so that errors from screenshots do not hide
the actual test error.
Decreased the timeout of the screenshot to 10 seconds (default was 60).
BUG=chromium:760676
TEST=Ran both crashing test and working test on local DUT
pre-cq-configs: bluestreak-pre-cq
Change-Id: Iab70e25965637a5f902e6987459c91e5f12f6bf4
Reviewed-on: https://chromium-review.googlesource.com/663364
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Harpreet Grewal <harpreet@chromium.org>
Reviewed-by: Claes Malmnäs <malmnas@google.com>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| 4534b786aae6a14992eac83278a7900ab730c8f0 |
|
08-Sep-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Add screenshot support in WebRTC loopback tests.
Takes screenshots at the end of each test, regardless off pass/fail
status.
Attempts to take a screenshot using graphics_utils as well as
telemetry's tab.Screenshot().
Also fixed some docstrings to match the style guide.
BUG=chromium:760676
TEST=Ran affected tests on local DUT and lab DUT
pre-cq-configs: bluestreak-pre-cq
Change-Id: I81dac674d502f53cc8c8d96af869346179e91c78
Reviewed-on: https://chromium-review.googlesource.com/657180
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Claes Malmnäs <malmnas@google.com>
Reviewed-by: Denis Tosic <dtosic@chromium.org>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| 7002a78182ff25a4fa9c0e4967a98e0c92c58b5f |
|
04-Sep-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Refactoring and minor fixes for more code-reuse.
Made the PausePlay and ResolutionSwitching tests use the
test_webrtc_peer_connection module to avoid repeating test boilerplate.
Added a verification method to loopback-peerconnection.js and use that
method to verify the streams are OK instead of custom logic per test.
This method accepts some bad video resolution reports, since the
SwitchResolution test incorrectly fails now in the lab since
occasionally resolutions are reported as 0x0.
Minor fixes in ResolutionSwitching and PausePlay javascripts to fix
issues brought up in reviews of the MainFeedSwitching test.
Removed the FeedTable from the pauseplay tests. There is no reason to
arrenge the feeds in a table, it just adds complexity.
Other minor changes.
BUG=chromium:760676
TEST=Ran all affected tests against local DUT
Change-Id: I2f05c527bd99f9dfa47861c1d2690b0cc4132819
Reviewed-on: https://chromium-review.googlesource.com/653957
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Denis Tosic <dtosic@chromium.org>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|
| 652ff6a2b182a89194520b59e65bc38714d86008 |
|
31-Aug-2017 |
Kristoffer Erlandsson <kerl@google.com> |
Add WebRTC stress test for video source switching
This test starts 5 high resolution loopback peer connections. Four of
the video elements are styled to be small, thumbnail sized and one is in
its native size. This is intended to simulate a video conference with
one main feed and several smaller feeds.
The test then frequently swaps the sourceObject of the main feed with a
randomly chosen smaller feed.
Extracted much of the Python test support code to a common location to
be shared with the other WebRTC peer connection tests.
The intention is to later add some more verifications than only checking
if Chrome crashes.
BUG=chromium:760983
TEST=Tested against local DUT
Change-Id: Ia9661d0f65ad0c7d5c22b7e29b37995cce01223f
Reviewed-on: https://chromium-review.googlesource.com/647455
Commit-Ready: Kristoffer Erlandsson <kerl@google.com>
Tested-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Kristoffer Erlandsson <kerl@google.com>
Reviewed-by: Denis Tosic <dtosic@chromium.org>
/external/autotest/client/common_lib/cros/test_webrtc_peer_connection.py
|