• Home
  • History
  • Annotate
  • only in /external/autotest/server/site_tests/telemetry_AFDOGenerate/
History log of /external/autotest/server/site_tests/telemetry_AFDOGenerate/
Revision Date Author Comments (<<< Hide modified files) (Show modified files >>>)
f3c86ddc1643791f96b68783a84368290942e305 20-Apr-2017 Ting-Yuan Huang <laszio@chromium.org> afdo: move samus to the llvm pipeline

Chrome on samus is going to be built by llvm.
Also removing link.

BUG=chromium:713446
TEST=None

Change-Id: I918be649c294338d97656f609dd5706b6e56d831
Reviewed-on: https://chromium-review.googlesource.com/482523
Commit-Ready: Ting-Yuan Huang <laszio@chromium.org>
Tested-by: Ting-Yuan Huang <laszio@chromium.org>
Reviewed-by: Caroline Tice <cmtice@chromium.org>
elemetry_AFDOGenerate.py
021ed349470fbaa3979898c2d8680ab67f7d35b3 21-Dec-2016 Ting-Yuan Huang <laszio@chromium.org> telemetry_AFDOGenerate: collect perf.data with images by clang

The code layout can be quite different by gcc and clang/llvm. To
make most of afdo, feedback file used by clang needs to be collected
on images built by llvm.

BUG=chromium:676173
TEST=Run and check files on gs

Change-Id: I0fc385b0f1914367ed2e9f4a24273e729ded3310
Reviewed-on: https://chromium-review.googlesource.com/422540
Commit-Ready: Ting-Yuan Huang <laszio@chromium.org>
Tested-by: Ting-Yuan Huang <laszio@chromium.org>
Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
elemetry_AFDOGenerate.py
0ab93253bcc62fe7a68698fd89448c20479f33b9 13-Oct-2016 Ting-Yuan Huang <laszio@chromium.org> telemetry_AFDOGenerate: Cutdown the training set.

This has been causing some builders to timeout.

BUG=chromium:653238
TEST=none

Change-Id: I3a433af99b12b105a461c57a0655eb433e7a7434
Reviewed-on: https://chromium-review.googlesource.com/398199
Commit-Ready: Ting-Yuan Huang <laszio@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
Tested-by: Ting-Yuan Huang <laszio@chromium.org>
Reviewed-by: Luis Lozano <llozano@chromium.org>
elemetry_AFDOGenerate.py
d422cecaa4e1e196c79bc6b3f2b0c6e609b86815 22-Aug-2016 Dan Shi <dshi@google.com> [autotest] Enable server-side packaging for telemetry_AFDOGenerate

The base container has been updated to include gsutil. The test can run with
server-side packaging now.

BUG=chromium:639720
TEST=http://cautotest/afe/#tab_id=view_job&object_id=74125736

Change-Id: Ibc7c32755608db7bef774f1d55cc02277a9e699a
Reviewed-on: https://chromium-review.googlesource.com/373919
Tested-by: Dan Shi <dshi@google.com>
Reviewed-by: Luis Lozano <llozano@chromium.org>
ontrol
89873ffc4ccce949b0a3953f6a039d45376ed758 02-Aug-2016 Ting-Yuan Huang <laszio@chromium.org> telemetry_AFDOGenerate: switch to page_cycler_v2.

The original page_cycler is deprecated and not available anymore.

BUG=none
TEST=test_that --board=$BOARD $DUT_ADDR \
--args=" run_local=[True|False] test=$TESTS " \
telemetry_AFDOGenerate

Change-Id: I1b69fc48d162030d8738059c213d6b8e7f78b9a5
Reviewed-on: https://chromium-review.googlesource.com/365190
Commit-Ready: Ting-Yuan Huang <laszio@chromium.org>
Tested-by: Ting-Yuan Huang <laszio@chromium.org>
Reviewed-by: Luis Lozano <llozano@chromium.org>
elemetry_AFDOGenerate.py
da018df37ab513d1fe2e92ecf5d0b4ae841cd85e 21-Jul-2016 Luis Lozano <llozano@chromium.org> AFDO: Allow to run AFDO profile on samus, link

Need to move AFDO profile collection to a newer board. Because of a
restriction in autotest, this needs to be run on a machine with at least
2GB in /tmp. So, allow to run this on samus, link.

BUG=None
TEST=Will verify that there are no performance implications.

Change-Id: I3fbaa96f888f38d63e522e514a3c33663ad7561f
Reviewed-on: https://chromium-review.googlesource.com/362073
Commit-Ready: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
Reviewed-by: Luis Lozano <llozano@chromium.org>
ontrol
elemetry_AFDOGenerate.py
d118012af85d2717da7144cf95a07943b794e7c8 10-Apr-2016 Ting-Yuan Huang <laszio@chromium.org> Disable telemetry_on_dut in telemetry_AFDOGenerate.

The benchmarks act as a training set and scores are irrelevant.
Local telemetry scripts influence the perf based profiling results.

BUG=none
TEST=test_that --board=$BOARD $DUT \
--args="ignore_failures=True local=True \
gs_test_location=True" \
telemetry_AFDOGenerate

Change-Id: Ifcb2fd19c08894a68da72c3bb2de4ce9321310c2
Reviewed-on: https://chromium-review.googlesource.com/338047
Commit-Ready: Ting-Yuan Huang <laszio@chromium.org>
Tested-by: Ting-Yuan Huang <laszio@chromium.org>
Reviewed-by: Caroline Tice <cmtice@chromium.org>
elemetry_AFDOGenerate.py
e2ae95d86c1cc5d2cd634ccf060631678b602628 10-Mar-2016 Christopher Wiley <wiley@chromium.org> Revert "Revert "Remove SUITE lines from control files in trivial cases""

This reverts commit 0af42bf5dbb673438f1253e13866c53aa7b91fe7.

Change-Id: I9ae2ad258bd6971eb88294da28c6f81238e123a7
Reviewed-on: https://chromium-review.googlesource.com/332095
Tested-by: Christopher Wiley <wiley@chromium.org>
Reviewed-by: Shuqian Zhao <shuqianz@chromium.org>
ontrol
9162c55fe4568d1ef42d1f5e5f57484285038c14 09-Mar-2016 Luis Lozano <llozano@chromium.org> AFDO: reduce time for profile collection

Profile collection is taking longer since when this process was started.
This may cause timeout problems in the PFQ builder especially when
benchmarks are retried. This may also be the cause for a weird
linux "perf" failure where it runs out-of-memory at the end of the
profile collection. To ameliorate these problems, I am reducing
the number of iterations for the benchmark that takes the longest time.

BUG=chromium:593086
BUG=chromium:581488
TEST=executed by hand. verified time is reduced.

Change-Id: I70824d0ca47da6d77bd2018e4208681bb2a25fa7
Reviewed-on: https://chromium-review.googlesource.com/331833
Commit-Ready: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
Reviewed-by: Caroline Tice <cmtice@chromium.org>
elemetry_AFDOGenerate.py
0af42bf5dbb673438f1253e13866c53aa7b91fe7 09-Mar-2016 Christopher Wiley <wiley@chromium.org> Revert "Remove SUITE lines from control files in trivial cases"

This reverts commit 1e499d54a49f023ccf7da9323c3a9765c510e660.

This has to wait for an infrastructure push.

Change-Id: Ie25306be0e777f7244dbfb913902eee502f01a89
Reviewed-on: https://chromium-review.googlesource.com/331805
Tested-by: Christopher Wiley <wiley@chromium.org>
Reviewed-by: Shuqian Zhao <shuqianz@chromium.org>
ontrol
2fd8e7cba07420bc2b7be921c0a8f97ee76c832e 07-Mar-2016 Christopher Wiley <wiley@google.com> Remove SUITE lines from control files in trivial cases

In all these control files, ATTRIBUTES defined a superset of suites from
SUITE, and the SUITE line looked like a single line:

SUITE = "foo"

BUG=b:27519238
TEST=inspection, generated change with scripts

Change-Id: I7d25554ad3e4458806c394ee66754d23495da07f
Reviewed-on: https://chromium-review.googlesource.com/331361
Commit-Ready: Christopher Wiley <wiley@chromium.org>
Tested-by: Christopher Wiley <wiley@chromium.org>
Reviewed-by: Shuqian Zhao <shuqianz@chromium.org>
ontrol
e97b5c96abaad985290993e57b7567bc8dbc76f5 26-Feb-2016 Luis Lozano <llozano@chromium.org> Temporarily remove smoothness.tought_webgl_cases.

This telemetry benchmark seems to be failing very
frequently. Remove until it is fixed. It has caused
increased times in AFDO collection and sometimes
timeouts for the lumpy-chrome-pfq builder.

BUG=chromium:590127
chromium:589905
TEST=none.

Change-Id: I91c03b14451f22b1425d9abea1cb003bf37cdb06
Reviewed-on: https://chromium-review.googlesource.com/329424
Reviewed-by: Luis Lozano <llozano@chromium.org>
Commit-Queue: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
elemetry_AFDOGenerate.py
6b2887a66f032115233cf0b45f7cc80a09ab0939 08-Oct-2015 Luis Lozano <llozano@chromium.org> AFDO: remove page_cycler.dhtml from training set.

This benchmark has been removed from Telemetry.

BUG=None
TEST=test_that telemetry_AFDOGenerate

Change-Id: If4caf3f5b14d740fcb23684afa0d6e1353cf50b3
Reviewed-on: https://chromium-review.googlesource.com/304800
Commit-Ready: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
Reviewed-by: David James <davidjames@chromium.org>
elemetry_AFDOGenerate.py
a600d5519d7949ee9470e07aac86bed7343cfcba 09-Sep-2015 Luis Lozano <llozano@chromium.org> AFDO: Use Telemetry and Superhero to collect AFDO profile.

Until now we have been avoiding using Telemetry directly to
run the benchmarks used in the profile collection. Telemetry
is now much more stable on ChromeOS so we can give it a try.
I also updated the list of benchmars in the profile to base
it on the Superhero benchmarks. This brings more "diversity"
to the profile set.
Also, added logic to retry benchmarks in case of failure.

With these chanages we get upto 19% improvement on some
benchmarks.

BUG=None
TEST=Collected profile several times. Tested retry logic.

Change-Id: I138cadf904e40fcbc8b8d6936c65d887dd0bca5e
Reviewed-on: https://chromium-review.googlesource.com/298062
Commit-Ready: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
Reviewed-by: Luis Lozano <llozano@chromium.org>
elemetry_AFDOGenerate.py
aa7ec8c17b2c52168ec212b926de38de40f04e5c 06-May-2015 Shuqian Zhao <shuqianz@chromium.org> [autotest] Seed ATTRIBUTES in all control files in autotest

The SUITE tag in the control files is being phased out and replaced by
ATTRIBUTES. During the transition period, both SUITE and ATTRIBUTES tags
will coexist, and a pre-upload hook will enforce that they agree with each
other and also ATTRIBUTES are in the attribute whitelist.

BUG=chromium:482749
TEST=Test with the pre-upload hook

Change-Id: I58288ff97c37af0b356115899b0d98e4052bc725
Reviewed-on: https://chromium-review.googlesource.com/269667
Reviewed-by: Shuqian Zhao <shuqianz@chromium.org>
Commit-Queue: Shuqian Zhao <shuqianz@chromium.org>
Trybot-Ready: Shuqian Zhao <shuqianz@chromium.org>
Tested-by: Shuqian Zhao <shuqianz@chromium.org>
ontrol
76d9968f3a3618671f3e83c0113e06e1f3025bd2 22-Apr-2015 Dan Shi <dshi@chromium.org> [autotest] Disable SSP for test telemetry_AFDOGenerate

The test uses gsutil to do upload, which is not supported in container.

BUG=chromium:479291
TEST=None

Change-Id: Ifc6747cde7e3c9300f73db31a600ede3f32cc55a
Reviewed-on: https://chromium-review.googlesource.com/266729
Trybot-Ready: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Gabe Black <gabeblack@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
ontrol
45b1d5ee093a1df18e286e1340c1b64145c18d4d 15-Sep-2014 Yunlian Jiang <yunlian@google.com> modify the comment of HOWTORUN for the test.

BUG=None
TEST=It shows the right commandline now.

Change-Id: If98f6e566c1e3af01fa512d182653cfcc38e5772
Reviewed-on: https://chromium-review.googlesource.com/218064
Reviewed-by: Luis Lozano <llozano@chromium.org>
Commit-Queue: Yunlian Jiang <yunlian@chromium.org>
Tested-by: Yunlian Jiang <yunlian@chromium.org>
elemetry_AFDOGenerate.py
09ef8f7eeda0452d48b53c4e28a1c6bdb24d0d7f 27-Aug-2014 Luis Lozano <llozano@chromium.org> Added some logging to GS uploads to diagnose some failures.

BUG=None
TEST=None

Change-Id: I667fe174891a5cd00034edb0168ebf5e3e94ed3e
Reviewed-on: https://chromium-review.googlesource.com/214363
Reviewed-by: Caroline Tice <cmtice@chromium.org>
Reviewed-by: Han Shen <shenhan@google.com>
Commit-Queue: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
elemetry_AFDOGenerate.py
d085cf6e4352c2cc62625ac3d161b1234b56e869 13-Aug-2014 Luis Lozano <llozano@chromium.org> List all the boards where this test can be run (sandybridge boards).

BUG=None.
TEST=Tested on lumpy, parrot.

Change-Id: I74c6caaa07ab69bf2eb1f671460601ec5a7b1a1a
Reviewed-on: https://chromium-review.googlesource.com/212291
Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
Commit-Queue: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
elemetry_AFDOGenerate.py
bf3b67055cd4aea47ede3f0c1368a61ba04f628c 06-May-2014 J. Richard Barnette <jrbarnette@chromium.org> Remove EXPERIMENTAL = True from all non-BVT tests.

The EXPERIMENTAL setting is being deprecated; the setting is a no-op
when the test isn't in the BVT and isn't in a suite with `file_bugs`
set to True. This removes the EXPERIMENTAL setting from control
files where the setting has no effect.

BUG=None
TEST=None

Change-Id: I8cd263fe7310f6e255d414c049458ee3458c79f9
Reviewed-on: https://chromium-review.googlesource.com/198430
Reviewed-by: Simran Basi <sbasi@chromium.org>
Tested-by: Richard Barnette <jrbarnette@chromium.org>
Commit-Queue: Richard Barnette <jrbarnette@chromium.org>
ontrol
c56792f43a0cb224ae0c5bbc121d0519f991773a 11-Feb-2014 Luis Lozano <llozano@chromium.org> Navigate a pre-defined set of URLs for Chrome profile collection.

The purpose of this test is to exercise chrome with a meaningful set
of pages while a profile of Chrome is captured. It also aims at using
the minimum set of functionality from Telemetry since Telemetry is not
very stable on ChromeOS at this point.

This test is designed to be called from the telemetry_AFDOGenerate
server test. The server test will start the "perf" profiling tool on
the DUT before starting this test. It will also capture the chrome
profile and upload it to Google Storage to be used for an optimized
build of Chrome.

BUG=None
TEST=Tested with test_that and in combination with telementry_AFDOGenerated
server test.

Change-Id: Ibe94cef3000289f93b01fb82c56b8bb00f7ba802
Reviewed-on: https://chromium-review.googlesource.com/185735
Reviewed-by: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
Commit-Queue: Luis Lozano <llozano@chromium.org>
elemetry_AFDOGenerate.py
c955980a394d10dd9c34784b7d57549344c905c5 06-Feb-2014 Luis Lozano <llozano@chromium.org> Add support for profiling using minimal functionality from Telemetry.

Telemetry benchmarks are quite flaky at this point in ChromeOS. So we
are adding a new mode to this test to capture the Chrome profile using
the minimal support from Telemetry. For that we need to control Chrome
directly which needs to be done with a client test. The client test
will ask Chrome to display the benchmarks pages directly instead of
using Telemetry "page sets" and "measurements" support.

BUG=None
TEST=Tested through test_that using client test (work in progress).
Verified the profile is captured and only one instance of the
profiler is executed.

Change-Id: I4140aa41b6930281fff1b1013c9664b5747a9516
Reviewed-on: https://chromium-review.googlesource.com/185123
Reviewed-by: Luis Lozano <llozano@chromium.org>
Commit-Queue: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
elemetry_AFDOGenerate.py
40b7d0d8a5da83d695903bd49c8deaa4572d309f 18-Jan-2014 Luis Lozano <llozano@chromium.org> Add current chrome version to generated AFDO perf data

Add the chrome version of the name of the generated AFDO perf.data
file. Had to add necessary support in cros_host class and in the
process commonized some code with site_sysinfo.py

BUG=None
TEST=Tested through test_that.

Change-Id: I4d6537c78f21febadc566b7ea8b3238dc809e135
Reviewed-on: https://chromium-review.googlesource.com/183132
Reviewed-by: Luis Lozano <llozano@chromium.org>
Commit-Queue: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
elemetry_AFDOGenerate.py
63b761b31094fa342415614f5c5a31e8694885bd 16-Jan-2014 Luis Lozano <llozano@chromium.org> Reduced the list of tests to run to more stable ones

Do this for now so that testing of whole infrastructure is easier.

BUG=None
TEST=Tested locally through test_that.

Change-Id: Ied9cae3acabcc64450e64cc44bf65015bb2010ab
Reviewed-on: https://chromium-review.googlesource.com/182866
Reviewed-by: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
Commit-Queue: Luis Lozano <llozano@chromium.org>
elemetry_AFDOGenerate.py
23ae319340ac2ccacc1fcafe605daf4f9b2f9838 09-Nov-2013 Luis Lozano <llozano@chromium.org> Add AFDOGenerate test to generate AFDO profile data

This runs a pre-determined set of benchmarks on the
DUT under the monitoring of the "perf" linux tool and
copies the resulting data to Google Storage to be
used by the AFDO optimized build.

As part of this, modified the telemetry_runner code
to support running tests without a devserver.

BUG=None
TEST=Tested by hand using the --local flag.
Tested with my own instance of autotest.

Change-Id: Ia237b393ab0f37a1f6e56e857c4aa39474bf72a6
Reviewed-on: https://chromium-review.googlesource.com/176286
Reviewed-by: Luis Lozano <llozano@chromium.org>
Commit-Queue: Luis Lozano <llozano@chromium.org>
Tested-by: Luis Lozano <llozano@chromium.org>
ontrol
elemetry_AFDOGenerate.py