History log of /external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
Revision Date Author Comments (<<< Hide modified files) (Show modified files >>>)
fff04d91f318ff6c45c6b37eaad7e88069185e54 28-Aug-2015 Ilja H. Friedel <ihf@chromium.org> Disable piglit in the test lab.

With every Intel board except for generic on Freon there is no need to
schedule Piglit anymore. It will be replaced by dEQP.

BUG=chromium:413082
TEST=None.

Change-Id: I5bd149bd516a724ddacf5afb5efea4cc55751d2c
Reviewed-on: https://chromium-review.googlesource.com/295931
Commit-Ready: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Haixia Shi <hshi@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
2a5b061e897ac69fad4de376c479cfd97c90d62a 22-Oct-2014 David James <davidjames@google.com> Increase JOB_RETRIES from 1 to 2.

BUG=chromium:426176
TEST=none

Change-Id: Ifa9cf6ead62b5d35d031973868ca193537cc144d
Reviewed-on: https://chromium-review.googlesource.com/225096
Reviewed-by: Fang Deng <fdeng@chromium.org>
Tested-by: David James <davidjames@chromium.org>
Commit-Queue: David James <davidjames@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
394e8d73efe710394fd77fa7d94aad842a07b1b4 02-Oct-2014 Ilja H. Friedel <ihf@chromium.org> Reorganize graphics SUITE and scheduling.

For automated testing use exactly one SUITE from {bvt-perbuild,
graphics_per-day, graphics_per-week}. There is also graphics_per-build but
currently it only runs once a day. See suite_scheduler.ini and
test_suites/control.graphics* for latest details.

As before, only fast, reliable and high value tests should be part of bvt-cq.
All bvt-cq tests should also be part of graphics_per-day to have clean non-cq
runs for sanity purpose.

To simplify bringup of new devices all graphics tests should also belong to
SUITE graphics and one of {graphics_system, graphics_browser} depending if
they are system or browser level tests.

BUG=None.
TEST=None.

Change-Id: I876b34eac2c481d8cfa11477fc28fadf0efefe7d
Reviewed-on: https://chromium-review.googlesource.com/221026
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Richard Barnette <jrbarnette@chromium.org>
Reviewed-by: Haixia Shi <hshi@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
519268c0cb7cfec038da5e38decaa8a0a30657a9 04-Sep-2014 Ilja H. Friedel <ihf@chromium.org> graphics_PiglitBVT: Add old expectations.

I did not merge old and new expectations properly in
https://chromium-review.googlesource.com/#/c/213771/
b7f1881be31427aaba414607a221e651a201f8ff

The generated test scripts are correct, but expectations that were
flaky are not properly carried forward into the newly generated json.

This change completely reworks how expectations are computed.
Anything that is inconsistent in the current log files is considered
flaky and we compute a pass rate. Historic pass rates from old
expectations are ignored and results are downgraded from 'flaky'
to 'skip' to signify that there is no computational reason to still
consider them flaky.

'crbug', 'comment' and 'command' are now regular expectation members
and are carried forward when running generate_script.py

BUG=chromium:389430
TEST=Run generate_scripts.py and observe no script changes.

Change-Id: Ieaddcf106eaed28b060d69b0463dae976672d9ff
Reviewed-on: https://chromium-review.googlesource.com/216524
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Stéphane Marchesin <marcheu@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
b7f1881be31427aaba414607a221e651a201f8ff 22-Aug-2014 Ilja H. Friedel <ihf@chromium.org> graphics_PiglitBVT: use new piglit binaries.

BUG=chromium:389430
TEST=ran on link

Change-Id: Ice30fc22ec37f9a425ccbfc6d8eec244854c50eb
Reviewed-on: https://chromium-review.googlesource.com/213771
Reviewed-by: Daniel Kurtz <djkurtz@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Jenny Zhang <jennyz@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
8f6567391f6be898f7c85c7c49cbdbc204c96105 13-Aug-2014 Richard Barnette <jrbarnette@chromium.org> Revert "Remove the obsolete BVT suites."

This reverts commit 50e29bb24429b4640dd6f22d9689ed7d2807aeb4.

Of course, the moment this hit prod, all branches started
complaining because of the missing suite control files.

BUG=chromium:403349
TEST=None

Change-Id: I980247a4386b731b1a4288b3f73e8acb754884f6
Reviewed-on: https://chromium-review.googlesource.com/212215
Reviewed-by: Richard Barnette <jrbarnette@chromium.org>
Tested-by: Richard Barnette <jrbarnette@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
50e29bb24429b4640dd6f22d9689ed7d2807aeb4 31-Jul-2014 J. Richard Barnette <jrbarnette@chromium.org> Remove the obsolete BVT suites.

Suites 'bvt', 'bvt_cq', and 'qav' are now obsolete. Delete them.

BUG=chromium:399089
TEST=ran suite_enumerator on bvt, bvt_cq and qav
CQ-DEPEND=CL:210372

Change-Id: Ibe1fdef30bcc5e83da45cde679463b47e56929ae
Reviewed-on: https://chromium-review.googlesource.com/210549
Tested-by: Richard Barnette <jrbarnette@chromium.org>
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Richard Barnette <jrbarnette@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
3e31a77736ae7eeb0c43d6cb9c3d73e5850871c7 09-Aug-2014 Alex Deymo <deymo@chromium.org> graphics_*: Set label Cr-OS-Kernel-Graphics when autofiling.

When a new bug is filled as untriaged, add the right Cr- flag so
the owners can watch for new failures. This patch includes missing
control files on the previous CL.

BUG=chromium:402142
TEST=None

Change-Id: I225a99279a59bbf6a25c474d309a75b59290c9e2
Reviewed-on: https://chromium-review.googlesource.com/211761
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Alex Deymo <deymo@chromium.org>
Tested-by: Alex Deymo <deymo@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
a223642dca9e8b723cb997963b31c08dfbb0041f 23-Jul-2014 J. Richard Barnette <jrbarnette@chromium.org> Populate the bvt-inline, bvt-cq, and bvt-perbuild suites.

This assigns tests from the BVT and QAV suites homes in the new
suites, but leaves the old bvt, bvt_cq, and qav suites still in
place, pending chromite changes.

BUG=chromium:396685
TEST=TBD

Change-Id: I4d6ad5928c095f43d90957a36e0031a287399c4e
Reviewed-on: https://chromium-review.googlesource.com/209509
Reviewed-by: Richard Barnette <jrbarnette@chromium.org>
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Jorge Lucangeli Obes <jorgelo@chromium.org>
Tested-by: Richard Barnette <jrbarnette@chromium.org>
Commit-Queue: Richard Barnette <jrbarnette@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
dac2ceca1cd1654b3c6c98daf83ac17ccfcb6408 12-Jun-2014 Stéphane Marchesin <marcheu@chromium.org> update piglit expectations

Also let me run the python script to regenerate them directly.

BUG=none
TEST=none

Change-Id: Ieb8bde87b8ba060b61df529539576ea1782f08dd
Reviewed-on: https://chromium-review.googlesource.com/203540
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
150bd85b0c6ee021357bfa20a163083fb72c8d20 29-May-2014 Fang Deng <fdeng@chromium.org> [autotest] Add JOB_RETRIES to graphics_PiglitBVT

graphics_PiglitBVT is in bvt_cq, enable retry for it.
TEST=None
BUG=None

Change-Id: Ie3ec20b7fcd2dc7f2ee893ca477c1c89df297f31
Reviewed-on: https://chromium-review.googlesource.com/201966
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: David James <davidjames@chromium.org>
Tested-by: Fang Deng <fdeng@chromium.org>
Commit-Queue: Fang Deng <fdeng@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
2a09f75c2a87eb69fd386d1725f4401c0e932d32 21-May-2014 Dan Shi <dshi@chromium.org> Add graphics_PiglitBVT tests to bvt_cq suite so they can run on CQ

BUG=None
TEST=None

Change-Id: Ib3cfe34f7f657b8837e7e1a93efb1fbe7193c421
Reviewed-on: https://chromium-review.googlesource.com/200761
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Prashanth B <beeps@chromium.org>
Reviewed-by: Alex Miller <milleral@chromium.org>
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
6884028b85676c326b89979643b53ff7409e8af3 20-May-2014 Ilja H. Friedel <ihf@chromium.org> graphics_PiglitBVT: add expectations for 3 unit tests.

Also move suite from qav to graphics as long as it is in bvt.

BUG=chromium:375394, chromium:374505
TEST=None.

Change-Id: I239e8ad4134372c7828d84b3f7ea08d824ed8bea
Reviewed-on: https://chromium-review.googlesource.com/200654
Reviewed-by: David James <davidjames@chromium.org>
Reviewed-by: Stéphane Marchesin <marcheu@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
62c6764122961d2c838d026f1c98ce047bbc5897 18-May-2014 Dan Shi <dshi@chromium.org> [autotest] add client/site_tests/graphics_PiglitBVT back to bvt suite

bvt run time is reduced so it should finish before timed out. Add the test
back to bvt suite to run in CQ. After CL 200269 is landed, we can revert this
change to put them in bvt_cq suite.

BUG=None
TEST=None

Change-Id: I8a2afd94aabbec11f703d5020f1d7184e3b21b9e
Reviewed-on: https://chromium-review.googlesource.com/200366
Commit-Queue: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Prashanth B <beeps@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
8ef3318e2cfef60b6d2d5fde9d07e94b4aba00b4 16-May-2014 Dan Shi <dshi@chromium.org> [autotest] Create a new suite bvt_cq to run in CQ only

BUG=chromium:374318
TEST=None

Change-Id: I11a8e66ddaf8e8cd967976239c7f7b4be8908c96
Reviewed-on: https://chromium-review.googlesource.com/200237
Reviewed-by: Prashanth B <beeps@chromium.org>
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
26eaf43d773c822c5489c55fcb240c31a47ca076 15-May-2014 Ilja Friedel <ihf@chromium.org> graphics_PiglitBVT: move to BVT suite.

Also remove three tests that are either flaky or fail on BYT.

BUG=chromium:365888
TEST=https://wmatrix.googleplex.com/unfiltered?hide_missing=True&releases=tot&tests=graphics_PiglitBVT

Change-Id: Ib7318c32ac4859ddd2bd74e07fd4e59985cc6571
Reviewed-on: https://chromium-review.googlesource.com/199904
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
3992aae4f5c5695a52269d47c45c0492fc9faf2b 13-May-2014 Ilja Friedel <ihf@chromium.org> graphics_PiglitBVT: add XAUTHORITY.

It seems sometimes the environment is already set up for us, but most
of the time it is not. Hopefully this is it.

BUG=chromium:365888
TEST=TESTS=graphics_PiglitBVT emerge-link autotest-tests
test_that 172.22.30.209 graphics_PiglitBVT

Change-Id: I1148139f07f067c71abb5dcaf7e628542fa252fe
Reviewed-on: https://chromium-review.googlesource.com/199590
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Stéphane Marchesin <marcheu@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
bb30f5c8471de9b12dc70b11a2a8be6dd59865ee 12-May-2014 Ilja H. Friedel <ihf@chromium.org> Add graphic_PiglitBVT to qav.

We need test results.

BUG=chromium:365888
TEST=None.

Change-Id: I20469c2ef2a6b061b0b5f52e3c08d1456eec5d31
Reviewed-on: https://chromium-review.googlesource.com/199382
Reviewed-by: Rohit Makasana <rohitbm@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
2dd622e5babbe4dda8c4df82740b985efb10155e 09-May-2014 Ilja Friedel <ihf@chromium.org> graphics_PiglitBVT: cleanup.

This change:
1) Fixes that pinetrail was recognized as "other".
2) Pipes stdout to the log files as the test runs.
3) Cleans up paths in graphics_PiglitBVT.py and *.sh scripts.
4) Makes individual test status clearer in the logs.
5) Changes SUITE=graphics_* to get results faster than trybots.
6) Adds a GraphicsStateChecker.
7) Sets DISPLAY=:0 in all scripts.

BUG=chromium:365888
TEST=Ran on Alex.

Change-Id: I26afe0e1683586e01b1c117df6728107739ca319
Reviewed-on: https://chromium-review.googlesource.com/198973
Reviewed-by: Stéphane Marchesin <marcheu@chromium.org>
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
62ec8a7a760685c352aa19978c96d4cf109fc5fa 07-May-2014 Ilja H. Friedel <ihf@chromium.org> Fix graphics_PiglitBVT.

1) Don't mark it experimental anymore.
2) Check for mali intead of exynos as GPU family.

BUG=chromium:365888
TEST=None.

Change-Id: I978a2283b0aca14aefcd1520b909dae598fe1073
Reviewed-on: https://chromium-review.googlesource.com/198748
Reviewed-by: Stéphane Marchesin <marcheu@chromium.org>
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py
99b7e65094726c8d7d4c7cc5b6e4d4165e4ce239 26-Apr-2014 Ilja H. Friedel <ihf@chromium.org> Piglit-stable: clean up towards closing the CQ.

Add a cleaned up version of Piglit to autotest that is suitable for
closing the CQ. The heart of this test is
generate_scripts.py

which using test results *main.txt from wmatrix/ generates simple
shell scripts running piglit tests that pass everywhere. To not make
this a too small set we destinguish 4 GPU families for now (exynos,
pinetrail, tegra, other) which have similar feature set/driver support.

For more detail in how to use the script check README.

BUG=chromium:365888
TEST=Followed steps in README. Ran on link.

Change-Id: I8043a5d095f094c939acc1c1f5b2b995f935b404
Reviewed-on: https://chromium-review.googlesource.com/197202
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_PiglitBVT/generate_scripts.py