| 61fcc1168add24d9efd06b997c3fe7753e98068f |
|
16-Feb-2017 |
Stéphane Marchesin <marcheu@chromium.org> |
graphics_GLMark2: Remove X11 remnants
BUG=chromium:655820
TEST=trybots
Change-Id: I57a4022ab987c6204cdd35eae19d4232febd3535
Reviewed-on: https://chromium-review.googlesource.com/444089
Commit-Ready: Stéphane Marchesin <marcheu@chromium.org>
Tested-by: Stéphane Marchesin <marcheu@chromium.org>
Reviewed-by: Ilja H. Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 619ee2569463359d155539539f5c0d7b2515ccd6 |
|
29-Oct-2016 |
Ilja H. Friedel <ihf@chromium.org> |
autotest graphics_*: unify TestStatus.
The goal is for graphics tests to only pass or fail. As much as
possible do not use TestError, TestWarn or TestNA etc. Having
only Pass/Fail will make reading on external dashboards (wmatrix,
sponge) less ambiguous. Also prepend all TestFail messages with
"Failed:" to make reading/understanding messages easier.
BUG=chromium:647465
TEST=pylint
Change-Id: I92160c9def35b72e22af8c19af6275932a63d00b
Reviewed-on: https://chromium-review.googlesource.com/404953
Commit-Ready: Ilja H. Friedel <ihf@chromium.org>
Tested-by: Ilja H. Friedel <ihf@chromium.org>
Reviewed-by: Dominik Behr <dbehr@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| edb23c8e7f7c86d25095c658c8700e275065541f |
|
30-Mar-2016 |
Ilja H. Friedel <ihf@chromium.org> |
graphics_GLMark2/Bench: explicitly raise TestFail.
Currently utils.run notices a negative return code and throws
a CmdError. This is unhandled by the test. Somehow the harness
colors the tests orange on wmatrix but the cq considers this
passing. Convert the ERROR to FAIL.
TEST=Veyron output changes from END ERROR -> END FAIL
20:24:16 INFO | autoserv| END ERROR graphics_GLMark2 graphics_GLMark2 timestamp=1459301055 localtime=Mar 29 20:24:15
20:24:52 INFO | autoserv| END GOOD ---- ---- timestamp=1459301090 localtime=Mar 29 20:24:50
to
20:35:31 INFO | autoserv| END FAIL graphics_GLMark2 graphics_GLMark2 timestamp=1459301730 localtime=Mar 29 20:35:30
20:36:08 INFO | autoserv| END GOOD ---- ---- timestamp=1459301766 localtime=Mar 29 20:36:06
BUG=chrome-os-partner:51809
Change-Id: I202de94bb5b99dab6db7872bb7666fd73c18dbfa
Reviewed-on: https://chromium-review.googlesource.com/336060
Commit-Ready: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Haixia Shi <hshi@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| f799af8d2e9e4ce8b7e5fb017f143a95260594f1 |
|
07-Nov-2015 |
Ilja H. Friedel <ihf@chromium.org> |
graphics_ perf tests: change heuristics for idle machine.
This is triggered by my adding the wait_for_idle_cpu in
https://chromium-review.googlesource.com/#/c/310590/
We want the CPU to calm down as much as possible before running perf tests to get
less noisy numbers. But we should only reject really bad numbers. This changes the
heuristics on when to give up and is motivated by nyan_ logs like the one below.
11/06 11:31:50.998 INFO | site_utils:0532| Starting to wait up to 60.0s for idle CPU...
11/06 11:31:52.001 INFO | site_utils:0544| After waiting 1.0s CPU utilization is 0.823.
11/06 11:31:54.006 INFO | site_utils:0544| After waiting 3.0s CPU utilization is 0.426.
11/06 11:31:58.016 INFO | site_utils:0544| After waiting 7.0s CPU utilization is 0.218.
11/06 11:32:06.035 INFO | site_utils:0544| After waiting 15.0s CPU utilization is 0.165.
11/06 11:32:22.057 INFO | site_utils:0544| After waiting 31.0s CPU utilization is 0.127.
11/06 11:32:38.090 INFO | site_utils:0544| After waiting 47.0s CPU utilization is 0.108.
11/06 11:32:54.126 INFO | site_utils:0544| After waiting 63.0s CPU utilization is 0.112.
11/06 11:32:54.144 WARNI| site_utils:0546| CPU did not become idle.
TEST=None.
BUG=None.
Change-Id: Ic458a8b37ae829fa884cf0f1e3d9e09573c8a195
Reviewed-on: https://chromium-review.googlesource.com/311460
Commit-Ready: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Haixia Shi <hshi@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 413340a4846f7e5c02f04811afdea572d17b0a24 |
|
24-Apr-2015 |
Frank Henigman <fjhenigman@chromium.org> |
graphics_GLMark2: make it work on freon
On freon, don't quit without doing anything.
Stop/start X server only if not freon.
Also look for an executable named glmark2-waffle.
BUG=chromium:413081
TEST=test_that -b link -i trybot-link-paladin/R45-7133.0.0-b1984 :lab: graphics_GLMark2
CQ-DEPEND=CL:274548
Change-Id: Icbd66a09ca2b736af871dbb72fd0fae2e082975e
Reviewed-on: https://chromium-review.googlesource.com/274711
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Frank Henigman <fjhenigman@chromium.org>
Commit-Queue: Frank Henigman <fjhenigman@chromium.org>
Tested-by: Frank Henigman <fjhenigman@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 8c7cbf848b1d752113dd32bed38f10960282a27c |
|
10-Apr-2015 |
Ilja H. Friedel <ihf@chromium.org> |
graphics_* adjustments for Freon.
This change
1) Fixes reporting from SanAngeles to the perf dashboard.
2) Restricts GLAPICheck to version check.
3) Moves graphics_GLMark2 to bvt-perbuild for now and makes explicit
that more Freon work is needed by using TestNAError.
And does some reformatting for the new pylint whitespace rules.
TEST=test_that <link> graphics_SanAngeles graphics_GLAPICheck graphics_GLMark2 graphics_GpuReset
BUG=chromium:413081
Change-Id: I97ad844d37709462df555a483c4c87de3cffe5c8
Reviewed-on: https://chromium-review.googlesource.com/265182
Trybot-Ready: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Frank Henigman <fjhenigman@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 671ca277049cb1a9bc171ad173c40c44786f022b |
|
27-Dec-2014 |
Chris Masone <cmasone@chromium.org> |
Make graphics tests kill X using python utils.
We'd like to deprecate term_process on base images, and the
graphics autotests are one of very few dependencies on this
shell function. The usage there should be easily replaced
by equivalent python code.
BUG=chromium:383133
TEST=Run graphics_*
Change-Id: I7f1607489f52fc9d0b591532ad1588aa1f46c049
Reviewed-on: https://chromium-review.googlesource.com/238303
Trybot-Ready: Chris Masone <cmasone@chromium.org>
Tested-by: Chris Masone <cmasone@chromium.org>
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Chris Masone <cmasone@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| a1c270a9a3aecbe82b9bfaf68ed6ced0c628d6db |
|
21-Nov-2014 |
Ilja H. Friedel <ihf@chromium.org> |
autotest: temporarily disable some bvt-cq tests under freon.
These tests will remain running in bvt-cq on non-freon boards.
But as they are currently failing and we need to get freon testing
started disable these tests.
This change is meant to be partially reverted with each passing test.
BUG=chromium:435437
TEST=test_that 100.96.58.154 suite:bvt-cq | tee link_freon_after.txt
rep FAILED link_freon_after.txt -> no output
Change-Id: I20eaed401e4ddbcc42efeb84fd2fe202e6c5a658
Reviewed-on: https://chromium-review.googlesource.com/231242
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Pawel Osciak <posciak@chromium.org>
Reviewed-by: Rohit Makasana <rohitbm@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| fa0614f3a86ae3408954326bcb6bf4e1e0b7879c |
|
29-Oct-2014 |
Ilja H. Friedel <ihf@chromium.org> |
autotest: graphics_GLMark2 should not wait in hasty mode.
BUG=chromium:427641, chromium:424032
TEST=None.
Change-Id: I64ba4360e20330fac5ef9e7d4cb7b5306399ff8d
Reviewed-on: https://chromium-review.googlesource.com/226340
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Haixia Shi <hshi@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 1337de35315dc2e77c74cf86a82c31f473ad017c |
|
28-Oct-2014 |
Ilja H. Friedel <ihf@chromium.org> |
autotest: add hasty mode to GLMark2.
This gets rid of validation mode. Instead we will run each subtest at 2s
by default, in hasty mode (used for bvt-cq) only 0.2s. This saves about
5 minutes of time in the cq, but still exerises the graphics pipeline.
Note this will impact the graphs on the perf dashboard.
BUG=chromium:427641
TEST=time bin/autotest tests/graphics_GLMark2/control.bvt-cq
real 0m21.634s
time bin/autotest tests/graphics_GLMark2/control
real 1m19.568s
Change-Id: I55902724f8fb3bcf22a86dba184d6b2852934b05
Reviewed-on: https://chromium-review.googlesource.com/226006
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Haixia Shi <hshi@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| d0ddb6acf3b6000a94c7829bd8a6acebd5fc2670 |
|
25-Sep-2014 |
Ilja H. Friedel <ihf@chromium.org> |
graphics tests: Bubble up errors from stderr.
Right now when external binaries are ran and fail due to a check this
may lead to a passing test. Try to catch this.
BUG=None.
TEST=Ran on nyan_big, observed graphics_SyncControlTest failing.
Change-Id: I1ea99d4bdf6539130ed964f2d2c55c8d0d7ee695
Reviewed-on: https://chromium-review.googlesource.com/220030
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Haixia Shi <hshi@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 67eac4d97a9e69f3fbe52c78b4d7f7fa35cfe562 |
|
28-Aug-2014 |
Ilja H. Friedel <ihf@chromium.org> |
graphics_*: monitor memory state after tests.
Move basic functionality from graphics_KernelMemory to graphics_utils.
Instrument all interesting tests with a GSC.
Forward memory statistics to dashboard.
BUG=chromium:408428
TEST=test_that 100.96.58.132 graphics_GLMark2 graphics_GLBench graphics_GpuReset graphics_KernelMemory graphics_SanAngeles graphics_WebGLAquarium graphics_WebGLClear graphics_WebGLManyPlanetsDeep graphics_WebGLPerformance
-----------------------------------------------------------------------------------------------------------------
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2 [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 buffer.columns_200.interleave_false.update-dispersion_0.9.update-fraction_0.5.update-method_map 1.575
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 buffer.columns_200.interleave_false.update-dispersion_0.9.update-fraction_0.5.update-method_subdata 1.404
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 buffer.columns_200.interleave_true.update-dispersion_0.9.update-fraction_0.5.update-method_map 1.414
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 build.use-vbo_false 0.618
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 build.use-vbo_true 0.536
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 bump.bump-render_height 0.475
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 bump.bump-render_high-poly 1.370
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 bump.bump-render_normals 0.465
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 conditionals.fragment-steps_0.vertex-steps_0 0.551
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 conditionals.fragment-steps_0.vertex-steps_5 0.552
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 conditionals.fragment-steps_5.vertex-steps_0 0.537
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 desktop.blur-radius_5.effect_blur.passes_1.separable_true.windows_4 1.626
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 desktop.effect_shadow.windows_4 0.972
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 effect2d.kernel_0-1-0_1--4-1_0-1-0_ 0.688
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 effect2d.kernel_1-1-1-1-1_1-1-1-1-1_1-1-1-1-1_ 1.458
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 function.fragment-complexity_low.fragment-steps_5 0.550
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 function.fragment-complexity_medium.fragment-steps_5 0.541
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 gem_objects_bytes 17842176
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 gem_objects_objects 10
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 glmark2_score 1398
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 ideas.speed_duration 0.634
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 jellyfish.default 0.982
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 loop.fragment-loop_false.fragment-steps_5.vertex-steps_5 0.550
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 loop.fragment-steps_5.fragment-uniform_false.vertex-steps_5 0.550
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 loop.fragment-steps_5.fragment-uniform_true.vertex-steps_5 0.542
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 meminfo_MemUsed 1631664
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 meminfo_SwapUsed 15576
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 memory_bytes 17842176
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 memory_objects 10
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 pulsar.light_false.quads_5.texture_false 0.571
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 refract.default 4.808
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 shading.shading_blinn-phong-inf 0.691
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 shading.shading_cel 0.702
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 shading.shading_gouraud 0.690
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 shading.shading_phong 0.699
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 shadow.default 1.555
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 terrain.default 7.194
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 texture.texture-filter_linear 0.497
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 texture.texture-filter_mipmap 0.481
/tmp/test_that_results_bdIjAZ/results-01-graphics_GLMark2/graphics_GLMark2 texture.texture-filter_nearest 0.496
/tmp/test_that_results_bdIjAZ/results-02-graphics_GLBench [ FAILED ]
/tmp/test_that_results_bdIjAZ/results-02-graphics_GLBench ERROR: Could not get cold machine.
/tmp/test_that_results_bdIjAZ/results-02-graphics_GLBench/graphics_GLBench [ FAILED ]
/tmp/test_that_results_bdIjAZ/results-02-graphics_GLBench/graphics_GLBench ERROR: Could not get cold machine.
/tmp/test_that_results_bdIjAZ/results-02-graphics_GLBench/graphics_GLBench gem_objects_bytes 17891328
/tmp/test_that_results_bdIjAZ/results-02-graphics_GLBench/graphics_GLBench gem_objects_objects 13
/tmp/test_that_results_bdIjAZ/results-02-graphics_GLBench/graphics_GLBench meminfo_MemUsed 1631792
/tmp/test_that_results_bdIjAZ/results-02-graphics_GLBench/graphics_GLBench meminfo_SwapUsed 15576
/tmp/test_that_results_bdIjAZ/results-02-graphics_GLBench/graphics_GLBench memory_bytes 17842176
/tmp/test_that_results_bdIjAZ/results-02-graphics_GLBench/graphics_GLBench memory_objects 10
/tmp/test_that_results_bdIjAZ/results-03-graphics_GLBench [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-03-graphics_GLBench/graphics_GLBench [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-03-graphics_GLBench/graphics_GLBench gem_objects_bytes 17842176
/tmp/test_that_results_bdIjAZ/results-03-graphics_GLBench/graphics_GLBench gem_objects_objects 10
/tmp/test_that_results_bdIjAZ/results-03-graphics_GLBench/graphics_GLBench meminfo_MemUsed 1634936
/tmp/test_that_results_bdIjAZ/results-03-graphics_GLBench/graphics_GLBench meminfo_SwapUsed 15576
/tmp/test_that_results_bdIjAZ/results-03-graphics_GLBench/graphics_GLBench memory_bytes 17842176
/tmp/test_that_results_bdIjAZ/results-03-graphics_GLBench/graphics_GLBench memory_objects 10
/tmp/test_that_results_bdIjAZ/results-04-graphics_GpuReset [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-04-graphics_GpuReset/graphics_GpuReset [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-05-graphics_KernelMemory [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-05-graphics_KernelMemory/graphics_KernelMemory [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-05-graphics_KernelMemory/graphics_KernelMemory gem_objects_bytes 213901312
/tmp/test_that_results_bdIjAZ/results-05-graphics_KernelMemory/graphics_KernelMemory gem_objects_objects 412
/tmp/test_that_results_bdIjAZ/results-05-graphics_KernelMemory/graphics_KernelMemory meminfo_MemUsed 2068820
/tmp/test_that_results_bdIjAZ/results-05-graphics_KernelMemory/graphics_KernelMemory meminfo_SwapUsed 15576
/tmp/test_that_results_bdIjAZ/results-05-graphics_KernelMemory/graphics_KernelMemory memory_bytes 208019456
/tmp/test_that_results_bdIjAZ/results-05-graphics_KernelMemory/graphics_KernelMemory memory_objects 315
/tmp/test_that_results_bdIjAZ/results-06-graphics_SanAngeles [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-06-graphics_SanAngeles/graphics_SanAngeles [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-06-graphics_SanAngeles/graphics_SanAngeles frames_per_sec_rate_san_angeles 134.7
/tmp/test_that_results_bdIjAZ/results-06-graphics_SanAngeles/graphics_SanAngeles gem_objects_bytes 221818880
/tmp/test_that_results_bdIjAZ/results-06-graphics_SanAngeles/graphics_SanAngeles gem_objects_objects 432
/tmp/test_that_results_bdIjAZ/results-06-graphics_SanAngeles/graphics_SanAngeles meminfo_MemUsed 2076480
/tmp/test_that_results_bdIjAZ/results-06-graphics_SanAngeles/graphics_SanAngeles meminfo_SwapUsed 15576
/tmp/test_that_results_bdIjAZ/results-06-graphics_SanAngeles/graphics_SanAngeles memory_bytes 215937024
/tmp/test_that_results_bdIjAZ/results-06-graphics_SanAngeles/graphics_SanAngeles memory_objects 335
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium avg_fps_0050_fishes 59.4736317249
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium avg_fps_1000_fishes 58.9920386175
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium avg_render_time_0050_fishes 0.00307254785938
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium avg_render_time_1000_fishes 0.0063975173696
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium gem_objects_bytes 17891328
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium gem_objects_objects 13
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium meminfo_MemUsed 1658712
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium meminfo_SwapUsed 15576
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium memory_bytes 17842176
/tmp/test_that_results_bdIjAZ/results-07-graphics_WebGLAquarium/graphics_WebGLAquarium memory_objects 10
/tmp/test_that_results_bdIjAZ/results-08-graphics_WebGLClear [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-08-graphics_WebGLClear/graphics_WebGLClear [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-08-graphics_WebGLClear/graphics_WebGLClear avg_fps 60
/tmp/test_that_results_bdIjAZ/results-08-graphics_WebGLClear/graphics_WebGLClear gem_objects_bytes 17891328
/tmp/test_that_results_bdIjAZ/results-08-graphics_WebGLClear/graphics_WebGLClear gem_objects_objects 13
/tmp/test_that_results_bdIjAZ/results-08-graphics_WebGLClear/graphics_WebGLClear meminfo_MemUsed 1650676
/tmp/test_that_results_bdIjAZ/results-08-graphics_WebGLClear/graphics_WebGLClear meminfo_SwapUsed 15576
/tmp/test_that_results_bdIjAZ/results-08-graphics_WebGLClear/graphics_WebGLClear memory_bytes 17842176
/tmp/test_that_results_bdIjAZ/results-08-graphics_WebGLClear/graphics_WebGLClear memory_objects 10
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep average_fps 59.8214285714
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep gem_objects_bytes 17891328
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep gem_objects_objects 13
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep js_render_time_ms_mean 1.36681974742
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep js_render_time_ms_std 0.489031342632
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep meminfo_MemUsed 1661920
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep meminfo_SwapUsed 15576
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep memory_bytes 17842176
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep memory_objects 10
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep per_frame_dt_ms_mean 16.7164179104
/tmp/test_that_results_bdIjAZ/results-09-graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep per_frame_dt_ms_std 0.61548635141
/tmp/test_that_results_bdIjAZ/results-10-graphics_WebGLPerformance [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-10-graphics_WebGLPerformance/graphics_WebGLPerformance [ PASSED ]
/tmp/test_that_results_bdIjAZ/results-10-graphics_WebGLPerformance/graphics_WebGLPerformance gem_objects_bytes 17891328
/tmp/test_that_results_bdIjAZ/results-10-graphics_WebGLPerformance/graphics_WebGLPerformance gem_objects_objects 13
/tmp/test_that_results_bdIjAZ/results-10-graphics_WebGLPerformance/graphics_WebGLPerformance meminfo_MemUsed 1652664
/tmp/test_that_results_bdIjAZ/results-10-graphics_WebGLPerformance/graphics_WebGLPerformance meminfo_SwapUsed 15576
/tmp/test_that_results_bdIjAZ/results-10-graphics_WebGLPerformance/graphics_WebGLPerformance memory_bytes 17842176
/tmp/test_that_results_bdIjAZ/results-10-graphics_WebGLPerformance/graphics_WebGLPerformance memory_objects 10
/tmp/test_that_results_bdIjAZ/results-10-graphics_WebGLPerformance/graphics_WebGLPerformance time_ms_geom_mean 11.48
-----------------------------------------------------------------------------------------------------------------
Total PASS: 18/20 (90%)
Change-Id: I2866e4fb9bbee1dd819d36b5b1c8e4883c502c12
Reviewed-on: https://chromium-review.googlesource.com/214634
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Stéphane Marchesin <marcheu@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 19ac1439d7b82c62cb051dba22db9198b28a8e84 |
|
01-Apr-2014 |
Ilja H. Friedel <ihf@chromium.org> |
graphics_GLMark2: More logging.
Try to store test output as we receive it.
BUG=chromium:358477
TEST=daisy: debug/graphics_GLMark2.DEBUG shows output as test runs.
Change-Id: I6210ff278e26ff0ed270303220629d5707b6a0ae
Reviewed-on: https://chromium-review.googlesource.com/192535
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Daniel Kurtz <djkurtz@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 3b4712cc3f0a77cfa7851fb73fb03fcb0c4e6318 |
|
14-Mar-2014 |
Ilja Friedel <ihf@chromium.org> |
Start monitoring temperature during tests.
There are two parts to this:
1) Added infrastructure to site_utils.py to get machine into defined state
and keep tests honest.
2) Change glbench binary to base its wait times on currently observed
temperatures.
This should make the test faster, as we can cut down on blind sleep times.
But I don't expect on its own to change the numbers.
BUG=chromium:344766
TEST=1) Ran graphics_GLBench on link.
2) Ran hardware_SsdDetection and firmware_TouchMTB on link to ensure
get_board() still works for them.
Change-Id: I3cb908a35d911a3f9ca6ef194aa5a3d1ac3e2152
Reviewed-on: https://chromium-review.googlesource.com/190290
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 4cae20cd48fdfdf0f32269081960c5e8b95c8142 |
|
26-Mar-2014 |
Ilja Friedel <ihf@chromium.org> |
Add logging to graphics_GLMark2.
Also silence a few of the pylint problems.
TEST=None.
BUG=chromium:356344
Change-Id: I6a1294da3014b1fac1fb081f680138fb651f15fb
Reviewed-on: https://chromium-review.googlesource.com/191725
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Stéphane Marchesin <marcheu@chromium.org>
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 42052a2eab846f5c2f22cdc2d231d74d99550f45 |
|
06-Mar-2014 |
Ilja H. Friedel <ihf@chromium.org> |
Wait for idle machine before running perf tests.
Most of the code moved into site_utils.py is from pyauto which is going
away. Also instrument two graphics tests with it. Finally massage some
GLBench units to get away from the generic and not quite right Hz.
BUG=chromium:344672, chromium:344766
TEST=Ran on link, made sure we get a "top" in the logs when not idle
after one minute.
Change-Id: I44bb2fc230544f27ec31e064e6c279ecd674cbf2
Reviewed-on: https://chromium-review.googlesource.com/189017
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Mike Frysinger <vapier@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 256dca92938a42e9c18b85bf7f373a05946e1384 |
|
27-Jan-2014 |
Daniel Kurtz <djkurtz@chromium.org> |
graphics_GLMark2: Output FrameTime for all scenes
For each test, GLMark2 prints FPS and FrameTime to stdout.
A test is a scene plus its options.
Parse stdout for the test results and output the FrameTime value as a
perf_value. The "description" field of the perf value is generated from
<scene>.<options>. However, the "description" field has character
restrictions, so we massage the description using a python string
translator.
Also: Use "raw strings" for python regular expressions
Signed-off-by: Daniel Kurtz <djkurtz@chromium.org>
BUG=chromium:330529
TEST=./run_remote_tests --remote=${ip} graphics_GLMark
=> Results now include per-scene FrameTime numbers
Change-Id: I581c0a8ded3eb12a2db7d41600a65db36d7c96dd
Reviewed-on: https://chromium-review.googlesource.com/183296
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Tested-by: Daniel Kurtz <djkurtz@chromium.org>
Commit-Queue: Daniel Kurtz <djkurtz@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 67a21bd0494108680fb2c6c1410b8a1aae1f148a |
|
31-Jan-2014 |
Daniel Kurtz <djkurtz@chromium.org> |
graphics_GLMark2: add back a glmark2 dep to install test on device
Oops. It turns out the recommended practice for autotests is to have
autotest install the test binaries via autotest deps, rather than baking
them into the test image.
Since we are using the dep to install the glmark2 executable, we might as
well just call it glmark2 always, even if it is really glmark2-es2.
This simplifies the autotest a bit.
Note: By default glmark2 looks for its resources at a path hardcoded at
build time. When built from the app-benchmarks/glmark2 ebuild, this path
will be "/usr/share/glmark2/". However, autotest can't copy the resources
to this location on the test machine; the share contents are copied to
autotest/deps/glmark2/data instead. Thus, we invoke glmark2 with its
"--data-dir" option.
Signed-off-by: Daniel Kurtz <djkurtz@chromium.org>
BUG=chromium:330529
TEST=emerge-${B} --unmerge glmark2 autotest-deps-glmark2 autotest-tests
TEST=TESTS=graphics_GLMark2 emerge-autotest-tests
TEST=run_remote_tests.sh graphics_GLMark2
CQ-DEPEND=CL:184283
Change-Id: I26142c7c5e585dcc8b9a1e25fa3c6ef71d33f6a0
Reviewed-on: https://chromium-review.googlesource.com/184316
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Dominik Behr <dbehr@chromium.org>
Tested-by: Daniel Kurtz <djkurtz@chromium.org>
Commit-Queue: Doug Anderson <dianders@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| e4286aac4aa03f140f6f79120479c5624f12d2b2 |
|
28-Jan-2014 |
Daniel Kurtz <djkurtz@chromium.org> |
graphics_GLMark2: Use system glmark2 instead of building it as a dep
Instead of building our own custom glmark2 as an autotest dep, we will now
try to find and use the glmark2[-es2] that has already been installed on
the system PATH. This glmark2 should have been installed by its own
ebuild. In a separate change, we ensured this by making autotest-test
RDEPEND on app-benchmarks/glmark2.
The app-benchmarks/glmark2.ebuild should install glmark2 and/or
glmark2-es2 somewhere on the PATH (either /usr/bin or /usr/local/bin).
Instead of looking at a fixed set of paths to determine which (if any)
glmark2 is installed, we probe PATH by trying to run each program with its "--help"
option.
A separate patch will remove the client/deps/glmark2.
Signed-off-by: Daniel Kurtz <djkurtz@chromium.org>
BUG=chromium:330529
TEST=TESTS=graphics_GLMark2 emerge-${b} autotest-tests
CQ-DEPEND=CL:181105
Change-Id: Ia1c92967ee0dcc856783a641336d0d52cd37f13b
Reviewed-on: https://chromium-review.googlesource.com/181108
Reviewed-by: Daniel Kurtz <djkurtz@chromium.org>
Commit-Queue: Daniel Kurtz <djkurtz@chromium.org>
Tested-by: Daniel Kurtz <djkurtz@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 2fbf42c4171fe3dd099184dca7bd6348bcc1ad9a |
|
15-Jan-2014 |
Ilja H. Friedel <ihf@chromium.org> |
Report graphics results to chrome-perf dashboard.
The two WebGL tests still need to be converted to Telemetry, but
GLBench, GLMark2 and Piglit seem to produce valid perf_measurements
files.
BUG=None.
TEST=1) python perf_uploader_unittest.py
2) run_remote_test of all affected graphics_* tests.
3) Check perf_measurements files.
Change-Id: I74ad29cddc3c7de1e161e5d516135bd284e70274
Reviewed-on: https://chromium-review.googlesource.com/182548
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 01cdf4a10736a8ace08d129836db50694be915ff |
|
14-Dec-2013 |
Dominik Behr <dbehr@chromium.org> |
graphics_GLMark2: fix building and running for OpenGL ES
This change enables OpenGL ES backend for GLMark2 when GRAPHICS_BACKEND
is set to OPENGLES and runs glmark or glmark-es2 executable depending
on which one is available.
BUG=chrome-os-partner:24530
TEST=run graphics_GLMark2 on daisy
Change-Id: Ic285236082488fc84dc001de45e11c5e9738cadc
Signed-off-by: Dominik Behr <dbehr@chromium.org>
Reviewed-on: https://chromium-review.googlesource.com/180132
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| d0f5566d60a22e7be03fefca1ef9e9f050b3463d |
|
12-Dec-2013 |
Dominik Behr <dbehr@chromium.org> |
graphics_GLMark2: initialize services variable
As noticed by djkurtz: Need this here so you can detect any exceptions
during setup. Otherwise, on setup() exception, the test framework will
call cleanup(), which will cause a second "no attribute" exception due
to the "if self._services", wiping out the setup exception.
BUG=chromium:325422
TEST=run graphics_GLMark2 test
Signed-off-by: Dominik Behr <dbehr@chromium.org>
Change-Id: I857b3b2f25a27eac1e7a541476187f50df90e008
Reviewed-on: https://chromium-review.googlesource.com/179841
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Dominik Behr <dbehr@chromium.org>
Tested-by: Dominik Behr <dbehr@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 97e4a38896b028387a78f8b23da341ea26c0467d |
|
10-Dec-2013 |
Dominik Behr <dbehr@chromium.org> |
stop ui before starting new X server
GLMark2 autotest script starts new X server on 2nd VT. Since
now we are running first X server as xorg user instead of root
it cannot release the VT or release or acquire DRM master so
2nd server doesn't start. This change copies the behavior of GLBench
test which stops UI service and first X server before starting
another one.
BUG=chromium:325422
TEST=run graphics_GLMark2 test
Change-Id: Ia1b1124a194d6eb89ccf854acd96118768ae3d5c
Signed-off-by: Dominik Behr <dbehr@chromium.org>
Reviewed-on: https://chromium-review.googlesource.com/179470
Reviewed-by: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Commit-Queue: Ilja Friedel <ihf@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| b586c10794da53a5f03bd3030c54e9713d32dafb |
|
11-Jun-2013 |
Chris Wolfe <cwolfe@chromium.org> |
Revert "graphics_GLMark2: Determine gl/gles from USE flag"
This broke the public ARM bots, because they are lacking the egl implementation required by glmark2 in glesv2 mode.
This reverts commit df5d396d923b8497bdc5d80f098f1fe9cc3f57cd
Change-Id: I46f72f2041150d32741bd9990ba7dc65ae4f7a06
Reviewed-on: https://gerrit.chromium.org/gerrit/58195
Reviewed-by: Andrew de los Reyes <adlr@chromium.org>
Tested-by: Chris Wolfe <cwolfe@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| df5d396d923b8497bdc5d80f098f1fe9cc3f57cd |
|
30-May-2013 |
Andrew Chew <achew@nvidia.com> |
graphics_GLMark2: Determine gl/gles from USE flag
Either use --enable-gl or --enable-glesv2, depending on whether the opengles
USE flag is set or not.
BUG=none
TEST=none
Change-Id: Iad8276813e82cce9122ce1ae2f66e71020a308e9
Signed-off-by: Andrew Chew <achew@nvidia.com>
Reviewed-on: https://gerrit.chromium.org/gerrit/57069
Reviewed-by: Ricky Liang <jcliang@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 8d9d5441072fdd76e1af8f3c937c837ad5223989 |
|
27-Jun-2012 |
Jon Salz <jsalz@chromium.org> |
Remove factory tree and repoint autotests.
BUG=None
TEST=cbuildbot, manual on DUT
Change-Id: I9dd383e69fa2a1094fb0f7c4cc4f08bcbb2ccc91
Reviewed-on: https://gerrit.chromium.org/gerrit/26231
Reviewed-by: Jon Salz <jsalz@chromium.org>
Tested-by: Jon Salz <jsalz@chromium.org>
Commit-Ready: Jon Salz <jsalz@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| a065b46aa55f2ddfd6f5cb638d6feca61e7c6eac |
|
31-May-2012 |
Jon Salz <jsalz@chromium.org> |
Add EventLog for individual tests in factory_StressTest.
Also fix handling of _event_queue, which is essentially a static
variable as written but should be an instance variable.
BUG=None
TEST=Manual
Change-Id: Iae77dec372357d09dcc0c20bb48027638add0f2d
Reviewed-on: https://gerrit.chromium.org/gerrit/24166
Commit-Ready: Jon Salz <jsalz@chromium.org>
Reviewed-by: Jon Salz <jsalz@chromium.org>
Tested-by: Jon Salz <jsalz@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 1e72a250c443210b10bef4f4eec776b2328e9b33 |
|
31-May-2012 |
Jon Salz <jsalz@chromium.org> |
Reposition glmark window to avoid obscuring console.
BUG=None
TEST=Manual
Change-Id: I6635b3d0456a46f074971f595668b1fbec04dc58
Reviewed-on: https://gerrit.chromium.org/gerrit/24151
Tested-by: Jon Salz <jsalz@chromium.org>
Reviewed-by: Hung-Te Lin <hungte@chromium.org>
Commit-Ready: Jon Salz <jsalz@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 57ff4a7253e8e8d9bf0b3e8e1aa66e3ecce1545b |
|
02-May-2012 |
Ilja H. Friedel <ihf@google.com> |
autotest: fully hook up graphics_GLMark2.
It started running recently with the new scheduler (I think). Make sure it also
runs with all other graphics_* tests and the score gets plotted on the perf
dashboard.
BUG=none
TEST=Runs on my lumpy, score shows up, json validates.
Change-Id: I83c9c270f869b947ac011efdf24f19a262b7e356
Reviewed-on: https://gerrit.chromium.org/gerrit/21605
Commit-Ready: Ilja H. Friedel <ihf@chromium.org>
Reviewed-by: Ilja H. Friedel <ihf@chromium.org>
Tested-by: Ilja H. Friedel <ihf@chromium.org>
Reviewed-by: Chinyue Chen <chinyue@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|
| 372fd8ae01e724dbfc0812bbecf6e1e3516d2c7d |
|
05-Apr-2012 |
Chinyue Chen <chinyue@chromium.org> |
A new autotest to run glmark2 on target machine.
This test could be used as both functional and performance test.
BUG=chrome-os-partner:8585
TEST=./run_remote_tests.sh --board=lumpy --remote=${REMOTE_IP}
--use_emerged graphics_GLMark2
Change-Id: I15bcb36c9e7ddc2a6568fd5e43d118e389d2e9a1
Reviewed-on: https://gerrit.chromium.org/gerrit/19719
Reviewed-by: Mike Frysinger <vapier@chromium.org>
Reviewed-by: Jon Salz <jsalz@chromium.org>
Commit-Ready: Chinyue Chen <chinyue@chromium.org>
Tested-by: Chinyue Chen <chinyue@chromium.org>
/external/autotest/client/site_tests/graphics_GLMark2/graphics_GLMark2.py
|