History log of /external/autotest/utils/external_packages.py
Revision Date Author Comments (<<< Hide modified files) (Show modified files >>>)
a2642062fab57988a8bc6e17b0f905c9300199d4 28-Jan-2016 Shuqian Zhao <shuqianz@chromium.org> [autotest] Update the paramiko download link

Paramiko is an external package need to be downloaded. Previous download
link is obsolete. Update the download link.

BUG=None
TEST=Test on test instance.

Change-Id: I6875ee48309a303b4e0af998b86e6b01b89022c9
Reviewed-on: https://chromium-review.googlesource.com/324145
Commit-Ready: Shuqian Zhao <shuqianz@chromium.org>
Tested-by: Shuqian Zhao <shuqianz@chromium.org>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/utils/external_packages.py
190ce46df13edce95c6bf2c91cd42d8f6cd92ed1 16-Dec-2015 Christopher Wiley <wiley@google.com> Remove autotest dependency on netifaces

This dependency cannot be installed without root on developer machines
and may be easily replaced with code we already have in autotest.

BUG=b:25929635
TEST=test_droid no longer fails trying to import this file

Change-Id: I2c5d76bc48d5bd10d6103fefaa5b629d74279fe6
Reviewed-on: https://chromium-review.googlesource.com/318831
Commit-Ready: Christopher Wiley <wiley@chromium.org>
Tested-by: Christopher Wiley <wiley@chromium.org>
Reviewed-by: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
f7a46379fa23972af7355d76ab7835fccaea037c 16-Dec-2015 Christopher Wiley <wiley@google.com> Don't run sudo commands on module import

Change the PIL installation logic to only run commands that require
root in situations where we're actuallying trying to install PIL.

BUG=None
TEST=from autotest_lib.utils import external_packages no longer
tries to mutate my machine's file system.
TEST=`./utils/build_externals.py imaginglibrary` still prompts for sudo

Change-Id: If80b12b1522d7e75e0a66817773099d22c3cb0bd
Reviewed-on: https://chromium-review.googlesource.com/318830
Commit-Ready: Christopher Wiley <wiley@chromium.org>
Tested-by: Christopher Wiley <wiley@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/utils/external_packages.py
cae83c7f545ba16316c819ce238cf6a00db4a4c5 23-Jul-2015 Dan Shi <dshi@chromium.org> [autotest] Update elasticsearch python module and add request_timeout in query

Without the request_timeout, it's quite often metadb query failed with error:
ReadTimeoutError("HTTPConnectionPool(host='xxx', port=9800):
Read timed out. (read timeout=3)

This can be avoid by increasing the request_timeout. The parameter is only
supported in newer elasticsearch module, thus it needs to be updated.

BUG=None
TEST=local run command
./site_utils/host_history.py --board lumpy --pool bvt -l 1
DEPLOY=build_externals

Change-Id: Ic4bdf7e26d7055fa38163994428ba8e45ce02581
Reviewed-on: https://chromium-review.googlesource.com/287670
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Fang Deng <fdeng@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
c0594a62af352664fda0cccdddf461b790d06506 15-Jul-2015 Fang Deng <fdeng@chromium.org> [autotest] upgrade statsd to 1.7.2

statsd 1.5 is not compatible with the latest version of setuptools,
which fails build_externals. Test 1.7.2 and upgrade it.

TEST=Manually send stats;Run scheduler which sends stats.
BUG=chromium:510235

Change-Id: I5967b478ebbe09a5fba49c2cafa71e1684d24c9f
Reviewed-on: https://chromium-review.googlesource.com/285644
Reviewed-by: Dan Shi <dshi@chromium.org>
Tested-by: Fang Deng <fdeng@chromium.org>
Commit-Queue: Fang Deng <fdeng@chromium.org>
/external/autotest/utils/external_packages.py
16c0a50cc87997fb6dd3cd7aa4b9cef3ca6bc7dd 15-Jul-2015 Dan Shi <dshi@chromium.org> [autotest] Upgrade setuptools and make errors more visible

setuptools is too old, upgrade it to latest.
Allow _build_and_install to return a tuple of success, error_message.
Then build_externals can print the error at the end as well.

BUG=chromium:510143
TEST=local test

Change-Id: Ia750fd333e6d0d9d137a68b49fafc441094f07bc
Reviewed-on: https://chromium-review.googlesource.com/285646
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Fang Deng <fdeng@chromium.org>
Commit-Queue: Fang Deng <fdeng@chromium.org>
/external/autotest/utils/external_packages.py
7b6297bde3b902b1d610427a22b315fc7aa771de 23-Jun-2015 Dan Shi <dshi@chromium.org> [autotest] Force to install package if it's not installed in autotest site-packages

This is needed for tests running in container to get the site-packages.

BUG=chromium:502546
TEST=local
delete site-packages\numpy
sudo apt-get install python-numpy
run utils/build_externals.py
confirm numpy is installed in site-packages.

Change-Id: I207164040b53db72b3926423652da8627b133273
Reviewed-on: https://chromium-review.googlesource.com/281207
Trybot-Ready: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
6f7606baaa45d1923324c9f5bb9abdc7ae9dc9c7 12-Jun-2015 J. Richard Barnette <jrbarnette@chromium.org> [autotest] Fix an error in an error report in build_externals.

For a certain error case in build_externals, the error report code
tried to create a string by saying <list>.join(<string>). The
resulting exception meant that the original error failed to be
reported.

This fixes the call to the correct <string>.join(<list>)

BUG=None
TEST=None

Change-Id: I75e9badd72c9b41a6008b1886a7afcfbfaddba18
Reviewed-on: https://chromium-review.googlesource.com/277087
Commit-Queue: Richard Barnette <jrbarnette@chromium.org>
Tested-by: Richard Barnette <jrbarnette@chromium.org>
Reviewed-by: Matthew Sartori <msartori@chromium.org>
/external/autotest/utils/external_packages.py
5f6b233a9406b4b6b78c6b47c1e6fefa123ccd5e 11-Apr-2015 Prathmesh Prabhu <pprabhu@chromium.org> [autotest] Make push-to-prod sync more aggressive.

Before this CL, the push-to-prod git repo sync through build_externals
would try to 'pull' the relevant repos. This would fail to pull new
branches from the remote repo.

This CL re-works the sync code to make it more aggressive. It now goes
through the more reliable fetch-and-reset path.

While there: fix unittest for unset git_repo_url. There was duplicated
code that was obviously not testing the 'fetch' path at least.

BUG=chromium:476124
TEST=(1) Synced a new remote branch to an existing repo that used to
fail before this CL.
(2) (updated) unittests.

Change-Id: I6d5337532aed62afd270762f21d9f496a823f2d5
Reviewed-on: https://chromium-review.googlesource.com/265351
Reviewed-by: Prathmesh Prabhu <pprabhu@chromium.org>
Commit-Queue: Prathmesh Prabhu <pprabhu@chromium.org>
Tested-by: Prathmesh Prabhu <pprabhu@chromium.org>
/external/autotest/utils/external_packages.py
a637db43709296bdc4961c966f6d1ba6b5aba45b 07-Apr-2015 Prathmesh Prabhu <pprabhu@chromium.org> [autotest] pin chromiumos projects to 'prod'.

We use several chromiumous projects along with autotest in the lab. Like
the autotest repo, we now pin these other repos also to a 'prod' branch.

BUG=chromium:463275
TEST=Run build_externals on a ganeti instance, ensure that that all the
git repos pulled are at the expected git-sha#

Change-Id: I112b6581b62acd7714f49bb01efd12a9c912f6f6
Reviewed-on: https://chromium-review.googlesource.com/264155
Reviewed-by: Prathmesh Prabhu <pprabhu@chromium.org>
Commit-Queue: Prathmesh Prabhu <pprabhu@chromium.org>
Tested-by: Prathmesh Prabhu <pprabhu@chromium.org>
/external/autotest/utils/external_packages.py
71884ff6fe449856c25a4bbc8d8cc38a9ff0ed2b 02-Apr-2015 Roshan Pius <rpius@chromium.org> Revert "autotest: Add pyshark for wifi packet capture analysis in lab machines."

This reverts commit 3448e558360d0d29c3703bc38c08e2f54ff76cc8.

BUG=chromium:470708
TEST=`python utils/build_externals.py`
DEPLOY=build_externals

Change-Id: Ie417254aa0432214bc4543a8735b89a208281b2f
Reviewed-on: https://chromium-review.googlesource.com/263723
Tested-by: Roshan Pius <rpius@chromium.org>
Reviewed-by: Dan Shi <dshi@chromium.org>
Commit-Queue: Roshan Pius <rpius@chromium.org>
/external/autotest/utils/external_packages.py
3448e558360d0d29c3703bc38c08e2f54ff76cc8 30-Mar-2015 Roshan Pius <rpius@chromium.org> autotest: Add pyshark for wifi packet capture analysis in lab machines.

Adding pyshark and it's dependencies for packet capture analysis done
in Wifi tests in Lab machines.

BUG=chromium:470708
TEST=`python utils/build_externals.py`
DEPLOY=build_externals

Change-Id: Id4800ce6f3f57f0840273cde0d9fa86c12a1dd96
Reviewed-on: https://chromium-review.googlesource.com/263121
Reviewed-by: Roshan Pius <rpius@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
Commit-Queue: Roshan Pius <rpius@chromium.org>
Tested-by: Roshan Pius <rpius@chromium.org>
/external/autotest/utils/external_packages.py
44e47b8940ac951b12814bc735c132f492ea0798 20-Mar-2015 Dan Shi <dshi@chromium.org> [autotest] Add netifaces package to external packages

It's needed for lxc to get the IP address used by lxcbr0.

BUG=chromium:453624
TEST=./utils/test_importer.py
confirm netifaces package is installed in site-packages

Change-Id: Ic0c852b2be1e82448746cb6de0ded9c1f6f7c47e
Reviewed-on: https://chromium-review.googlesource.com/261380
Trybot-Ready: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
2d9a28ce3d894b9cc50b0c41dce0aaca119f575e 14-Mar-2015 Dan Shi <dshi@chromium.org> [autotest] Add a symlink before building PIL package

A new test requires PIL.Image.core.zip_decoder, which is provided by zlib.
The path of zlib library might be different from what PIL setup.py is
expected. This change does the best attempt to link the library
to a path PIL setup.py will try.

BUG=chromium:466826
TEST=run following python script, confirm Image.core.zip_decoder does not exist
before this change. After this change applied, run build_externals, then run
the python script again, confirm Image.core.zip_decoder exists.
import common
from PIL import Image
Image.core.zip_decoder

DEPOLOY=build_externals

Change-Id: I5856d9817cc4c9ee2bc69a740d56311d585edba5
Reviewed-on: https://chromium-review.googlesource.com/260130
Trybot-Ready: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Wai-Hong Tam <waihong@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
a742761176ae9df932caa20f9ae6fae26ab3ea28 15-Nov-2014 Michael Janssen <jamuraa@chromium.org> [autotest] Fixes for install on trusty

- Apache default site is now named 000-default, try both
- a2enmod version fails on trusty because it's builtin
- libfreetype6-dev puts ft2build.h in a different place.

BUG=None
TEST=run on trusty vm, run on precise vm, goobuntu trusty, open
localhost to confirm AFE is up

Change-Id: I6ea818c873c4dabbafa6c6e2930d5186dfe25df6
Reviewed-on: https://chromium-review.googlesource.com/229940
Tested-by: Michael Janssen <jamuraa@chromium.org>
Reviewed-by: Dan Shi <dshi@chromium.org>
Commit-Queue: Michael Janssen <jamuraa@chromium.org>
/external/autotest/utils/external_packages.py
5934b7121277a4283119676773f89c0f989b5f06 13-Aug-2014 Michael Liang <michaelliang@chromium.org> [autotest] Add Urllib3 package to external_packages.py

Some autotest servers don't have urllib3 installed.

BUG=None
TEST=pip uninstall urllib3; ./build_externals;
inside python: import common, import urllib3,
verified import succeeded.
DEPLOY=build_externals

Change-Id: I3c6c4280d06128b789e3a94c5c827c2630383e2a
Reviewed-on: https://chromium-review.googlesource.com/212139
Reviewed-by: Dan Shi <dshi@chromium.org>
Commit-Queue: Michael Liang <michaelliang@chromium.org>
Tested-by: Michael Liang <michaelliang@chromium.org>
/external/autotest/utils/external_packages.py
428b34464f1060129cbcda08d60ec44ed88a518d 22-Jul-2014 J. Richard Barnette <jrbarnette@chromium.org> Add the Python Imaging Library as an external dependency.

A recent change to support chameleon added a dependency on the
Python Imaging Library. That library isn't guaranteed available on
all hosts that might run Autotest. In particular, the library isn't
guaranteed to be present on the Autotest lab drone systems, which is
where it's most required.

This change adds the library using the Autotest external dependency
mechanism, and changes affected 'import' statements to account
for a location change.

BUG=None
TEST=manually test the import statements, plus pylint

Change-Id: I745a7d6050dfbf081447656213b2f9ed270d0a43
Reviewed-on: https://chromium-review.googlesource.com/209353
Tested-by: Richard Barnette <jrbarnette@chromium.org>
Reviewed-by: Wai-Hong Tam <waihong@chromium.org>
Commit-Queue: Richard Barnette <jrbarnette@chromium.org>
/external/autotest/utils/external_packages.py
d2d294c83fe8355d432f84771a651b1c99029bcf 25-Jun-2014 Michael Liang <michaelliang@chromium.org> [autotest] Add capability to log metadata stats module to esdb

Adds functionality to stats objects to take in optional metadata that
is reported to elasticsearch. This change also includes a functional
test script that verifies stats objects correctly report metadata
to elasticsearch. This involves adding an external package for
wrapping a connection to es. Also added mock for elasticsearch
which resulted in refactor of statsd_mock.

TEST=python stats_es_functionaltest.py --all --es_port=prod
for both http and udp (by changing shadow config)
TEST=python elasticsearch_mock_unittest.py
TEST=python statsd_mock_unittest.py
BUG=None

Change-Id: I5971e39623e465a42a46dafc61fb26a1fb129391
Reviewed-on: https://chromium-review.googlesource.com/205776
Tested-by: Michael Liang <michaelliang@chromium.org>
Reviewed-by: Dan Shi <dshi@chromium.org>
Commit-Queue: Michael Liang <michaelliang@chromium.org>
/external/autotest/utils/external_packages.py
a87e54878e81b762e4eeea7bcf9ce2e925685b17 10-Jun-2014 Alex Miller <milleral@chromium.org> [autotest] Add psutil package.

BUG=chromium:375348
DEPLOY=build_externals
TEST=built externals

Change-Id: I043c14cec98f822e9a0072f8a44ec3144ffd0479
Reviewed-on: https://chromium-review.googlesource.com/203172
Tested-by: Alex Miller <milleral@chromium.org>
Reviewed-by: Prashanth B <beeps@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
bb1a9675c0abbf1e260a310257f59ad0711f3589 03-Mar-2014 Scott James Remnant <keybuk@chromium.org> [autotest] Add btsocket to external packages

This is downloaded from git and built using setup.py

BUG=chromium:348704
TEST=./utils/build_externals.py; python -c 'import common,btsocket'
CQ-DEPEND=CL:188561
DEPLOY=build_externals

Change-Id: Ice00e49e5b64b90bc85e33b1b9d06b6de4d7925e
Reviewed-on: https://chromium-review.googlesource.com/188552
Reviewed-by: Scott James Remnant <keybuk@chromium.org>
Tested-by: Scott James Remnant <keybuk@chromium.org>
Commit-Queue: Scott James Remnant <keybuk@chromium.org>
/external/autotest/utils/external_packages.py
5ac9da35f551b88a4bcb121dc73c66cc2022e3c7 12-Feb-2014 Tom Wai-Hong Tam <waihong@chromium.org> Remove the internal chameleon repo from external packages

We abstracted the interfaces using Chameleond. So the display tests
no longer depends on the library in the chameleon repo. So remove it
from the external packages.

BUG=chromium:336726
TEST=None, trivial removal.

Change-Id: Ic10d230be03797a2f517344287635cb606827f36
Reviewed-on: https://chromium-review.googlesource.com/185829
Reviewed-by: Ricky Liang <jcliang@chromium.org>
Commit-Queue: Wai-Hong Tam <waihong@chromium.org>
Tested-by: Wai-Hong Tam <waihong@chromium.org>
/external/autotest/utils/external_packages.py
d6b8377f09d721933f6e1a0aae28fb2e7ff5eeff 07-Jan-2014 Simran Basi <sbasi@chromium.org> [autotest] Add faulthandler to autoserv

This change adds the faulthandler package as a new external_package.
It then imports it to autoserv and then registers SIGTERM. This will
dump the thread's current traceback on SIGTERM then execute the
previous signal handler.

BUG=chromium:302815
DEPLOY=build_externals
TEST=Executed build_externals and ensured faulthandler was downloaded
and installed and that re-executing build_externals did not reinstall
it. Then ran sleeptest with a 1 minute timeout and ensured the
faulthandler output showed up in autoserv.DEBUG when the scheduler
aborted it.

Change-Id: Id59f897bb766a821ef463c8166531db480c68041
Reviewed-on: https://chromium-review.googlesource.com/181688
Reviewed-by: Alex Miller <milleral@chromium.org>
Commit-Queue: Simran Basi <sbasi@chromium.org>
Tested-by: Simran Basi <sbasi@chromium.org>
/external/autotest/utils/external_packages.py
fdb51c5dc90492b1e8aaaa432e05abfc6fb3c897 04-Sep-2013 Ricky Liang <jcliang@chromium.org> Add XML RPC server for display testing.

Also add video-chameleon repo into external_packages dependencies since
it is needed by the test.

BUG=None
CQ-DEPEND=CL:*148316
DEPLOY=build_externals
TEST=Manually on my DUTs

Change-Id: I5f97d47a5142d63754cc7fbc5f6ed35b34cb4821
Reviewed-on: https://chromium-review.googlesource.com/177561
Reviewed-by: Dean Liao <deanliao@chromium.org>
Tested-by: Ricky Liang <jcliang@chromium.org>
Commit-Queue: Ricky Liang <jcliang@chromium.org>
/external/autotest/utils/external_packages.py
2371d1a548bbf53654db008708a04b34787eb413 22-Nov-2013 Jason Abele <jabele@chromium.org> autotest: add selenium to external_packages

In order to run the wifi_interop suite, the drones need to have selenium
installed.

BUG=chromium:321806
DEPLOY=build_externals
TEST=./utils/build_externals.py
python -c "import common; import selenium; print selenium.__version__"

Change-Id: I766327352d0c20818a082f07f42cbeced6a4daba
Reviewed-on: https://chromium-review.googlesource.com/177795
Tested-by: Jason Abele <jabele@chromium.org>
Reviewed-by: Prashanth B <beeps@chromium.org>
Commit-Queue: Jason Abele <jabele@chromium.org>
/external/autotest/utils/external_packages.py
9fbe67f32e5b68170cd0a5726b95b96b7f73add6 07-Sep-2013 Alex Miller <milleral@chromium.org> [autotest] Move site-utils packages to GoB.

CQ-DEPEND=I7cb235f16723b7720bdfc4c7019d2d59f34892c7
BUG=chromium:286471
DEPLOY=build_externals
TEST=ran build_externals

Change-Id: I870bf1106c0a9e2f8caacac2a5631271ff4ed3ac
Reviewed-on: https://chromium-review.googlesource.com/168466
Tested-by: Alex Miller <milleral@chromium.org>
Reviewed-by: Chris Sosa <sosa@chromium.org>
Tested-by: Chris Sosa <sosa@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
32a630851fbb67e8297739fff71165f5acc78751 22-Aug-2013 beeps <beeps@chromium.org> [autotest] Teach site host about jsonrpc.

Refactor code to create an ssh tunnel. Mirror the
xmlrpc implementation in site_host for jsonrpc.
Also add jsonrpc to site-packages.

TEST=Creates a jsonrpc connection and issued rpcs, locked
a DUT and ran basic wifi tests.
BUG=chromium:272445
DEPLOY=build_externals

Change-Id: I77c95b4a91896b2807f901f7050e28e1836b7b0e
Reviewed-on: https://chromium-review.googlesource.com/66848
Reviewed-by: Alexander Miller <milleral@chromium.org>
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
Reviewed-by: Richard Barnette <jrbarnette@chromium.org>
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
4f34170dbb70080a56de88dc13859b3a7ffffb0a 25-Mar-2013 Alex Miller <milleral@chromium.org> [autotest] Use |json| instead of |simplejson|.

simplejson was moved into the library as of python 2.4. We're now at
python 2.6/2.7, and having to keep installing simplejson everywhere has
slowly turned into a hassle. Since we can just trivially drop/rename
it, let's do so.

The rpc_interface parts of this change have been vetted, the rest is
done just as a s/simplejson/json/ across the code, which afaik should be
a safe thing to do.

BUG=None
TEST=unit, run_suite
DEPLOY=apache

Change-Id: Iab35f71157e7e5cd3be5291c776b07eb3283be8e
Reviewed-on: https://gerrit.chromium.org/gerrit/46424
Tested-by: Aviv Keshet <akeshet@chromium.org>
Reviewed-by: Alex Miller <milleral@chromium.org>
Commit-Queue: Aviv Keshet <akeshet@chromium.org>
/external/autotest/utils/external_packages.py
47d61281a7b23a5e6d8c5835659b502f56108d07 17-Apr-2013 Alex Miller <milleral@chromium.org> [autotest] Bump django to 1.5.

This includes a mysql-python version bump to get rid of a warning
message, and a few fixes throughout the codebase to get things working
again under django 1.5.

TEST=AFE works, RPCs work, run_suite works, scheduler works
BUG=chromium:232388
DEPLOY=apache,scheduler

Change-Id: Ie0d7f5fd1203a25bdedb78d31778d8373aaf6ff5
Reviewed-on: https://gerrit.chromium.org/gerrit/48402
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Brian Harring <ferringb@chromium.org>
Tested-by: Alex Miller <milleral@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
d5335858ea37a3f48fc7f619e86f307cf5b55acb 09-Apr-2013 beeps <beeps@chromium.org> [Autotest] Installs the GFlags package through build_externals.

GFlags is needed by certain modules in apiclient, which is used in
automatic bug filing.

BUG=chromium:229296
TEST=Uninstalled gflags and checked that apiclient is unable to import
HttpError, then ran build_externals and checked that it can.
DEPLOY=build_externals on cautotest, drones.

Change-Id: I42a1f06a48d123a2b9d430499fabf37031dcded3
Reviewed-on: https://gerrit.chromium.org/gerrit/47652
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
e0db09dad16a5293add841966186a66d0f8b1fe9 25-Feb-2013 beeps <beeps@chromium.org> [autotest] Adds areas labels to the bug filer.

1. Adds the apiclient library to external packages.

2. Query the issues tracker project to get a list of
predefined 'Area-' labels and convert all that match
the failing test into labels for the new bug. Querying
is done through the new project hosting v2 api and we use
bugdroid1's api key for authentication.

TEST=Checked that the appropriate labels are appended to failing tests.
Repeated this with the python apiclient package uninstalled.
BUG=None

Change-Id: Iff809fe4370b0497898efc40b76d4cee7028145b
Reviewed-on: https://gerrit.chromium.org/gerrit/47304
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
aae3f1c191a28e1ed4bde92fc50e15b260246b23 19-Mar-2013 beeps <beeps@chromium.org> [Autotest] Git pull instead of fetch/reset when building externals.

Build externals will now perform a git pull -r when a repo
is already present. Previously we attempted to fetch --all and
reset --hard HEAD, for this to achieve what was intended
we need to figure out the name of the upstream branch the
current branch is tracking. This change makes it so
we just fail to build externals when there's a local rebase
conflict (which there shouldn't be in site-packages anyway).

BUG=chromium:222144
TEST=Ran build externals with and without site-packages and imported
git dependent modules. Ran the revision_control unittests.

Change-Id: I1d41f9eea44a86386a28392c315c8802368ccb2f
Reviewed-on: https://gerrit.chromium.org/gerrit/45912
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
ee10e936b495e2f4bb3de2b5a5641854a565623d 19-Mar-2013 Alex Miller <milleral@chromium.org> [autotest] Use fixes in upstream statsd.

All of the DNS hacks got pushed to upstream with a proper
implementation, so they can be dropped locally if we use the
just-released upstream version.

BUG=None
TEST=Ran scheduler with stat locally

Change-Id: I4d355c778b998b4610841b7c8710c94c30d54a5a
Reviewed-on: https://gerrit.chromium.org/gerrit/45815
Tested-by: Alex Miller <milleral@chromium.org>
Reviewed-by: Aviv Keshet <akeshet@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
c2c9a01905a157e2ce47d26b07db6c8f576cf3c1 06-Mar-2013 Scott Zawalski <scottz@google.com> Update numpy from 1.2.1 to 1.7.0.

Update numpy in external_packages so that we can properly compile
on precise variants. http://projects.scipy.org/numpy/ticket/1355

TEST=built numpy on both precise and lucid variants via build_external.
BUG=chromium-os:37600

Change-Id: Ia9b146fbf39bfa76447b8cd4fc6172d81dae6058
Reviewed-on: https://gerrit.chromium.org/gerrit/44726
Tested-by: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Commit-Queue: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
/external/autotest/utils/external_packages.py
1bf41c4ff52e8a3ea1a99fa7331a1c77349c9f22 27-Feb-2013 Chris Sosa <sosa@chromium.org> Switch over test_image to use devserver gsutil_util api.

This CL switches full_release_test from using gs ls naively as
gs ls has a race condition with gs cp i.e. if I gs cp a file
into GS, it's not guaranteed to be there in a following call to
gs ls (even though you can download/cat it with gs cat or gs cp).
We've already worked around this problem in the devserver (specially
in gsutil_util). This change modifies our call to gs ls to use the
devserver gsutil_util instead.

I've also had some leftover cleanup from previous CL's on this
topic that are in full_release_tests. Minor nits.

BUG=chromium-os:37575
TEST=Ran it with / without archive_url.

Change-Id: I03d533bc40742c534884de5234cddebde1e528a2
Reviewed-on: https://gerrit.chromium.org/gerrit/44208
Tested-by: Chris Sosa <sosa@chromium.org>
Reviewed-by: Gilad Arnold <garnold@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Commit-Queue: Chris Sosa <sosa@chromium.org>
/external/autotest/utils/external_packages.py
0e1217c84d579ce36ce084a442b6bdec0630e5a3 22-Feb-2013 Alex Miller <milleral@chromium.org> [autotest] Detect modules and versions of site-packages properly.

gvizapi was looking for the wrong module.
gdata and hdctools do not have versions as part of the package.

BUG=chromium-os:38901
TEST=./utils/build_externals.py

Change-Id: I251976364883c3f414ebf46242b3d48bdf1ad8b9
Reviewed-on: https://gerrit.chromium.org/gerrit/43792
Commit-Queue: Alex Miller <milleral@chromium.org>
Reviewed-by: Alex Miller <milleral@chromium.org>
Tested-by: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
57631dc37a9f25cda25af804c1bf50ef55b1c22f 22-Feb-2013 Dan Shi <dshi@chromium.org> [autotest] Add comma back in urls, minor fix in docstring

Add comma back in assignment statement to urls to make it a list.
Minor typo fix in suite_scheduler docstring.

BUG=None
TEST=run_sutie against lumpy with smoke suite, and run suite_scheduler
agaist a test suite.

Change-Id: I04696407cb44848de14160fc00c7ce7583210b31
Reviewed-on: https://gerrit.chromium.org/gerrit/43796
Commit-Queue: Dan Shi <dshi@chromium.org>
Reviewed-by: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
e7b6e8bd6ffa474166aaaa36976ee8a54c71bc3e 14-Feb-2013 Alex Miller <milleral@chromium.org> [autotest] Add packages required by unittests.

pyudev is needed by client/cros/rf/config_unittest.py
dnspython is needed by server/cros/recall_test.py

BUG=chromium-os:37989
TEST=./build_externals.py ran successfully

Change-Id: I84e70ec3ea9afe1d005afc962aaf244197363b4c
Reviewed-on: https://gerrit.chromium.org/gerrit/43246
Tested-by: Alex Miller <milleral@chromium.org>
Reviewed-by: Aviv Keshet <akeshet@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
93bef48a4825a0355717978dce845d1c74c08e56 05-Feb-2013 beeps <beeps@chromium.org> [autotest] Added gdata to site-packages.

Needed so we can file bugs automatically when bugs fail.

TEST= imported gdata, verified that we file bugs on test failure.
BUG=chromium-os:38553

Change-Id: I229fb673d12820dfcf8ed5505be00f71fb3de4a3
Reviewed-on: https://gerrit.chromium.org/gerrit/42587
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
2a6acf8502bc1e0cd5fa1b8ab60329c0ccf7dd76 11-Feb-2013 Scott Zawalski <scottz@google.com> Add statsd 1.5.7 to our site-packages install process.

TEST=utils/build_externals.py
BUG=None

Change-Id: I1841feb6c4c821f9050348ce8d4f7749e99d3978
Reviewed-on: https://gerrit.chromium.org/gerrit/43054
Tested-by: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Commit-Queue: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
/external/autotest/utils/external_packages.py
d9153b52ba5a50c16dce111a9e03d6241c969d11 24-Jan-2013 beeps <beeps@chromium.org> [autotest] Allows us to pull repos as part of build_externals.

Pulls/clones chromite and hdctools/servo into site-packages. Also add
helper methods to revision_control.py and a -work-tree option, along
with a unittest.

TEST=built externals and imported servo/chromite.
BUG=chromium-os:38096

Change-Id: I1bae6e3f730495030665267876c8594800aa27d4
Reviewed-on: https://gerrit.chromium.org/gerrit/41910
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
bafbbb0ff97fa5a5e07a47003d1ea57566f2186d 16-May-2012 Chris Masone <cmasone@chromium.org> [autotest] Re-land "Add logic to symbolicate dumps using dev server, stage symbols on-demand"

re-run /usr/local/autotest/utils/build_externals.py before trying to use this
outside the chroot.

When trying to symbolicate a crash dump using the dev server, we first
have to stage debug symbols on-demand. We can't stage them up front,
sadly. So, block and stage them on-demand, doing so iff we actually get
crashes during a test.

This reverts commit 77e95f2dd7a025966aa2cdf19cfb5f0bfcf2608f.

BUG=chromium-os:29730,chromium-os:30400
TEST=run_remote_tests a test that generates a crash dump; symbolication should
TEST=occur locally.
TEST=set up a dev server that does not have symbols staged, and run a test
TEST=that generates a crash dump. The symbols should get staged and the dump
TEST=symbolicated. Now run another. The symbols should be re-used.
STATUS=Fixed

Change-Id: I85c9f16ec054210ebacf22c4713d9ba65927551b
Reviewed-on: https://gerrit.chromium.org/gerrit/22866
Tested-by: Chris Masone <cmasone@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Commit-Ready: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
77e95f2dd7a025966aa2cdf19cfb5f0bfcf2608f 16-May-2012 Chris Masone <cmasone@chromium.org> Revert "[autotest] Add logic to symbolicate dumps using dev server, staging symbols on-demand"

An important change that this depends on got reverted because it broke a test that is of marginal utility, so this will start breaking stuff again if we leave it in.

This reverts commit d1294ffd263104fd0b7473c38c646fc9d26b8ea9

Change-Id: Ibcc1193db2e1a5907ddaf11fd6ab1b803dbdf303
Reviewed-on: https://gerrit.chromium.org/gerrit/22766
Commit-Ready: Chris Masone <cmasone@chromium.org>
Reviewed-by: Chris Masone <cmasone@chromium.org>
Tested-by: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
06e087cf2830e677cde88e32e4f42d0bc0547e68 08-May-2012 Chris Masone <cmasone@chromium.org> [autotest] Add logic to symbolicate dumps using dev server, staging symbols on-demand

re-run /usr/local/autotest/utils/build_externals.py before trying to use this
outside the chroot.

When trying to symbolicate a crash dump using the dev server, we first
have to stage debug symbols on-demand. We can't stage them up front,
sadly. So, block and stage them on-demand, doing so iff we actually get
crashes during a test.

BUG=chromium-os:29730,chromium-os:30400
TEST=run_remote_tests a test that generates a crash dump; symbolication should
TEST=occur locally.
TEST=set up a dev server that does not have symbols staged, and run a test
TEST=that generates a crash dump. The symbols should get staged and the dump
TEST=symbolicated. Now run another. The symbols should be re-used.

This reverts commit 01310f99e1aa2862af087583a0815c3271fc10c1.
This reverts commit 52c7fb7c3b8c6fcc81b62a391d3cd8b9443b25d1.

Change-Id: I5385d5213f21bc03c9301d4f9f88ed06d30d8e1f
Reviewed-on: https://gerrit.chromium.org/gerrit/22501
Commit-Ready: Chris Masone <cmasone@chromium.org>
Reviewed-by: Chris Masone <cmasone@chromium.org>
Tested-by: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
01310f99e1aa2862af087583a0815c3271fc10c1 08-May-2012 Scott Zawalski <scottz@chromium.org> Revert "[autotest] Re-land "Add logic to symbolicate dumps using dev server""

Cherrypy is hanging when we send multiple POSTs using request to it in a short
amount of time

BUG=30650

This reverts commit 043bf47e7946366517757cdb981de99eb81adcb6

Change-Id: I6f91b730289d14502eeffcf672ccb36494d5f847
Reviewed-on: https://gerrit.chromium.org/gerrit/22115
Commit-Ready: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Tested-by: Scott Zawalski <scottz@chromium.org>
/external/autotest/utils/external_packages.py
4245a73ec638b602bd4546637b41c74f39158e14 30-Apr-2012 Chris Masone <cmasone@chromium.org> [autotest] Re-land "Add logic to symbolicate dumps using dev server"

re-run /usr/local/autotest/utils/build_externals.py before trying to use this
outside the chroot.

BUG=chromium-os:29730
TEST=point local autoserv at a local dev server, run a test that causes a crash; it should symbolicate the crash

This reverts commit 8972fa982c3ec369737f1e45f52a3b350c1824e7.

Change-Id: I080fb56b0d2508ccd90b4140826d7020efc81982
Reviewed-on: https://gerrit.chromium.org/gerrit/21493
Tested-by: Chris Masone <cmasone@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Commit-Ready: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
8972fa982c3ec369737f1e45f52a3b350c1824e7 30-Apr-2012 Chris Masone <cmasone@chromium.org> Revert "[autotest] Add logic to symbolicate dumps using dev server"

Somehow, import logging is failing...?

This reverts commit 98bc0046b399518cb1217469b9306a4ab7a4b928

Change-Id: Iedab8e712494a730b797b0490dcabf5c6578e192
Reviewed-on: https://gerrit.chromium.org/gerrit/21478
Commit-Ready: Chris Masone <cmasone@chromium.org>
Reviewed-by: Chris Masone <cmasone@chromium.org>
Tested-by: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
d6a4718a15d37306f31a65ad8d6b9023b4a69b42 25-Apr-2012 Chris Masone <cmasone@chromium.org> [autotest] Add logic to symbolicate dumps using dev server

re-run /usr/local/autotest/utils/build_externals.py before trying to use this
outside the chroot.

BUG=chromium-os:29730
TEST=point local autoserv at a local dev server, run a test that causes a crash; it should symbolicate the crash into a .txt named after the minidump file.

CQ-DEPEND=Ib9d5b0abb73567fd8450db50d3e50d27bdc169f4

Change-Id: Id0d1fd6b4f00e560dd5683d87140ed943697f185
Reviewed-on: https://gerrit.chromium.org/gerrit/21277
Commit-Ready: Chris Masone <cmasone@chromium.org>
Reviewed-by: Chris Masone <cmasone@chromium.org>
Tested-by: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
74a314b490ff542c4dd2ae4aa0d11c6394d92960 23-Jun-2011 Dale Curtis <dalecurtis@chromium.org> Upstream Autotest merge.

As titled, a merge up to 93fc426ca133e775eb495f34d138fc57d92fb55e.

- Removes a bunch of deprecated code.
- Moves several private utilities into the private repo.
- Couple changes ported upstream and resynced.

BUG=None
TEST=In progress... will spin up new Autotest server and use
run_remote_tests for bvt, regression, smoke.

Change-Id: Id3e2ad529bb7b05f148e5d98aea46bb9ea828200
Reviewed-on: http://gerrit.chromium.org/gerrit/3350
Tested-by: Dale Curtis <dalecurtis@chromium.org>
Reviewed-by: Dale Curtis <dalecurtis@chromium.org>
/external/autotest/utils/external_packages.py
ddd44b22416bb1285c8bdf25267ba346d84da3f5 15-Apr-2011 Mike Truty <truty@google.com> Integrate dynamic charts into autotest frontend.

BUG=chromium-os:14044
TEST=http://truty.i/croschart/server/x86-mario-r12/MARIO_MP/0.12.306.0/0.12.389.0/platform_BootPerfServer/seconds_kernel_to_startup/1280/1024/

Review URL: http://codereview.chromium.org/6821082

Change-Id: Ide1bac507850a45a9a34ef9459a6b148e52e3305
/external/autotest/utils/external_packages.py
861b2d54aec24228cdb3895dbc40062cb40cb2ad 04-Feb-2011 Eric Li <ericli@chromium.org> Merge remote branch 'cros/upstream' into master

Merged to upstream autotest @4749~@5215.

The entire change list description is too big to enlist here. Please refer to upstream (http://autotest.kernel.org/browser) for more details.

BUG=
TEST=emerged both x86 and arm build.
Tested emerged x86 build bvt against a chromeos device.

Review URL: http://codereview.chromium.org/6246035

Change-Id: I8455f2135c87c321c6efc232e2869dc8f675395e
/external/autotest/utils/external_packages.py
bdaab795cffa33f9a37995bb283047cb03699272 07-Jan-2011 Kenneth Waters <kwaters@chromium.org> Revert "Merge remote branch 'cros/upstream' into autotest-rebase"

This reverts commit 7edb30498d75a29a3287fe07070f2b51a116c5d4.

TEST=Built for tegra2_seaboard
BUG=10756

Review URL: http://codereview.chromium.org/6124004

Change-Id: Ifcd1a2279f5a62b99552a8f961c1430889a3a928
/external/autotest/utils/external_packages.py
7edb30498d75a29a3287fe07070f2b51a116c5d4 07-Jan-2011 Eric Li <ericli@chromium.org> Merge remote branch 'cros/upstream' into autotest-rebase

Merged to upstream trunk@5066, from trunk@4749.

There is no way I could enlist each individual CL from the upstream here since it will blow up the changelist description field.

BUG=
TEST=
Had patched this CL into a fresh cut client to avoid any side effect.
run_remote_test bvt from both emerged location and third_party/autotest/file.

Both test passed!

We should also keep any eye on this to see how it gets propagated into cautotest server.
TBR=dalecurtis

Change-Id: I72f2bc7a9de530178484aea1bfb5ace68bcad029
/external/autotest/utils/external_packages.py
6f27d4f22a1ba5063968b8c322fa0845f3279ade 29-Sep-2010 Eric Li <ericli@chromium.org> Merge remote branch 'cros/upstream' into tempbranch3

Merge to trunk@4817

BUG=
TEST=

Review URL: http://codereview.chromium.org/3554003

Change-Id: I83376bc7d28104ec2678e157eadbe7df7c05c0e0
/external/autotest/utils/external_packages.py
517d95a1ef4edb04da427763f86068a447d45ec7 29-Sep-2010 Benson Leung <bleung@chromium.org> Revert "Merge remote branch 'cros/upstream' into tempbranch2"

This reverts commit 25fc6d1f28e54c46689f12d3b93c2540ef45323a.

TBR=ericli@chromium.org

Review URL: http://codereview.chromium.org/3541002

Change-Id: Ib0165b19bfdf02264f8a6a74ddf3ae74c8c0f7df
/external/autotest/utils/external_packages.py
25fc6d1f28e54c46689f12d3b93c2540ef45323a 29-Sep-2010 Eric Li <ericli@chromium.org> Merge remote branch 'cros/upstream' into tempbranch2

Merged to trunk@4816.

BUG=
TEST=we will build a new autotest server instance, and keep cautotest running and then later do a cname switch.

Review URL: http://codereview.chromium.org/3511003

Change-Id: Iee5f52f45f28f84927d6c6f9a74edc370d40288a
/external/autotest/utils/external_packages.py
992056e92cd076bec68bd4e07a0025acf5627bfb 30-Apr-2010 jamesren <jamesren@592f7852-d20e-0410-864c-8624ca9c26a4> Fix handling of GWT Incubator external package in build_externals

Signed-off-by: James Ren <jamesren@google.com>



git-svn-id: http://test.kernel.org/svn/autotest/trunk@4453 592f7852-d20e-0410-864c-8624ca9c26a4
/external/autotest/utils/external_packages.py
012d0325b33deeb81f06fa11f5498d2bc8146f57 30-Apr-2010 jamesren <jamesren@592f7852-d20e-0410-864c-8624ca9c26a4> Move to GWT 2.0.3. Drop in new gwt-incubator to match.

Signed-off-by: James Ren <jamesren@google.com>



git-svn-id: http://test.kernel.org/svn/autotest/trunk@4452 592f7852-d20e-0410-864c-8624ca9c26a4
/external/autotest/utils/external_packages.py
e4151ef1187142ba271e61b6cedf81fe9e6aa1c6 21-Apr-2010 jamesren <jamesren@592f7852-d20e-0410-864c-8624ca9c26a4> Remove an over-aggressive assertion

Signed-off-by: James Ren <jamesren@google.com>



git-svn-id: http://test.kernel.org/svn/autotest/trunk@4437 592f7852-d20e-0410-864c-8624ca9c26a4
/external/autotest/utils/external_packages.py
ca2a900b17c70744fc6f70a51332d83372d5ec73 21-Apr-2010 jamesren <jamesren@592f7852-d20e-0410-864c-8624ca9c26a4> Add GWT Incubator to site-packages

Signed-off-by: James Ren <jamesren@google.com>



git-svn-id: http://test.kernel.org/svn/autotest/trunk@4433 592f7852-d20e-0410-864c-8624ca9c26a4
/external/autotest/utils/external_packages.py
ff6e5aa0035294673366922b504aaf31c7200ab4 12-Feb-2010 jamesren <jamesren@592f7852-d20e-0410-864c-8624ca9c26a4> Refactored build_externals to support site-specific packages. Package declarations are now in external_packages.py and site_external_packages.py; build_externals.py is just the base script.

Also added functions to support building packages using make.

Signed-off-by: Steve Howard <showard@google.com>


git-svn-id: http://test.kernel.org/svn/autotest/trunk@4238 592f7852-d20e-0410-864c-8624ca9c26a4
/external/autotest/utils/external_packages.py