History log of /external/autotest/utils/external_packages.py
Revision Date Author Comments (<<< Hide modified files) (Show modified files >>>)
e70fed89bd1af4919550525abbeb62ff420b0a31 14-Jul-2017 Aviv Keshet <akeshet@chromium.org> autotest: expunge all references to statsd

BUG=chromium:667171
TEST=grep for statsd, Statsd, STATSD all return no results

Change-Id: I2796819e6fe5536a817f90ee8e8fa8f731595f46
Reviewed-on: https://chromium-review.googlesource.com/571408
Commit-Ready: Aviv Keshet <akeshet@chromium.org>
Tested-by: Aviv Keshet <akeshet@chromium.org>
Reviewed-by: Allen Li <ayatane@chromium.org>
/external/autotest/utils/external_packages.py
917bafa6b36316e3990061a305f761537b70f9f5 26-Oct-2016 Aviv Keshet <akeshet@chromium.org> [autotest] external_packages: remove dnspython

The last remaining user of this module seems to have been removed in
https://chromium-review.googlesource.com/203106

BUG=None
TEST=None

Change-Id: If9e6935f557a14b417b5d5137dcdd057c4d735d8
Reviewed-on: https://chromium-review.googlesource.com/403215
Commit-Ready: Aviv Keshet <akeshet@chromium.org>
Tested-by: Aviv Keshet <akeshet@chromium.org>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/utils/external_packages.py
041d329f1c1aa16b2738338fd9833abbcee62b20 11-Jul-2017 Aviv Keshet <akeshet@chromium.org> external_packages: drop httplib2

The version we are shipping is ancient, and incompatible with new
version of ts_mon. httplib2 is a standard package in many python
distributions by now, it is doubtful that we even need to be treating it
as an autotest site-package.

BUG=chromium:740648
TEST=Examined cautotest/ server, saw that httplib2 is already available.

Change-Id: Ifcdb40172e16e1b0f3d477760588ff519643e5db
Reviewed-on: https://chromium-review.googlesource.com/565619
Commit-Ready: Aviv Keshet <akeshet@chromium.org>
Tested-by: Aviv Keshet <akeshet@chromium.org>
Reviewed-by: Xixuan Wu <xixuan@chromium.org>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/utils/external_packages.py
6484eba67b6078a5fbf45d26aaa2ea4a0220b104 22-Jun-2017 Allen Li <ayatane@chromium.org> Remove unused gviz package

This was originally added for croschart, which exists no longer. grep
shows no hits.

BUG=chromium:735638
TEST=None

Change-Id: I0cc099c49ec4f63ef517f8bf278c8b76c849aef8
Reviewed-on: https://chromium-review.googlesource.com/544121
Reviewed-by: Prathmesh Prabhu <pprabhu@chromium.org>
Tested-by: Allen Li <ayatane@chromium.org>
Commit-Queue: Allen Li <ayatane@chromium.org>
/external/autotest/utils/external_packages.py
8ce47ead3f10061c88775a9c8230d75e2596a758 12-May-2017 Wai-Hong Tam <waihong@google.com> external_packages: Enable PIL by fetching it from CrOS mirror

Re-enable PIL package but change to fetching it from CrOS mirror

BUG=chromium:716541
TEST=Ran build_externals.py saw it downloaded and passed checksum.

Change-Id: Ic50bff4e1a5ece9ec2859e983bc7b22a11e2e228
Reviewed-on: https://chromium-review.googlesource.com/505347
Commit-Ready: Wai-Hong Tam <waihong@google.com>
Tested-by: Wai-Hong Tam <waihong@google.com>
Reviewed-by: Chris Ching <chingcodes@chromium.org>
Reviewed-by: Mike Frysinger <vapier@chromium.org>
/external/autotest/utils/external_packages.py
998d640b368350a985d11e1ec2c0122b189a60f8 28-Apr-2017 Chris Ching <chingcodes@chromium.org> external_packages: Removed broken package ImagingLibrary

BUG=chromium:716541
TEST=none

Change-Id: I912e7658203722ab6e8d9d44dfdde5ddde3a91d4
Reviewed-on: https://chromium-review.googlesource.com/490607
Commit-Ready: Aviv Keshet <akeshet@chromium.org>
Tested-by: Chris Ching <chingcodes@chromium.org>
Reviewed-by: Aviv Keshet <akeshet@chromium.org>
/external/autotest/utils/external_packages.py
4d750423a525161e6dcf45edff5d9256e05410c7 06-Mar-2017 Benny Peake <bpeake@google.com> Added tzlocal and pytz packages to external_packages

Added packages for common timezone operations to the
list of external packages so they can be used in
autotest.

BUG=b:34690570
TEST=None

Change-Id: Ie591e415db5f071e4d057658a0043d8d48c1fa4e
Reviewed-on: https://chromium-review.googlesource.com/450517
Commit-Ready: Benjamin Peake <bpeake@chromium.org>
Tested-by: Benjamin Peake <bpeake@chromium.org>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/utils/external_packages.py
c368db304d3b59d3943e7ceb1607d0d7cbdadbcd 01-Mar-2017 Aviv Keshet <akeshet@chromium.org> autotest: eliminate paramiko

BUG=chromium:697254
TEST=None

Change-Id: Idb935267f7b01b5330d4097c633323f01717b61c
Reviewed-on: https://chromium-review.googlesource.com/447823
Commit-Ready: Aviv Keshet <akeshet@chromium.org>
Tested-by: Aviv Keshet <akeshet@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
/external/autotest/utils/external_packages.py
4e54ae7287b9601242e99dd6a8158d8b91824997 01-Mar-2017 Aviv Keshet <akeshet@chromium.org> autotest: stop using atfork

CQ-DEPEND=CL:*332048
BUG=chromium:697254
TEST=None

Change-Id: I3f3ae5d036e43248f7832059bccc70cb83a61263
Reviewed-on: https://chromium-review.googlesource.com/447864
Commit-Ready: Aviv Keshet <akeshet@chromium.org>
Tested-by: Aviv Keshet <akeshet@chromium.org>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/utils/external_packages.py
cffc7e6cc00f818584815fc1a9e02d576155a73d 16-Nov-2016 Allen Li <ayatane@chromium.org> [autotest] Add test for should_retry()

BUG=None
TEST=Run tests

Change-Id: I8d7cc9ea28634ef96bfde84a7da192e978212651
Reviewed-on: https://chromium-review.googlesource.com/412367
Commit-Ready: Allen Li <ayatane@chromium.org>
Tested-by: Allen Li <ayatane@chromium.org>
Reviewed-by: Richard Barnette <jrbarnette@google.com>
/external/autotest/utils/external_packages.py
88b44b958e8d47ea0051d99145923636c1ae5097 26-Oct-2016 Aviv Keshet <akeshet@chromium.org> [autotest] external_packages: remove gflags

This module looks like it used to be required by some old version of
apiclient. But we no longer use external_packages to install apiclient.
I don't see any other references to this package. Remove it.

BUG=None
TEST=git grep gflag -> no python dependencies (some c dependences on an
unrelated gflag.h)

Change-Id: I5e2b2956074e9dac5216aab113f9609a79af8c4d
Reviewed-on: https://chromium-review.googlesource.com/403112
Commit-Ready: Aviv Keshet <akeshet@chromium.org>
Tested-by: Aviv Keshet <akeshet@chromium.org>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/utils/external_packages.py
697f7ed278ea77c8fdcb9f3b6489ee65f0333c64 21-Oct-2016 Shuqian Zhao <shuqianz@chromium.org> [autotest] make build_externals support testing for chromite

In order for testing chromite during push, build_externals should
support updating chromite repo to master branch

BUG=None
TEST=
$./utils/build_externals.py
# this command updates chromite to prod branch successfully
$./utils/build_externals.py --use_chromite_master
# this command updates chromite to master branch successfully
$ ./site_utils/deploy_server_local.py
# this command updates chromite to prod branch successfully
$./site_utils/deploy_server_local.py --update_push_servers
# this command updates chromite to master branch successfully

Change-Id: I29196084943d11984f5e9cc61693d57e9e148caf
Reviewed-on: https://chromium-review.googlesource.com/401180
Reviewed-by: Shuqian Zhao <shuqianz@chromium.org>
Commit-Queue: Shuqian Zhao <shuqianz@chromium.org>
Tested-by: Shuqian Zhao <shuqianz@chromium.org>
/external/autotest/utils/external_packages.py
d63f450f5102ecc07471594ee3bae63af7f7d6a6 13-Sep-2016 xixuan <xixuan@chromium.org> [autotest]: Update the invalid links for several packages for Build_externals.

This CL corrects several unavailable links for packages, including AtFork,
Httplib2, gwt, GVizAPI, Gdata, and GFlags.

BUG=chromium:646209
TEST=Remove site-packages and ExternalPackages, and then run
./utils/Build_externals.py locally.

Change-Id: I8eae03e1ed92b4cb7463315170c359facb42f3f8
Reviewed-on: https://chromium-review.googlesource.com/384339
Commit-Ready: Xixuan Wu <xixuan@chromium.org>
Tested-by: Xixuan Wu <xixuan@chromium.org>
Reviewed-by: Xixuan Wu <xixuan@chromium.org>
/external/autotest/utils/external_packages.py
ebe4631ff1ea61a6846d2424c37e9718a1726ddd 07-Sep-2016 xixuan <xixuan@chromium.org> Autotest: Let build_externals update the newest packages.

Previously, when build_externals checks whether there's a need to update a
package, it always return False. This causes some out-of-dated packages.

This CL updates to check the version of packages correctly.

BUG=chromium:644834
TEST=Run build_externals.py in local workstation.

Change-Id: I09edbb19ba70f31299f0177d87f33a6cce4ed58e
Reviewed-on: https://chromium-review.googlesource.com/382592
Commit-Ready: Xixuan Wu <xixuan@chromium.org>
Tested-by: Xixuan Wu <xixuan@chromium.org>
Reviewed-by: Shuqian Zhao <shuqianz@chromium.org>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/utils/external_packages.py
79ab90a76154a763aefb10ed381da8f3dcb25062 07-Sep-2016 Shuqian Zhao <shuqianz@chromium.org> Revert "[autotest] Install mock as external package in autotest."

This reverts commit 09f9cabd0c0b3979f3e2611811f56e2817e3045d.

Change-Id: Id361debafb2750ce48115ae704b559e833e54ea0
Reviewed-on: https://chromium-review.googlesource.com/382031
Reviewed-by: Paul Hobbs <phobbs@google.com>
Commit-Queue: Xixuan Wu <xixuan@chromium.org>
Tested-by: Xixuan Wu <xixuan@chromium.org>
/external/autotest/utils/external_packages.py
09f9cabd0c0b3979f3e2611811f56e2817e3045d 02-Sep-2016 Shuqian Zhao <shuqianz@chromium.org> [autotest] Install mock as external package in autotest.

Install mock in autotest.

BUG=None
TEST=Run utils/external_packages.py locally

Change-Id: Idb81d71e60800ba5a3d295a29f949d03d9684400
Reviewed-on: https://chromium-review.googlesource.com/380455
Commit-Ready: Paul Hobbs <phobbs@google.com>
Tested-by: Shuqian Zhao <shuqianz@chromium.org>
Reviewed-by: Paul Hobbs <phobbs@google.com>
/external/autotest/utils/external_packages.py
a9f2a2b966058047b734d987352d8df17d6f6c56 03-Aug-2016 Allen Li <ayatane@google.com> [autotest] Add missing pylint dependencies

astroid and logilab-common are pylint dependencies that aren't installed
automatically, so we need to install them ourselves.

This needs to do some egg-info metadata fiddling because Python
packaging is complicated.

BUG=chromium:632901
TEST=Ran build_externals.py and run_pylint.py with clean state

Change-Id: I80c4188609541211ab1d495352328a89599e55d8
Reviewed-on: https://chromium-review.googlesource.com/364881
Commit-Ready: Allen Li <ayatane@chromium.org>
Tested-by: Allen Li <ayatane@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
/external/autotest/utils/external_packages.py
63d726a0bd28265cdb7780427b45a3422fc37458 25-Jun-2016 Aviv Keshet <akeshet@chromium.org> autotest: remove the |requests| external package

This appears to be a standard piece of the python distribution now, and
at a higher version that the ancient one we were using.

BUG=chromium:622988
TEST=gmail_lib works

Change-Id: I7fef8ad3c16997215dfeb7290cf39e90d226f490
Reviewed-on: https://chromium-review.googlesource.com/356186
Tested-by: Aviv Keshet <akeshet@chromium.org>
Reviewed-by: Richard Barnette <jrbarnette@google.com>
Tested-by: Richard Barnette <jrbarnette@google.com>
/external/autotest/utils/external_packages.py
963b568aae6273b6fd39a5d9912005f6f2747dd3 24-Jun-2016 Aviv Keshet <akeshet@chromium.org> autotest: don't use own copy of googleapiclient or oauth2client

Autotest already uses chromite as a third party library, which already
provides those libraries. Use the chromite copy instead.

Note: in order to take effect in deployment, this CL requires a manual
cleanup of the existing copy of these libraries in autotest:
From path/to/autotest/files/site-packages run:
rm -rf apiclient
rm -rf oauth2client
rm -rf googleapiclient

BUG=chromium:622988
TEST=tested by patching on .hot

Change-Id: Ieaefffe5be73542a2cf1eb163c0d60d14cf46630
Reviewed-on: https://chromium-review.googlesource.com/356230
Reviewed-by: Aviv Keshet <akeshet@chromium.org>
Tested-by: Aviv Keshet <akeshet@chromium.org>
/external/autotest/utils/external_packages.py
1815f722bd7f18a11d98810c46eb2b812137a482 24-Jun-2016 Aviv Keshet <akeshet@chromium.org> autotest: use google-api-python-client to 1.5.1; oauth2client 1.5.2

This change allows us to pull in oauth2client 1.5.2, which is in keeping
with what we use in chromite.

We also upgrade to a newer version of google-api-python-client that no
longer ships with its own conflicting version of oauth2client.

BUG=chromium:622877
TEST=import common; import oauth2client; oaut2client.__file__ -> in
autotest site packages, oauth2client.__version__ = 1.5.2

Change-Id: I4c52d07a1a0cb6bbc07dbd154487447b2acdfdaa
Reviewed-on: https://chromium-review.googlesource.com/355721
Reviewed-by: Aviv Keshet <akeshet@chromium.org>
Commit-Queue: Aviv Keshet <akeshet@chromium.org>
Tested-by: Aviv Keshet <akeshet@chromium.org>
/external/autotest/utils/external_packages.py
ff5b5ed28231883ce71563d068c8928466da4035 10-Jun-2016 Dan Shi <dshi@google.com> [autotest] Add pylint 1.1.0 to external_packages.

Autotest pylint check is based on pylint 1.1.0. However, the pylint version in
chroot and dept_tools are both 1.4.1. This difference causes developer can't
upload CLs inside chroot, and it leads to lots of confusion due to different
errors from 1.1 and 1.4.1.

This change adds pylint 1.1.0 to external_packages. With that, after developers
runs utils/build_externals.py, pylint 1.1.0 will be installed in site-packages
folder. Then utils/run_pylint.py can import the desired 1.1.0 version and run
proper checks.

BUG=chromium:452983
TEST=local test,
run ./utils/run_pylint.py server/hosts/adb_host.py in chroot, lint check should
fail.
run build_externals
run ./utils/run_pylint.py server/hosts/adb_host.py in chroot again, lint check
should pass with no error.

Change-Id: I1dcaabe26c43ecfd288fb647c9066b5083eeb10f
Reviewed-on: https://chromium-review.googlesource.com/351481
Commit-Ready: Dan Shi <dshi@google.com>
Tested-by: Dan Shi <dshi@google.com>
Reviewed-by: Simran Basi <sbasi@chromium.org>
/external/autotest/utils/external_packages.py
a2642062fab57988a8bc6e17b0f905c9300199d4 28-Jan-2016 Shuqian Zhao <shuqianz@chromium.org> [autotest] Update the paramiko download link

Paramiko is an external package need to be downloaded. Previous download
link is obsolete. Update the download link.

BUG=None
TEST=Test on test instance.

Change-Id: I6875ee48309a303b4e0af998b86e6b01b89022c9
Reviewed-on: https://chromium-review.googlesource.com/324145
Commit-Ready: Shuqian Zhao <shuqianz@chromium.org>
Tested-by: Shuqian Zhao <shuqianz@chromium.org>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/utils/external_packages.py
190ce46df13edce95c6bf2c91cd42d8f6cd92ed1 16-Dec-2015 Christopher Wiley <wiley@google.com> Remove autotest dependency on netifaces

This dependency cannot be installed without root on developer machines
and may be easily replaced with code we already have in autotest.

BUG=b:25929635
TEST=test_droid no longer fails trying to import this file

Change-Id: I2c5d76bc48d5bd10d6103fefaa5b629d74279fe6
Reviewed-on: https://chromium-review.googlesource.com/318831
Commit-Ready: Christopher Wiley <wiley@chromium.org>
Tested-by: Christopher Wiley <wiley@chromium.org>
Reviewed-by: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
f7a46379fa23972af7355d76ab7835fccaea037c 16-Dec-2015 Christopher Wiley <wiley@google.com> Don't run sudo commands on module import

Change the PIL installation logic to only run commands that require
root in situations where we're actuallying trying to install PIL.

BUG=None
TEST=from autotest_lib.utils import external_packages no longer
tries to mutate my machine's file system.
TEST=`./utils/build_externals.py imaginglibrary` still prompts for sudo

Change-Id: If80b12b1522d7e75e0a66817773099d22c3cb0bd
Reviewed-on: https://chromium-review.googlesource.com/318830
Commit-Ready: Christopher Wiley <wiley@chromium.org>
Tested-by: Christopher Wiley <wiley@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/utils/external_packages.py
cae83c7f545ba16316c819ce238cf6a00db4a4c5 23-Jul-2015 Dan Shi <dshi@chromium.org> [autotest] Update elasticsearch python module and add request_timeout in query

Without the request_timeout, it's quite often metadb query failed with error:
ReadTimeoutError("HTTPConnectionPool(host='xxx', port=9800):
Read timed out. (read timeout=3)

This can be avoid by increasing the request_timeout. The parameter is only
supported in newer elasticsearch module, thus it needs to be updated.

BUG=None
TEST=local run command
./site_utils/host_history.py --board lumpy --pool bvt -l 1
DEPLOY=build_externals

Change-Id: Ic4bdf7e26d7055fa38163994428ba8e45ce02581
Reviewed-on: https://chromium-review.googlesource.com/287670
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Fang Deng <fdeng@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
c0594a62af352664fda0cccdddf461b790d06506 15-Jul-2015 Fang Deng <fdeng@chromium.org> [autotest] upgrade statsd to 1.7.2

statsd 1.5 is not compatible with the latest version of setuptools,
which fails build_externals. Test 1.7.2 and upgrade it.

TEST=Manually send stats;Run scheduler which sends stats.
BUG=chromium:510235

Change-Id: I5967b478ebbe09a5fba49c2cafa71e1684d24c9f
Reviewed-on: https://chromium-review.googlesource.com/285644
Reviewed-by: Dan Shi <dshi@chromium.org>
Tested-by: Fang Deng <fdeng@chromium.org>
Commit-Queue: Fang Deng <fdeng@chromium.org>
/external/autotest/utils/external_packages.py
16c0a50cc87997fb6dd3cd7aa4b9cef3ca6bc7dd 15-Jul-2015 Dan Shi <dshi@chromium.org> [autotest] Upgrade setuptools and make errors more visible

setuptools is too old, upgrade it to latest.
Allow _build_and_install to return a tuple of success, error_message.
Then build_externals can print the error at the end as well.

BUG=chromium:510143
TEST=local test

Change-Id: Ia750fd333e6d0d9d137a68b49fafc441094f07bc
Reviewed-on: https://chromium-review.googlesource.com/285646
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Fang Deng <fdeng@chromium.org>
Commit-Queue: Fang Deng <fdeng@chromium.org>
/external/autotest/utils/external_packages.py
7b6297bde3b902b1d610427a22b315fc7aa771de 23-Jun-2015 Dan Shi <dshi@chromium.org> [autotest] Force to install package if it's not installed in autotest site-packages

This is needed for tests running in container to get the site-packages.

BUG=chromium:502546
TEST=local
delete site-packages\numpy
sudo apt-get install python-numpy
run utils/build_externals.py
confirm numpy is installed in site-packages.

Change-Id: I207164040b53db72b3926423652da8627b133273
Reviewed-on: https://chromium-review.googlesource.com/281207
Trybot-Ready: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
6f7606baaa45d1923324c9f5bb9abdc7ae9dc9c7 12-Jun-2015 J. Richard Barnette <jrbarnette@chromium.org> [autotest] Fix an error in an error report in build_externals.

For a certain error case in build_externals, the error report code
tried to create a string by saying <list>.join(<string>). The
resulting exception meant that the original error failed to be
reported.

This fixes the call to the correct <string>.join(<list>)

BUG=None
TEST=None

Change-Id: I75e9badd72c9b41a6008b1886a7afcfbfaddba18
Reviewed-on: https://chromium-review.googlesource.com/277087
Commit-Queue: Richard Barnette <jrbarnette@chromium.org>
Tested-by: Richard Barnette <jrbarnette@chromium.org>
Reviewed-by: Matthew Sartori <msartori@chromium.org>
/external/autotest/utils/external_packages.py
5f6b233a9406b4b6b78c6b47c1e6fefa123ccd5e 11-Apr-2015 Prathmesh Prabhu <pprabhu@chromium.org> [autotest] Make push-to-prod sync more aggressive.

Before this CL, the push-to-prod git repo sync through build_externals
would try to 'pull' the relevant repos. This would fail to pull new
branches from the remote repo.

This CL re-works the sync code to make it more aggressive. It now goes
through the more reliable fetch-and-reset path.

While there: fix unittest for unset git_repo_url. There was duplicated
code that was obviously not testing the 'fetch' path at least.

BUG=chromium:476124
TEST=(1) Synced a new remote branch to an existing repo that used to
fail before this CL.
(2) (updated) unittests.

Change-Id: I6d5337532aed62afd270762f21d9f496a823f2d5
Reviewed-on: https://chromium-review.googlesource.com/265351
Reviewed-by: Prathmesh Prabhu <pprabhu@chromium.org>
Commit-Queue: Prathmesh Prabhu <pprabhu@chromium.org>
Tested-by: Prathmesh Prabhu <pprabhu@chromium.org>
/external/autotest/utils/external_packages.py
a637db43709296bdc4961c966f6d1ba6b5aba45b 07-Apr-2015 Prathmesh Prabhu <pprabhu@chromium.org> [autotest] pin chromiumos projects to 'prod'.

We use several chromiumous projects along with autotest in the lab. Like
the autotest repo, we now pin these other repos also to a 'prod' branch.

BUG=chromium:463275
TEST=Run build_externals on a ganeti instance, ensure that that all the
git repos pulled are at the expected git-sha#

Change-Id: I112b6581b62acd7714f49bb01efd12a9c912f6f6
Reviewed-on: https://chromium-review.googlesource.com/264155
Reviewed-by: Prathmesh Prabhu <pprabhu@chromium.org>
Commit-Queue: Prathmesh Prabhu <pprabhu@chromium.org>
Tested-by: Prathmesh Prabhu <pprabhu@chromium.org>
/external/autotest/utils/external_packages.py
71884ff6fe449856c25a4bbc8d8cc38a9ff0ed2b 02-Apr-2015 Roshan Pius <rpius@chromium.org> Revert "autotest: Add pyshark for wifi packet capture analysis in lab machines."

This reverts commit 3448e558360d0d29c3703bc38c08e2f54ff76cc8.

BUG=chromium:470708
TEST=`python utils/build_externals.py`
DEPLOY=build_externals

Change-Id: Ie417254aa0432214bc4543a8735b89a208281b2f
Reviewed-on: https://chromium-review.googlesource.com/263723
Tested-by: Roshan Pius <rpius@chromium.org>
Reviewed-by: Dan Shi <dshi@chromium.org>
Commit-Queue: Roshan Pius <rpius@chromium.org>
/external/autotest/utils/external_packages.py
3448e558360d0d29c3703bc38c08e2f54ff76cc8 30-Mar-2015 Roshan Pius <rpius@chromium.org> autotest: Add pyshark for wifi packet capture analysis in lab machines.

Adding pyshark and it's dependencies for packet capture analysis done
in Wifi tests in Lab machines.

BUG=chromium:470708
TEST=`python utils/build_externals.py`
DEPLOY=build_externals

Change-Id: Id4800ce6f3f57f0840273cde0d9fa86c12a1dd96
Reviewed-on: https://chromium-review.googlesource.com/263121
Reviewed-by: Roshan Pius <rpius@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
Commit-Queue: Roshan Pius <rpius@chromium.org>
Tested-by: Roshan Pius <rpius@chromium.org>
/external/autotest/utils/external_packages.py
44e47b8940ac951b12814bc735c132f492ea0798 20-Mar-2015 Dan Shi <dshi@chromium.org> [autotest] Add netifaces package to external packages

It's needed for lxc to get the IP address used by lxcbr0.

BUG=chromium:453624
TEST=./utils/test_importer.py
confirm netifaces package is installed in site-packages

Change-Id: Ic0c852b2be1e82448746cb6de0ded9c1f6f7c47e
Reviewed-on: https://chromium-review.googlesource.com/261380
Trybot-Ready: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
2d9a28ce3d894b9cc50b0c41dce0aaca119f575e 14-Mar-2015 Dan Shi <dshi@chromium.org> [autotest] Add a symlink before building PIL package

A new test requires PIL.Image.core.zip_decoder, which is provided by zlib.
The path of zlib library might be different from what PIL setup.py is
expected. This change does the best attempt to link the library
to a path PIL setup.py will try.

BUG=chromium:466826
TEST=run following python script, confirm Image.core.zip_decoder does not exist
before this change. After this change applied, run build_externals, then run
the python script again, confirm Image.core.zip_decoder exists.
import common
from PIL import Image
Image.core.zip_decoder

DEPOLOY=build_externals

Change-Id: I5856d9817cc4c9ee2bc69a740d56311d585edba5
Reviewed-on: https://chromium-review.googlesource.com/260130
Trybot-Ready: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Wai-Hong Tam <waihong@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
a742761176ae9df932caa20f9ae6fae26ab3ea28 15-Nov-2014 Michael Janssen <jamuraa@chromium.org> [autotest] Fixes for install on trusty

- Apache default site is now named 000-default, try both
- a2enmod version fails on trusty because it's builtin
- libfreetype6-dev puts ft2build.h in a different place.

BUG=None
TEST=run on trusty vm, run on precise vm, goobuntu trusty, open
localhost to confirm AFE is up

Change-Id: I6ea818c873c4dabbafa6c6e2930d5186dfe25df6
Reviewed-on: https://chromium-review.googlesource.com/229940
Tested-by: Michael Janssen <jamuraa@chromium.org>
Reviewed-by: Dan Shi <dshi@chromium.org>
Commit-Queue: Michael Janssen <jamuraa@chromium.org>
/external/autotest/utils/external_packages.py
5934b7121277a4283119676773f89c0f989b5f06 13-Aug-2014 Michael Liang <michaelliang@chromium.org> [autotest] Add Urllib3 package to external_packages.py

Some autotest servers don't have urllib3 installed.

BUG=None
TEST=pip uninstall urllib3; ./build_externals;
inside python: import common, import urllib3,
verified import succeeded.
DEPLOY=build_externals

Change-Id: I3c6c4280d06128b789e3a94c5c827c2630383e2a
Reviewed-on: https://chromium-review.googlesource.com/212139
Reviewed-by: Dan Shi <dshi@chromium.org>
Commit-Queue: Michael Liang <michaelliang@chromium.org>
Tested-by: Michael Liang <michaelliang@chromium.org>
/external/autotest/utils/external_packages.py
428b34464f1060129cbcda08d60ec44ed88a518d 22-Jul-2014 J. Richard Barnette <jrbarnette@chromium.org> Add the Python Imaging Library as an external dependency.

A recent change to support chameleon added a dependency on the
Python Imaging Library. That library isn't guaranteed available on
all hosts that might run Autotest. In particular, the library isn't
guaranteed to be present on the Autotest lab drone systems, which is
where it's most required.

This change adds the library using the Autotest external dependency
mechanism, and changes affected 'import' statements to account
for a location change.

BUG=None
TEST=manually test the import statements, plus pylint

Change-Id: I745a7d6050dfbf081447656213b2f9ed270d0a43
Reviewed-on: https://chromium-review.googlesource.com/209353
Tested-by: Richard Barnette <jrbarnette@chromium.org>
Reviewed-by: Wai-Hong Tam <waihong@chromium.org>
Commit-Queue: Richard Barnette <jrbarnette@chromium.org>
/external/autotest/utils/external_packages.py
d2d294c83fe8355d432f84771a651b1c99029bcf 25-Jun-2014 Michael Liang <michaelliang@chromium.org> [autotest] Add capability to log metadata stats module to esdb

Adds functionality to stats objects to take in optional metadata that
is reported to elasticsearch. This change also includes a functional
test script that verifies stats objects correctly report metadata
to elasticsearch. This involves adding an external package for
wrapping a connection to es. Also added mock for elasticsearch
which resulted in refactor of statsd_mock.

TEST=python stats_es_functionaltest.py --all --es_port=prod
for both http and udp (by changing shadow config)
TEST=python elasticsearch_mock_unittest.py
TEST=python statsd_mock_unittest.py
BUG=None

Change-Id: I5971e39623e465a42a46dafc61fb26a1fb129391
Reviewed-on: https://chromium-review.googlesource.com/205776
Tested-by: Michael Liang <michaelliang@chromium.org>
Reviewed-by: Dan Shi <dshi@chromium.org>
Commit-Queue: Michael Liang <michaelliang@chromium.org>
/external/autotest/utils/external_packages.py
a87e54878e81b762e4eeea7bcf9ce2e925685b17 10-Jun-2014 Alex Miller <milleral@chromium.org> [autotest] Add psutil package.

BUG=chromium:375348
DEPLOY=build_externals
TEST=built externals

Change-Id: I043c14cec98f822e9a0072f8a44ec3144ffd0479
Reviewed-on: https://chromium-review.googlesource.com/203172
Tested-by: Alex Miller <milleral@chromium.org>
Reviewed-by: Prashanth B <beeps@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
bb1a9675c0abbf1e260a310257f59ad0711f3589 03-Mar-2014 Scott James Remnant <keybuk@chromium.org> [autotest] Add btsocket to external packages

This is downloaded from git and built using setup.py

BUG=chromium:348704
TEST=./utils/build_externals.py; python -c 'import common,btsocket'
CQ-DEPEND=CL:188561
DEPLOY=build_externals

Change-Id: Ice00e49e5b64b90bc85e33b1b9d06b6de4d7925e
Reviewed-on: https://chromium-review.googlesource.com/188552
Reviewed-by: Scott James Remnant <keybuk@chromium.org>
Tested-by: Scott James Remnant <keybuk@chromium.org>
Commit-Queue: Scott James Remnant <keybuk@chromium.org>
/external/autotest/utils/external_packages.py
5ac9da35f551b88a4bcb121dc73c66cc2022e3c7 12-Feb-2014 Tom Wai-Hong Tam <waihong@chromium.org> Remove the internal chameleon repo from external packages

We abstracted the interfaces using Chameleond. So the display tests
no longer depends on the library in the chameleon repo. So remove it
from the external packages.

BUG=chromium:336726
TEST=None, trivial removal.

Change-Id: Ic10d230be03797a2f517344287635cb606827f36
Reviewed-on: https://chromium-review.googlesource.com/185829
Reviewed-by: Ricky Liang <jcliang@chromium.org>
Commit-Queue: Wai-Hong Tam <waihong@chromium.org>
Tested-by: Wai-Hong Tam <waihong@chromium.org>
/external/autotest/utils/external_packages.py
d6b8377f09d721933f6e1a0aae28fb2e7ff5eeff 07-Jan-2014 Simran Basi <sbasi@chromium.org> [autotest] Add faulthandler to autoserv

This change adds the faulthandler package as a new external_package.
It then imports it to autoserv and then registers SIGTERM. This will
dump the thread's current traceback on SIGTERM then execute the
previous signal handler.

BUG=chromium:302815
DEPLOY=build_externals
TEST=Executed build_externals and ensured faulthandler was downloaded
and installed and that re-executing build_externals did not reinstall
it. Then ran sleeptest with a 1 minute timeout and ensured the
faulthandler output showed up in autoserv.DEBUG when the scheduler
aborted it.

Change-Id: Id59f897bb766a821ef463c8166531db480c68041
Reviewed-on: https://chromium-review.googlesource.com/181688
Reviewed-by: Alex Miller <milleral@chromium.org>
Commit-Queue: Simran Basi <sbasi@chromium.org>
Tested-by: Simran Basi <sbasi@chromium.org>
/external/autotest/utils/external_packages.py
fdb51c5dc90492b1e8aaaa432e05abfc6fb3c897 04-Sep-2013 Ricky Liang <jcliang@chromium.org> Add XML RPC server for display testing.

Also add video-chameleon repo into external_packages dependencies since
it is needed by the test.

BUG=None
CQ-DEPEND=CL:*148316
DEPLOY=build_externals
TEST=Manually on my DUTs

Change-Id: I5f97d47a5142d63754cc7fbc5f6ed35b34cb4821
Reviewed-on: https://chromium-review.googlesource.com/177561
Reviewed-by: Dean Liao <deanliao@chromium.org>
Tested-by: Ricky Liang <jcliang@chromium.org>
Commit-Queue: Ricky Liang <jcliang@chromium.org>
/external/autotest/utils/external_packages.py
2371d1a548bbf53654db008708a04b34787eb413 22-Nov-2013 Jason Abele <jabele@chromium.org> autotest: add selenium to external_packages

In order to run the wifi_interop suite, the drones need to have selenium
installed.

BUG=chromium:321806
DEPLOY=build_externals
TEST=./utils/build_externals.py
python -c "import common; import selenium; print selenium.__version__"

Change-Id: I766327352d0c20818a082f07f42cbeced6a4daba
Reviewed-on: https://chromium-review.googlesource.com/177795
Tested-by: Jason Abele <jabele@chromium.org>
Reviewed-by: Prashanth B <beeps@chromium.org>
Commit-Queue: Jason Abele <jabele@chromium.org>
/external/autotest/utils/external_packages.py
9fbe67f32e5b68170cd0a5726b95b96b7f73add6 07-Sep-2013 Alex Miller <milleral@chromium.org> [autotest] Move site-utils packages to GoB.

CQ-DEPEND=I7cb235f16723b7720bdfc4c7019d2d59f34892c7
BUG=chromium:286471
DEPLOY=build_externals
TEST=ran build_externals

Change-Id: I870bf1106c0a9e2f8caacac2a5631271ff4ed3ac
Reviewed-on: https://chromium-review.googlesource.com/168466
Tested-by: Alex Miller <milleral@chromium.org>
Reviewed-by: Chris Sosa <sosa@chromium.org>
Tested-by: Chris Sosa <sosa@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
32a630851fbb67e8297739fff71165f5acc78751 22-Aug-2013 beeps <beeps@chromium.org> [autotest] Teach site host about jsonrpc.

Refactor code to create an ssh tunnel. Mirror the
xmlrpc implementation in site_host for jsonrpc.
Also add jsonrpc to site-packages.

TEST=Creates a jsonrpc connection and issued rpcs, locked
a DUT and ran basic wifi tests.
BUG=chromium:272445
DEPLOY=build_externals

Change-Id: I77c95b4a91896b2807f901f7050e28e1836b7b0e
Reviewed-on: https://chromium-review.googlesource.com/66848
Reviewed-by: Alexander Miller <milleral@chromium.org>
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
Reviewed-by: Richard Barnette <jrbarnette@chromium.org>
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
4f34170dbb70080a56de88dc13859b3a7ffffb0a 25-Mar-2013 Alex Miller <milleral@chromium.org> [autotest] Use |json| instead of |simplejson|.

simplejson was moved into the library as of python 2.4. We're now at
python 2.6/2.7, and having to keep installing simplejson everywhere has
slowly turned into a hassle. Since we can just trivially drop/rename
it, let's do so.

The rpc_interface parts of this change have been vetted, the rest is
done just as a s/simplejson/json/ across the code, which afaik should be
a safe thing to do.

BUG=None
TEST=unit, run_suite
DEPLOY=apache

Change-Id: Iab35f71157e7e5cd3be5291c776b07eb3283be8e
Reviewed-on: https://gerrit.chromium.org/gerrit/46424
Tested-by: Aviv Keshet <akeshet@chromium.org>
Reviewed-by: Alex Miller <milleral@chromium.org>
Commit-Queue: Aviv Keshet <akeshet@chromium.org>
/external/autotest/utils/external_packages.py
47d61281a7b23a5e6d8c5835659b502f56108d07 17-Apr-2013 Alex Miller <milleral@chromium.org> [autotest] Bump django to 1.5.

This includes a mysql-python version bump to get rid of a warning
message, and a few fixes throughout the codebase to get things working
again under django 1.5.

TEST=AFE works, RPCs work, run_suite works, scheduler works
BUG=chromium:232388
DEPLOY=apache,scheduler

Change-Id: Ie0d7f5fd1203a25bdedb78d31778d8373aaf6ff5
Reviewed-on: https://gerrit.chromium.org/gerrit/48402
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Brian Harring <ferringb@chromium.org>
Tested-by: Alex Miller <milleral@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
d5335858ea37a3f48fc7f619e86f307cf5b55acb 09-Apr-2013 beeps <beeps@chromium.org> [Autotest] Installs the GFlags package through build_externals.

GFlags is needed by certain modules in apiclient, which is used in
automatic bug filing.

BUG=chromium:229296
TEST=Uninstalled gflags and checked that apiclient is unable to import
HttpError, then ran build_externals and checked that it can.
DEPLOY=build_externals on cautotest, drones.

Change-Id: I42a1f06a48d123a2b9d430499fabf37031dcded3
Reviewed-on: https://gerrit.chromium.org/gerrit/47652
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
e0db09dad16a5293add841966186a66d0f8b1fe9 25-Feb-2013 beeps <beeps@chromium.org> [autotest] Adds areas labels to the bug filer.

1. Adds the apiclient library to external packages.

2. Query the issues tracker project to get a list of
predefined 'Area-' labels and convert all that match
the failing test into labels for the new bug. Querying
is done through the new project hosting v2 api and we use
bugdroid1's api key for authentication.

TEST=Checked that the appropriate labels are appended to failing tests.
Repeated this with the python apiclient package uninstalled.
BUG=None

Change-Id: Iff809fe4370b0497898efc40b76d4cee7028145b
Reviewed-on: https://gerrit.chromium.org/gerrit/47304
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
aae3f1c191a28e1ed4bde92fc50e15b260246b23 19-Mar-2013 beeps <beeps@chromium.org> [Autotest] Git pull instead of fetch/reset when building externals.

Build externals will now perform a git pull -r when a repo
is already present. Previously we attempted to fetch --all and
reset --hard HEAD, for this to achieve what was intended
we need to figure out the name of the upstream branch the
current branch is tracking. This change makes it so
we just fail to build externals when there's a local rebase
conflict (which there shouldn't be in site-packages anyway).

BUG=chromium:222144
TEST=Ran build externals with and without site-packages and imported
git dependent modules. Ran the revision_control unittests.

Change-Id: I1d41f9eea44a86386a28392c315c8802368ccb2f
Reviewed-on: https://gerrit.chromium.org/gerrit/45912
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
ee10e936b495e2f4bb3de2b5a5641854a565623d 19-Mar-2013 Alex Miller <milleral@chromium.org> [autotest] Use fixes in upstream statsd.

All of the DNS hacks got pushed to upstream with a proper
implementation, so they can be dropped locally if we use the
just-released upstream version.

BUG=None
TEST=Ran scheduler with stat locally

Change-Id: I4d355c778b998b4610841b7c8710c94c30d54a5a
Reviewed-on: https://gerrit.chromium.org/gerrit/45815
Tested-by: Alex Miller <milleral@chromium.org>
Reviewed-by: Aviv Keshet <akeshet@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
c2c9a01905a157e2ce47d26b07db6c8f576cf3c1 06-Mar-2013 Scott Zawalski <scottz@google.com> Update numpy from 1.2.1 to 1.7.0.

Update numpy in external_packages so that we can properly compile
on precise variants. http://projects.scipy.org/numpy/ticket/1355

TEST=built numpy on both precise and lucid variants via build_external.
BUG=chromium-os:37600

Change-Id: Ia9b146fbf39bfa76447b8cd4fc6172d81dae6058
Reviewed-on: https://gerrit.chromium.org/gerrit/44726
Tested-by: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Commit-Queue: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
/external/autotest/utils/external_packages.py
1bf41c4ff52e8a3ea1a99fa7331a1c77349c9f22 27-Feb-2013 Chris Sosa <sosa@chromium.org> Switch over test_image to use devserver gsutil_util api.

This CL switches full_release_test from using gs ls naively as
gs ls has a race condition with gs cp i.e. if I gs cp a file
into GS, it's not guaranteed to be there in a following call to
gs ls (even though you can download/cat it with gs cat or gs cp).
We've already worked around this problem in the devserver (specially
in gsutil_util). This change modifies our call to gs ls to use the
devserver gsutil_util instead.

I've also had some leftover cleanup from previous CL's on this
topic that are in full_release_tests. Minor nits.

BUG=chromium-os:37575
TEST=Ran it with / without archive_url.

Change-Id: I03d533bc40742c534884de5234cddebde1e528a2
Reviewed-on: https://gerrit.chromium.org/gerrit/44208
Tested-by: Chris Sosa <sosa@chromium.org>
Reviewed-by: Gilad Arnold <garnold@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Commit-Queue: Chris Sosa <sosa@chromium.org>
/external/autotest/utils/external_packages.py
0e1217c84d579ce36ce084a442b6bdec0630e5a3 22-Feb-2013 Alex Miller <milleral@chromium.org> [autotest] Detect modules and versions of site-packages properly.

gvizapi was looking for the wrong module.
gdata and hdctools do not have versions as part of the package.

BUG=chromium-os:38901
TEST=./utils/build_externals.py

Change-Id: I251976364883c3f414ebf46242b3d48bdf1ad8b9
Reviewed-on: https://gerrit.chromium.org/gerrit/43792
Commit-Queue: Alex Miller <milleral@chromium.org>
Reviewed-by: Alex Miller <milleral@chromium.org>
Tested-by: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
57631dc37a9f25cda25af804c1bf50ef55b1c22f 22-Feb-2013 Dan Shi <dshi@chromium.org> [autotest] Add comma back in urls, minor fix in docstring

Add comma back in assignment statement to urls to make it a list.
Minor typo fix in suite_scheduler docstring.

BUG=None
TEST=run_sutie against lumpy with smoke suite, and run suite_scheduler
agaist a test suite.

Change-Id: I04696407cb44848de14160fc00c7ce7583210b31
Reviewed-on: https://gerrit.chromium.org/gerrit/43796
Commit-Queue: Dan Shi <dshi@chromium.org>
Reviewed-by: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
/external/autotest/utils/external_packages.py
e7b6e8bd6ffa474166aaaa36976ee8a54c71bc3e 14-Feb-2013 Alex Miller <milleral@chromium.org> [autotest] Add packages required by unittests.

pyudev is needed by client/cros/rf/config_unittest.py
dnspython is needed by server/cros/recall_test.py

BUG=chromium-os:37989
TEST=./build_externals.py ran successfully

Change-Id: I84e70ec3ea9afe1d005afc962aaf244197363b4c
Reviewed-on: https://gerrit.chromium.org/gerrit/43246
Tested-by: Alex Miller <milleral@chromium.org>
Reviewed-by: Aviv Keshet <akeshet@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/utils/external_packages.py
93bef48a4825a0355717978dce845d1c74c08e56 05-Feb-2013 beeps <beeps@chromium.org> [autotest] Added gdata to site-packages.

Needed so we can file bugs automatically when bugs fail.

TEST= imported gdata, verified that we file bugs on test failure.
BUG=chromium-os:38553

Change-Id: I229fb673d12820dfcf8ed5505be00f71fb3de4a3
Reviewed-on: https://gerrit.chromium.org/gerrit/42587
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
2a6acf8502bc1e0cd5fa1b8ab60329c0ccf7dd76 11-Feb-2013 Scott Zawalski <scottz@google.com> Add statsd 1.5.7 to our site-packages install process.

TEST=utils/build_externals.py
BUG=None

Change-Id: I1841feb6c4c821f9050348ce8d4f7749e99d3978
Reviewed-on: https://gerrit.chromium.org/gerrit/43054
Tested-by: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Commit-Queue: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
/external/autotest/utils/external_packages.py
d9153b52ba5a50c16dce111a9e03d6241c969d11 24-Jan-2013 beeps <beeps@chromium.org> [autotest] Allows us to pull repos as part of build_externals.

Pulls/clones chromite and hdctools/servo into site-packages. Also add
helper methods to revision_control.py and a -work-tree option, along
with a unittest.

TEST=built externals and imported servo/chromite.
BUG=chromium-os:38096

Change-Id: I1bae6e3f730495030665267876c8594800aa27d4
Reviewed-on: https://gerrit.chromium.org/gerrit/41910
Commit-Queue: Prashanth Balasubramanian <beeps@chromium.org>
Reviewed-by: Prashanth Balasubramanian <beeps@chromium.org>
Tested-by: Prashanth Balasubramanian <beeps@chromium.org>
/external/autotest/utils/external_packages.py
bafbbb0ff97fa5a5e07a47003d1ea57566f2186d 16-May-2012 Chris Masone <cmasone@chromium.org> [autotest] Re-land "Add logic to symbolicate dumps using dev server, stage symbols on-demand"

re-run /usr/local/autotest/utils/build_externals.py before trying to use this
outside the chroot.

When trying to symbolicate a crash dump using the dev server, we first
have to stage debug symbols on-demand. We can't stage them up front,
sadly. So, block and stage them on-demand, doing so iff we actually get
crashes during a test.

This reverts commit 77e95f2dd7a025966aa2cdf19cfb5f0bfcf2608f.

BUG=chromium-os:29730,chromium-os:30400
TEST=run_remote_tests a test that generates a crash dump; symbolication should
TEST=occur locally.
TEST=set up a dev server that does not have symbols staged, and run a test
TEST=that generates a crash dump. The symbols should get staged and the dump
TEST=symbolicated. Now run another. The symbols should be re-used.
STATUS=Fixed

Change-Id: I85c9f16ec054210ebacf22c4713d9ba65927551b
Reviewed-on: https://gerrit.chromium.org/gerrit/22866
Tested-by: Chris Masone <cmasone@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Commit-Ready: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
77e95f2dd7a025966aa2cdf19cfb5f0bfcf2608f 16-May-2012 Chris Masone <cmasone@chromium.org> Revert "[autotest] Add logic to symbolicate dumps using dev server, staging symbols on-demand"

An important change that this depends on got reverted because it broke a test that is of marginal utility, so this will start breaking stuff again if we leave it in.

This reverts commit d1294ffd263104fd0b7473c38c646fc9d26b8ea9

Change-Id: Ibcc1193db2e1a5907ddaf11fd6ab1b803dbdf303
Reviewed-on: https://gerrit.chromium.org/gerrit/22766
Commit-Ready: Chris Masone <cmasone@chromium.org>
Reviewed-by: Chris Masone <cmasone@chromium.org>
Tested-by: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
06e087cf2830e677cde88e32e4f42d0bc0547e68 08-May-2012 Chris Masone <cmasone@chromium.org> [autotest] Add logic to symbolicate dumps using dev server, staging symbols on-demand

re-run /usr/local/autotest/utils/build_externals.py before trying to use this
outside the chroot.

When trying to symbolicate a crash dump using the dev server, we first
have to stage debug symbols on-demand. We can't stage them up front,
sadly. So, block and stage them on-demand, doing so iff we actually get
crashes during a test.

BUG=chromium-os:29730,chromium-os:30400
TEST=run_remote_tests a test that generates a crash dump; symbolication should
TEST=occur locally.
TEST=set up a dev server that does not have symbols staged, and run a test
TEST=that generates a crash dump. The symbols should get staged and the dump
TEST=symbolicated. Now run another. The symbols should be re-used.

This reverts commit 01310f99e1aa2862af087583a0815c3271fc10c1.
This reverts commit 52c7fb7c3b8c6fcc81b62a391d3cd8b9443b25d1.

Change-Id: I5385d5213f21bc03c9301d4f9f88ed06d30d8e1f
Reviewed-on: https://gerrit.chromium.org/gerrit/22501
Commit-Ready: Chris Masone <cmasone@chromium.org>
Reviewed-by: Chris Masone <cmasone@chromium.org>
Tested-by: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
01310f99e1aa2862af087583a0815c3271fc10c1 08-May-2012 Scott Zawalski <scottz@chromium.org> Revert "[autotest] Re-land "Add logic to symbolicate dumps using dev server""

Cherrypy is hanging when we send multiple POSTs using request to it in a short
amount of time

BUG=30650

This reverts commit 043bf47e7946366517757cdb981de99eb81adcb6

Change-Id: I6f91b730289d14502eeffcf672ccb36494d5f847
Reviewed-on: https://gerrit.chromium.org/gerrit/22115
Commit-Ready: Scott Zawalski <scottz@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Tested-by: Scott Zawalski <scottz@chromium.org>
/external/autotest/utils/external_packages.py
4245a73ec638b602bd4546637b41c74f39158e14 30-Apr-2012 Chris Masone <cmasone@chromium.org> [autotest] Re-land "Add logic to symbolicate dumps using dev server"

re-run /usr/local/autotest/utils/build_externals.py before trying to use this
outside the chroot.

BUG=chromium-os:29730
TEST=point local autoserv at a local dev server, run a test that causes a crash; it should symbolicate the crash

This reverts commit 8972fa982c3ec369737f1e45f52a3b350c1824e7.

Change-Id: I080fb56b0d2508ccd90b4140826d7020efc81982
Reviewed-on: https://gerrit.chromium.org/gerrit/21493
Tested-by: Chris Masone <cmasone@chromium.org>
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Commit-Ready: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
8972fa982c3ec369737f1e45f52a3b350c1824e7 30-Apr-2012 Chris Masone <cmasone@chromium.org> Revert "[autotest] Add logic to symbolicate dumps using dev server"

Somehow, import logging is failing...?

This reverts commit 98bc0046b399518cb1217469b9306a4ab7a4b928

Change-Id: Iedab8e712494a730b797b0490dcabf5c6578e192
Reviewed-on: https://gerrit.chromium.org/gerrit/21478
Commit-Ready: Chris Masone <cmasone@chromium.org>
Reviewed-by: Chris Masone <cmasone@chromium.org>
Tested-by: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
d6a4718a15d37306f31a65ad8d6b9023b4a69b42 25-Apr-2012 Chris Masone <cmasone@chromium.org> [autotest] Add logic to symbolicate dumps using dev server

re-run /usr/local/autotest/utils/build_externals.py before trying to use this
outside the chroot.

BUG=chromium-os:29730
TEST=point local autoserv at a local dev server, run a test that causes a crash; it should symbolicate the crash into a .txt named after the minidump file.

CQ-DEPEND=Ib9d5b0abb73567fd8450db50d3e50d27bdc169f4

Change-Id: Id0d1fd6b4f00e560dd5683d87140ed943697f185
Reviewed-on: https://gerrit.chromium.org/gerrit/21277
Commit-Ready: Chris Masone <cmasone@chromium.org>
Reviewed-by: Chris Masone <cmasone@chromium.org>
Tested-by: Chris Masone <cmasone@chromium.org>
/external/autotest/utils/external_packages.py
74a314b490ff542c4dd2ae4aa0d11c6394d92960 23-Jun-2011 Dale Curtis <dalecurtis@chromium.org> Upstream Autotest merge.

As titled, a merge up to 93fc426ca133e775eb495f34d138fc57d92fb55e.

- Removes a bunch of deprecated code.
- Moves several private utilities into the private repo.
- Couple changes ported upstream and resynced.

BUG=None
TEST=In progress... will spin up new Autotest server and use
run_remote_tests for bvt, regression, smoke.

Change-Id: Id3e2ad529bb7b05f148e5d98aea46bb9ea828200
Reviewed-on: http://gerrit.chromium.org/gerrit/3350
Tested-by: Dale Curtis <dalecurtis@chromium.org>
Reviewed-by: Dale Curtis <dalecurtis@chromium.org>
/external/autotest/utils/external_packages.py
ddd44b22416bb1285c8bdf25267ba346d84da3f5 15-Apr-2011 Mike Truty <truty@google.com> Integrate dynamic charts into autotest frontend.

BUG=chromium-os:14044
TEST=http://truty.i/croschart/server/x86-mario-r12/MARIO_MP/0.12.306.0/0.12.389.0/platform_BootPerfServer/seconds_kernel_to_startup/1280/1024/

Review URL: http://codereview.chromium.org/6821082

Change-Id: Ide1bac507850a45a9a34ef9459a6b148e52e3305
/external/autotest/utils/external_packages.py
861b2d54aec24228cdb3895dbc40062cb40cb2ad 04-Feb-2011 Eric Li <ericli@chromium.org> Merge remote branch 'cros/upstream' into master

Merged to upstream autotest @4749~@5215.

The entire change list description is too big to enlist here. Please refer to upstream (http://autotest.kernel.org/browser) for more details.

BUG=
TEST=emerged both x86 and arm build.
Tested emerged x86 build bvt against a chromeos device.

Review URL: http://codereview.chromium.org/6246035

Change-Id: I8455f2135c87c321c6efc232e2869dc8f675395e
/external/autotest/utils/external_packages.py
bdaab795cffa33f9a37995bb283047cb03699272 07-Jan-2011 Kenneth Waters <kwaters@chromium.org> Revert "Merge remote branch 'cros/upstream' into autotest-rebase"

This reverts commit 7edb30498d75a29a3287fe07070f2b51a116c5d4.

TEST=Built for tegra2_seaboard
BUG=10756

Review URL: http://codereview.chromium.org/6124004

Change-Id: Ifcd1a2279f5a62b99552a8f961c1430889a3a928
/external/autotest/utils/external_packages.py
7edb30498d75a29a3287fe07070f2b51a116c5d4 07-Jan-2011 Eric Li <ericli@chromium.org> Merge remote branch 'cros/upstream' into autotest-rebase

Merged to upstream trunk@5066, from trunk@4749.

There is no way I could enlist each individual CL from the upstream here since it will blow up the changelist description field.

BUG=
TEST=
Had patched this CL into a fresh cut client to avoid any side effect.
run_remote_test bvt from both emerged location and third_party/autotest/file.

Both test passed!

We should also keep any eye on this to see how it gets propagated into cautotest server.
TBR=dalecurtis

Change-Id: I72f2bc7a9de530178484aea1bfb5ace68bcad029
/external/autotest/utils/external_packages.py
6f27d4f22a1ba5063968b8c322fa0845f3279ade 29-Sep-2010 Eric Li <ericli@chromium.org> Merge remote branch 'cros/upstream' into tempbranch3

Merge to trunk@4817

BUG=
TEST=

Review URL: http://codereview.chromium.org/3554003

Change-Id: I83376bc7d28104ec2678e157eadbe7df7c05c0e0
/external/autotest/utils/external_packages.py
517d95a1ef4edb04da427763f86068a447d45ec7 29-Sep-2010 Benson Leung <bleung@chromium.org> Revert "Merge remote branch 'cros/upstream' into tempbranch2"

This reverts commit 25fc6d1f28e54c46689f12d3b93c2540ef45323a.

TBR=ericli@chromium.org

Review URL: http://codereview.chromium.org/3541002

Change-Id: Ib0165b19bfdf02264f8a6a74ddf3ae74c8c0f7df
/external/autotest/utils/external_packages.py
25fc6d1f28e54c46689f12d3b93c2540ef45323a 29-Sep-2010 Eric Li <ericli@chromium.org> Merge remote branch 'cros/upstream' into tempbranch2

Merged to trunk@4816.

BUG=
TEST=we will build a new autotest server instance, and keep cautotest running and then later do a cname switch.

Review URL: http://codereview.chromium.org/3511003

Change-Id: Iee5f52f45f28f84927d6c6f9a74edc370d40288a
/external/autotest/utils/external_packages.py
992056e92cd076bec68bd4e07a0025acf5627bfb 30-Apr-2010 jamesren <jamesren@592f7852-d20e-0410-864c-8624ca9c26a4> Fix handling of GWT Incubator external package in build_externals

Signed-off-by: James Ren <jamesren@google.com>



git-svn-id: http://test.kernel.org/svn/autotest/trunk@4453 592f7852-d20e-0410-864c-8624ca9c26a4
/external/autotest/utils/external_packages.py
012d0325b33deeb81f06fa11f5498d2bc8146f57 30-Apr-2010 jamesren <jamesren@592f7852-d20e-0410-864c-8624ca9c26a4> Move to GWT 2.0.3. Drop in new gwt-incubator to match.

Signed-off-by: James Ren <jamesren@google.com>



git-svn-id: http://test.kernel.org/svn/autotest/trunk@4452 592f7852-d20e-0410-864c-8624ca9c26a4
/external/autotest/utils/external_packages.py
e4151ef1187142ba271e61b6cedf81fe9e6aa1c6 21-Apr-2010 jamesren <jamesren@592f7852-d20e-0410-864c-8624ca9c26a4> Remove an over-aggressive assertion

Signed-off-by: James Ren <jamesren@google.com>



git-svn-id: http://test.kernel.org/svn/autotest/trunk@4437 592f7852-d20e-0410-864c-8624ca9c26a4
/external/autotest/utils/external_packages.py
ca2a900b17c70744fc6f70a51332d83372d5ec73 21-Apr-2010 jamesren <jamesren@592f7852-d20e-0410-864c-8624ca9c26a4> Add GWT Incubator to site-packages

Signed-off-by: James Ren <jamesren@google.com>



git-svn-id: http://test.kernel.org/svn/autotest/trunk@4433 592f7852-d20e-0410-864c-8624ca9c26a4
/external/autotest/utils/external_packages.py
ff6e5aa0035294673366922b504aaf31c7200ab4 12-Feb-2010 jamesren <jamesren@592f7852-d20e-0410-864c-8624ca9c26a4> Refactored build_externals to support site-specific packages. Package declarations are now in external_packages.py and site_external_packages.py; build_externals.py is just the base script.

Also added functions to support building packages using make.

Signed-off-by: Steve Howard <showard@google.com>


git-svn-id: http://test.kernel.org/svn/autotest/trunk@4238 592f7852-d20e-0410-864c-8624ca9c26a4
/external/autotest/utils/external_packages.py