History log of /external/autotest/scheduler/agent_task.py
Revision Date Author Comments (<<< Hide modified files) (Show modified files >>>)
e6803234ac5233c48ff50b57460d42641e04a52b 20-Jan-2016 Dan Shi <dshi@google.com> [autotest] Add switch to enable/disable devserver and drone election in restricted subnet.

This allows devserver and drone election in restricted subnet to be enabled/
disabled separatedly.

BUG=chromium:574872
TEST=unittest

Change-Id: If2c3d1ad1bd9be5546bf2f8a027bcd88627ae2c5
Reviewed-on: https://chromium-review.googlesource.com/322468
Commit-Ready: Dan Shi <dshi@google.com>
Tested-by: Dan Shi <dshi@google.com>
Reviewed-by: Dan Shi <dshi@google.com>
/external/autotest/scheduler/agent_task.py
114e17228efd62ab595690be30cb1e3f26fabebe 11-Jan-2016 Dan Shi <dshi@google.com> [autotest] Support selecting drone in restricted subnet

For agent task uses host in restricted subnet, only use drone in the subnet.
For agent task uses host NOT in restricted subnet, only use drones NOT in any
restricted subnet.

BUG=chromium:574872
TEST=local run, unittest

Change-Id: I3492fe14660e7629f982937d428d230ca9dcf3dc
Reviewed-on: https://chromium-review.googlesource.com/321116
Commit-Ready: Dan Shi <dshi@google.com>
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Fang Deng <fdeng@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
/external/autotest/scheduler/agent_task.py
8d7f3561b90d88c985004104c18be44c2af6be70 11-Jan-2016 Dan Shi <dshi@google.com> [autotest] Fix a reference bug

SchedulerError was moved from host_scheduler to scheduler_lib.

Also change suite scheduler driver to use contextlib.closing for threadpool
handling.

BUG=None
TEST=unittest, test suite scheduler run

Change-Id: I56016c4817a5a7fece7076a82bede462f74d5d59
Reviewed-on: https://chromium-review.googlesource.com/321380
Commit-Ready: Dan Shi <dshi@google.com>
Tested-by: Dan Shi <dshi@google.com>
Reviewed-by: Simran Basi <sbasi@chromium.org>
/external/autotest/scheduler/agent_task.py
8e6affb2614b6b6f03ab97b52740f03df1470ade 16-Dec-2015 Simran Basi <sbasi@google.com> [autotest] Pass in --lab to autoserv for Special Tasks.

Special tasks kick off autoserv in a number of different locations,
this change informs special tasks ran by the scheduler that they
are running in the lab.

BUG=chromium:570125
TEST=Local MobLab run.

Change-Id: I741f64a54bf5ce0997be34435ad7db1a2051e39d
Reviewed-on: https://chromium-review.googlesource.com/318753
Commit-Ready: Simran Basi <sbasi@chromium.org>
Tested-by: Simran Basi <sbasi@chromium.org>
Reviewed-by: Simran Basi <sbasi@chromium.org>
/external/autotest/scheduler/agent_task.py
80f7c5339175966a1fad1cb0d6b5fbbab46ba032 25-Aug-2015 Dan Shi <dshi@chromium.org> [autotest] Replace scheduler email alerts with stats and metadata logging.

The emails are not manageable. Replace with logs in metadata and stats server.

BUG=chromium:524243
TEST=unittest, local scheduler run

Change-Id: Ib9854576b64edfb428195d5cb323b8f883e635d5
Reviewed-on: https://chromium-review.googlesource.com/295482
Tested-by: Dan Shi <dshi@chromium.org>
Reviewed-by: Aviv Keshet <akeshet@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/scheduler/agent_task.py
35d661e09666d315325f8942d06949ca7283666f 26-Sep-2014 MK Ryu <mkryu@google.com> [autotest] Integrate crashlog collection into repair workflow.

When a DUT goes offline before logs are gathered, we lose those
logs if the DUT is re-imaged.
To grab such logs as much as we can, we integrate crashlog
collection into the repair workflow.

BUG=chromium:215160
TEST=./server/autoserv -R -m <DUT ip> -r ~/tmp/repair
CQ-DEPEND=CL:221510

Change-Id: Ifd562bfd539b133381572aeec503d9a3940ab448
Reviewed-on: https://chromium-review.googlesource.com/219999
Reviewed-by: Fang Deng <fdeng@chromium.org>
Commit-Queue: Mungyung Ryu <mkryu@google.com>
Tested-by: Mungyung Ryu <mkryu@google.com>
/external/autotest/scheduler/agent_task.py
7cf3d84fda609f6402543bb7e0bf3e3b7f93d539 13-Aug-2014 Dan Shi <dshi@chromium.org> [autotest] Record more metadata to include more job related information.

For host history rpc to return more info like job name/owner, we added a new
attribute metadata_info to host object. metadata_info is a dictionary
containing information such as task_id, task_name, job_id, job_name,
parent_job_id.
When host status is changed, metadata_info will be reported to metaDB.

Examples of metadata_info are:

{"hostname": "192.96.48.88", "task_name": "Verify", "task_id": 6551}
{"job_name": "dummy_pass", "hostname": "192.96.48.88", "task_name": "Reset", "task_id": 6552, "job_id": 4133, "parent_job_id": 4132}
{'owner': 'debug_user', 'parent_job_id': null, 'job_id': 4140, 'job_name': 'dummy_pass'}

BUG=chromium:394451
TEST=local setup,
site_utils/host_history.py --hosts 100.96.48.196
test output with visiting page: http://172.25.61.45:9200/_plugin/elastic-hammer/
Enter following in filter, then click search to see results.
{"query": {"bool": {"minimum_should_match": 3,
"should": [{"term": {"_type": "host_history"}},
{"term": {"hostname": "100.96.48.196"}},
{"range": {"time_recorded": {"gte": 1408121317,
"lte": 1409007215}}}]}},
"size": 10000,
"sort": [{"time_recorded": "asc"}]}

Change-Id: Icddc27fb39529924d0030dbec97176a2d8b683fc
Reviewed-on: https://chromium-review.googlesource.com/212304
Reviewed-by: Dan Shi <dshi@chromium.org>
Tested-by: Dan Shi <dshi@chromium.org>
Commit-Queue: Dan Shi <dshi@chromium.org>
/external/autotest/scheduler/agent_task.py
36accc6a2a572e9d502407b34701f535a169f524 23-Jul-2014 Jakob Jülich <jakobjuelich@google.com> [autotest] Fixing and re-enabling monitor_db_functional_test.

The test was disabled and outdated. Database access and mocking of the drone
manager changed. This fixes these issues, updates the unit tests to the
current status and reanables them.

BUG=chromium:395756
DEPLOY=scheduler
TEST=ran ./utils/unittest_suite.py

Change-Id: I6a3eda5ddfaf07f06d6b403692b004b22939ffb6
Reviewed-on: https://chromium-review.googlesource.com/209567
Reviewed-by: Alex Miller <milleral@chromium.org>
Tested-by: Jakob Jülich <jakobjuelich@google.com>
Commit-Queue: Jakob Jülich <jakobjuelich@google.com>
/external/autotest/scheduler/agent_task.py
04be2bd5e4666a5c253e9c30ab20555e04286032 08-May-2014 Ilja H. Friedel <ihf@chromium.org> Autotest: Change logging.warn() to logging.warning().

logging.warn() is deprecated. See
http://bugs.python.org/issue13235

Substitution was performed via
~/cros/src/third_party/autotest/files$ find ./ -type f | xargs sed -i 's/logging.warn(/logging.warning(/'

BUG=None.
TEST=There should be one-- and preferably only one --obvious way to do it.

Change-Id: Ie5665743121a49f7fbd5d1f47896a7c65e87e489
Reviewed-on: https://chromium-review.googlesource.com/198793
Commit-Queue: Ilja Friedel <ihf@chromium.org>
Tested-by: Ilja Friedel <ihf@chromium.org>
Reviewed-by: Alex Miller <milleral@chromium.org>
/external/autotest/scheduler/agent_task.py
ec21225c11b0983b563c24bb71828f5bb6bbcaee 01-Mar-2014 Alex Miller <milleral@chromium.org> [autotest] Feed job labels from the scheduler to autoserv.

All job labels now get passed into reset, verify, cleanup, provision,
and repair. Everything bug provision can run standalone, and thus
passing the job labels needs to be optional for those.

BUG=chromium:334418
DEPLOY=scheduler
TEST=special tasks run fine, scheduler shows autoserv being invoked
correctly

Change-Id: I524cc8441e654685e50c935fb1d55cf87e8a2f73
Reviewed-on: https://chromium-review.googlesource.com/188455
Reviewed-by: Alex Miller <milleral@chromium.org>
Tested-by: Alex Miller <milleral@chromium.org>
Commit-Queue: Alex Miller <milleral@chromium.org>
/external/autotest/scheduler/agent_task.py
cc9fc70587d37775673e47b3dcb4d6ded0c6dcb4 02-Dec-2013 beeps <beeps@chromium.org> [autotest] RDB Refactor II + Request/Response API.

Scheduler Refactor:
1. Batched processing of jobs.
2. Rdb hits the database instead of going through host_scheduler.
3. Migration to add a leased column.The scheduler released hosts
every tick, back to the rdb.
4. Client rdb host that queue_entries use to track a host, instead
of a database model.

Establishes a basic request/response api for the rdb:
rdb_utils:
1. Requests: Assert the format and fields of some basic request types.
2. Helper client/server modules to communicate with the rdb.
rdb_lib:
1. Request managers for rdb methods:
a. Match request-response
b. Abstract the batching of requests.
2. JobQueryManager: Regulates database access for job information.
rdb:
1. QueryManagers: Regulate database access
2. RequestHandlers: Use query managers to get things done.
3. Dispatchers: Send incoming requests to the appropriate handlers.
Ignores wire formats.

TEST=unittests, functional verification.
BUG=chromium:314081, chromium:314083, chromium:314084
DEPLOY=scheduler, migrate

Change-Id: Id174c663c6e78295d365142751053eae4023116d
Reviewed-on: https://chromium-review.googlesource.com/183385
Reviewed-by: Prashanth B <beeps@chromium.org>
Commit-Queue: Prashanth B <beeps@chromium.org>
Tested-by: Prashanth B <beeps@chromium.org>
/external/autotest/scheduler/agent_task.py
5e2bb4aa28611aaacaa8798fd07943ede1df46c6 28-Oct-2013 beeps <beeps@chromium.org> [autotest] Scheduler refactor.

Break scheduler into simpler modules.
This change also modifies run_pylint to check for undefined variables.

BUG=chromium:312338
TEST=Ran smoke suite against multiple duts.
Triggered agents like repair, verify etc. Pylint, Unittests.
DEPLOY=scheduler

Change-Id: Ibd685a27b5b50abd26cdf2976ac4189c3e9acc0a
Reviewed-on: https://chromium-review.googlesource.com/174080
Commit-Queue: Prashanth B <beeps@chromium.org>
Tested-by: Prashanth B <beeps@chromium.org>
Reviewed-by: Alex Miller <milleral@chromium.org>
/external/autotest/scheduler/agent_task.py