History log of /external/vogar/src/vogar/target/TestRunner.java
Revision Date Author Comments (<<< Hide modified files) (Show modified files >>>)
cef780b87ae30112756d40ea3c639a1660fd7c29 26-Feb-2015 Nicolas Geoffray <ngeoffray@google.com> Add a --test-only option to Vogar.

Option disables running caliper and classes with main.

Change-Id: I5fa5221bc9842dffd1b1f676751b0b892b876449
/external/vogar/src/vogar/target/TestRunner.java
edcbbe19c10582d415cf2206eee72e32472e6ed6 07-Jul-2011 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Adjust the built-in Android profiler's expected API to match the current implementation.

git-svn-id: http://vogar.googlecode.com/svn/trunk@258 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
bd8bda78cc5740aeae8de67b52f1d86e208f4864 07-Mar-2011 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Use our own minimal JUnit instead of the full framework. This permits us to create test instances lazily and dispose of them eagerly.

git-svn-id: http://vogar.googlecode.com/svn/trunk@238 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
b5c5c44d0c0a01c278cdac68ae23646682eb8ef7 19-Dec-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Inject the log rather than looking it up statically. This is needed for other apps that want to reuse the ExpectationStore but not the rest of Vogar!

git-svn-id: http://vogar.googlecode.com/svn/trunk@219 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
1d793b53e7df1780e48e2819d204f51c7d4a59af 15-Dec-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Force an exit. Threads spawned by tests shouldn't keep the test runner process alive.

git-svn-id: http://vogar.googlecode.com/svn/trunk@214 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
3cea2f55f3da60eb0c4bdd1616cbfa964ee2cd91 02-Dec-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Fix skipPast so that it's honored across test classes.

git-svn-id: http://vogar.googlecode.com/svn/trunk@210 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
5f9e5b96aaea17c60c82f11b8933d00ff52b5a85 02-Dec-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Name main classes by their class name, not the action name. Otherwise it's ambiguous when many main methods are run from a single .jar.

git-svn-id: http://vogar.googlecode.com/svn/trunk@209 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
a20d57c3defdf4faad67b052e29aaa8be099cae6 01-Dec-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Don't report completed normally until all of the test classes have completed normally. We were short circuiting too early when vogar was run with a package name.

git-svn-id: http://vogar.googlecode.com/svn/trunk@207 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
6fa1029b5a60514952d707a51253f5929628a4ec 02-Nov-2010 bdc@google.com <bdc@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Profiler improvements for JUnit

Pushed Profiler instance down to Runner.run to allow better
intergration with Runner implementations. Primary goal was to allow
JUnitRunner profiling of separate test thread.

src/vogar/target/Runner.java
src/vogar/target/JUnitRunner.java
src/vogar/target/JUnit4Runner.java
src/vogar/target/CaliperRunner.java
src/vogar/target/TestRunner.java
src/vogar/target/MainRunner.java

Change Profiler API to allow start/stop around individual tests, with
setup/shutdown at overall. In single thread profiling mode,
AndroidProfiler now changes the thread based to the current thread
before starting, again for improve JUnitRunner behavior.

src/vogar/target/Profiler.java
src/vogar/android/AndroidProfiler.java



git-svn-id: http://vogar.googlecode.com/svn/trunk@196 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
1bdeb9dd8f1ab3f308c285729af007ae8970425b 29-Oct-2010 bdc@google.com <bdc@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> vogar --profile support

From the vogar usage message:
--profile: run with a profiler to produce an ASCII hprof file.

--profile-file <filename>: filename for hprof profile data.
Default is: java.hprof.txt

--profile-depth <count>: number of frames in profile stack traces.
Default is: 4

--profile-interval <milliseconds>: interval between profile samples.
Default is: 10

--profile-thread-group: profile thread group instead of single thread in dalvikvms
Note --mode jvm only supports full VM profiling.
Default is: false

New command line arguments parsing and usage:
src/vogar/Vogar.java

For the RI, we pass the profile arguments via -agentlib:hprof
src/vogar/JavaVm.java

TestRunner now uses the new Profiler class. Also removed
unnecessary args argument from run methods.
src/vogar/target/TestRunner.java

New abstract Profiler class and its Android implementation. When
running on the RI, hprof is used outside of the TargetRunner.
Because SamplingProfiler is not a public class, it is accessed via
reflection from AndroidProfiler.
src/vogar/target/Profiler.java
src/vogar/android/AndroidProfiler.java

New TestProperties for profiler options
src/vogar/Mode.java
src/vogar/TestProperties.java

Retrieve the profiler output in the dalvikvm
src/vogar/RetrievedFilesFilter.java

Runner.init now takes profile so that Caliper can know to run with --debug
src/vogar/target/Runner.java
src/vogar/target/CaliperRunner.java
src/vogar/target/JUnitRunner.java
src/vogar/target/JUnit4Runner.java
src/vogar/target/MainRunner.java

javadoc correction
src/vogar/android/EnvironmentDevice.java
src/vogar/EnvironmentHost.java

Caliper revision 253
lib/caliper.jar

http://code.google.com/p/vogar/issues/detail?id=16



git-svn-id: http://vogar.googlecode.com/svn/trunk@194 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
ee67ab77cdaa11c37318aa01c22b7b1cb88c914c 28-Oct-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Fixing vogar to cleanup after itself when parsing properties.

git-svn-id: http://vogar.googlecode.com/svn/trunk@192 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
3cc430f91313dab5074cffa6508c0b47cd9f2b50 25-Oct-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Sort tests. Kill the target process if there's a timeout.

The target process has a new flag --skipPast.

git-svn-id: http://vogar.googlecode.com/svn/trunk@191 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
dbd85addb4e44255c4296b82d3ca45ad33a56649 16-Oct-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Fixed activity mode. Vogar will use stdout/stderr by default, and a socket when that's not possible.

git-svn-id: http://vogar.googlecode.com/svn/trunk@179 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
693bab6f249797311a9c4bcd4c9d9c7cfd5ae8d3 16-Oct-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Change how host + target processes communicate.

It used to read XML over a socket. This was robust but omitted native output to stdout and stderr.

Now it reads JSON over stdout. The socket code is still in place (but not currently used) because this change breaks activity mode. I'll do that as a follow up commit.

git-svn-id: http://vogar.googlecode.com/svn/trunk@178 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
84f59696573fe05a50e77832ee26c5abde46fa9e 29-Sep-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Use a pristine environment during class init.

See issue 38.

git-svn-id: http://vogar.googlecode.com/svn/trunk@171 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
3b87953e156bf57511664a32ed95bcedb8131e0d 22-Sep-2010 dominicc@google.com <dominicc@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Adds JUnit 4 support. Adds unit tests for running JUnit tests.

For <mailto:kazuu@google.com>.



git-svn-id: http://vogar.googlecode.com/svn/trunk@159 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
e5dfbecbaa8568c2885a4cb859c8afa8b6a08d5b 21-Aug-2010 jsharpe@google.com <jsharpe@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Three changes: -Xdexopt:none for dalvikvm when performance doesn't matter (i.e. no --benchmark flag), dex everything together when performance does matter (i.e. with --benchmark flag) (and enforce this for Caliper benchmarks), and a tiny formatting change that happened to be in my sandbox.

git-svn-id: http://vogar.googlecode.com/svn/trunk@149 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
8a9cc00a0d2c02483690de28eabe2b60b5804538 03-Aug-2010 jsharpe@google.com <jsharpe@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Print native output if --native-output flag is set. This helps with valgrind. Currently no attempt is made to line up native output with non-native output, so a bit of work must be done by the user to figure out which native output corresponds to which non-native output.

git-svn-id: http://vogar.googlecode.com/svn/trunk@142 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
3c513c52be35990697865d1ad171378565cae1f0 30-Jul-2010 jsharpe@google.com <jsharpe@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Dedupe tests by excluding AllTests when running a package of tests. Allow monitors to write unstructured output for debugging purposes.

git-svn-id: http://vogar.googlecode.com/svn/trunk@139 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
c68971a68a4f7fe5a58ca0f59161bb44fcf2833d 22-Jul-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Refactoring how monitors work to make custom monitors possible.

git-svn-id: http://vogar.googlecode.com/svn/trunk@136 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
37f7c3a73d290eed1bf4cdff80e029eaa7620801 22-Jul-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Extract an interface for monitors; and permit the environments to supply custom monitors.

git-svn-id: http://vogar.googlecode.com/svn/trunk@134 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
6057a96a66bce2a30ceceb2fbb0d41bbc04a05f0 30-Jun-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Forward arguments to the target process.

git-svn-id: http://vogar.googlecode.com/svn/trunk@115 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
fcd851661001aec3c2c0db3a72f20c30c934ae44 17-Jun-2010 bjdodson@google.com <bjdodson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Removed timeout for benchmarks

git-svn-id: http://vogar.googlecode.com/svn/trunk@95 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
5884b0e6bc3eec46f4a374254626a14d128179fa 16-Jun-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Run tests in parallel whenever --no-stream is specified.

git-svn-id: http://vogar.googlecode.com/svn/trunk@90 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
8c03f5a6370cf6521384a268e12808e163ae4339 25-May-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Adding tags to expectations and a 'large' tag for extending the timeout by 10x. The motivation here is to permit some additional jtreg tests to run to completion; particularly those like EnumSetBash that run a while.


git-svn-id: http://vogar.googlecode.com/svn/trunk@76 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
72c9585a2c7535a2a847b8c316d28d875582dc09 21-May-2010 jsharpe@google.com <jsharpe@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Add the ability to append "#method_name" when specifying junit test classes. It will then just run the specified method, rather every test method in the class.

git-svn-id: http://vogar.googlecode.com/svn/trunk@68 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
638d42932a6aca6ddb0454674dc20b96e68faf32 19-May-2010 enh@google.com <enh@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> src/vogar/target/CaliperRunner.java:
src/vogar/target/MainRunner.java:
src/vogar/target/Runner.java:
src/vogar/target/TestRunner.java: say "timeoutSeconds" instead of "timeout" where possible.


git-svn-id: http://vogar.googlecode.com/svn/trunk@64 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
d296ba8af13d367b4a701ddeba405ee51caa05c1 19-May-2010 enh@google.com <enh@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> src/vogar/commands/AndroidSdk.java:
src/vogar/commands/Command.java:
src/vogar/Driver.java:
src/vogar/Mode.java:
src/vogar/target/CaliperRunner.java:
src/vogar/target/JUnitRunner.java:
src/vogar/target/MainRunner.java:
src/vogar/target/Runner.java:
src/vogar/target/TestRunner.java:
src/vogar/TestProperties.java:
src/vogar/Vogar.java: pass --timeout through to the JunitRunner. This isn't sufficient; try "~dalvik-prebuild/bin/run-harmony-tests --timeout 10 org.apache.harmony.nio_char.tests.java.nio.charset.AllTests tests.api.java.nio.charset.AllTests", for example. We still end up skipping a lot of tests, and when we time out, we get "Received bad XML from localhost:8787 org.xml.sax.SAXParseException: XML document structures must start and end within the same entity.".


git-svn-id: http://vogar.googlecode.com/svn/trunk@62 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
127e44af6f749f1dcc027958501c0e62f44cde5c 19-May-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Actually fixing lost newlines on --mode host


git-svn-id: http://vogar.googlecode.com/svn/trunk@59 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
1d4fef707a383dc57285e6608ca290be48811a85 19-May-2010 jsharpe@google.com <jsharpe@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Skip tests that for which we can't find a runner. Add new yellow output for skipped tests. This fixes an illegal argument exception that would come up in this case previously.

git-svn-id: http://vogar.googlecode.com/svn/trunk@57 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
a7a8fe1efa0fb3299d68709d60701a045bcc72f3 13-May-2010 jsharpe@google.com <jsharpe@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Add class analysis so that we no longer rely on file names to determine which type of test to run (e.g. junit, caliper, etc). This decision is also now made on the device side.

As a result cleaned up the RunnerSpec classes, which are no longer required.

git-svn-id: http://vogar.googlecode.com/svn/trunk@53 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
c1808e2e978c6f96aacee728d39e1fc6eaad766e 29-Apr-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Avoid passing null output into the XML serializer!

git-svn-id: http://vogar.googlecode.com/svn/trunk@41 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
400bee347dd7464ecc17dc24c82f59c59645ff44 27-Apr-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Changing vogar to accept package names like org.json, which will cause it to run all tests in that package on its classpath.

Removing the last traces of java.util.logging. We now have only two granularities: verbose (not kept by default) and info (always kept).

Giving up on trying to identify an argument's type by its value. To specify arguments to the target process, list them after the actions with a --.

git-svn-id: http://vogar.googlecode.com/svn/trunk@31 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java
7850f3f3da0099b76f09ed64d23e0a43ba4a5c76 23-Apr-2010 jessewilson@google.com <jessewilson@google.com@aa685c63-decc-881d-cd2b-7fa72aad72e1> Initial checkin of vogar!


git-svn-id: http://vogar.googlecode.com/svn/trunk@2 aa685c63-decc-881d-cd2b-7fa72aad72e1
/external/vogar/src/vogar/target/TestRunner.java