testing - Looking for "test execution manager" software to manage automated tests -


we develop several products , have extensive unit-tests , automated functional tests them. problem tests don't run frequently, manually developer or before shipping new version.

i'm looking "test execution manager" software allow:

  • defining test suites collection of existing tests ;
  • executing test suites on multiple machines in our test lab ;
  • collecting results , presenting them nicely ;
  • preserve test execution history , results

most "testing solutions" i've found concentrate on "writing automated tests" (which have working) or closely integrate other aspects of software development, defining requirements , filing bugs (which have , don't want change).

  • can recommend simple , flexible software above without forcing specific development processes?
  • i though on using (or abusing) hudson ci this. hudson can run tests, collect results , present them, both periodically or due code commit; not designed test suite definition. input experienced hudson users on idea appreciated..

first of all, our developers not allowed check in code without running unit tests. run ci server (hudson), builds after commit , runs unit tests. working on getting functional tests implemented nightly builds.

you said developers test software? bad thing. @ least let developer not familiar code test app otherwise overlook bugs, because existence ruled out developer writing code. additionally, writes functional tests? developers again? should ba's write them. remember, 4 eyes see more two.

so after said, assume, unit tests, run before code checked scm. following targeted @ functional tests.

simple solution:

  • you can create scripts bundle tests (batch or shell script runs individual test).
  • executing of test suites 1 of purposes of hudson
  • collecting , presenting results, hudson for
  • see above, can done hudson, without abusing it.

a solution:

did @ tools ibm rational quality manager? depending on test tools use, might want use test management tool different one. oracle offers tool it. don't mistaken these tools can expensive , offer way more want use. little bit google should find suits needs. keywords "centralized test management".

in case use fitnesse functional test. can define suites in fitnesse , think suite can part of larger suite. fitnesse keeps historic test data. test can run command line enables run tests ant or maven.

if use unit test framework functional testing can run them part of nightly build , schedule using ci server (hudson or cruise control or ...)


Comments

Popular posts from this blog

android - Spacing between the stars of a rating bar? -

aspxgridview - Devexpress grid - header filter does not work if column is initially hidden -

c# - How to execute a particular part of code asynchronously in a class -