Test Suite Runner

In order to streamline the Scooby/Cosmo testing process I have created a shell script where tests can be added to the suite as they are created. This way instead of running one at a time, all of the current important tests for Scooby/Cosmo can be ran and then all of the output examined at one time, and this way we are sure not to overlook any of the tests or their output.

#Suite for running mutliple tests
#!/bin/bash

echo "---Running Test Suite----"
echo "Running test 1: Calendar Stress Test Recurrence 100"
python TESTRunner.py file=scoobyCalendarStress.py classname=scoobyCalendarStress recurrence=100 debug=0
 echo "Running test 2: Multiple Adding and Removing of Events, Recurrence 100"
python TESTRunner.py file=scoobyMultiAddRemEventsTest.py classname=scoobyMultiAddRemEventsTest recurrence=100 debug=0
 echo "Running test 3: Multiple Events, Recurrence 100"
python TESTRunner.py file=scoobyMultipleEventsTest.py classname=scoobyMultipleEventsTest recurrence=100 debug=0 
echo "Running test 3: Multiple events and Status Changes, Recurrence 100"
python TESTRunner.py file=scoobyStatusTest.py classname=scoobyStatusTest recurrence=100 debug=0 


echo "---Ended Test Suite---"

exit

As a new test is written a the test will be echoed, followed by the python command to run that test.

To take all of the output we can use the shell:

adam$ sh runSuite.sh > SuiteOutput^?.txt

Example of the output when debug level is 0:
(if debug is set higher in the tests the output will contain much more detail)

adam$ sh runScoobySuite.sh 
---Running Scooby Suite----
Running test 1: Calendar Stress Test Recurrence 100
 startingTest Setup Accounts
 Failure :: Test Status Code Check on 201 :: expected 201 ; received 204
 Recurrences :: 100
 Failures :: 1
 Passes :: 202
 Total tests run :: 203
 Running test 2: Multiple Adding and Removing of Events, Recurrence 100
 startingTest Setup Accounts
 Failure :: Test Status Code Check on 201 :: expected 201 ; received 204
 Failure :: Test verifyListInResponse :: None,['error']
Recurrences :: 100
 Failures :: 2
 Passes :: 202
 Total tests run :: 204
 Running test 3: Multiple Events, Recurrence 100
 startingTest Setup Accounts
 Failure :: Test Status Code Check on 201 :: expected 201 ; received 204
 Failure :: Test verifyListInResponse :: None,['error']
Recurrences :: 100
 Failures :: 2
 Passes :: 102
 Total tests run :: 104
 Running test 3: Multiple events and Status Changes, Recurrence 100
 startingTest Setup Accounts
 Failure :: Test Status Code Check on 201 :: expected 201 ; received 204
 Failure :: Test verifyListInResponse :: None,['error']
Recurrences :: 100
 Failures :: 2
 Passes :: 302
 Total tests run :: 304
---Ended Test Suite---