Chandler Wiki : Chandler Automated Test System

Product | Planning | Teams | Developers | Notes

r30 - 12 Sep 2007 - 14:41:03 - AparnaKadakiaYou are here: OSAF > Projects Web > QualityAssuranceTeam > ChandlerAutomatedTestSystem

---+ Chandler Automated Test System (CATS)

Chandler Automated Test System (CATS) is a test framework built to write and execute python test cases for Chandler.

The framework uses CPIAScript for script execution but CATS has additional libraries built into it. The first library we built is =<nop>QAUITestAppLib= which encapsulates all the methods related to UI actions in Chandler. For instance, creating a new event, note, mail or task, filing in the title field, filing in the accounts dialog etc... It also has methods to verify data by going through the Chandler detail view as well as checking data in the repository. =<nop>QAUITestAppLib= removes the complexity from the test case so test development is easy. Some of the design points of the new framework are:

   * Test script is isolated from application change by abstracting the methods in =<nop>QAUITestAppLib=.
   * Framework provides concept of test suite and test scripts.
   * Framework supports local test development and execution as well as test suite execution
   * Framework supports test script level reporting as well as test suite summary report.

<img src="%ATTACHURLPATH%/CatsArchitecture.jpg" alt="CatsArchitecture.jpg"  width="508" height="391"  />

   * Sample test script : CreateNoteTestScript
   * Sample output from a testscript run: TestScriptOutput

We have also added a logging mechanism that logs the output of the test results as well as timing information for the various UI actions. The logger also summarises the results of multiple test runs at the end of the report.

---++ Where CATS live
All the CATS libraries and scripts reside under =chandler/tools=. The test scripts are under =chandler/tools/QATestScripts=.

To add additional testscripts you would need to check out the chandler sources in read/write mode. e.g.:
<pre class=xml>svn co svn+ssh://svn.osafoundation.org/svn/chandler/trunk chandler</pre>
   
For additional information on checking out sources, please refer to the [[http://wiki.osafoundation.org/bin/view/Projects/SubversionGuidelines][following page]]. In addition to this you will also need write privileges to the qa repository in svn. Please contact me for the above.

---++ Running CATS
   * Define a =CATSREPORTDIR= environement variable to give the path where you want to save the report files.<br />
       The default value is your Chandler directory.
   * Set the =PARCELPATH= environment variable to point to the cert parcel so you won't be prompted with the 'Do you want to trust this certificate' dialog. You can set the =PARCELPATH= to point to =$CHANDLERHOME/tools/QATestScripts/DataFiles= where a cert parcel is already checked in. Go to the Chandler directory and run CATS with the following command. On Linux and Mac:
<pre class=xml>cd $CHANDLERHOME
release/RunChandler --create --stderr -f tools/QATestScripts/Functional/TestNewEvent.py</pre> 
or 
<pre class=xml>release/RunChandler --create --stderr --scriptFile=tools/QATestScripts/Functional/TestNewEvent.py</pre> 
On Windows:
<pre class=xml>cd $CHANDLERHOME
./release/RunChandler.bat --create --stderr -f `cygpath -w tools/QATestScripts/Performance/PerfStampEvent.py`</pre> 
or 
<pre class=xml>./release/RunChandler.bat --create --stderr --scriptFile=`cygpath -w tools/QATestScripts/Performance/PerfStampEvent.py`</pre>
   * Alternately, you can also run the test scripts using the =do_tests.sh= script. This will over-ride your personal =PARCELPATH= environment variable and adds OSAF CA certificates to the repository. It will also run the test using Chandler debug then release (so it runs the test twice).
<pre class=xml>cd $CHANDLERHOME
tools/do_tests.sh -f</pre>
to run the entire functional test suite or
<pre class=xml>tools/do_tests.sh -p</pre>
to run the entire performance test suite or 
<pre class=xml>tools/do_tests.sh -t TestNewEvent.py</pre>
to run individual tests.

---++ Performance Tests
   A subset of performance tests as identified on the [[PerformanceProject][performance project]] page have been automated using CATS test scripts. They reside under =chandler/tools/QATestScripts/Performance=. The data files used by these scripts are checked in under =qa/tools/QATestScripts/DataFiles=.
    
---++ Documentation

   <img src="%ATTACHURLPATH%/archi-cats-dir.jpg" alt="archi-cats-dir.jpg"/>

   * [[Journal.OlivierGiroussensTestScriptsDescription][Test scripts description]]

---++ Next Generation Ideas

   * Projects.ChandlerAutomatedTestSystemThree (CATS 3)
      * Projects.ChandlerAutomatedTestSystemZeroPointTwo (CATS 0.2)
      * Projects.ChandlerAutomatedTestToDoList
      * Projects.WritingChandlerAutomatedTestsWithCATSZeroPointTwo
      * Projects.RunningChandlerTests 
      * Projects.TestIssuesAndProjects

Show attachments

Hide attachments

Topic attachments
I	Attachment	Action	Size	Date	Who	Comment
graffle	New-cats-archi.graffle	manage	38.2 K	31 Mar 2006 - 00:58	OlivierGiroussens

chandlerproject.org

VISION
TOUR

Download Desktop
Get a Hub Account
Get Chandler Server

FAQ
Get Started

Blog
Mailing Lists
Chat on IRC

Report a Bug
Get Involved

OSAF Community
About OSAF

Projects Wiki Changes

Open Source Applications Foundation

Except where otherwise noted, this site and its content are licensed by OSAF under an Creative Commons License, Attribution Only 3.0.
See list of page contributors for attributions.