Difference: BLAHWorkPlan (1 vs. 9)

Revision 92011-02-24 - AlessioGianelle

Line: 1 to 1
Changed:
<
<
META TOPICPARENT name="TestWokPlan"
>
>
META TOPICPARENT name="TestPage"
 

BLAH Test suite

The blah test suite is made up of two different set of testing scripts, written in python and shell scripting: one is to perform functionality testing and the other one to perform stress testing. Following is a more detailed description of the scripts and the testing workplan.

Revision 82008-12-11 - ElisabettaMolinari

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

BLAH Test suite

The blah test suite is made up of two different set of testing scripts, written in python and shell scripting: one is to perform functionality testing and the other one to perform stress testing. Following is a more detailed description of the scripts and the testing workplan.
Line: 41 to 41
  It could be improved so that a batch system is not a requirement for testing blah. For such purpose some fake scripts that simulate the behaviour of the _submit.sh, _resume.sh, _status.sh, _cancel.sh scripts should be developed, they would be then called by blah but would not actually send any command to the batch system.
Added:
>
>
  • Create other types of jobs besides the 'DEFAULT' and 'HOLDRELEASE' ones already defined in the testsuite and perform stress testing with them
  -- ElisabettaMolinari - 20 Jun 2008

Revision 72008-12-11 - ElisabettaMolinari

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

BLAH Test suite

The blah test suite is made up of two different set of testing scripts, written in python and shell scripting: one is to perform functionality testing and the other one to perform stress testing. Following is a more detailed description of the scripts and the testing workplan.
Line: 9 to 9
 A set of functionality testing scripts written in python is described here: https://twiki.cern.ch/twiki/bin/view/LCG/AvailableTests#Batch_Local_Ascii_Helper_BLAH
Changed:
<
<
They perform testing on the basic BLAH functionalities
>
>
They perform testing on the basic BLAH functionalities: BLAH_JOB_SUBMIT, BLAH_JOB_CANCEL, BLAH_JOB_HOLD, BLAH_JOB_RESUME, BLAH_JOB_STATUS, BLAH_JOB_REFRESH_PROXY
 

Stress testing

The scripts can be found at http://jra1mw.cvs.cern.ch:8180/cgi-bin/jra1mw.cgi/org.glite.testsuites.ctb/BLAH/tests/shell/
Line: 33 to 33
 
  • Perform consecutive submission of simple jobs of type 'HOLDRELEASE', that print systime sleep for 300 sec and print systime again, issuing hold resume commands periodically

Added:
>
>

Hints for future work

All the testing scripts described above can be considered as a basis for testers of the BLAH component. They cover basic testing scenarios and can be integrated with further testing scripts covering more use cases. Following some additional use cases and testing scenarios for which blah testing scripts are missing:

  • The current testsuite requires a batch system running, such as lsf, pbs, etc.. where blah can submits jobs to. It could be improved so that a batch system is not a requirement for testing blah. For such purpose some fake scripts that simulate the behaviour of the _submit.sh, _resume.sh, _status.sh, _cancel.sh scripts should be developed, they would be then called by blah but would not actually send any command to the batch system.
  -- ElisabettaMolinari - 20 Jun 2008 \ No newline at end of file

Revision 62008-12-04 - ElisabettaMolinari

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

BLAH Test suite

The blah test suite is made up of two different set of testing scripts, written in python and shell scripting: one is to perform functionality testing and the other one to perform stress testing. Following is a more detailed description of the scripts and the testing workplan.
Line: 18 to 18
 They have to be run on the same machine where BLAH and the local batch system are running, under the user dir for which a valid user proxy is owned, say for ex. '/home/dteam001' Following the common files of the testsuite and short descriptions, they all have to be present in the user home dir that is running the testsuite together with a valid user proxy to be copied in the subdir 'test_job'
Changed:
<
<
  • blah_test.conf --> this file contains default values for the mandatory variables needed by the testsuite
>
>
  • blah_test.conf --> this file contains default values for the mandatory variables needed by the testsuite. Among others the user can select the batch system type (like for ex. lsf, pbs, condor, etc..), the queue and the number of jobs to be submitted.
 
  • functions.sh --> set of common functions used by the testsuite, like for ex. creating the classad to be submitted to blah

Revision 52008-12-02 - ElisabettaMolinari

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

BLAH Test suite

The blah test suite is made up of two different set of testing scripts, written in python and shell scripting: one is to perform functionality testing and the other one to perform stress testing. Following is a more detailed description of the scripts and the testing workplan.

Revision 42008-11-28 - ElisabettaMolinari

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"
Added:
>
>

BLAH Test suite

The blah test suite is made up of two different set of testing scripts, written in python and shell scripting: one is to perform functionality testing and the other one to perform stress testing. Following is a more detailed description of the scripts and the testing workplan.

Developers: Elisabetta Molinari, Francesco Prelz

 

Functionality testing

A set of functionality testing scripts written in python is described here: https://twiki.cern.ch/twiki/bin/view/LCG/AvailableTests#Batch_Local_Ascii_Helper_BLAH
Added:
>
>
They perform testing on the basic BLAH functionalities
 

Stress testing

Changed:
<
<
A set of bash testing scripts to exercise the blah daemon by submitting and monitoring jobs have been developed and committed here http://jra1mw.cvs.cern.ch:8180/cgi-bin/jra1mw.cgi/org.glite.testsuites.ctb/BLAH/tests/
  • blah_exerciser_submit.sh:
  • blah_exerciser_holdrelease.sh
>
>
The scripts can be found at http://jra1mw.cvs.cern.ch:8180/cgi-bin/jra1mw.cgi/org.glite.testsuites.ctb/BLAH/tests/shell/

The main objective of this set of scripts is to perform stress testing of the blah component, by submitting and monitoring jobs via BLAH to the local batch system. They have to be run on the same machine where BLAH and the local batch system are running, under the user dir for which a valid user proxy is owned, say for ex. '/home/dteam001' Following the common files of the testsuite and short descriptions, they all have to be present in the user home dir that is running the testsuite together with a valid user proxy to be copied in the subdir 'test_job'

  • blah_test.conf --> this file contains default values for the mandatory variables needed by the testsuite

  • functions.sh --> set of common functions used by the testsuite, like for ex. creating the classad to be submitted to blah

Stress testing using 'blah_exerciser_submit.sh':

  • Perform consecutive submission of simple jobs of type 'DEFAULT', that do a sleep of 10sec on the worker node, monitor them and prints out the submission and completion times

Stress testing using 'blah_exerciser_holdrelease.sh'

This script calls another one, 'blah_exerciser_holdrelease_test.sh' that performs perodic hold release of the submitted jobs

  • Perform consecutive submission of simple jobs of type 'HOLDRELEASE', that print systime sleep for 300 sec and print systime again, issuing hold resume commands periodically

  -- ElisabettaMolinari - 20 Jun 2008

Revision 32008-11-28 - ElisabettaMolinari

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"
Changed:
<
<
Here's a reference to the testsuite written in python:
>
>

Functionality testing

A set of functionality testing scripts written in python is described here:
 https://twiki.cern.ch/twiki/bin/view/LCG/AvailableTests#Batch_Local_Ascii_Helper_BLAH
Changed:
<
<
Also a set of bash scripts for testing blah will be available, work on it is in progress.
>
>

Stress testing

A set of bash testing scripts to exercise the blah daemon by submitting and monitoring jobs have been developed and committed here http://jra1mw.cvs.cern.ch:8180/cgi-bin/jra1mw.cgi/org.glite.testsuites.ctb/BLAH/tests/
  • blah_exerciser_submit.sh:
  • blah_exerciser_holdrelease.sh
  -- ElisabettaMolinari - 20 Jun 2008

Revision 22008-10-24 - ElisabettaMolinari

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"
Added:
>
>
Here's a reference to the testsuite written in python: https://twiki.cern.ch/twiki/bin/view/LCG/AvailableTests#Batch_Local_Ascii_Helper_BLAH
 
Changed:
<
<
>
>
Also a set of bash scripts for testing blah will be available, work on it is in progress.
 

-- ElisabettaMolinari - 20 Jun 2008 \ No newline at end of file

Revision 12008-06-20 - ElisabettaMolinari

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="TestWokPlan"

-- ElisabettaMolinari - 20 Jun 2008

 
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback