Difference: WMSWorkPlan (1 vs. 10)

Revision 102011-04-27 - AlessioGianelle

Line: 1 to 1
 
META TOPICPARENT name="TestPage"
Line: 255 to 255
 

WMS-prologue-epilogue.sh

Changed:
<
<
Test jdl's attributes Prologue (PrologueArguments) and Epilogue (EpilogueArguments).
>
>
Test jdl's attributes Prologue (PrologueArguments) and Epilogue (EpilogueArguments).
 Success means that job has been correctly submitted, and that at the end output files are correctly retrieved. Then some checks are done on the output files written by the prologue, the executable and the epilogue scripts.

Revision 92011-03-28 - AlessioGianelle

Line: 1 to 1
 
META TOPICPARENT name="TestPage"
Line: 253 to 253
 
  • bug #79308 parameters should not be negative (SegFault)
Added:
>
>

WMS-prologue-epilogue.sh

 
Changed:
<
<
>
>
Test jdl's attributes Prologue (PrologueArguments) and Epilogue (EpilogueArguments). Success means that job has been correctly submitted, and that at the end output files are correctly retrieved. Then some checks are done on the output files written by the prologue, the executable and the epilogue scripts.
 

Regression tests

Revision 72011-03-11 - AlessioGianelle

Line: 1 to 1
 
META TOPICPARENT name="TestPage"
Line: 233 to 233
 
  • deep resubmission
Success if job fails with the expected reason
Added:
>
>

WMS-job-parametric.sh

Test parametric job.

  • Test integer version of Parameters
  • Test integer version of Parameters changing 'start' and 'step' values
  • Test list version of Parameters
For these three tests job is only register and the produced jdl is checked.

  • Test submission and check the output
  • Test submission using a list as parameters
Success means that job finished with Done Success, that the required produced output files are correctly retrieved and that they are as expected.

Known issues:

  • bug #79027 ParameterStart must be equal to 0
  • bug #79144 NodesCollocation is not support
  • bug #79165 Parameters list must be composed by strings
  • bug #79308 parameters should not be negative (SegFault)

 

Regression tests

Location: http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.testsuites.ctb/WMS/regression/

Line: 241 to 265
 

Releases and Changelog

Changed:
<
<
>
>
  • 2011-03-11 (Ale) Added WMS-job-parametric.sh test
 

Revision 62011-03-03 - AlessioGianelle

Line: 1 to 1
 
META TOPICPARENT name="TestPage"
Line: 52 to 52
 

Testsuite description

Changed:
<
<

WMS-command_job-delegate-proxy.sh

>
>

WMS command tests

WMS-command_job-delegate-proxy.sh

  This test is intended to verify glite-wms-job-delegate-proxy command
Line: 69 to 71
 
  • Try to delegate with an expired proxy
  • Try to submit with an expired delegation
Added:
>
>

WMS-command_job-list-match.sh

 
Added:
>
>
This test is intended to verify glite-wms-job-list-match command
 
Added:
>
>
Test the command with these options:
  • --logfile
  • --output
  • --endpoint
  • --rank
success if command returns 0
 
Added:
>
>
  • Test a failure matching (requirements = false). Success if no matching is found.
  • Test a restricted matching (only Cream CEs). Success if none LCG CE matches.
  • Test delegation proxy option --delegationid (delegate before the mm). Success if command returns 0.
 
Added:
>
>

WMS-command_job-info.sh

 
Added:
>
>
This test is intended to verify glite-wms-job-info command
 
Changed:
<
<

Releases and Changelog

>
>
Test these options for all the command: --jdl-original --jdl --proxy --delegationid
  • --version
  • --input
  • --config
  • --output
  • --logfile
  • --endpoint
  • all options toghether
success if command returns 0

  • Check if the JobID is set correctly in the retrieved jdl
  • Check if the expiration time of the delegation is set correctly"

WMS-command_job-submit.sh

This test is intended to verify glite-wms-job-submit command

Test the command with these options:

  • --version option
  • --endpoint option
  • --output option
  • --logfile option
  • --nomsg option
  • all options together
success if command returns 0

  • --input option (with --noint)
  • --resource option
success if job is submit to the required CE

  • --register-only option
success if job is in state Submitted

  • --start option
success if job correctly terminated

  • --transfer-files --proto option
success if job output is as expected (i.e. files are correctly transferred)

  • --valid option
  • --to option
success if ExpiryTime is correctly set in the jdl and if job aborted with reason request expired

  • --default-jdl option
success if the attribute id the default-jdl is add to the job's jdl

WMS-command_job-status.sh

This test is intended to verify glite-wms-job-status command

Test the command with these options:

  • --version
  • --config
  • --output
  • --logfile
  • --input
success if command returns 0

Testing these options requires certain indexing capabilities to be enabled on the LB server, so they can failed.

  • --exclude (exclude Waiting, Done, Cleared and Aborted jobs)
  • --status (look for Waiting job)
  • --user-tag
success if command output is as expected.
 
Added:
>
>

WMS-command_job-logging-info.sh

 
Added:
>
>
This test is intended to verify glite-wms-job-logging-info command
 
Added:
>
>
Test the command with these options:
  • --version option
  • --config
  • --output
  • --logfile
  • --input
  • --to
  • --from
  • --event (show only ACCEPTED events)
  • --exclude (exclude ACCEPTED events)
  • all the options together (extract only EnQueued events)
success if command returns 0 and output is as expected.

WMS-command_job-output.sh

This test is intended to verify glite-wms-job-output command

Test the command with these options:

  • --version
  • --logfile
  • --dir
  • --nosubdir
  • --list-only
  • --nopurge
  • --input
success means that the status is "CLEARED" (otherwise a WARNING is produced) and that output files std.out and std.err are correctly retrieved.

  • Try to retrieve output of a Cleared job. Success if command failed.

WMS-command_job-cancel.sh

This test is intended to verify glite-wms-job-cancel command

Test the command with these options:

  • --version
  • --config
  • --output
  • --logfile
  • --input
  • all options together
success means that the final state of the job is "Cancelled"

  • cancel a finished job. Succes if command fails.

WMS-command_job-perusal.sh

This test is intended to verify glite-wms-job-perusal command

Test the command with these options:

  • --version
  • --set
  • --get
  • --get with --dir
  • --get with --nodisplay and --all
success if the retrieved pieces of file are exactly the job's output.
 
Added:
>
>

Functionality tests

 
Added:
>
>

WMS-job-cycle.sh

 
Added:
>
>
Test a complete job cycle: from submission to get-output
  • submission of a normal job to an LCG-CE
  • submission of a normal job to a CREAM CE
success if job terminated correctly and the retrieved output files are the two expected files (std.out and std.err)

You can try submission to a specific CE using command's option -c

WMS-job-resubmit.sh

Test the two types of possible resubmissions.

  • shallow resubmission
  • deep resubmission
Success if job fails with the expected reason
 

Regression tests

Location: http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.testsuites.ctb/WMS/regression/

Deleted:
<
<
To create a regression test please follow this simple rules:
 
Deleted:
<
<
  • Create a description file: <bug number>.txt with this information:
Bug: <put the bug number>
Link: <link to savannah bug page>
Summary: <short description of the bug>
And then a list of actions that should be taken to test the bug.

  • If need create a jdl file: <bug number>.jdl
 
Changed:
<
<
You can add also this attribute to jdl that could be useful for future checks:
>
>

Releases and Changelog

 
Deleted:
<
<
usertags = [ bug = "<put bug number>" ];
 
Deleted:
<
<
  • If need create a bash script file: <bug_number>_exe.sh
 
Deleted:
<
<
You can found also a directory with some example file of data to use as InputSandBox and a directory with not silly executables.
 
Deleted:
<
<
These tests are NOT supposed to be run automatically so some manual intervention should be required also on the WMS machine.
 

-- AlessioGianelle - 08 Jul 2008

Revision 52011-03-03 - AlessioGianelle

Line: 1 to 1
 
META TOPICPARENT name="TestPage"
Line: 48 to 48
  As you can see there are some required parameters: WMS which is the WMS hostname to test, LB which is the LB hostname and VO which is the name of the user's VO.
Changed:
<
<
To use the WMS service a valid proxy is needed; there are three ways to set it for the testsuite: you can create a valid proxy before execute the testsuite (i.e. the default location pointed by X509_USER_PROXY is used) or you can left the testsuite to create it for you digiting the passphare in an interactive mode (i.e. use option -i) or setting a default key without password. Note that some tests require the possibility to create limited proxies so they work only in the second case (i.e. if you give to teh testsuite the opportunity to create the proxy).
>
>
To use the WMS service a valid proxy is needed. There are three ways to set it for the testsuite: you can create a valid proxy before execute the testsuite (i.e. the default location pointed by X509_USER_PROXY is used) or you can left the testsuite to create it for you digiting the passphrase in an interactive mode (i.e. use option -i) or setting a default key without password. Note that some tests require the possibility to create limited proxies so they work only in the second case (i.e. if you give to the testsuite the opportunity to create the proxy).

Testsuite description

WMS-command_job-delegate-proxy.sh

This test is intended to verify glite-wms-job-delegate-proxy command

Test the command with these options:

  • --version
  • --logfile
  • --output
  • --endpoint
  • --autm-delegation
success means that command has success, delegation is stored in the WMS and that we are able to submit a job

The following tests are possible only in interactive mode (i.e. use option -i)

  • Delegate a shorter proxy
  • Try to delegate with an expired proxy
  • Try to submit with an expired delegation

 

Line: 56 to 78
 

Releases and Changelog

Deleted:
<
<

Testsuite description

 

Revision 42011-02-28 - AlessioGianelle

Line: 1 to 1
 
META TOPICPARENT name="TestPage"
Line: 11 to 11
  Developers: Alessio Gianelle
Changed:
<
<
The testsuite should be divided into two parts: the first one is composed by some scripts one for each commands available in the WMS-CLI (glite-wms-job-*), the purpose of these tests is to check every single command and to check if the service reacts as expected. Then there are some general scripts which check singles features of the WMS service.
>
>
The testsuite should be divided into two parts: the first one is composed by some scripts one for each commands available in the WMS-CLI (glite-wms-job-*), the purpose of these tests is to check every single command and to check if the service reacts as expected; these tests can also be used to check the WMS command line commands. Then there are some general scripts which check singles features of the WMS service.
  There are two ways to configure the tests: you can use a configuration file (wms-command.conf) like this one:
Line: 48 to 48
  As you can see there are some required parameters: WMS which is the WMS hostname to test, LB which is the LB hostname and VO which is the name of the user's VO.
Added:
>
>
To use the WMS service a valid proxy is needed; there are three ways to set it for the testsuite: you can create a valid proxy before execute the testsuite (i.e. the default location pointed by X509_USER_PROXY is used) or you can left the testsuite to create it for you digiting the passphare in an interactive mode (i.e. use option -i) or setting a default key without password. Note that some tests require the possibility to create limited proxies so they work only in the second case (i.e. if you give to teh testsuite the opportunity to create the proxy).
 

Releases and Changelog

Revision 32011-02-28 - AlessioGianelle

Line: 1 to 1
 
META TOPICPARENT name="TestPage"
Added:
>
>

WMS Service test suite

Introduction

The WMS-service testsuite is a set of shell scripts that interacts with the WMS command line tools in order to perform several functional tests.

Location: org.glite.testsuites.ctb/WMS/WMS-service

Developers: Alessio Gianelle

The testsuite should be divided into two parts: the first one is composed by some scripts one for each commands available in the WMS-CLI (glite-wms-job-*), the purpose of these tests is to check every single command and to check if the service reacts as expected. Then there are some general scripts which check singles features of the WMS service.

There are two ways to configure the tests: you can use a configuration file (wms-command.conf) like this one:

### Required parameters
# WMS used for tests
WMS="wms.pd.infn.it"
# LB used in the test
LB="lb.pd.infn.it"
# User VO
VO="dteam"

### Optional parameters
# Default requirements
DEFAULTREQ="other.GlueCEStateStatus == \"Production\""
# Number of retrievals before to stop test (timeout)
NUM_STATUS_RETRIEVALS=100
# Seconds between two retreivals
SLEEP_TIME=30

Or you can set the required parameters through command line options:

 -h          this help
 -l          save output in a file
 -d <level > print verbose messages (level = (1|2|3)
 -i          interactive mode (it asks for proxy pwd)
 -n          nagios mode
 -c <conf>   configuration file
 -W <wms>    WMS host (required if conf file is not used)
 -L <lb>     LB host (required if conf file is not used)
 -C <ce>     CE host
 -v <vo>     User VO (required if conf file is not used)

As you can see there are some required parameters: WMS which is the WMS hostname to test, LB which is the LB hostname and VO which is the name of the user's VO.

Releases and Changelog

Testsuite description

 

Regression tests

Location: http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.testsuites.ctb/WMS/regression/

Revision 22011-02-24 - AlessioGianelle

Line: 1 to 1
Changed:
<
<
META TOPICPARENT name="TestWokPlan"
>
>
META TOPICPARENT name="TestPage"
 

Regression tests

Location: http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.testsuites.ctb/WMS/regression/

Revision 12008-07-08 - AlessioGianelle

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="TestWokPlan"

Regression tests

Location: http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.testsuites.ctb/WMS/regression/

To create a regression test please follow this simple rules:

  • Create a description file: <bug number>.txt with this information:
Bug: <put the bug number>
Link: <link to savannah bug page>
Summary: <short description of the bug>
And then a list of actions that should be taken to test the bug.

  • If need create a jdl file: <bug number>.jdl

You can add also this attribute to jdl that could be useful for future checks:

usertags = [ bug = "<put bug number>" ];

  • If need create a bash script file: <bug_number>_exe.sh

You can found also a directory with some example file of data to use as InputSandBox and a directory with not silly executables.

These tests are NOT supposed to be run automatically so some manual intervention should be required also on the WMS machine.

-- AlessioGianelle - 08 Jul 2008

 
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback