Difference: CreamWorkPlan (1 vs. 32)

Revision 322011-04-28 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestPage"

CREAM Test work plan

Changed:
<
<

Introduction

>
>

Warning

 
Deleted:
<
<
The CREAM testsuite is a set of python scripts that interacts with the CREAM command line tools in order to perform several functional tests.

Installation and setup

The easiest way to deploy the testsuite is to have a UI node already available, for further details refer to the Generic Installation and Configuration Guide. The testsuite can be installed using yum creating a file called testsuites.repo in the yum.repos.d directory with the following definition:

[ETICS-name-CREAM-service-testsuite]
name=ETICS Repository of CREAM-service-testsuite
baseurl=http://etics-repository.cern.ch:8080/repository/pm/registered/repomd/name/CREAM-service-testsuite_1_0_7
protect=0
enabled=1
gpgcheck=0
and then running
yum update
yum install glite-testsuites-cream

After the installation it is suggested to check if the environment variable GLITE_LOCATION points to the correct gLite installation directory, i.e. the one containing the bin folder with the CREAM clients.

Testsuite and ETICS

The testsuite can be downloaded and build directly from the ETICS framework. For any details concerning the ETICS client installation refer to the User Guide or to the twiki site. The following list of commands is required in order to retrieve and build the latest stable release:
etics-workspace-setup
etics-get-project org.glite
etics-checkout --config glite-testsuites-cream_R_1_0_7_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
etics-build org.glite.testsuites.cream

Releases and Changelog

  • 1.0.3.0 (2009-02-24)
    • Fixed bug: bad termination condition in cream-monitored-* tests with failures during the submission
  • 1.0.4.0 (2009-03-05)
    • Changed command line of the CE monitor client, this version can be used only with the clients whose version is 1.11 or higher
  • 1.0.5.0 (2009-04-17)
    • Fixed minor issues
    • New options "nopurge" and "sotimeout" are available
  • 1.0.6.0 (2009-05-26)
    • Fixed man pages in rpm
    • Fixed minor issues
  • 1.0.7.0 (2009-03-02)
    • Support for event query

Work plan

Testsuite description

The set of test can be divided into two main categories, according to the type of status detection mechanism for a job:

Proxy management

Each test can be run using either an external user voms-proxy or with an internal management of the voms-proxy. The default mechanism is using an external voms-proxy. The external voms-proxy is not renewed by the test, the user is responsible for updating that credential if required in such a way that it does not interfere with tests, for example "renaming" the new proxy into the old one. The external voms-proxy path is defined with the environment variable X509_USER_PROXY, the main default is /tmp/x509_uuid. With the internal management of the voms-proxy the testsuite keeps track of the renewal of that credential, the user has just to provide a valid personal certificate and private key. The environment variables required for enabling this mode are: X509_USER_CERT and X509_USER_KEY; when this mode is selected each test requires the definition of the VO to be used (option --vo) and the voms-proxy-init client must be properly configured.

Delegation management

Each test can be run either using a single delegated proxy on the CE for all the submissions or with one delegated proxy per submitted job, see --delegationType option. The tester must be aware of using the second mode can overload the entire system, both the service and the testsuite, so the tuning of the test parameters must consider that issue.

Isolation and interference tests

One of the basic requirements for a test is to be isolated; each test handles only its own jobs and resources in general (delegated proxies, lease tokens, etc.) with no interferences from other tests. Multiple tests can be executed in parallel in order to detect interferences on the service side; for example the cream-test-monitored-lease-expired test can be run together with cream-test-monitored-submit for discovering a wrong lease management for the jobs submitted by the latter.

Hints for test tuning

  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter. With shorter life-time the job can terminate before the testsuite is able to detect the change of its status.
  • In order to test the internal proxy renewal mechanism of the CREAM service it's strongly suggested to run at least one test with notifications and proxy renewal all alone, with no other tests running on the same CE.
  • It is strongly suggested to configure the socket timeout according to the latency of the network using the "--sotimeout" option (available since version 1.0.5)

Proposed test plan

The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers. In the following the CREAM CE under test is cream-12.pd.infn.it (port 8443) with Torque as batch system and cream_A as assigned queue, the hostname and port must be replaced with the correct values according to the arrangement of the testbed; the VO dteam is used.

The simple.jdl contains:

[ executable="/bin/sleep"; arguments="180";]

The long.jdl contains:

[ executable="/bin/sleep"; arguments="1800";]

The onehoursleep contains:

[ executable="/bin/sleep"; arguments="3600";]

The testsandbox.jdl contains:

[
executable="/bin/cp";
arguments="grid-mapfile out-`date +%s%N`-`whoami`.txt";
inputsandbox={
    "gsiftp://cream-12.pd.infn.it/etc/grid-security/grid-mapfile"
};
outputsandbox={
    "out*.txt"
};
outputsandboxbasedesturi="gsiftp://cream-12.pd.infn.it/tmp";
epilogue="/bin/sleep";
epiloguearguments="60";
]

The log4py.conf contains:

[Default]
Format: %T %L %C [%F] - %M
Target: cream-test-cream-12.log
Ansi: False
LogLevel: Debug

  1. Simple submission with polling:
    cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -l log4py.conf -j simple.jdl \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A 
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
  2. Simple submission with notifications:
    cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -l log4py.conf -j simple.jdl \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
  3. Submission and cancellation with polling:
    cream-test-monitored-cancel -r 30 -n 1000 -m 50 -C 50 -l log4py.conf -j simple.jdl \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
  4. Submission and cancellation with notifications:
    cream-test-notified-cancel -r 30 -n 1000 -m 50 -C 50 -p 9000 -l log4py.conf -j simple.jdl \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
  5. Submission with polling and sandbox transfer:
    cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -l log4py.conf \
        -j testsandbox.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. The output sandbox on the CE must be checked and removed manually.
  6. Submission with notifications and sandbox transfer:
     cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -l log4py.conf \
        -j testsandbox.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. The output sandbox on the CE must be checked and removed manually.
  7. Simple submission with polling and proxy renewal:
    cream-test-monitored-submit -r 60 -n 50 -m 10 -C 10 -l log4py.conf -j long.jdl \
        --vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
  8. Simple submission with notifications and proxy renewal:
    cream-test-notified-submit -r 60 -n 50 -m 10 -C 10 -p 9000 -l log4py.conf -j long.jdl \
        --vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
  9. Simple submission with polling and proxy expired:
    cream-test-monitored-proxy-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf \
        --vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
  10. Simple submission with polling and lease expired:
    cream-test-monitored-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. One lease token is defined for all jobs.
  11. Simple submission with notifications and lease expired:
    cream-test-notified-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 -p 9000 \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.
  12. Simple submission with polling, lease expired and proxy renewal:
    cream-test-monitored-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 \
        --vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
  13. Simple submission with notifications, lease expired and proxy renewal:
    cream-test-notified-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 -p 9000 \
        --vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
  14. Simple submission with polling and lease updated:
    cream-test-monitored-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.
  15. Simple submission with notifications and lease updated:
    cream-test-notified-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 -p 9000 \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.
  16. Simple submission with polling, lease updated and proxy renewal:
    cream-test-monitored-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 \
        --vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
  17. Simple submission with notifications, lease updated and proxy renewal:
    cream-test-notified-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 -p 9000 \
        --vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
  18. Proxy renewal for job in IDLE:
    cream-test-monitored-submit -r 60 -n $TOTAL -m $PART -C $PART -l log4py.conf -j onehoursleep.jdl \
        --vo dteam --valid 00:45 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required. The variable $PART is an integer greater than the number of jobs which can be run concurrently in the batch system, the variable $TOTAL is a multiple of $PART.

Missing tests

  • Logging and Bookkeeping integration: tests of the notifications sent by the job wrapper to the local logger (if installed) and in the next future for direct CREAM-LB integration.
  • Shallow resubmission support: tests for token handling.

Contacts

For any trouble concerning the test suite or the test plan please contacts: sa3-italia@mi.infn.it
 \ No newline at end of file
Added:
>
>
This site is deprecated, please use the new one

Revision 312011-02-24 - AlessioGianelle

Line: 1 to 1
Changed:
<
<
META TOPICPARENT name="TestWokPlan"
>
>
META TOPICPARENT name="TestPage"
 

CREAM Test work plan

Introduction

Revision 302010-03-02 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 13 to 13
 
[ETICS-name-CREAM-service-testsuite]
name=ETICS Repository of CREAM-service-testsuite
Changed:
<
<
baseurl=http://etics-repository.cern.ch:8080/repository/pm/registered/repomd/name/CREAM-service-testsuite
>
>
baseurl=http://etics-repository.cern.ch:8080/repository/pm/registered/repomd/name/CREAM-service-testsuite_1_0_7
 protect=0 enabled=1 gpgcheck=0
Line: 31 to 31
 The following list of commands is required in order to retrieve and build the latest stable release:
etics-workspace-setup
etics-get-project org.glite
Changed:
<
<
etics-checkout --config glite-testsuites-cream_R_1_0_6_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
>
>
etics-checkout --config glite-testsuites-cream_R_1_0_7_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
 etics-build org.glite.testsuites.cream
Line: 47 to 47
 
  • 1.0.6.0 (2009-05-26)
    • Fixed man pages in rpm
    • Fixed minor issues
Added:
>
>
  • 1.0.7.0 (2009-03-02)
    • Support for event query
 

Work plan

Revision 292010-01-21 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 11 to 11
 The easiest way to deploy the testsuite is to have a UI node already available, for further details refer to the Generic Installation and Configuration Guide. The testsuite can be installed using yum creating a file called testsuites.repo in the yum.repos.d directory with the following definition:
Changed:
<
<
[testsuites] name=Testsuites baseurl=http://devel12.cnaf.infn.it:7444/repository/testsuites/
>
>
[ETICS-name-CREAM-service-testsuite] name=ETICS Repository of CREAM-service-testsuite baseurl=http://etics-repository.cern.ch:8080/repository/pm/registered/repomd/name/CREAM-service-testsuite protect=0
 enabled=1
Added:
>
>
gpgcheck=0
  and then running

Revision 282009-05-26 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 29 to 29
 The following list of commands is required in order to retrieve and build the latest stable release:
etics-workspace-setup
etics-get-project org.glite
Changed:
<
<
etics-checkout --config glite-testsuites-cream_R_1_0_5_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
>
>
etics-checkout --config glite-testsuites-cream_R_1_0_6_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
 etics-build org.glite.testsuites.cream
Line: 41 to 41
 
    • Changed command line of the CE monitor client, this version can be used only with the clients whose version is 1.11 or higher
  • 1.0.5.0 (2009-04-17)
    • Fixed minor issues
Changed:
<
<
    • New option "nopurge" is available
>
>
    • New options "nopurge" and "sotimeout" are available
  • 1.0.6.0 (2009-05-26)
    • Fixed man pages in rpm
    • Fixed minor issues
 

Work plan

Revision 272009-05-13 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 76 to 76
 

Hints for test tuning

  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter. With shorter life-time the job can terminate before the testsuite is able to detect the change of its status.
  • In order to test the internal proxy renewal mechanism of the CREAM service it's strongly suggested to run at least one test with notifications and proxy renewal all alone, with no other tests running on the same CE.
Added:
>
>
  • It is strongly suggested to configure the socket timeout according to the latency of the network using the "--sotimeout" option (available since version 1.0.5)
 

Proposed test plan

The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers. In the following the CREAM CE under test is cream-12.pd.infn.it (port 8443) with Torque as batch system and cream_A as assigned queue, the hostname and port must be replaced with the correct values according to the arrangement of the testbed; the VO dteam is used.

Revision 262009-04-17 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 29 to 29
 The following list of commands is required in order to retrieve and build the latest stable release:
etics-workspace-setup
etics-get-project org.glite
Changed:
<
<
etics-checkout --config glite-testsuites-cream_R_1_0_4_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
>
>
etics-checkout --config glite-testsuites-cream_R_1_0_5_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
 etics-build org.glite.testsuites.cream
Line: 39 to 39
 
    • Fixed bug: bad termination condition in cream-monitored-* tests with failures during the submission
  • 1.0.4.0 (2009-03-05)
    • Changed command line of the CE monitor client, this version can be used only with the clients whose version is 1.11 or higher
Added:
>
>
  • 1.0.5.0 (2009-04-17)
    • Fixed minor issues
    • New option "nopurge" is available
 

Work plan

Revision 252009-03-05 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 29 to 29
 The following list of commands is required in order to retrieve and build the latest stable release:
etics-workspace-setup
etics-get-project org.glite
Changed:
<
<
etics-checkout --config glite-testsuites-cream_R_1_0_3_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
>
>
etics-checkout --config glite-testsuites-cream_R_1_0_4_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
 etics-build org.glite.testsuites.cream
Line: 37 to 37
 
  • 1.0.3.0 (2009-02-24)
    • Fixed bug: bad termination condition in cream-monitored-* tests with failures during the submission
Added:
>
>
  • 1.0.4.0 (2009-03-05)
    • Changed command line of the CE monitor client, this version can be used only with the clients whose version is 1.11 or higher
 

Work plan

Line: 181 to 183
 

Missing tests

  • Logging and Bookkeeping integration: tests of the notifications sent by the job wrapper to the local logger (if installed) and in the next future for direct CREAM-LB integration.
  • Shallow resubmission support: tests for token handling.
\ No newline at end of file
Added:
>
>

Contacts

For any trouble concerning the test suite or the test plan please contacts: sa3-italia@mi.infn.it
 \ No newline at end of file

Revision 242009-03-04 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 70 to 70
 

Hints for test tuning

  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter. With shorter life-time the job can terminate before the testsuite is able to detect the change of its status.
Added:
>
>
  • In order to test the internal proxy renewal mechanism of the CREAM service it's strongly suggested to run at least one test with notifications and proxy renewal all alone, with no other tests running on the same CE.
 

Proposed test plan

The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers. In the following the CREAM CE under test is cream-12.pd.infn.it (port 8443) with Torque as batch system and cream_A as assigned queue, the hostname and port must be replaced with the correct values according to the arrangement of the testbed; the VO dteam is used.

Revision 232009-03-02 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 29 to 29
 The following list of commands is required in order to retrieve and build the latest stable release:
etics-workspace-setup
etics-get-project org.glite
Changed:
<
<
etics-checkout --config glite-testsuites-cream_R_1_0_2_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
>
>
etics-checkout --config glite-testsuites-cream_R_1_0_3_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
 etics-build org.glite.testsuites.cream

Revision 222009-02-26 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 33 to 33
 etics-build org.glite.testsuites.cream
Added:
>
>

Releases and Changelog

  • 1.0.3.0 (2009-02-24)
    • Fixed bug: bad termination condition in cream-monitored-* tests with failures during the submission
 

Work plan

Testsuite description

Revision 212008-12-22 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 24 to 24
  After the installation it is suggested to check if the environment variable GLITE_LOCATION points to the correct gLite installation directory, i.e. the one containing the bin folder with the CREAM clients.
Added:
>
>

Testsuite and ETICS

The testsuite can be downloaded and build directly from the ETICS framework. For any details concerning the ETICS client installation refer to the User Guide or to the twiki site. The following list of commands is required in order to retrieve and build the latest stable release:
etics-workspace-setup
etics-get-project org.glite
etics-checkout --config glite-testsuites-cream_R_1_0_2_0 --project-config glite_branch_3_1_0 org.glite.testsuites.cream
etics-build org.glite.testsuites.cream
 

Work plan

Testsuite description

Line: 57 to 66
 

Hints for test tuning

  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter. With shorter life-time the job can terminate before the testsuite is able to detect the change of its status.
Changed:
<
<

Proposed test plan (WORK IN PROGRESS)

>
>

Proposed test plan

 The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers. In the following the CREAM CE under test is cream-12.pd.infn.it (port 8443) with Torque as batch system and cream_A as assigned queue, the hostname and port must be replaced with the correct values according to the arrangement of the testbed; the VO dteam is used.

The simple.jdl contains:

[ executable="/bin/sleep"; arguments="180";]

Revision 202008-12-11 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 64 to 64
  The long.jdl contains:
[ executable="/bin/sleep"; arguments="1800";]
Added:
>
>
The onehoursleep contains:
[ executable="/bin/sleep"; arguments="3600";]
 The testsandbox.jdl contains:
[
executable="/bin/cp";
Line: 114 to 116
  The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. The output sandbox on the CE must be checked and removed manually.
  1. Simple submission with polling and proxy renewal:
    cream-test-monitored-submit -r 60 -n 50 -m 10 -C 10 -l log4py.conf -j long.jdl \
Changed:
<
<
--vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
>
>
--vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
  1. Simple submission with notifications and proxy renewal:
    cream-test-notified-submit -r 60 -n 50 -m 10 -C 10 -p 9000 -l log4py.conf -j long.jdl \
Changed:
<
<
--vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
>
>
--vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
  1. Simple submission with polling and proxy expired:
    cream-test-monitored-proxy-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf \
Changed:
<
<
--vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
>
>
--vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
  1. Simple submission with polling and lease expired:
    cream-test-monitored-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 \
Line: 134 to 136
  The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.
  1. Simple submission with polling, lease expired and proxy renewal:
    cream-test-monitored-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 \
Changed:
<
<
--vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
>
>
--vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
  1. Simple submission with notifications, lease expired and proxy renewal:
    cream-test-notified-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 -p 9000 \
Changed:
<
<
--vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
>
>
--vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
  1. Simple submission with polling and lease updated:
    cream-test-monitored-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 \
Line: 150 to 152
  The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.
  1. Simple submission with polling, lease updated and proxy renewal:
    cream-test-monitored-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 \
Changed:
<
<
--vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
>
>
--vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
  1. Simple submission with notifications, lease updated and proxy renewal:
    cream-test-notified-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 -p 9000 \
Changed:
<
<
--vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
>
>
--vo dteam --valid 00:20 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
  1. Proxy renewal for job in IDLE:
    cream-test-monitored-submit -r 60 -n $TOTAL -m $PART -C $PART -l log4py.conf -j onehoursleep.jdl \

Revision 192008-12-10 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 156 to 156
 cream-test-notified-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 -p 9000 --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
Added:
>
>
  1. Proxy renewal for job in IDLE:
    cream-test-monitored-submit -r 60 -n $TOTAL -m $PART -C $PART -l log4py.conf -j onehoursleep.jdl \
        --vo dteam --valid 00:45 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required. The variable $PART is an integer greater than the number of jobs which can be run concurrently in the batch system, the variable $TOTAL is a multiple of $PART.
 

Missing tests

  • Logging and Bookkeeping integration: tests of the notifications sent by the job wrapper to the local logger (if installed) and in the next future for direct CREAM-LB integration.

Revision 182008-12-09 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 156 to 156
 cream-test-notified-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 -p 9000 --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
Added:
>
>

Missing tests

  • Logging and Bookkeeping integration: tests of the notifications sent by the job wrapper to the local logger (if installed) and in the next future for direct CREAM-LB integration.
  • Shallow resubmission support: tests for token handling.
 \ No newline at end of file

Revision 172008-12-04 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 88 to 88
 LogLevel: Debug
Changed:
<
<
  • Simple submission with polling:
>
>
  1. Simple submission with polling:
 cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -l log4py.conf -j simple.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
Changed:
<
<
  • Simple submission with notifications:
>
>
  1. Simple submission with notifications:
 cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -l log4py.conf -j simple.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
Changed:
<
<
  • Submission and cancellation with polling:
>
>
  1. Submission and cancellation with polling:
 cream-test-monitored-cancel -r 30 -n 1000 -m 50 -C 50 -l log4py.conf -j simple.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
Changed:
<
<
  • Submission and cancellation with notifications:
>
>
  1. Submission and cancellation with notifications:
 cream-test-notified-cancel -r 30 -n 1000 -m 50 -C 50 -p 9000 -l log4py.conf -j simple.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
Changed:
<
<
  • Submission with polling and sandbox transfer:
>
>
  1. Submission with polling and sandbox transfer:
 cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -l log4py.conf -j testsandbox.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. The output sandbox on the CE must be checked and removed manually.
Changed:
<
<
  • Submission with notifications and sandbox transfer:
>
>
  1. Submission with notifications and sandbox transfer:
  cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -l log4py.conf -j testsandbox.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. The output sandbox on the CE must be checked and removed manually.
Changed:
<
<
  • Simple submission with polling and proxy renewal:
>
>
  1. Simple submission with polling and proxy renewal:
 cream-test-monitored-submit -r 60 -n 50 -m 10 -C 10 -l log4py.conf -j long.jdl --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
Changed:
<
<
  • Simple submission with notifications and proxy renewal:
>
>
  1. Simple submission with notifications and proxy renewal:
 cream-test-notified-submit -r 60 -n 50 -m 10 -C 10 -p 9000 -l log4py.conf -j long.jdl --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
Changed:
<
<
  • Simple submission with polling and proxy expired:
>
>
  1. Simple submission with polling and proxy expired:
 cream-test-monitored-proxy-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
Changed:
<
<
  • Simple submission with polling and lease expired:
>
>
  1. Simple submission with polling and lease expired:
 cream-test-monitored-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. One lease token is defined for all jobs.
Changed:
<
<
  • Simple submission with notifications and lease expired:
>
>
  1. Simple submission with notifications and lease expired:
 cream-test-notified-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.
Changed:
<
<
  • Simple submission with polling, lease expired and proxy renewal:
>
>
  1. Simple submission with polling, lease expired and proxy renewal:
 cream-test-monitored-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
Changed:
<
<
  • Simple submission with notifications, lease expired and proxy renewal:
>
>
  1. Simple submission with notifications, lease expired and proxy renewal:
 cream-test-notified-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 -p 9000 --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
Changed:
<
<
  • Simple submission with polling and lease updated:
>
>
  1. Simple submission with polling and lease updated:
 cream-test-monitored-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.
Changed:
<
<
  • Simple submission with notifications and lease updated:
>
>
  1. Simple submission with notifications and lease updated:
 cream-test-notified-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.
Changed:
<
<
  • Simple submission with polling, lease updated and proxy renewal:
>
>
  1. Simple submission with polling, lease updated and proxy renewal:
 cream-test-monitored-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.
Changed:
<
<
  • Simple submission with notifications, lease updated and proxy renewal:
>
>
  1. Simple submission with notifications, lease updated and proxy renewal:
 cream-test-notified-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 -p 9000 --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs. \ No newline at end of file

Revision 162008-12-03 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Revision 152008-12-01 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 62 to 62
  The simple.jdl contains:
[ executable="/bin/sleep"; arguments="180";]
Changed:
<
<
The long.jdl contains:
[ executable="/bin/sleep"; arguments="1200";]
>
>
The long.jdl contains:
[ executable="/bin/sleep"; arguments="1800";]
  The testsandbox.jdl contains:
[
Line: 89 to 89
 

  • Simple submission with polling:
Changed:
<
<
cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j simple.jdl
>
>
cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50-l log4py.conf -j simple.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.

  • Simple submission with notifications:
Changed:
<
<
cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j simple.jdl
>
>
cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -l log4py.conf -j simple.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.

  • Submission and cancellation with polling:
Changed:
<
<
cream-test-monitored-cancel -r 30 -n 1000 -m 50 -C 50 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j simple.jdl
>
>
cream-test-monitored-cancel -r 30 -n 1000 -m 50 -C 50 -l log4py.conf -j simple.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.

  • Submission and cancellation with notifications:
Changed:
<
<
cream-test-notified-cancel -r 30 -n 1000 -m 50 -C 50 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j simple.jdl
>
>
cream-test-notified-cancel -r 30 -n 1000 -m 50 -C 50 -p 9000 -l log4py.conf -j simple.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.

  • Submission with polling and sandbox transfer:
Changed:
<
<
cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j testsandbox.jdl
>
>
cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -l log4py.conf -j testsandbox.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. The output sandbox on the CE must be checked and removed manually.

  • Submission with notifications and sandbox transfer:
Changed:
<
<
cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j testsandbox.jdl
>
>
cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -l log4py.conf -j testsandbox.jdl -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. The output sandbox on the CE must be checked and removed manually.

  • Simple submission with polling and proxy renewal:
Changed:
<
<
cream-test-monitored-submit -r 60 -n 50 -m 10 -C 10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py_cream-12.conf -j test2.jdl --vo dteam --valid 00:10
>
>
cream-test-monitored-submit -r 60 -n 50 -m 10 -C 10 -l log4py.conf -j long.jdl --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.

  • Simple submission with notifications and proxy renewal:
Changed:
<
<
cream-test-notified-submit -r 60 -n 50 -m 10 -C 10 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py_cream-12.conf -j test2.jdl --vo dteam --valid 00:10
>
>
cream-test-notified-submit -r 60 -n 50 -m 10 -C 10 -p 9000 -l log4py.conf -j long.jdl --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.

  • Simple submission with polling and proxy expired:
Changed:
<
<
cream-test-monitored-proxy-expired -r 60 -n 50 -m 10 -C 10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py_cream-12.conf --vo dteam --valid 00:10
>
>
cream-test-monitored-proxy-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
  The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required. \ No newline at end of file
Added:
>
>
  • Simple submission with polling and lease expired:
    cream-test-monitored-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. One lease token is defined for all jobs.

  • Simple submission with notifications and lease expired:
    cream-test-notified-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 -p 9000 \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.

  • Simple submission with polling, lease expired and proxy renewal:
    cream-test-monitored-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 \
        --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.

  • Simple submission with notifications, lease expired and proxy renewal:
    cream-test-notified-lease-expired -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 -p 9000 \
        --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.

  • Simple submission with polling and lease updated:
    cream-test-monitored-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.

  • Simple submission with notifications and lease updated:
    cream-test-notified-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 -p 9000 \
        -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.One lease token is defined for all jobs.

  • Simple submission with polling, lease updated and proxy renewal:
    cream-test-monitored-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 \
        --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.

  • Simple submission with notifications, lease updated and proxy renewal:
    cream-test-notified-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1800 -p 9000 \
        --vo dteam --valid 00:10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.One lease token is defined for all jobs.

Revision 142008-12-01 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 58 to 58
 
  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter. With shorter life-time the job can terminate before the testsuite is able to detect the change of its status.

Proposed test plan (WORK IN PROGRESS)

Changed:
<
<
The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers. In the following the CREAM CE under test is cream-12.pd.infn.it (port 8443) with Torque as batch system and cream_A as assigned queue, the hostname and port must be replaced with the correct values according to the arrangement of the testbed.
>
>
The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers. In the following the CREAM CE under test is cream-12.pd.infn.it (port 8443) with Torque as batch system and cream_A as assigned queue, the hostname and port must be replaced with the correct values according to the arrangement of the testbed; the VO dteam is used.
  The simple.jdl contains:
[ executable="/bin/sleep"; arguments="180";]
Line: 119 to 119
 
  • Simple submission with notifications and proxy renewal:
    cream-test-notified-submit -r 60 -n 50 -m 10 -C 10 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py_cream-12.conf -j test2.jdl --vo dteam --valid 00:10
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
\ No newline at end of file
Added:
>
>
  • Simple submission with polling and proxy expired:
    cream-test-monitored-proxy-expired -r 60 -n 50 -m 10 -C 10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py_cream-12.conf --vo dteam --valid 00:10
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
 \ No newline at end of file

Revision 132008-11-27 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 57 to 57
 

Hints for test tuning

  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter. With shorter life-time the job can terminate before the testsuite is able to detect the change of its status.
Changed:
<
<

Proposed test plan

>
>

Proposed test plan (WORK IN PROGRESS)

 The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers. In the following the CREAM CE under test is cream-12.pd.infn.it (port 8443) with Torque as batch system and cream_A as assigned queue, the hostname and port must be replaced with the correct values according to the arrangement of the testbed.
Changed:
<
<
The simple.jdl contains:
[
executable="/bin/sleep";
arguments="180";
]
>
>
The simple.jdl contains:
[ executable="/bin/sleep"; arguments="180";]

The long.jdl contains:

[ executable="/bin/sleep"; arguments="1200";]
  The testsandbox.jdl contains:
[
Line: 114 to 111
 
  • Submission with notifications and sandbox transfer:
     cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j testsandbox.jdl
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. The output sandbox on the CE must be checked and removed manually.
\ No newline at end of file
Added:
>
>
  • Simple submission with polling and proxy renewal:
    cream-test-monitored-submit -r 60 -n 50 -m 10 -C 10 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py_cream-12.conf -j test2.jdl --vo dteam --valid 00:10
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.

  • Simple submission with notifications and proxy renewal:
    cream-test-notified-submit -r 60 -n 50 -m 10 -C 10 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py_cream-12.conf -j test2.jdl --vo dteam --valid 00:10
    
    The variables X509_USER_CERT and X509_USER_KEY must point to the location of the user certificate and private key, passphrase is required.
 \ No newline at end of file

Revision 122008-11-26 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 106 to 106
 
  • Submission and cancellation with notifications:
    cream-test-notified-cancel -r 30 -n 1000 -m 50 -C 50 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j simple.jdl
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
\ No newline at end of file
Added:
>
>
  • Submission with polling and sandbox transfer:
    cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j testsandbox.jdl
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. The output sandbox on the CE must be checked and removed manually.

  • Submission with notifications and sandbox transfer:
     cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j testsandbox.jdl
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy. The output sandbox on the CE must be checked and removed manually.
 \ No newline at end of file

Revision 112008-11-26 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 58 to 58
 
  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter. With shorter life-time the job can terminate before the testsuite is able to detect the change of its status.

Proposed test plan

Changed:
<
<
The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers. In the following the CREAM CE under test is cream-12.pd.infn.it:8443 with Torque and cream_A as assigned queue.
>
>
The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers. In the following the CREAM CE under test is cream-12.pd.infn.it (port 8443) with Torque as batch system and cream_A as assigned queue, the hostname and port must be replaced with the correct values according to the arrangement of the testbed.
  The simple.jdl contains:
[
Line: 67 to 67
 ]
Added:
>
>
The testsandbox.jdl contains:
[
executable="/bin/cp";
arguments="grid-mapfile out-`date +%s%N`-`whoami`.txt";
inputsandbox={
    "gsiftp://cream-12.pd.infn.it/etc/grid-security/grid-mapfile"
};
outputsandbox={
    "out*.txt"
};
outputsandboxbasedesturi="gsiftp://cream-12.pd.infn.it/tmp";
epilogue="/bin/sleep";
epiloguearguments="60";
]
 The log4py.conf contains:
[Default]
Format: %T %L %C [%F] - %M

Revision 102008-11-25 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 82 to 82
 
  • Simple submission with notifications:
    cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j simple.jdl
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
Added:
>
>
  • Submission and cancellation with polling:
    cream-test-monitored-cancel -r 30 -n 1000 -m 50 -C 50 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j simple.jdl
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.

  • Submission and cancellation with notifications:
    cream-test-notified-cancel -r 30 -n 1000 -m 50 -C 50 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j simple.jdl
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.
 \ No newline at end of file

Revision 92008-11-25 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 58 to 58
 
  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter. With shorter life-time the job can terminate before the testsuite is able to detect the change of its status.

Proposed test plan

Deleted:
<
<
The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers.
 \ No newline at end of file
Added:
>
>
The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers. In the following the CREAM CE under test is cream-12.pd.infn.it:8443 with Torque and cream_A as assigned queue.

The simple.jdl contains:

[
executable="/bin/sleep";
arguments="180";
]

The log4py.conf contains:

[Default]
Format: %T %L %C [%F] - %M
Target: cream-test-cream-12.log
Ansi: False
LogLevel: Debug

  • Simple submission with polling:
    cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j simple.jdl
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.

  • Simple submission with notifications:
    cream-test-notified-submit -r 30 -n 1000 -m 50 -C 50 -p 9000 -R cream-12.pd.infn.it:8443/cream-pbs-cream_A -l log4py.conf -j simple.jdl
    
    The renewal process is disabled, the variable X509_USER_PROXY must point to a 12-hours long proxy.

Revision 82008-11-24 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 56 to 56
 

Hints for test tuning

  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter. With shorter life-time the job can terminate before the testsuite is able to detect the change of its status.
\ No newline at end of file
Added:
>
>

Proposed test plan

The set of tests described in this section is used for the pre-certification of the latest version of the CREAM CE and can be considered a template for external testers.
 \ No newline at end of file

Revision 72008-11-18 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"
Changed:
<
<

CREAM Test work plan (WORK IN PROGRESS)

>
>

CREAM Test work plan

 

Introduction

Line: 26 to 26
 

Work plan

Changed:
<
<

Testsuite composition

>
>

Testsuite description

 The set of test can be divided into two main categories, according to the type of status detection mechanism for a job:
Line: 50 to 50
 Each test can be run either using a single delegated proxy on the CE for all the submissions or with one delegated proxy per submitted job, see --delegationType option. The tester must be aware of using the second mode can overload the entire system, both the service and the testsuite, so the tuning of the test parameters must consider that issue.
Added:
>
>

Isolation and interference tests

One of the basic requirements for a test is to be isolated; each test handles only its own jobs and resources in general (delegated proxies, lease tokens, etc.) with no interferences from other tests. Multiple tests can be executed in parallel in order to detect interferences on the service side; for example the cream-test-monitored-lease-expired test can be run together with cream-test-monitored-submit for discovering a wrong lease management for the jobs submitted by the latter.
 

Hints for test tuning

Deleted:
<
<
  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter.
 \ No newline at end of file
Added:
>
>
  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter. With shorter life-time the job can terminate before the testsuite is able to detect the change of its status.
 \ No newline at end of file

Revision 62008-11-17 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan (WORK IN PROGRESS)

Line: 9 to 9
 

Installation and setup

The easiest way to deploy the testsuite is to have a UI node already available, for further details refer to the Generic Installation and Configuration Guide.

Changed:
<
<
The testsuite can be installed using yum creating a file in the yum.repos.d directory with the following definition:
>
>
The testsuite can be installed using yum creating a file called testsuites.repo in the yum.repos.d directory with the following definition:
 
Changed:
<
<
[Testsuite]
>
>
[testsuites]
 name=Testsuites baseurl=http://devel12.cnaf.infn.it:7444/repository/testsuites/ enabled=1 and then running
Changed:
<
<
yum install org.glite.testsuites.cream
>
>
yum update yum install glite-testsuites-cream
 

After the installation it is suggested to check if the environment variable GLITE_LOCATION points to the correct gLite installation directory, i.e. the one containing the bin folder with the CREAM clients.

Revision 52008-11-14 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"
Changed:
<
<

CREAM Test work plan

>
>

CREAM Test work plan (WORK IN PROGRESS)

 

Introduction

Line: 28 to 28
 

Testsuite composition

The set of test can be divided into two main categories, according to the type of status detection mechanism for a job:
  • with polling (synchronous):
Changed:
<
<
    • cream-test-monitored-cancel
    • cream-test-monitored-lease-expired
    • cream-test-monitored-lease-updated
    • cream-test-monitored-proxy-expired
    • cream-test-monitored-submit
    • cream-test-notified-lease-updated
>
>
 
  • with notifications (asynchronous):
Changed:
<
<
    • cream-test-notified-cancel
    • cream-test-notified-lease-expired
    • cream-test-notified-lease-updated
    • cream-test-notified-submit
>
>
 

Proxy management

Each test can be run using either an external user voms-proxy or with an internal management of the voms-proxy.
Line: 49 to 48
 

Delegation management

Each test can be run either using a single delegated proxy on the CE for all the submissions or with one delegated proxy per submitted job, see --delegationType option. The tester must be aware of using the second mode can overload the entire system, both the service and the testsuite, so the tuning of the test parameters must consider that issue.
Added:
>
>

Hints for test tuning

  • Due to unavoidable delays in the command scheduling, the life-time of the job submitted with the cream-test-notified-cancel has to be at least 3 times longer than the rate parameter.

Revision 42008-11-14 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 21 to 21
 yum install org.glite.testsuites.cream
Added:
>
>
After the installation it is suggested to check if the environment variable GLITE_LOCATION points to the correct gLite installation directory, i.e. the one containing the bin folder with the CREAM clients.
 

Work plan

Testsuite composition

Line: 39 to 41
 
    • cream-test-notified-submit

Proxy management

Changed:
<
<
Each test can be run using an external user voms-proxy or with an internal management of the voms-proxy.
>
>
Each test can be run using either an external user voms-proxy or with an internal management of the voms-proxy.
 The default mechanism is using an external voms-proxy. The external voms-proxy is not renewed by the test, the user is responsible for updating that credential if required in such a way that it does not interfere with tests, for example "renaming" the new proxy into the old one.
Changed:
<
<
The external voms-proxy path is defined with the environment variable X509_USER_PROXY, the main default is /tmp/x509_u.
>
>
The external voms-proxy path is defined with the environment variable X509_USER_PROXY, the main default is /tmp/x509_uuid. With the internal management of the voms-proxy the testsuite keeps track of the renewal of that credential, the user has just to provide a valid personal certificate and private key. The environment variables required for enabling this mode are: X509_USER_CERT and X509_USER_KEY; when this mode is selected each test requires the definition of the VO to be used (option --vo) and the voms-proxy-init client must be properly configured.

Delegation management

Each test can be run either using a single delegated proxy on the CE for all the submissions or with one delegated proxy per submitted job, see --delegationType option. The tester must be aware of using the second mode can overload the entire system, both the service and the testsuite, so the tuning of the test parameters must consider that issue.

Revision 32008-11-13 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Line: 23 to 23
 

Work plan

Changed:
<
<
-- AlessioGianelle - 20 Jun 2008
>
>

Testsuite composition

The set of test can be divided into two main categories, according to the type of status detection mechanism for a job:
  • with polling (synchronous):
    • cream-test-monitored-cancel
    • cream-test-monitored-lease-expired
    • cream-test-monitored-lease-updated
    • cream-test-monitored-proxy-expired
    • cream-test-monitored-submit
    • cream-test-notified-lease-updated
  • with notifications (asynchronous):
    • cream-test-notified-cancel
    • cream-test-notified-lease-expired
    • cream-test-notified-lease-updated
    • cream-test-notified-submit

Proxy management

Each test can be run using an external user voms-proxy or with an internal management of the voms-proxy. The default mechanism is using an external voms-proxy. The external voms-proxy is not renewed by the test, the user is responsible for updating that credential if required in such a way that it does not interfere with tests, for example "renaming" the new proxy into the old one. The external voms-proxy path is defined with the environment variable X509_USER_PROXY, the main default is /tmp/x509_u.

Revision 22008-11-11 - PaoloAndreetto

Line: 1 to 1
 
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

Added:
>
>

Introduction

The CREAM testsuite is a set of python scripts that interacts with the CREAM command line tools in order to perform several functional tests.

Installation and setup

The easiest way to deploy the testsuite is to have a UI node already available, for further details refer to the Generic Installation and Configuration Guide. The testsuite can be installed using yum creating a file in the yum.repos.d directory with the following definition:

[Testsuite]
name=Testsuites
baseurl=http://devel12.cnaf.infn.it:7444/repository/testsuites/
enabled=1
and then running
yum install org.glite.testsuites.cream

Work plan

 -- AlessioGianelle - 20 Jun 2008

Revision 12008-06-20 - AlessioGianelle

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="TestWokPlan"

CREAM Test work plan

-- AlessioGianelle - 20 Jun 2008

 
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback