Tags:
, view all tags

WMS test report

Summary

  • Component: WMS 3.3.5

  • ETICS Subsystem Configuration Name: emi-wms_R_3_3_7_1 emi-jdl_R_3_2_6_1

  • VCS Tag: emi-ice_R_3_3_4_1, emi-wms-manager_R_3_3_1_3, emi-jobsubmission_R_3_3_2_1, emi-wmproxy_R_3_3_5_1, emi-wms-brokerinfo_R_3_3_2_1, emi-wms-configuration_R_3_3_2_1, emi-wms-ism_R_3_3_2_1, emi-wms-matchmaking_R_3_3_2_1, emi-wms-purger_R_3_3_2_1, emi-yaim-wms_R_4_1_5_1, emi-jdl-api-cpp_R_3_2_6_1, emi-wms-nagios_R_1_0_0_0, emi-wms-mp_R_1_0_2_0

  • EMI Major Release: EMI 1 (Kebnekaise)

  • Platform: sl5 epel

  • Certification report: not yet available

  • Outcome: Certification under way

Deployment Tests

Clean installation

  • Starting from a SL5 x86_64 kernel machine:

[root@emi-demo11 ~]# cat /etc/redhat-release 
Scientific Linux SL release 5.7 (Boron)
[root@emi-demo11 ~]# uname -a
Linux emi-demo11.cnaf.infn.it 2.6.18-274.18.1.el5 #1 SMP Thu Feb 9 12:20:03 EST 2012 x86_64 x86_64 x86_64 GNU/Linux
[root@emi-demo11 ~]# wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -O /tmp/emi-key_gd.asc
[root@emi-demo11 ~]# rpm --import /tmp/emi-key_gd.asc

Update

[root@emi-demo12 yum.repos.d]# rpm -qa|grep wms-manager
glite-wms-manager-3.3.1-3.sl5

The wms emi-demo12 is configured in proxy mode, pointing to the LB devel17.cnaf.infn.it

Unit Tests

N/A: Tests will be available with EMI-2.

Basic Functionality tests

Submission

Where possible the tests should use internal testbed CEs (located in Padova). This is accomplished by adding the following line to wms-command.conf:
DEFAULTREQ= other.GlueCEStateStatus == "Testing"
This is not possible, for example, for parallel jobs.

Normal

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:28:22
===> Ended  : 10:32:49
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120316102822.log
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:30:51
===> Ended  : 10:35:08
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120316103051.log
   [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V infngrid -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:31:52
===> Ended  : 10:37:14
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120316103152.log
* submit.tgz: submit.tgz
Proxy mode
Pointing the testsuite at emi-demo12:

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 10:50:40
===> Ended  : 10:56:37
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120316105040.log
* WMSService-TS_20120316105040.log: WMSService-TS_20120316105040.log

ARC CE
Job submitted on a production CE using the cms VO.
[capannini@cert-17 regression_tests]$ lcg-infosites --is egee-bdii.cnaf.infn.it --vo cms ce |grep arc
     80         0           95         5        95   arc.univ.kiev.ua:2811/nordugrid-torque-arc
    768       707          196        61       196   jade-cms.hip.fi:2811/nordugrid-GE-arc
    256         0            0         0         0   korundi.grid.helsinki.fi:2811/nordugrid-GE-arc

[cristofori@ui ~]$ glite-wms-job-submit -e https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server -a -r jade-cms.hip.fi:2811/nordugrid-GE-arc firsttest.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g

==========================================================================




[cristofori@ui ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        jade-cms.hip.fi:2811/nordugrid-GE-arc
Submitted:          Tue Mar 27 14:27:13 2012 CEST
==========================================================================




[cristofori@ui ~]$ glite-wms-job-output --dir ./ https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

                         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g
have been successfully retrieved and stored in the directory:
/home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g

================================================================================


[cristofori@ui ~]$ cat /home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g/stderr.log
[cristofori@ui ~]$ cat /home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g/stdout.log
cmsuser07

===> Test PASSED
The selected CE was not upgraded to version >1.x so we didn't hit the bug https://savannah.cern.ch/bugs/?92742

Jdl with DataRequirements
[capannini@devel15 WMS-service]$ cat ~/certification/data-req.jdl
###########################################
#      JDL with Data Requirements         #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";

FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};

DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; 
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};

DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i -j ~/certification/data-req.jdl
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:33:22
===> Ended  : 11:54:21
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120316113322.log
* WMSService-TS_20120316113322.log: WMSService-TS_20120316113322.log

Jdl with ISBBaseURI and OSBDestURI
Test on CREAM ce:

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA

==========================================================================


[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA
Current Status:     Done (Success)
Logged Reason(s):
    - Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA: reason is User C=IT,O=INFN,OU=Personal Certificate,L=CNAF,CN=Fabio Capannini not authorized for operation {http://www.gridsite.org/namespaces/delegation-2}getProxyReq
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cccreamceli10.in2p3.fr:8443/cream-sge-short
Submitted:          Fri Mar 16 14:29:07 2012 CET
==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_FNmMujUg_2yIhS0iY8h9YA

================================================================================

[capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_FNmMujUg_2yIhS0iY8h9YA
std.err

Log on devel09.cnaf.infn.it:

[root@devel09 ~]# cat /tmp/myjobOutput 
FNmMujUg_2yIhS0iY8h9YA
total 76
-rwxr-xr-x 1 dteam009 dteam 80 Mar 16 14:33 exe.sh
-rw-r--r-- 1 dteam009 dteam  0 Mar 16 14:33 std.err
-rw-r--r-- 1 dteam009 dteam 23 Mar 16 14:33 std.out
-rw-r--r-- 1 dteam009 dteam  6 Mar 16 14:33 test1
-rw-r--r-- 1 dteam009 dteam  6 Mar 16 14:33 test2

===>   test PASSED


Same process with an LCG CE:

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/nz4pKzrc453q3uSn-q8vsQ

==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/nz4pKzrc453q3uSn-q8vsQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/nz4pKzrc453q3uSn-q8vsQ
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        gridce2.pi.infn.it:2119/jobmanager-lcglsf-cert
Submitted:          Fri Mar 16 14:51:57 2012 CET
==========================================================================

[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/nz4pKzrc453q3uSn-q8vsQ

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/nz4pKzrc453q3uSn-q8vsQ
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_nz4pKzrc453q3uSn-q8vsQ

================================================================================


[capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_nz4pKzrc453q3uSn-q8vsQ
std.err

Log on devel09:

[root@devel09 ~]# cat /tmp/myjobOutput 
nz4pKzrc453q3uSn-q8vsQ
total 96
-rwxr-xr-x 1 dteam016 dteam  80 Mar 16 14:53 exe.sh
-rw-r--r-- 1 dteam016 dteam 118 Mar 16 14:53 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fnz4pKzrc453q3uSn-q8vsQ.output
-rw-r--r-- 1 dteam016 dteam   0 Mar 16 14:53 std.err
-rw-r--r-- 1 dteam016 dteam  23 Mar 16 14:53 std.out
-rw-r--r-- 1 dteam016 dteam   6 Mar 16 14:53 test1
-rw-r--r-- 1 dteam016 dteam   6 Mar 16 14:53 test2
-rw------- 1 dteam016 dteam 103 Mar 16 14:53 tmp.dSuMI19622
-rw------- 1 dteam016 dteam   2 Mar 16 14:53 tmp.iYrdk19621
-rw------- 1 dteam016 dteam   2 Mar 16 14:53 tmp.kpcpo19636
-rw------- 1 dteam016 dteam   0 Mar 16 14:53 tmp.nAPiv19635
-rw------- 1 dteam016 dteam 103 Mar 16 14:53 tmp.rUfjz19637

===>   test PASSED

Jdl with ISBBaseURI and OSBBaseDestURI

Submit to CREAM CE

[capannini@cert-17 certification]$ cat BaseURI.jdl 
###########################################
#  JDL with ISBURI & OSBBaseDestURI       #
###########################################

Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";

InputSandboxBaseURI = "gsiftp://emi-demo12.cnaf.infn.it:2811/tmp";

FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxBaseDestURI="gsiftp://devel20.cnaf.infn.it:2811/tmp";

#requirements = other.GlueCEStateStatus == "Testing" &&  regexp("/cream", other.GlueCEUniqueID);
requirements = regexp("/cream", other.GlueCEUniqueID);

RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf BaseURI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g

==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g
Current Status:     Done (Success)
Logged Reason(s):
    - Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g: reason is User C=IT,O=INFN,OU=Personal Certificate,L=CNAF,CN=Fabio Capannini not authorized for operation {http://www.gridsite.org/namespaces/delegation-2}getProxyReq
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        gridce0.pi.infn.it:8443/cream-lsf-cert
Submitted:          Fri Mar 16 16:13:56 2012 CET
==========================================================================

[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

No output files to be retrieved for the job:
https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g

================================================================================

Log on devel20:

[root@devel20 ~]# ls /tmp/std*
/tmp/std.err  /tmp/std.out
[root@devel20 ~]# 
[root@devel20 ~]# 
[root@devel20 ~]# cat /tmp/std.out 
hlAzaQOlelzhpDmzgGL88g
total 76
-rwxr-xr-x 1 dteam015 dteam 80 Mar 16 16:14 exe.sh
-rw-r--r-- 1 dteam015 dteam  0 Mar 16 16:14 std.err
-rw-r--r-- 1 dteam015 dteam 23 Mar 16 16:14 std.out
-rw-r--r-- 1 dteam015 dteam  6 Mar 16 16:14 test1
-rw-r--r-- 1 dteam015 dteam  6 Mar 16 16:14 test2

===>     === test PASSED === 

Submit to an LCG CE:

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf BaseURI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/urEE8OAYVl2r9jUsAysuQw

==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/urEE8OAYVl2r9jUsAysuQw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/urEE8OAYVl2r9jUsAysuQw
Current Status:     Done (Success)
Logged Reason(s):
    - Job got an error while in the CondorG queue.
    - Job terminated successfully
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        t2-ce-03.lnl.infn.it:2119/jobmanager-lcglsf-cert1
Submitted:          Fri Mar 16 16:25:36 2012 CET
==========================================================================

[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/urEE8OAYVl2r9jUsAysuQw

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

No output files to be retrieved for the job:
https://emi-demo11.cnaf.infn.it:9000/urEE8OAYVl2r9jUsAysuQw

================================================================================

Log on devel20:

[root@devel20 ~]# ls /tmp/std.*
/tmp/std.err  /tmp/std.out
[root@devel20 ~]# cat /tmp/std.out 
7A98_2qv4Qkqihilp2blrg
total 36
-rwxr-xr-x  1 dteam022 dteam  80 Mar 16 16:56 exe.sh
-rw-r--r--  1 dteam022 dteam 118 Mar 16 16:56 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f7A98_5f2qv4Qkqihilp2blrg.output
-rw-r--r--  1 dteam022 dteam   0 Mar 16 16:56 std.err
-rw-r--r--  1 dteam022 dteam  23 Mar 16 16:56 std.out
-rw-r--r--  1 dteam022 dteam   6 Mar 16 16:56 test1
-rw-r--r--  1 dteam022 dteam   6 Mar 16 16:56 test2
-rw-------  1 dteam022 dteam 103 Mar 16 16:56 tmp.boMqn22089
-rw-------  1 dteam022 dteam   2 Mar 16 16:56 tmp.lnMRO22073
-rw-------  1 dteam022 dteam 103 Mar 16 16:56 tmp.mxsln22074
-rw-------  1 dteam022 dteam   0 Mar 16 16:56 tmp.nBJFQ22087
-rw-------  1 dteam022 dteam   2 Mar 16 16:56 tmp.twwvt22088

===> Test PASSED

Jdl with AllowZippedISB

[capannini@cert-17 certification]$ cat AllowZIP.jdl 
###########################################
#   JDL with AllowZippedISB attribute     #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";

InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"};
OutputSandbox = {"std.out", "std.err"};

requirements = other.GlueCEStateStatus == "Testing" && regexp("/cream", other.GlueCEUniqueID);

AllowZippedISB=true;

RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 certification]$ glite-wms-job-submit --debug -a -c ~/wms_emi-demo11.conf AllowZIP.jdl 
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Vo read from proxy certificate extension
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - VirtualOrganisation value : dteam
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Configuration file: /home/capannini/wms_emi-demo11.conf - VirtualOrganisation, RetryCount, rank attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes"
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Loaded user configuration file:
 /home/capannini/wms_emi-demo11.conf
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Configuration file: //etc/glite-wms/dteam/glite_wmsui.conf - VirtualOrganisation, MyProxyServer attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes"
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Loaded Vo specific configuration file:
 //etc/glite-wms/dteam/glite_wmsui.conf
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Loaded Configuration values: 
 [
  JdlDefaultAttributes = 
   [
    PerusalFileEnable = false; 
    ShallowRetryCount = 10; 
    SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; 
    RetryCount = 3; 
    AllowZippedISB = true; 
    VirtualOrganisation = "dteam"; 
    rank =  -other.GlueCEStateEstimatedResponseTime; 
    MyProxyServer = "myproxy.cnaf.infn.it"
   ]; 
  OutputStorage = "/tmp"; 
  ListenerStorage = "/tmp"; 
  ErrorStorage = "/var/tmp"; 
  WmProxyEndPoints = { "https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server" }
 ]
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Getting Endpoint URL from configuration file 
-----------------------------------------

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy getVersion service
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - WMProxy Version: 3.3.5 
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Sending Proxy Request to https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy delegationns__getProxyReq service
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - delegationns__getProxyReq -  The proxy has been successfully retrieved
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy delegationns__putProxyReq service
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - The proxy has been successfully delegated with the identifier: QEfCo4sVtkysnpwMV4Br5w
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy getTransferProtocols service
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - getTransferProtocols -  Available protocols: gsiftp, https
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - FileTransferProtocol not specified; using the default protocol: gsiftp
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - The JDL file is: /home/capannini/certification/AllowZIP.jdl
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Retrieving the list of the local ISB files from the user JDL 
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Total size of the ISB file(s) to be transferred to: 1126406
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Max single job size of the ISB file(s) to be transferred to: 1024000
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Checking the User-FreeQuota on the server 
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy getFreeQuota service
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - getFreeQuota -  User freequota not set on the server
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Getting the max ISB size from the server https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy getMaxInputSandboxSize service
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - getMaxInputSandboxSize -  Max ISB size information successfully retrieved
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - The max job size (1024000 bytes) doesn't exceed the max size limit of 100000000 bytes: File transfer is allowed
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - File archiving and file compression allowed by user in the JDL
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Registering JDL [ StdOutput = "std.out"; ShallowRetryCount = 2; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 1; Executable = "/bin/ls"; Type = "job"; Arguments = "-la"; AllowZippedISB = true; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank =  -other.GlueCEStateEstimatedResponseTime; ZippedISB = { "ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar.gz" }; OutputSandbox = { "std.out","std.err" }; InputSandbox = { "file:///home/capannini/certification/fileA","file:///home/capannini/certification/fileB","file:///home/capannini/certification/fileC","file:///home/capannini/certification/fileD","file:///home/capannini/certification/fileE" }; StdError = "std.err"; rank =  -other.GlueCEStateEstimatedResponseTime; MyProxyServer = "myproxy.cnaf.infn.it"; requirements = other.GlueCEStateStatus == "Testing" && regexp("/cream",other.GlueCEUniqueID) ]
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Registering the job to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy jobRegister service
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - The JobId is:  https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Archiving the ISB files: /tmp/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - This archive file has been successfully created: /tmp/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Compressing the file (.gz): /tmp/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - ISB ZIPPED file successfully created: /tmp/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar.gz
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Getting the SandboxDestinationURI from the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy getSandboxDestURI service with gsiftp protocol 
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - getSandboxDestURI -  Destination URIs sucessfully retrieved
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - DestinationURI: gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/KA/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fKAx2BtFz9BkraoEKeaHNAw/input
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - FileTransfer (gsiftp): using globus-url-copy to transfer the local InputSandBox file(s) to the submission endpoint
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - File Transfer (gsiftp) 
 Command: /usr/bin/globus-url-copy
Source: file:///tmp/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar.gz
Destination: gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/KA/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fKAx2BtFz9BkraoEKeaHNAw/input/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar.gz
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - File Transfer (gsiftp) Transfer successfully done
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Starting the job:  https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy jobStart service
-----------------------------------------
-----------------------------------------
16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - jobStart -  The job has been successfully started
-----------------------------------------

====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw

==========================================================================

      *** Log file created ***
Possible Errors and Debug messages have been printed in the following file:
/var/tmp/glite-wms-job-submit_504_3015_20120316_17-00-28.log

Check if AllowZippedISB has been included in the jdl:

[capannini@cert-17 certification]$ glite-wms-job-info --jdl https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw|grep Allow
  AllowZippedISB = true; 

[capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-31.pd.infn.it:8443/cream-pbs-creamtest1
Submitted:          Fri Mar 16 17:00:28 2012 CET
==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_KAx2BtFz9BkraoEKeaHNAw

================================================================================


[capannini@cert-17 certification]$ ls -l /tmp/jobOutput/capannini_KAx2BtFz9BkraoEKeaHNAw
totale 4
-rw-r--r-- 1 capannini emitestbed   0 16 mar 17:06 std.err
-rw-r--r-- 1 capannini emitestbed 623 16 mar 17:06 std.out
[capannini@cert-17 certification]$ cat /tmp/jobOutput/capannini_KAx2BtFz9BkraoEKeaHNAw/std.out 
total 1132
drwxr-xr-x 2 dteam026 dteam    4096 Mar 16 17:00 .
drwxr-xr-x 3 dteam026 dteam    4096 Mar 16 17:00 ..
-rw-r--r-- 1 dteam026 dteam    4077 Mar 16 17:00 .BrokerInfo
-rw-r--r-- 1 dteam026 dteam       2 Mar 16 17:00 fileA
-rw-r--r-- 1 dteam026 dteam       2 Mar 16 17:00 fileB
-rw-r--r-- 1 dteam026 dteam 1024000 Mar 16 17:00 fileC
-rw-r--r-- 1 dteam026 dteam  102400 Mar 16 17:00 fileD
-rw-r--r-- 1 dteam026 dteam       2 Mar 16 17:00 fileE
-rw-r--r-- 1 dteam026 dteam       0 Mar 16 17:00 std.err
-rw-r--r-- 1 dteam026 dteam       0 Mar 16 17:00 std.out
-rw-r--r-- 1 dteam026 dteam       0 Mar 16 17:00 .tmp_file

====> Test passed

Jdl with ExpiryTime
[capannini@cert-17 certification]$ cat ExpiryTime.jdl 
###########################################
#       JDL with ExpiryTime attribute     #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";

InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"};
OutputSandbox = {"std.out", "std.err"};

requirements = false;

ExpiryTime = 1331914400;

RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 certification]$ date +%s
1331914321

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ExpiryTime.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/DLi-uEyoyTgKNYdsBfXMUQ

==========================================================================


[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/DLi-uEyoyTgKNYdsBfXMUQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/DLi-uEyoyTgKNYdsBfXMUQ
Current Status:     Waiting 
Status Reason:      BrokerHelper: no compatible resources
Submitted:          Fri Mar 16 17:13:15 2012 CET
==========================================================================

[capannini@cert-17 certification]$ date +%s
1331915013

[capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/DLi-uEyoyTgKNYdsBfXMUQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/DLi-uEyoyTgKNYdsBfXMUQ
Current Status:     Aborted 
Status Reason:      request expired
Submitted:          Fri Mar 16 17:13:15 2012 CET
==========================================================================

===> Test PASSED

Jdl with ShortDeadlineJob
To test SDJs the following bdii must be used: egee-bdii.cnaf.infn.it

[capannini@cert-17 certification]$ cat SDLJ.jdl 
###########################################
# JDL with ShortDeadlineJob attribute     #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";

InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"};
OutputSandbox = {"std.out", "std.err"};

requirements = true;

ShortDeadlineJob = true;

RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 certification]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf SDLJ.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

==========================================================================

           COMPUTING ELEMENT IDs LIST 
 The following CE(s) matching your job requirements have been found:

   *CEId*
 - ce01.ariagni.hellasgrid.gr:2119/jobmanager-pbs-dteam.sdj
 - ce01.marie.hellasgrid.gr:2119/jobmanager-pbs-sdj
 - ce02.marie.hellasgrid.gr:2119/jobmanager-pbs-sdj
 - cream-ce01.ariagni.hellasgrid.gr:8443/cream-pbs-dteam.sdj
 - cream-ce01.marie.hellasgrid.gr:8443/cream-pbs-sdj
 - grid4.mif.vu.lt:2119/jobmanager-lcgpbs-sdj
 - grive02.ibcp.fr:8443/cream-pbs-sdj
 - mario.univ-lille1.fr:8443/cream-pbs-sdj

==========================================================================

[capannini@cert-17 certification]$ python ~/wms_tests.old/WMS-service/WMS-job-cycle.py -c ~/wms_tests.old/WMS-service/wms-command.conf -V dteam -d 3 -l -t 1 -i -j SDLJ.jdl
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: /home/capannini/wms_tests.old/WMS-service/WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 17:32:05
===> Ended  : 17:43:26
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120316173205.log

Collection

Bulk submission

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 12:22:14
===> Ended  : 12:56:24
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120319122214.log
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 14:17:00
===> Ended  : 14:55:41
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120319141700.log
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating proxy ........................................................................................................................................... Done
Proxy Verify OK
Your proxy is valid until: Mon Mar 26 15:59:39 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy ................... Done

Your proxy is valid until Tue Mar 20 02:00:12 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:45
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:45
uri       : voms.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 2
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 15:00:43
===> Ended  : 15:42:21
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120319150043.log

All in a jdl
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 15:14:03
===> Ended  : 15:42:18
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120319151403.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 15:18:26
===> Ended  : 15:56:37
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120319151826.log

[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:40:34
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:39:34
uri       : voms.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 15:20:10
===> Ended  : 15:56:46
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120319152010.log

Parametric job

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:16:16
===> Ended  : 17:37:20
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120319161616.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu  -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:16:45
===> Ended  : 17:27:39
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120319161645.log

[capannini@cert-17 WMS-service]$  python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:17:29
===> Ended  : 16:57:30
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120319161729.log
* param.tgz: param.tgz

DAG job

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:19:51
===> Ended  : 12:17:56
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320111951.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu  -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:19:41
===> Ended  : 12:17:57
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320111941.log
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:38:18
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:37:18
uri       : voms.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:19:35
===> Ended  : 12:17:32
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320111935.log
* dag.tgz: dag.tgz

Parallel job

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 5 -i===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 5: Submit a MPI job (3 cases LCG-CE, CREAM, general) 


 Test 5A: Submit to an LCG-CE 


 Test 5B: Submit to a CREAM CE 


 Test 5C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 12:20:15
===> Ended  : 12:32:42
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320122015.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 5
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 5: Submit a MPI job (3 cases LCG-CE, CREAM, general) 


 Test 5A: Submit to an LCG-CE 


 Test 5B: Submit to a CREAM CE 


 Test 5C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 17:45:39
===> Ended  : 18:20:06
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320174539.log

Testing forwarding parameters for parallel jobs
In order to test the passing of mpi parameters (wholenodes,smpgranularity,cpunumber,hostnumber) to the ce, an mpi jdl is submitted with varying values for the parameters, specifying a cream CE as destination. Then the cream jobid is retrieved via a glite-wms-job-logging-info -v 2 ("Dest jobid" field of a Transfer event).Finally the cream jdl is found via glite-ce-job-status -L 2 <cream-jobid>.

The following jdls were submitted:

1)

Executable = "openmpi-wrapper.sh";
Arguments="hello";
StdOutput  = "hello.out";
StdError   = "hello.err";
OutputSandbox = {"hello.out","hello.err"};
InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"};
Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID);
WholeNodes = true;
SMPGranularity = 2;
CpuNumber=2;
Hostnumber = 1;
Resulting cream JDL:
JDL            = [[ CEInfoHostName = "cex.grid.unipg.it"; OutputSandboxPath = "/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "cex.grid.unipg.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000011:BH=0000000000:JSS=000004:LM=000012:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank =  -other.GlueCEStateEstimatedResponseTime; ce_id = "cex.grid.unipg.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_9Y6A4yCPUrI5GyKYt7p3yQ_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/k0SUJnW3rEOTwV5SeQgAWA"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 2; InputSandboxPath = "/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/input"; CeApplicationDir = "/opt/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/token.txt_0"; rank =  -other.GlueCEStateEstimatedResponseTime; WholeNodes = true; CpuNumber = 2; edg_previous_matches = { "ce.scope.unina.it" }; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "torque"; MyProxyServer = "myproxy.cnaf.infn.it"; edg_previous_matches_ex = { [ timestamp = 1332241946; ce_id = "ce.scope.unina.it" ] }; X509UserProxy = "/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; Hostnumber = 1; requirements = ( ( ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && other.GlueCEInfoTotalCPUs >= 2 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueCEInfoTotalCPUs >= 2 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) :  !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA" ]]
2)
Executable = "openmpi-wrapper.sh";
Arguments="hello";
StdOutput  = "hello.out";
StdError   = "hello.err";
OutputSandbox = {"hello.out","hello.err"};
InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"};
Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID);
WholeNodes = true;
SMPGranularity = 2;
Resulting cream jdl:
JDL            = [[ CEInfoHostName = "cex.grid.unipg.it"; OutputSandboxPath = "/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "cex.grid.unipg.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000005:BH=0000000000:JSS=000002:LM=000002:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank =  -other.GlueCEStateEstimatedResponseTime; ce_id = "cex.grid.unipg.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_J-4DceQ34C_J3-t-Z2F69Q_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/iiJ6s786Fq0Lm6kCuJaCWQ"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 2; InputSandboxPath = "/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/input"; CeApplicationDir = "/opt/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/token.txt_0"; rank =  -other.GlueCEStateEstimatedResponseTime; WholeNodes = true; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "torque"; MyProxyServer = "myproxy.cnaf.infn.it"; X509UserProxy = "/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; requirements = ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) :  !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ" ]]
3)
Executable = "openmpi-wrapper.sh";
Arguments="hello";
StdOutput  = "hello.out";
StdError   = "hello.err";
OutputSandbox = {"hello.out","hello.err"};
InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"};
Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID);
WholeNodes = false;
SMPGranularity = 3;
CpuNumber=3;
Hostnumber = 1;

Submission result:

[capannini@cert-17 mpi]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf mpi.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


Error - 
SMPGranularity and HostNumber are mutually exclusive when WholeNodes allocation is not requested: wrong combination of values

4)

Executable = "openmpi-wrapper.sh";
Arguments="hello";
StdOutput  = "hello.out";
StdError   = "hello.err";
OutputSandbox = {"hello.out","hello.err"};
InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"};
Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID);
WholeNodes = false;
SMPGranularity = 3;
CpuNumber=3;
Resulting cream jdl:
JDL            = [[ CEInfoHostName = "gridsrv2-4.dir.garr.it"; OutputSandboxPath = "/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "gridsrv2-4.dir.garr.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000005:BH=0000000000:JSS=000002:LM=000002:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank =  -other.GlueCEStateEstimatedResponseTime; ce_id = "gridsrv2-4.dir.garr.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_gJoXBXkTpXAm9blO6-oh6w_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/jYRRmxWg0IzO4ayEujALIg"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 3; InputSandboxPath = "/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/input"; CeApplicationDir = "/opt/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/token.txt_0"; rank =  -other.GlueCEStateEstimatedResponseTime; WholeNodes = false; CpuNumber = 3; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "pbs"; MyProxyServer = "myproxy.cnaf.infn.it"; X509UserProxy = "/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; requirements = ( ( ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && other.GlueCEInfoTotalCPUs >= 3 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueCEInfoTotalCPUs >= 3 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) :  !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg" ]]
5)
Executable = "openmpi-wrapper.sh";
Arguments="hello";
StdOutput  = "hello.out";
StdError   = "hello.err";
OutputSandbox = {"hello.out","hello.err"};
InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"};
Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID);
WholeNodes = true;
SMPGranularity = 8;
CpuNumber=8;
Hostnumber = 2;
Resulting ce jdl:
JDL            = [[ CEInfoHostName = "ce-02.roma3.infn.it"; OutputSandboxPath = "/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "ce-02.roma3.infn.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000005:BH=0000000000:JSS=000002:LM=000002:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank =  -other.GlueCEStateEstimatedResponseTime; ce_id = "ce-02.roma3.infn.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_wwQRc-_md4BHrKn3nazbOw_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/sDZrZug3OE9ZMgX2u45AhA"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 8; InputSandboxPath = "/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/input"; CeApplicationDir = "/storage/local/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/token.txt_0"; rank =  -other.GlueCEStateEstimatedResponseTime; WholeNodes = true; CpuNumber = 8; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "pbs"; MyProxyServer = "myproxy.cnaf.infn.it"; X509UserProxy = "/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; Hostnumber = 2; requirements = ( ( ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && other.GlueCEInfoTotalCPUs >= 8 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueCEInfoTotalCPUs >= 8 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) :  !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA" ]]
===> test PASSED

Perusal

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 6: Submit a perusal job 


 BEWARE default min perusal interval is 1000 secs, so this phase could take many minutes 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:36:17
===> Ended  : 17:02:41
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320163617.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu  -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 6: Submit a perusal job 


 BEWARE default min perusal interval is 1000 secs, so this phase could take many minutes 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:36:46
===> Ended  : 17:05:11
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320163646.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 6
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 6: Submit a perusal job 


 BEWARE default min perusal interval is 1000 secs, so this phase could take many minutes 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:37:11
===> Ended  : 17:04:33
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320163711.log
* perusal.tgz: perusal.tgz

Delegation

[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 Test 3: Try to delegate with a short proxy and check the validity 


 Test 4: Works with expired proxy 

===> 
===> Test: WMS-delegation-test.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 17:49:18
===> Ended  : 17:50:36
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320174918.log

[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 Test 3: Try to delegate with a short proxy and check the validity 


 Test 4: Works with expired proxy 

===> 
===> Test: WMS-delegation-test.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 17:49:50
===> Ended  : 17:51:05
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320174950.log

[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 4:07:36
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 5:06:36
uri       : voms.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 There are other two tests which require the user proxy password. Use -i option to enable them 

===> 
===> Test: WMS-delegation-test.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 17:50:26
===> Ended  : 17:50:30
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120320175026.log

Job List-match

Without data
[capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 10:52:17
===> Ended  : 10:52:41
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321105217.log

[capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 10:52:40
===> Ended  : 10:53:02
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321105240.log

[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating proxy ............................................................................................................................... Done
Proxy Verify OK
Your proxy is valid until: Wed Mar 28 11:53:08 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ............................................................................................................................................................................... Done

Your proxy is valid until Wed Mar 21 21:53:34 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:53
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:52
uri       : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 10:53:48
===> Ended  : 10:54:07
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321105348.log

With data
[capannini@cert-17 WMS-service]$ export LFC_HOST=prod-lfc-shared-central.cern.ch
[capannini@cert-17 WMS-service]$ lcg-lr --vo dteam lfn:/grid/dteam/fcapanni/PI_1M.txt
srm://gridsrm.pi.infn.it/dteam/fcapanni/PI_1M.txt
srm://srm-public.cern.ch/castor/cern.ch/grid/dteam/fcapanni/PI_1M.txt
The two SEs where the file can be found are gridsrm.pi.infn.it and srm-public.cern.ch.

[capannini@cert-17 WMS-service]$ cat JDLs/data-req.jdl 
###########################################
#      JDL with Data Requirements         #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";

FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};

DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; 
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};

DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 WMS-service]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf JDLs/data-req.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

==========================================================================

           COMPUTING ELEMENT IDs LIST 
 The following CE(s) matching your job requirements have been found:

   *CEId*
 - ce203.cern.ch:8443/cream-lsf-grid_2nh_dteam
 - ce203.cern.ch:8443/cream-lsf-grid_dteam
 - ce204.cern.ch:8443/cream-lsf-grid_2nh_dteam
 - ce204.cern.ch:8443/cream-lsf-grid_dteam
 - ce206.cern.ch:8443/cream-lsf-grid_2nh_dteam
 - ce206.cern.ch:8443/cream-lsf-grid_dteam
 - ce208.cern.ch:8443/cream-lsf-grid_2nh_dteam
 - ce208.cern.ch:8443/cream-lsf-grid_dteam
 - cream.sns.it:8443/cream-pbs-cert
 - gridce3.pi.infn.it:8443/cream-lsf-certmpi
 - gridce0.pi.infn.it:8443/cream-lsf-cert
 - gridce1.pi.infn.it:2119/jobmanager-lcglsf-cert
 - gridce2.pi.infn.it:2119/jobmanager-lcglsf-cert
 - gridce.sns.it:2119/jobmanager-lcgpbs-cert

==========================================================================

In order to verify that these CEs are close to the above SEs:

[capannini@cert-17 WMS-service]$  lcg-infosites --vo dteam closeSE|grep -A 5 ce203
Name of the CE: ce203.cern.ch:8443/cream-lsf-grid_2nh_dteam
   srm-atlas.cern.ch
   srm-cms.cern.ch
   srm-lhcb.cern.ch
   srm-public.cern.ch

Name of the CE: ce203.cern.ch:8443/cream-lsf-grid_dteam
   srm-atlas.cern.ch
   srm-cms.cern.ch
   srm-lhcb.cern.ch
   srm-public.cern.ch

[capannini@cert-17 WMS-service]$  lcg-infosites --vo dteam closeSE|grep -A 5 ce204
Name of the CE: ce204.cern.ch:8443/cream-lsf-grid_2nh_dteam
   srm-atlas.cern.ch
   srm-cms.cern.ch
   srm-lhcb.cern.ch
   srm-public.cern.ch

Name of the CE: ce204.cern.ch:8443/cream-lsf-grid_dteam
   srm-atlas.cern.ch
   srm-cms.cern.ch
   srm-lhcb.cern.ch
   srm-public.cern.ch

[capannini@cert-17 WMS-service]$  lcg-infosites --vo dteam closeSE|grep -A 5 gridce3.pi
Name of the CE: gridce3.pi.infn.it:8443/cream-lsf-certmpi
   gridsrm.pi.infn.it

Name of the CE: gridgate.cp.dias.ie:2119/jobmanager-lcgpbs-test
   gridstore.cp.dias.ie

[capannini@cert-17 WMS-service]$  lcg-infosites --vo dteam closeSE|grep -A 5 gridce2
Name of the CE: gridce2.pi.infn.it:2119/jobmanager-lcglsf-cert
   gridsrm.pi.infn.it

Name of the CE: gridce3.pi.infn.it:8443/cream-lsf-certmpi
   gridsrm.pi.infn.it

===> Test PASSED

Gangmatching
[capannini@cert-17 certification]$ cat gang.jdl 
[
executable="ls.sh";
myproxyserver="";
SErequirements = anyMatch(other.storage.CloseSEs, target.GlueSAStateAvailableSpace > 20);
//SErequirements = true;
CErequirements = other.GlueCEStateStatus == "Production" && other.GlueCEInfoTotalCPUs >= 2;
requirements = CErequirements && SErequirements;
inputsandbox={"ls.sh"};
stdoutput="out3.out";
stderror="err2.err";
outputsandbox={"out3.out", "err2.err", "ls.sh", "a"};
]

[capannini@cert-17 certification]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf gang.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

==========================================================================

           COMPUTING ELEMENT IDs LIST 
 The following CE(s) matching your job requirements have been found:

   *CEId*
 - cccreamceli05.in2p3.fr:8443/cream-sge-long
 - cccreamceli05.in2p3.fr:8443/cream-sge-medium
 - cccreamceli05.in2p3.fr:8443/cream-sge-short
 - cccreamceli06.in2p3.fr:8443/cream-sge-long
 - cccreamceli06.in2p3.fr:8443/cream-sge-medium
 - cccreamceli06.in2p3.fr:8443/cream-sge-short
 - cccreamceli09.in2p3.fr:8443/cream-sge-long
 - cccreamceli09.in2p3.fr:8443/cream-sge-medium
 - cccreamceli09.in2p3.fr:8443/cream-sge-short
 - cccreamceli10.in2p3.fr:8443/cream-sge-long
 - cccreamceli10.in2p3.fr:8443/cream-sge-medium
 - cccreamceli10.in2p3.fr:8443/cream-sge-short
 - cmsrm-ce01.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert
 - cmsrm-ce02.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert
 - grid010.ct.infn.it:2119/jobmanager-lcgpbs-cert
 - unict-dmi-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-cert
 - virgo-ce.roma1.infn.it:2119/jobmanager-lcgpbs-cert
 - cmsrm-cream01.roma1.infn.it:8443/cream-lsf-cmsgcert
 - ce-01.grid.sissa.it:8443/cream-pbs-blade
 - cream-ce.pg.infn.it:8443/cream-pbs-cert
 - inaf-ce-01.ct.pi2s2.it:8443/cream-lsf-cert

==========================================================================

In order to verify that the SErequirements are met:

[capannini@cert-17 certification]$ lcg-infosites closeSE|grep -A 5 cccreamceli05
Name of the CE: cccreamceli05.in2p3.fr:8443/cream-sge-long
   ccsrm.in2p3.fr

Name of the CE: cccreamceli05.in2p3.fr:8443/cream-sge-medium
   ccsrm.in2p3.fr

Name of the CE: cccreamceli05.in2p3.fr:8443/cream-sge-short
   ccsrm.in2p3.fr

Name of the CE: cccreamceli06.in2p3.fr:8443/cream-sge-long
   ccsrm.in2p3.fr

[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ lcg-infosites se |egrep 'Avail|ccsrm.in2p3.fr'
 Avail Space(kB)  Used Space(kB)  Type    SE
     12601333761      2431051775  SRM     ccsrm.in2p3.fr
[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ 
[capannini@cert-17 certification]$ lcg-infosites closeSE|grep -A 5 cmsrm-ce01
Name of the CE: cmsrm-ce01.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert
   cmsrm-se01.roma1.infn.it

Name of the CE: cmsrm-ce02.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert
   cmsrm-se01.roma1.infn.it

[capannini@cert-17 certification]$ lcg-infosites se |egrep 'Avail|cmsrm-se01.roma1.infn.it'
 Avail Space(kB)  Used Space(kB)  Type    SE
            1000          999999  SRM     cmsrm-se01.roma1.infn.it
[capannini@cert-17 certification]$ lcg-infosites closeSE|grep -A 5 unict-dmi-ce-01
Name of the CE: unict-dmi-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-cert
   unict-dmi-se-01.ct.pi2s2.it

Name of the CE: unime-ce-01.me.pi2s2.it:2119/jobmanager-lcglsf-cert
   unime-se-01.me.pi2s2.it

[capannini@cert-17 certification]$ lcg-infosites se |egrep 'Avail|unict-dmi-se-01.ct.pi2s2.it'
 Avail Space(kB)  Used Space(kB)  Type    SE
        58137369         8679392  SRM     unict-dmi-se-01.ct.pi2s2.it

Moreover, setting SErequirements = true in the jdl, the list of matching CEs is far longer.

===> Test PASSED

Prologue and Epilogue jobs

[capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V dteam -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 12:42:41
===> Ended  : 12:48:00
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321124241.log

[capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 12:42:55
===> Ended  : 12:47:44
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321124255.log

[capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 12:43:46
===> Ended  : 12:50:02
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321124346.log
* prologue.tgz: prologue.tgz

Shallow and deep resubmission

[capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try a shallow resubmission 


 Test 2: Try a deep resubmission 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 15:43:25
===> Ended  : 16:07:40
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321154325.log

[capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try a shallow resubmission 


 Test 2: Try a deep resubmission 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 15:43:41
===> Ended  : 15:56:24
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321154341.log

[capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Try a shallow resubmission 


 Test 2: Try a deep resubmission 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 15:44:20
===> Ended  : 15:56:28
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321154420.log
* resubmit.tgz: resubmit.tgz

Job cancel

[capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V dteam -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Cancel Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try to cancel a normal job 


 Test 2: Try to cancel a DAG job 


 Test 3: Try to cancel one node of a DAG job 


 Test 4: Try to cancel a collection job 


 Test 5: Try to cancel one node of a collection job 


 Test 6: Try to cancel a parametric job 


 Test 7: Try to cancel one node of a parametric job 


 Test 8: Try to cancel a MPI job 

===> 
===> Test: WMS-job-cancel.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 17:32:35
===> Ended  : 17:39:44
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321173235.log

[capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Cancel Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try to cancel a normal job 


 Test 2: Try to cancel a DAG job 


 Test 3: Try to cancel one node of a DAG job 


 Test 4: Try to cancel a collection job 


 Test 5: Try to cancel one node of a collection job 


 Test 6: Try to cancel a parametric job 


 Test 7: Try to cancel one node of a parametric job 


 Test 8: Try to cancel a MPI job 

===> 
===> Test: WMS-job-cancel.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 17:32:58
===> Ended  : 17:39:39
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321173258.log

[capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Cancel Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Try to cancel a normal job 


 Test 2: Try to cancel a DAG job 


 Test 3: Try to cancel one node of a DAG job 


 Test 4: Try to cancel a collection job 


 Test 5: Try to cancel one node of a collection job 


 Test 6: Try to cancel a parametric job 


 Test 7: Try to cancel one node of a parametric job 


 Test 8: Try to cancel a MPI job 

===> 
===> Test: WMS-job-cancel.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 17:37:44
===> Ended  : 17:46:02
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120321173744.log
* cancel.tgz: cancel.tgz

Proxy renewal

It is necessary to clean the proxies from ice and proxyreneal:
[root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice stop
stopping ICE... ok
[root@emi-demo11 siteinfo]# rm -rf /var/ice/persist_dir/*
[root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice start
[root@emi-demo11 siteinfo]# rm -f /var/glite/spool/glite-renewd/*

then

Setting MYPROXYSERVER=emitb2.ics.muni.cz in wms-command.conf

[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ........................................... Done
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ............................................. Done

Your proxy is valid until Fri Mar 23 04:02:35 2012
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ myproxy-init -s emitb2.ics.muni.cz -d -n
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating proxy ....................................................................... Done
Proxy Verify OK
Your proxy is valid until: Thu Mar 29 17:02:38 2012
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on emitb2.ics.muni.cz.

The following bug https://savannah.cern.ch/bugs/?func=detailitem&item_id=90610 was not hit by the testsuite because glite-wms-job-info, used by the testsuite, distinguishes between the proxies and doesn't show the bug.

[capannini@cert-17 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test proxy renewal operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test proxy renewal with LCG CE 


 Test 2: Test proxy renewal with CREAM CE 


 Test 3: Test proxy renewal with LCG CE (without setting MYPROXYSERVER) 


 Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER) 

===> ERROR: Timeout reached while waiting the job https://emi-demo11.cnaf.infn.it:9000/7PGXtMm8gcJ5wIcnzYyGqQ to finish
===> 
===> Test: WMS-proxy-renewal.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:08:16
===> Ended  : 14:31:07
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER)'] <<< 
===> 
===> Test log file is WMSService-TS_20120323100816.log
===> Error messages have been written in /home/capannini/wms_tests.old/WMS-service/WMSService-Test_20120323100816/errors.log
===> 
===>  Test directory /home/capannini/wms_tests.old/WMS-service/WMSService-Test_20120323100816 has not been cleaned for debug purpose
You have new mail in /var/spool/mail/capannini
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l -t 4  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test proxy renewal operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER) 

===> 
===> Test: WMS-proxy-renewal.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 14:41:17
===> Ended  : 14:41:57
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120323144117.log

Configuration file

Verified that the following entries are present in /etc/glite-wms/glite_wms.conf :

ICE section

ICE =  [
    job_cancellation_threshold_time   =   300;
    max_logfile_size   =   100*1024*1024;
    cream_url_prefix   =   "https://";
    start_subscription_updater   =   true;
    max_ice_mem  =  2096000;
    InputType   =   "jobdir";
    subscription_update_threshold_time   =   3600;
    ice_log_level   =   700;
    listener_enable_authn   =   true;
    listener_enable_authz   =   true;
    poller_status_threshold_time   =   30*60;
    lease_update_frequency   =   20*60;
    lease_delta_time   =   0;
    cream_url_postfix   =   "/ce-cream/services/CREAM2";
    subscription_duration   =   86400;
    start_lease_updater   =   false;
    notification_frequency   =   3*60;
    creamdelegation_url_postfix   =   "/ce-cream/services/gridsite-delegation";
    ice_host_cert   =   "/home/glite/.certs/hostcert.pem";
    cemon_url_postfix   =   "/ce-monitor/services/CEMonitor";
    ice_topic   =   "CREAM_JOBS";
    start_proxy_renewer   =   true;
    Input   =   "/var/ice/jobdir";
    max_logfile_rotations   =   10;
    start_poller   =   true;
    listener_port   =   7010;
    poller_delay   =   2*60;
    creamdelegation_url_prefix   =   "https://";
    purge_jobs   =   false;
    start_listener   =   false;
    proxy_renewal_frequency   =   600;
    bulk_query_size   =   100;
    soap_timeout   =   60;
    persist_dir   =   "/var/ice/persist_dir";
    log_on_file  =  true;
    logfile   =   "${WMS_LOCATION_LOG}/ice.log";
    ice_host_key   =   "/home/glite/.certs/hostkey.pem";
    max_ice_threads   =   10;
    log_on_console  =  false;
    cemon_url_prefix   =   "https://";
    ice_empty_threshold  =  600;
    ];
WorkloadManagerProxy:
WorkloadManagerProxy =  [
    EnableServiceDiscovery  =  false;
    ListMatchRootPath  =  "/tmp";
    OperationLoadScripts =  [
          jobSubmit  =  "${WMS_LOCATION_SBIN}/glite_wms_wmproxy_load_monitor --oper jobSubmit --load1 22 --load5 20 --load15 18 --memusage 99
 --diskusage 95 --fdnum 1000 --jdnum 1500  --ftpconn 300";
          jobRegister  =  "${WMS_LOCATION_SBIN}/glite_wms_wmproxy_load_monitor --oper jobRegister --load1 22 --load5 20 --load15 18 --memusag
e 99 --diskusage 95 --fdnum 1000 --jdnum 1500 --ftpconn 300";
          ];
    MinPerusalTimeInterval  =  1000;
    MaxServedRequests  =  50;
    ServiceDiscoveryInfoValidity  =  3600;
    LBServer  =  {"emi-demo11.cnaf.infn.it:9000"};
    LBServiceDiscoveryType  =  "org.glite.lb.server";
    LogLevel  =  5;
    SandboxStagingPath  =  "${WMS_LOCATION_VAR}/SandboxDir";
    LBLocalLogger  =  "localhost:9002";
    WeightsCacheValidity  =  86400;
    LogFile  =  "${WMS_LOCATION_LOG}/wmproxy.log";
    AsyncJobStart  =  true;
    GridFTPPort  =  2811;
    MaxInputSandboxSize  =  100000000;
    ];
NetworkServer:
NetworkServer =  [
    II_Timeout  =  100;
    EnableQuotaManagement  =  false;
    QuotaInsensibleDiskPortion  =  2.0;
    SandboxStagingPath  =  "${WMS_LOCATION_VAR}/SandboxDir";
    II_DN  =  "mds-vo-name=local, o=grid";
    MasterThreads  =  8;
    ConnectionTimeout  =  300;
    LogFile  =  "${WMS_LOCATION_LOG}/networkserver_events.log";
    LogLevel  =  5;
    II_Contact  =  "cert-bdii-04.cnaf.infn.it";
    //II_Contact  =  "egee-bdii.cnaf.infn.it";
    II_Port   =  2170;
    QuotaAdjustmentAmount  =  10000;
    DispatcherThreads  =  10;
    Gris_DN  =  "mds-vo-name=local, o=grid";
    Gris_Port  =  2170;
    DLI_SI_CatalogTimeout  =  60;
    EnableDynamicQuotaAdjustment  =  false;
    ListMatchParadise  =  "${WMS_LOCATION_TMP}/MatchArea";
    Gris_Timeout  =  20;
    BacklogSize  =  64;
    ListeningPort  =  7772;
    MaxInputSandboxSize  =  10000000;
    ];
WorkloadManager:
WorkloadManager =  [
    DisablePurchasingFromGris  =  true;
    IsmBlackList  =  {};
    ExpiryPeriod  =  7200;
    PipeDepth  =  200;
    JobWrapperTemplateDir  =  "${WMS_JOBWRAPPER_TEMPLATE}";
    IsmDump  =  "${WMS_LOCATION_VAR}/workload_manager/ismdump.fl";
    IsmIiPurchasingRate  =  480;
    MatchRetryPeriod  =  600;
    MaxReplansCount  =  5;
    EnableRecovery  =  true;
    DispatcherType  =  "jobdir";
    LogLevel  =  5;
    LogFile   =  "${WMS_LOCATION_LOG}/workload_manager_events.log";
    DliServiceName  =  "data-location-interface";
    RuntimeMalloc  =  "/usr/lib64/libjemalloc.so.1";
    IsmUpdateRate  =  600;
    WmsRequirements   =  ((ShortDeadlineJob =?= TRUE) ? RegExp(".*sdj$", other.GlueCEUniqueID) : !RegExp(".*sdj$", other.GlueCEUniqueID)) && (other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs) && (EnableWmsFeedback =?= TRUE ? RegExp("cream", other.GlueCEImplementationName, "i") : true);
    CeMonitorAsynchPort  =  0;
    QueueSize  =  1000;
    EnableBulkMM  =  true;
    MaxRetryCount  =  10;
    SiServiceName  =  "org.glite.SEIndex";
    IsmThreads  =  false;
    MaxOutputSandboxSize  =  -1;
    CeForwardParameters  =  {"GlueHostMainMemoryVirtualSize","GlueHostMainMemoryRAMSize","GlueCEPolicyMaxCPUTime"};
    CeMonitorServices  =  {};
    IsmIiLDAPCEFilterExt  =  "(|(GlueCEAccessControlBaseRule=VO:atlas)(GlueCEAccessControlBaseRule=VOMS:/atlas/*)(GlueCEAccessControlBaseRule=VO:alice)(GlueCEAccessControlBaseRule=VOMS:/alice/*)(GlueCEAccessControlBaseRule=VO:lhcb)(GlueCEAccessControlBaseRule=VOMS:/lhcb/*)(GlueCEAccessControlBaseRule=VO:cms)(GlueCEAccessControlBaseRule=VOMS:/cms/*)(GlueCEAccessControlBaseRule=VO:dteam)(GlueCEAccessControlBaseRule=VOMS:/dteam/*)(GlueCEAccessControlBaseRule=VO:biomed)(GlueCEAccessControlBaseRule=VOMS:/biomed/*)(GlueCEAccessControlBaseRule=VO:ops)(GlueCEAccessControlBaseRule=VOMS:/ops/*)(GlueCEAccessControlBaseRule=VO:infngrid)(GlueCEAccessControlBaseRule=VOMS:/infngrid/*)(GlueCEAccessControlBaseRule=VO:testers.eu-emi.eu)(GlueCEAccessControlBaseRule=VOMS:/testers.eu-emi.eu/*))";
    ReplanGracePeriod  =  3600;
    Input  =  "${WMS_LOCATION_VAR}/workload_manager/jobdir";
    WorkerThreads  =  5;
    ];
Common section:
Common =  [
    HostProxyFile  =  "${WMS_LOCATION_VAR}/glite/wms.proxy";
    LBProxy  =  true;
    DGUser  =  "${GLITE_WMS_USER}";
    ];
Logmonitor section:
LogMonitor =  [
    CondorLogRecycleDir  =  "${WMS_LOCATION_VAR}/logmonitor/CondorG.log/recycle";
    LockFile  =  "${WMS_LOCATION_VAR}/logmonitor/lock";
    AbortedJobsTimeout  =  600;
    CondorLogDir  =  "${WMS_LOCATION_VAR}/logmonitor/CondorG.log";
    MonitorInternalDir  =  "${WMS_LOCATION_VAR}/logmonitor/internal";
    MainLoopDuration  =  5;
    GlobusDownTimeout  =  7200;
    LogLevel  =  5;
    JobsPerCondorLog  =  1000;
    LogFile  =  "${WMS_LOCATION_LOG}/logmonitor_events.log";
    ExternalLogFile  =  "${WMS_LOCATION_LOG}/logmonitor_external.log";
    RemoveJobFiles  =  true;
    IdRepositoryName  =  "irepository.dat";
    ForceCancellationRetries  =  2;
    ];
JobController section:
JobController =  [
    Input  =  "${WMS_LOCATION_VAR}/jobcontrol/jobdir/";
    ContainerRefreshThreshold  =  1000;
    CondorQuery  =  "${CONDORG_INSTALL_PATH}/bin/condor_q";
    LogFile  =  "${WMS_LOCATION_LOG}/jobcontoller_events.log";
    CondorDagman  =  "${CONDORG_INSTALL_PATH}/bin/condor_dagman";
    MaximumTimeAllowedForCondorMatch  =  1800;
    CondorRelease  =  "${CONDORG_INSTALL_PATH}/bin/condor_release";
    OutputFileDir  =  "${WMS_LOCATION_VAR}/jobcontrol/condorio";
    InputType  =  "jobdir";
    CondorRemove  =  "${CONDORG_INSTALL_PATH}/bin/condor_rm";
    DagmanMaxPre  =  10;
    LockFile  =  "${WMS_LOCATION_VAR}/jobcontrol/lock";
    SubmitFileDir  =  "${WMS_LOCATION_VAR}/jobcontrol/submit";
    CondorSubmit  =  "${CONDORG_INSTALL_PATH}/bin/condor_submit";
    LogLevel  =  5;
    ];
Verified that:

===> test PASSED

Limiter mechanism

[capannini@cert-17 WMS-service]$ python WMS-limiter-mechanism.py -c wms-command.conf -V dteam -d 3 -l -t 1,4,6-10
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Limiter Mechanism 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Test option --load1 threshold for load average (1 min) 


 Test 4: Test option --memusage threshold for memory usage (%) 


 Test 6: Test option --ftpconn threshold for number of FTP connections 


 Test 7: Test option --diskusage threshold for disk usage (%) 

===> 
===> Test: WMS-limiter-mechanism.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:27:11
===> Ended  : 11:27:24
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120323112711.log

Purge

Normal job cycle
[capannini@cert-17 WMS-service]$ python WMS-check-purger.py -c wms-command.conf -V dteam -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Purge Mechanism 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Test purge , normal job cycle ( Submit to LCG CE ) 


 Test 2: Test purge, normal job cycle ( Submit to CREAM CE ) 


 Test 3: Test proxy cache purging 

===> 
===> Test: WMS-check-purger.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 12:34:19
===> Ended  : 13:00:47
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120323123419.log
SandboxDir cron purger
The purge of the SandBox dir is done by a cron job

- Submit a job and force its purge before it finishes:

[capannini@cert-17 ~]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ls.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/VytISYunnM2UepnpRN9o3w

==========================================================================


[capannini@cert-17 ~]$ 
[capannini@cert-17 ~]$ 
[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/VytISYunnM2UepnpRN9o3w


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/VytISYunnM2UepnpRN9o3w
Current Status:     Scheduled 
Status Reason:      unavailable
Destination:        cebo-t3-01.cr.cnaf.infn.it:8443/cream-lsf-T3_BO
Submitted:          Fri Mar 23 12:36:49 2012 CET
==========================================================================

[root@emi-demo11 SandboxDir]# su - glite
[glite@emi-demo11 ~]$ 
[glite@emi-demo11 ~]$ 
[glite@emi-demo11 ~]$ 
[glite@emi-demo11 ~]$ 
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/Vy/ -s
23 Mar, 12:38:06 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/VytISYunnM2UepnpRN9o3w: removed DONE job

===>     === test PASSED === 

- Purge a done job:

[capannini@cert-17 ~]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ls.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q

==========================================================================


[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-39.pd.infn.it:8443/cream-pbs-cert
Submitted:          Fri Mar 23 12:42:45 2012 CET
==========================================================================

[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/HX -s
23 Mar, 12:51:19 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q: removed DONE job

[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q
Current Status:     Cleared 
Status Reason:      timed out, resource purge forced
Destination:        cream-39.pd.infn.it:8443/cream-pbs-cert
Submitted:          Fri Mar 23 12:42:45 2012 CET
==========================================================================

===>     === test PASSED ===

- Purge only jobs older than 12 hours:

[glite@emi-demo11 ~]$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin +720
/var/SandboxDir/2n/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f2n1K8mLSRn62CxdRL5V2mw
/var/SandboxDir/S9/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fS9jwBKA1y0ViIyQOozZ8gA

Try to purge:

[glite@emi-demo11 ~]$ date
Fri Mar 23 15:39:16 CET 2012
[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/2n
total 4
drwxrwx--- 5 dteam047 glite 4096 Mar 22 16:52 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f2n1K8mLSRn62CxdRL5V2mw
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/2n -t 43200
23 Mar, 15:39:48 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/2n1K8mLSRn62CxdRL5V2mw: removed ABORTED job
[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/2n
total 0
[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/S9
total 4
drwxrwx--- 5 dteam047 glite 4096 Mar 21 17:35 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fS9jwBKA1y0ViIyQOozZ8gA
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/S9 -t 43200
23 Mar, 15:40:32 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/S9jwBKA1y0ViIyQOozZ8gA: removed DONE job
[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/S9
total 0

Find some directories that should not be purged:

[glite@emi-demo11 ~]$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin -240
/var/SandboxDir/7P/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f7PGXtMm8gcJ5wIcnzYyGqQ
/var/SandboxDir/OG/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOGPEs-2Ne0i4TayaIG_5fDFQ

Try to purge:

[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/7P -t 43200
[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/7P
total 4
drwxrwx--- 5 dteam047 glite 4096 Mar 23 12:30 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f7PGXtMm8gcJ5wIcnzYyGqQ
[glite@emi-demo11 ~]$ 
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/OG -t 43200
[glite@emi-demo11 ~]$ 
[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/OG
total 4
drwxrwx--- 5 dteam047 glite 4096 Mar 23 11:46 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOGPEs-2Ne0i4TayaIG_5fDFQ

===> Test PASSED

- Purge a job whose proxy is already expired

[glite@emi-demo11 ~]$ openssl x509 -in /var/SandboxDir/Zc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fZc2nqpKxjTTflY1DLirJEA/user.proxy -noout -dates
notBefore=Mar 21 16:28:16 2012 GMT
notAfter=Mar 22 16:32:16 2012 GMT

[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/Zc2nqpKxjTTflY1DLirJEA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Zc2nqpKxjTTflY1DLirJEA
Current Status:     Submitted 
Submitted:          Wed Mar 21 17:33:16 2012 CET
Parent Job:         https://emi-demo11.cnaf.infn.it:9000/4yBhu_osKLHV6-qE7STjaQ
==========================================================================

[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/Zc -s23 Mar, 15:56:25 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/Zc2nqpKxjTTflY1DLirJEA: removed SUBMITTED job

[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/Zc2nqpKxjTTflY1DLirJEA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Zc2nqpKxjTTflY1DLirJEA
Current Status:     Cleared 
Status Reason:      timed out, resource purge forced
Submitted:          Wed Mar 21 17:33:16 2012 CET
Parent Job:         https://emi-demo11.cnaf.infn.it:9000/4yBhu_osKLHV6-qE7STjaQ
==========================================================================

===>     === test PASSED ===

- Purge a dag job

[capannini@cert-17 dag]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf dag.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g

==========================================================================

[capannini@cert-17 dag]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g
Current Status:     Running 
Status Reason:      unavailable
Destination:        dagman
Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================

- Nodes information for: 
    Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/0oWd90UfoGa_Hpekbxanjw
    Current Status:     Submitted 
    Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================
    
    Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/SPpi50irdHyOVsjnOlfJ2A
    Current Status:     Submitted 
    Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================
    
    Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/WZyAUZqFIPJijTyT9kb5iQ
    Current Status:     Ready 
    Destination:        argoce01.na.infn.it:2119/jobmanager-lcgpbs-cert
    Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================
    
    Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/iHlJijMoMfZeD05Ax3nJNA
    Current Status:     Submitted 
    Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================
    
    Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/oX3RwUu__q7fOPKX5l8OJA
    Current Status:     Submitted 
    Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================

[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/nS -s
23 Mar, 16:01:46 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:354): https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g: 5/5 nodes removed
23 Mar, 16:01:46 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:366): https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g: removed RUNNING dag 

[capannini@cert-17 dag]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g
Current Status:     Cleared 
Status Reason:      timed out, resource purge forced
Destination:        dagman
Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================

- Nodes information for: 
    Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/0oWd90UfoGa_Hpekbxanjw
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================
    
    Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/SPpi50irdHyOVsjnOlfJ2A
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================
    
    Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/WZyAUZqFIPJijTyT9kb5iQ
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Destination:        argoce01.na.infn.it:2119/jobmanager-lcgpbs-cert
    Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================
    
    Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/iHlJijMoMfZeD05Ax3nJNA
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================
    
    Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/oX3RwUu__q7fOPKX5l8OJA
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Submitted:          Fri Mar 23 15:58:59 2012 CET
==========================================================================
===>     === test PASSED === 

Published information

bdb database information

ldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=grid'
# extended LDIF
#
# LDAPv3
# base <o=grid> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#

# grid
dn: o=grid
objectClass: organization
o: grid

# local, grid
dn: Mds-Vo-name=local,o=grid
Mds-Vo-name: local
objectClass: Mds

# resource, grid
dn: Mds-Vo-name=resource,o=grid
Mds-Vo-name: resource
objectClass: Mds

# emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637, resource, grid
dn: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_84141563
 7,Mds-Vo-name=resource,o=grid
GlueServiceAccessControlBaseRule: VO:atlas
GlueServiceAccessControlBaseRule: VO:alice
GlueServiceAccessControlBaseRule: VO:lhcb
GlueServiceAccessControlBaseRule: VO:cms
GlueServiceAccessControlBaseRule: VO:dteam
GlueServiceAccessControlBaseRule: VO:biomed
GlueServiceAccessControlBaseRule: VO:ops
GlueServiceAccessControlBaseRule: VO:infngrid
GlueServiceAccessControlBaseRule: VO:testers.eu-emi.eu
GlueServiceStatus: Other
GlueServiceStatusInfo: ??
objectClass: GlueTop
objectClass: GlueService
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueServiceUniqueID: emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637
GlueServiceAccessControlRule: atlas
GlueServiceAccessControlRule: alice
GlueServiceAccessControlRule: lhcb
GlueServiceAccessControlRule: cms
GlueServiceAccessControlRule: dteam
GlueServiceAccessControlRule: biomed
GlueServiceAccessControlRule: ops
GlueServiceAccessControlRule: infngrid
GlueServiceAccessControlRule: testers.eu-emi.eu
GlueServiceEndpoint: https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_se
 rver
GlueServiceVersion: 3.3.5
GlueSchemaVersionMinor: 3
GlueServiceName: INFN-CREAMTEST-WMProxy
GlueServiceType: org.glite.wms.WMProxy
GlueServiceWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl
GlueServiceSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-guid
 e.pdf
GlueForeignKey: GlueSiteUniqueID=INFN-CREAMTEST
GlueServiceOwner: atlas
GlueServiceOwner: alice
GlueServiceOwner: lhcb
GlueServiceOwner: cms
GlueServiceOwner: dteam
GlueServiceOwner: biomed
GlueServiceOwner: ops
GlueServiceOwner: infngrid
GlueServiceOwner: testers.eu-emi.eu
GlueSchemaVersionMajor: 1
GlueServiceStartTime: 2012-03-26T00:00:01+02:00

# DN, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637, resource, grid
dn: GlueServiceDataKey=DN,GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glit
 e.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: DN
GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx
 y_841415637
GlueServiceDataValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=emi-demo11.cnaf.infn.it

# glite-info-service_version, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_8
 41415637, resource, grid
dn: GlueServiceDataKey=glite-info-service_version,GlueServiceUniqueID=emi-demo
 11.cnaf.infn.it_org.glite.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_version
GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx
 y_841415637
GlueServiceDataValue: 1.6

# glite-info-service_hostname, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_
 841415637, resource, grid
dn: GlueServiceDataKey=glite-info-service_hostname,GlueServiceUniqueID=emi-dem
 o11.cnaf.infn.it_org.glite.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_hostname
GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx
 y_841415637
GlueServiceDataValue: emi-demo11.cnaf.infn.it

# search result
search: 2
result: 0 Success

# numResponses: 8
# numEntries: 7

Stats database definitions

ldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=infosys'
# extended LDIF
#
# LDAPv3
# base <o=infosys> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#

# infosys
dn: o=infosys
objectClass: organization
o: infosys

# zip, infosys
dn: CompressionType=zip,o=infosys
objectClass: CompressedContent
Hostname: localhost
CompressionType: zip
Data: file:///var/lib/bdii/archive/12-03-26-11-05-27-snapshot.gz

# localhost, infosys
dn: Hostname=localhost,o=infosys
objectClass: UpdateStats
Hostname: localhost
FailedDeletes: 0
ModifiedEntries: 5
DeletedEntries: 0
UpdateTime: 0
FailedAdds: 0
FailedModifies: 0
TotalEntries: 14
QueryTime: 0
NewEntries: 1
DBUpdateTime: 0
ReadTime: 0
PluginsTime: 0
ProvidersTime: 0

# search result
search: 2
result: 0 Success

# numResponses: 4
# numEntries: 3

Stats database definitions

ldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=glue'
# extended LDIF
#
# LDAPv3
# base <o=glue> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#

# glue
dn: o=glue
objectClass: organization
o: glue

# grid, glue
dn: GLUE2GroupID=grid,o=glue
objectClass: GLUE2Group
GLUE2GroupID: grid

# resource, glue
dn: GLUE2GroupID=resource,o=glue
objectClass: GLUE2Group
GLUE2GroupID: resource

# emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue
dn: GLUE2ServiceID=emi-demo11.cnaf.infn.it_wmproxy_2598325561,GLUE2GroupID=res
 ource,o=glue
GLUE2EntityValidity: 3600
GLUE2ServiceType: org.glite.wms.WMProxy
GLUE2ServiceID: emi-demo11.cnaf.infn.it_wmproxy_2598325561
objectClass: GLUE2Service
GLUE2ServiceQualityLevel: production
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-service
GLUE2EntityOtherInfo: InfoProviderVersion=1.1
GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it
GLUE2ServiceComplexity: endpointType=1, share=0, resource=0
GLUE2ServiceCapability: executionmanagement.candidatesetgenerator
GLUE2ServiceCapability: executionmanagement.jobdescription
GLUE2ServiceCapability: executionmanagement.jobmanager
GLUE2EntityName: INFN-CREAMTEST-WMProxy
GLUE2ServiceAdminDomainForeignKey: INFN-CREAMTEST
GLUE2EntityCreationTime: 2012-03-26T09:05:27Z

# emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598325561
 , emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue
dn: GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.W
 MProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.infn.it_wmproxy_2598325561,G
 LUE2GroupID=resource,o=glue
GLUE2EntityValidity: 3600
GLUE2EndpointQualityLevel: production
GLUE2EndpointImplementor: gLite
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint
GLUE2EntityOtherInfo: InfoProviderVersion=1.2
GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it
GLUE2EntityOtherInfo: MiddlewareName=EMI
GLUE2EntityOtherInfo: MiddlewareVersion=1.10.0-1
GLUE2EndpointCapability: executionmanagement.candidatesetgenerator
GLUE2EndpointCapability: executionmanagement.jobdescription
GLUE2EndpointCapability: executionmanagement.jobmanager
GLUE2EndpointHealthState: ok
GLUE2EndpointServiceForeignKey: emi-demo11.cnaf.infn.it_wmproxy_2598325561
GLUE2EntityName: WMProxy endpoint for Service emi-demo11.cnaf.infn.it_wmproxy_
 2598325561
GLUE2EndpointTechnology: webservice
GLUE2EndpointWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl
GLUE2EndpointInterfaceName: org.glite.wms.WMProxy
GLUE2EndpointURL: https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_serve
 r
GLUE2EndpointDowntimeInfo: See the GOC DB for downtimes: https://goc.egi.eu/
GLUE2EndpointImplementationVersion: 3.3.5
GLUE2EndpointSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-gu
 ide.pdf
GLUE2EndpointIssuerCA: /C=IT/O=INFN/CN=INFN CA
GLUE2EndpointServingState: production
objectClass: GLUE2Endpoint
GLUE2EndpointInterfaceVersion: 1.0
GLUE2EndpointImplementationName: WMS
GLUE2EndpointTrustedCA: IGTF
GLUE2EndpointID: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMPr
 oxy_2598325561
GLUE2EndpointStartTime: 2012-03-25T22:00:01Z
GLUE2EndpointHealthStateInfo: WMProxy httpd listening on port 7443 httpd is ru
 nning .... === WMProxy Server running instances: UID PID PPID C STIME TTY TIM
 E CMD glite 11507 27310 0 09:28 ? 00:00:00 /usr/bin/glite_wms_wmproxy_server
GLUE2EntityCreationTime: 2012-03-26T09:05:27Z

# DN_1, emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598
 325561, emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue
dn: GLUE2ExtensionLocalID=DN_1,GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy
 _2598325561_org.glite.wms.WMProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.i
 nfn.it_wmproxy_2598325561,GLUE2GroupID=resource,o=glue
GLUE2ExtensionLocalID: DN_1
GLUE2ExtensionKey: DN
objectClass: GLUE2Extension
GLUE2ExtensionValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=emi-demo11.cnaf.infn.it
GLUE2ExtensionEntityForeignKey: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org
 .glite.wms.WMProxy_2598325561

# emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598325561
 _Policy, emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_25
 98325561, emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue
dn: GLUE2PolicyID=emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMP
 roxy_2598325561_Policy,GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy_259832
 5561_org.glite.wms.WMProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.infn.it_
 wmproxy_2598325561,GLUE2GroupID=resource,o=glue
GLUE2AccessPolicyEndpointForeignKey: emi-demo11.cnaf.infn.it_wmproxy_259832556
 1_org.glite.wms.WMProxy_2598325561
GLUE2EntityValidity: 3600
objectClass: GLUE2Policy
objectClass: GLUE2AccessPolicy
GLUE2PolicyRule: VO:atlas
GLUE2PolicyRule: VO:alice
GLUE2PolicyRule: VO:lhcb
GLUE2PolicyRule: VO:cms
GLUE2PolicyRule: VO:dteam
GLUE2PolicyRule: VO:biomed
GLUE2PolicyRule: VO:ops
GLUE2PolicyRule: VO:infngrid
GLUE2PolicyRule: VO:testers.eu-emi.eu
GLUE2PolicyScheme: org.glite.standard
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint
GLUE2EntityOtherInfo: InfoProviderVersion=1.2
GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it
GLUE2PolicyUserDomainForeignKey: atlas
GLUE2PolicyUserDomainForeignKey: alice
GLUE2PolicyUserDomainForeignKey: lhcb
GLUE2PolicyUserDomainForeignKey: cms
GLUE2PolicyUserDomainForeignKey: dteam
GLUE2PolicyUserDomainForeignKey: biomed
GLUE2PolicyUserDomainForeignKey: ops
GLUE2PolicyUserDomainForeignKey: infngrid
GLUE2PolicyUserDomainForeignKey: testers.eu-emi.eu
GLUE2PolicyID: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProx
 y_2598325561_Policy
GLUE2EntityName: Access control rules for Endpoint emi-demo11.cnaf.infn.it_wmp
 roxy_2598325561_org.glite.wms.WMProxy_2598325561
GLUE2EntityCreationTime: 2012-03-26T09:05:27Z

# search result
search: 2
result: 0 Success

# numResponses: 8
# numEntries: 7

Performance test

Collection of 1000 nodes

Submission of a collection of 1000 nodes
[capannini@cert-17 StressTest]$ ./StressTest.sh -t 1 -n 1000 -c ~/wms_devel20.conf -j ls.jdl
Test starts on mer mar 21 12:13:25 CET 2012: submit 1 collections (of 1000 nodes) with a frequency of 60 seconds using 1 users.

Submission n. 1:
mer mar 21 12:13:25 CET 2012: user 0 is submitting...

Connecting to the service https://devel20.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://devel17.cnaf.infn.it:9000/_-FtjYEN09PrG31-TpMU1A

The job identifier has been saved in the following file:
/home/capannini/certification/StressTest/Test_1332328400/output/USER0_0.jobid

==========================================================================


Submission takes 5 seconds.
1 jobs submitted in 5 seconds: 5/5/5 (min/avg/max)
Test finishes at mer mar 21 12:13:30 CET 2012
All the nodes of the collection reached the status Done (Success), except a few of them which were submitted to the CE cremoso.cnaf.infn.it which had problems.

===> Test PASSED

Stress test

  • 2880 collection of 25 nodes each (total: 72000 jobs)
  • One collection every 60 seconds
  • one user
  • Use LCG-CEs and CREAM-CEs (with different batch systems)
  • Use automatic-delegation
  • The job is a `ls -l`
  • Resubmission is enabled
  • Enable proxy renewal

[capannini@cert-17 StressTest]$ ./StressTest.sh -t 2880 -n 25 -c ~/wms_devel20.conf -j ls.jdl
Test starts on mer mar 21 16:10:09 CET 2012: submit 2880 collections (of 25 nodes) with a frequency of 60 seconds using 1 users.

Results

2880 jobs submitted in 4721 seconds: 1/1/48 (min/avg/max) Test finishes at ven mar 23 16:09:44 CET 2012

Results: DONE : 71777 NOTDone: 0 Aborted: 98


Total : 71875

done jobs on CREAM CEs: 71354 (99.4%) done jobs on LCG CEs: 423 (0.6%)

The above statistics is obatined in the following way: [capannini@cert-17 output]$ cat *.done|wc -l 71777 [capannini@cert-17 output]$ cat *.done|grep '8443/cream' |wc -l 71354 [capannini@cert-17 output]$ cat *.done|grep '2119/jobmanager'|wc -l 423

====> Test PASSED (Aborted/Total = 0.1%)

Regression tests

Bugs attached to the task

bug #87261: WMproxy GACLs do not support wildcards (as they used to do) Fix Certified

The WMproxy GACL file should accept now wildcards, on the FQAN tag only.

VO: dteam, FQAN: /dteam/Role=NULL/Capability=NULL

Test #1: GACL: [...] /dteam /dteam/R* [...]

access granted: [capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo11.conf ls.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/laC85FTZblaB409x38-mMQ

======================================================================

WMP log says: 26 Mar, 12:20:58 -D- PID: 32135 - "GaclManager::loadCredential": GACL FQAN fqan:/dteam/R%2A was matched to /dteam/Role=NULL/Capability=NULL

Test #2: [...] /dteam /dteam/r* [...]

access denied :

[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo11.conf ls.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

Warning - Unable to delegate the credential to the endpoint: https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server AuthorizationException: Authorization error: user not authorized at checkGaclUserAuthZ()[/home/condor/execute/dir_2494/userdir/emi.wms.wmproxy/build/../src/authorizer/wmpauthorizer.cpp:416] at checkGaclUserAuthZ()[/home/condor/execute/dir_2494/userdir/emi.wms.wmproxy/build/../src/authorizer/wmpauthorizer.cpp:281] at authorize()[/home/condor/execute/dir_2494/userdir/emi.wms.wmproxy/build/../src/authorizer/wmpauthorizer.cpp:149] at getProxyReq()[/home/condor/execute/dir_2494/userdir/emi.wms.wmproxy/build/../src/server/wmpoperations.cpp:627]

Switching to next WMProxy Server...

Error - Operation failed Unable to find any endpoint where to perform service request

Test #3:

[...] /dtea* [...]

access granted

[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo11.conf ls.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/EPcAIfYJL6YkFKhlgJkNRw

======================================================================

WMP log says: 26 Mar, 12:22:36 -D- PID: 32135 - "GaclManager::loadCredential": GACL FQAN fqan:/dtea%2A was matched to /dteam/Role=NULL/Capability=NULL

Test #4: [...] /dteam /dteam/* [...]

access granted

[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo11.conf ls.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/2M1Csn3LSER-jq5nfgNblw

======================================================================

WMP log says: 26 Mar, 12:24:23 -D- PID: 32135 - "GaclManager::loadCredential": GACL FQAN fqan:/dteam/%2A was matched to /dteam/Role=NULL/Capability=NULL

bug #91875: EMI WMS doesn't use grid_monitor Fix Certified

Submit a job to a GRAM CE and check that the scrpt /opt/lcg/sbin/grid_monitor.sh (linked by /usr/sbin/grid_monitor.sh) is accessed in read.


[root@emi-demo11 ~]# date
lun mar 26 14:18:26 CEST 2012

[root@emi-demo11 ~]# ls -lu /opt/lcg/sbin/grid_monitor.sh 
-rwxr-xr-x 1 root root 41918 23 mar 14:35 /opt/lcg/sbin/grid_monitor.sh


[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo11.conf ls.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/as7TpX-6HLtf1o81piz24g

==========================================================================

[root@emi-demo11 ~]# ls -lu /opt/lcg/sbin/grid_monitor.sh 
-rwxr-xr-x 1 root root 41918 26 mar 14:20 /opt/lcg/sbin/grid_monitor.sh

Old bugs

bug #40982: When a collection is aborted the "Abort" event should be logged for the sub-nodes as well /2 Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 40982 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 40982 


 All tests PASSED 

bug #44599: WMS should consider "MaxTotalJobs" Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 44599 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 44599 


 All tests PASSED 

bug #50009: wmproxy.gacl person record allows anyone to pass Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 50009 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 50009 


 All tests PASSED 

bug #52617: [ yaim-wms ] host{cert,key}.pem in /home/glite Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 52617 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 52617 


 All tests PASSED 

bug #58968: Request for handling SMPGranularity attribute in the JDL Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 58968 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 58968 


 All tests PASSED 

bug #62211: [ yaim-wms ] Enable Glue 2.0 publishing Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 62211 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 62211 


 All tests PASSED 

bug #70061: WMS hates collections with 192 nodes! Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 70061 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 70061 


 All tests PASSED 

bug #70824: environment values in JDL cannot have spaces Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 70824 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 70824 


 All tests PASSED 

bug #73192: Submission failed due to a credential problem Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 73192 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 73192 


 All tests PASSED 

bug #73699: Wrong retry count computation Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 73699 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 73699 


 All tests PASSED 

bug #73711: edg_wll_SetLoggingJobProxy with empty sequence code returns "no state in DB" Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 73711 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 73711 


 All tests PASSED 

bug #75368: ICE should log a DONE_FAILED to LB every time the job is going to be resubmitted Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 75368 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 75368 


 All tests PASSED 

bug #77004: Wrong myproxyserver string processing in ICE Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 77004 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 77004 


 All tests PASSED 

bug #77055: "MyProxyServer: wrong type caught for attribute" for parametric jobs Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 77055 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 77055 


 All tests PASSED 

bug #77694: Resource BDII for WMS needs to be revisit Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 77694 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 77694 


 All tests PASSED 

bug #77876: While purging DAGs/Collections the CLEAR event is only logged for the parent node Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 77876 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 77876 


 All tests PASSED 

bug #78406: [ yaim-wms ] yaim should set IsmIiLDAPCEFilterExt according to the supported VO(s) Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 78406 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 78406 


 All tests PASSED 

bug #78484: [ YAIM_WMS ] Multiple parameter configuration added in condor_config.local Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 78484 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 78484 


 All tests PASSED 

bug #79141: various bugs about parametric jobs Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 79141 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 79141 


 All tests PASSED 

bug #81376: glite-wms-wmproxy.restart.cron MUST support graceful wmp restart Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 81376 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 81376 


 All tests PASSED 

bug #81568: some inconsistencies in locations for logs and configuration Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 81568 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 81568 


 All tests PASSED 

bug #82687: emi WMS problems with ISB tar file handling Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 82687 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 82687 


 All tests PASSED 

bug #82776: typo in WMS jobwrapper Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 82776 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 82776 


 All tests PASSED 

bug #82983: [yaim-wms] authorization problem in WMS EMI-1 Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 82983 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 82983 


 All tests PASSED 

bug #83062: [yaim-wms] A different template should be used for glue2 publication Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 83062 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 83062 


 All tests PASSED 

bug #85327: [yaim-wms] glite-wms-wmproxy.restart.cron missing HOSTNAME environment variable Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 85327 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 85327 


 All tests PASSED 

bug #86490: EMI WMS stops accepting jobs after 31999th submission for the same DN (on ext3) Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 86490 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 86490 


 All tests PASSED 

bug #86682: [yaim-wms] yaim changes ownership of /var Passed

[capannini@cert-17 regression_tests]$ python execute_regTest.py -d 3 -b 86682 -l
+++++++++++++++++++++++++++++++++++++++++++++++++++++
+ Regression TestSuite ....                         +
+++++++++++++++++++++++++++++++++++++++++++++++++++++

 Testing bug 86682 


 All tests PASSED 

FabioCapannini - 2012-03-15

Topic attachments
I Attachment Action Size Date Who Comment
Unknown file formatlog WMSService-TS_20120316105040.log manage 12.1 K 2012-03-16 - 10:30 FabioCapannini  
Unknown file formatlog WMSService-TS_20120316113322.log manage 34.8 K 2012-03-16 - 11:02 FabioCapannini  
Unknown file formatlog WMSService-TS_20120316173205.log manage 20.9 K 2012-03-16 - 16:49 FabioCapannini  
Unknown file formatlog WMSService-TS_20120323100816.log manage 388.7 K 2012-03-23 - 13:50 FabioCapannini  
Unknown file formatlog WMSService-TS_20120323112711.log manage 17.4 K 2012-03-23 - 10:30 FabioCapannini  
Unknown file formatlog WMSService-TS_20120323123419.log manage 69.7 K 2012-03-23 - 13:53 FabioCapannini  
Unknown file formatlog WMSService-TS_20120323144117.log manage 3.9 K 2012-03-23 - 13:50 FabioCapannini  
Compressed Zip archivetgz all.tgz manage 9.9 K 2012-03-19 - 15:14 FabioCapannini  
Compressed Zip archivetgz bulk.tgz manage 10.4 K 2012-03-19 - 15:11 FabioCapannini  
Compressed Zip archivetgz cancel.tgz manage 8.9 K 2012-03-22 - 10:59 FabioCapannini  
Compressed Zip archivetgz dag.tgz manage 12.1 K 2012-03-20 - 11:35 FabioCapannini  
Compressed Zip archivetgz deleg.tgz manage 1.9 K 2012-03-20 - 16:55 FabioCapannini  
Unknown file formatlog install.log manage 122.4 K 2012-03-15 - 11:11 FabioCapannini Installation log
Compressed Zip archivetgz listmatch.tgz manage 1.5 K 2012-03-21 - 09:59 FabioCapannini  
Compressed Zip archivetgz parallel.tgz manage 5.0 K 2012-03-21 - 09:27 FabioCapannini  
Compressed Zip archivetgz param.tgz manage 15.8 K 2012-03-20 - 09:48 FabioCapannini  
Compressed Zip archivetgz perusal.tgz manage 3.8 K 2012-03-20 - 16:48 FabioCapannini  
Compressed Zip archivetgz prologue.tgz manage 3.0 K 2012-03-21 - 11:53 FabioCapannini  
Compressed Zip archivetgz resubmit.tgz manage 4.6 K 2012-03-21 - 16:28 FabioCapannini  
Compressed Zip archivetgz submit.tgz manage 3.0 K 2012-03-16 - 09:45 FabioCapannini  
Unknown file formatlog update.log manage 31.1 K 2012-03-15 - 11:48 FabioCapannini Update log
Unknown file formatlog yaim-config.log manage 9.0 K 2012-03-15 - 11:25 FabioCapannini yaim configuration log
Edit | Attach | PDF | History: r34 < r33 < r32 < r31 < r30 | Backlinks | Raw View | More topic actions...
Topic revision: r31 - 2012-03-28 - FabioCapannini
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback