WMS v. 3.4 test report

Summary

  • Component: WMS 3.4

  • ETICS Subsystem Configuration Name: emi-wms_R_3_4_0_7

  • VCS Tag:

  • EMI Major Release: EMI 2 (KMatterhorn)

  • Platform: SL5/x86_64 + EPEL

  • Certification report: not yet available

  • Outcome: Certification under way

Deployment Tests

Clean installation - PASSED

  • Starting from a SL5 x86_64 kernel machine:

[root@cert-13 ~]# cat /etc/redhat-release 
Scientific Linux SL release 5.8 (Boron)
[root@cert13 ~]# uname -a
Linux cert-13.cnaf.infn.it 2.6.18-308.13.1.el5 

INSTALL LOG : * 20120831_151144_WMS3.4_SL5_EMI2INSTALL.log: 20120831_151144_WMS3.4_SL5_EMI2INSTALL.log

COMMAND SEQUENCE:

wget http://emisoft.web.cern.ch/emisoft/dist/EMI/2/RPM-GPG-KEY-emi -P /etc/pki/rpm-gpg/
yum -y install yum-protectbase
yum -y install yum-priorities
rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/2/sl5/x86_64/base/emi-release-2.0.0-1.sl5.noarch.rpm
wget --no-check-certificate http://emisoft.web.cern.ch/emisoft/dist/EMI/certification/repos/emi2-cert-sl5-base.repo -O /etc/yum.repos.d/emi2-cert-sl5-base.repo
yum clean all
yum makecache
yum -y install emi-release
yum -y install yum-protectbase
yum -y install yum-priorities
yum -y install ca-policy-egi-core
yum -y install emi-wms 
yum -y install condor-emi
/opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB 
/opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB
chown root:root /var /var/log 
source /usr/libexec/grid-env.sh; /usr/sbin/glite-wms-create-proxy.sh /var/glite/wms.proxy /var/log/wms/create_proxy.log
rpm -qa |grep emi |sort
service gLite stop
service gLite start
service gLite status

Update Installation - PASSED

INSTALL LOG : * 20120903_180452_TEST_EMI1TOEMI2UPDATE.log: 20120903_180452_TEST_EMI1TOEMI2UPDATE.log

COMMAND SEQUENCE:

wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -P /etc/pki/rpm-gpg/
yum -y install yum-protectbase
yum -y install yum-priorities
rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/1/sl5/x86_64/base/emi-release-1.0.0-1.sl5.noarch.rpm
yum clean all
yum makecache
yum -y install emi-release
yum -y install yum-protectbase
yum -y install yum-priorities
yum -y install ca-policy-egi-core
yum -y install emi-wms
/opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB 
/opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB
rpm -qa |grep emi
rpm -qa |grep wms
service gLite restart
rpm -e emi-release
rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/2/sl5/x86_64/base/emi-release-2.0.0-1.sl5.noarch.rpm
wget --no-check-certificate http://emisoft.web.cern.ch/emisoft/dist/EMI/certification/repos/emi2-cert-sl5-base.repo -O /etc/yum.repos.d/emi2-cert-sl5-base.repo
yum clean all
yum makecache
yum -y remove condor condor-lcg
yum -y install emi-wms condor-emi
yum -y update
rpm -qa |grep emi
rpm -qa |grep wms
chown root:root /var /var/log 
source /usr/libexec/grid-env.sh; /usr/sbin/glite-wms-create-proxy.sh /var/glite/wms.proxy /var/log/wms/create_proxy.log 
/opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB 
/opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB
service gLite restart
chmod a+r /etc/nsswitch.conf
/sbin/restorecon /etc/nsswitch.conf
/etc/init.d/glite-wms-wmproxy restart

Unit Tests - NA

N/A: Tests will be available with EMI-2.

Basic Functionality tests

Submission

Normal - PASSED

[dongiovanni@emitestbed08 ~]$ glite-wms-job-status  https://cert-13.cnaf.infn.it:9000/bJ-1NLTGcc3OjUldvbhZrg
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/bJ-1NLTGcc3OjUldvbhZrg
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        ctb04.gridctb.uoa.gr:8443/cream-pbs-emitesters
Submitted:          Fri Aug 31 15:51:39 2012 CEST
==========================================================================

SUBMISSION TESTSUITE: * WMSService-TS_20120831163229.log: WMSService-TS_20120831163229.log

[dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 
 Test 1A: Submit to an LCG-CE 
 Test 1B: Submit to a CREAM CE 
 Test 1C: Submit without restrictions 
===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 16:32:29
===> Ended  : 16:57:23
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120831163229.log

Normal on EMI1->EMI2 UPDATE Installation - PASSED

[dongiovanni@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/4dapc9K3V1IWpGjjdREq2w 
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/4dapc9K3V1IWpGjjdREq2w
Current Status:     Scheduled 
Status Reason:      unavailable
Destination:        ctb04.gridctb.uoa.gr:8443/cream-pbs-emitesters
Submitted:          Tue Sep  4 12:06:01 2012 CEST
==========================================================================

SUBMISSION TESTSUITE: * WMSService-TS_20120904121133.log: WMSService-TS_20120904121133.log

[dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 
 Test 1A: Submit to an LCG-CE 
 Test 1B: Submit to a CREAM CE 
 Test 1C: Submit without restrictions 
===> ERROR: Command glite-wms-job-status --verbosity 0 https://cert-13.cnaf.infn.it:9000/8TrsHieqXo1ukD1Aaw9S2A failed. Failure message: **** Error: API_NATIVE_ERROR ****  
Error while calling the "Job:getStatus" native api 
Unable to retrieve the status for: https://cert-13.cnaf.infn.it:9000/8TrsHieqXo1ukD1Aaw9S2A
glite.lb.Exception: edg_wll_JobStatus: Connection refused: edg_wll_gss_connect()
        at glite::lb::Job::status[./src/Job.cpp:87]
===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:11:33
===> Ended  : 12:58:05
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120904121133.log

Proxy Mode - PASSED

SUBMISSION TESTLOG: * WMSService-TS_20120903160648.log: WMSService-TS_20120903160648.log

[dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 
 Test 1A: Submit to an LCG-CE 
 Test 1B: Submit to a CREAM CE 
 Test 1C: Submit without restrictions 
===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 16:06:48
===> Ended  : 16:33:44
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120903160648.log

ARC CE - PASSED
Job submitted on a production CE using the cms VO. During this test the following misbehavior was found: https://ggus.eu/tech/ticket_show.php?ticket=86094
[capannini@cert-17 ~]$ lcg-infosites --is egee-bdii.cnaf.infn.it --vo cms ce |grep arc
     68         0           10         2        10   arc.univ.kiev.ua:2811/nordugrid-torque-arc
    768         0          909       600       309   gsiftp://jade-cms.hip.fi:2811/jobs?queue=arc

[cristofori@ui ~]$ glite-wms-job-submit -o test_Fabio.txt -e https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server -a -r jade-cms.hip.fi:2811/nordugrid-GE-arc firsttest.jdl

Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA

The job identifier has been saved in the following file:
/home/GUEST/cristofori/test_Fabio.txt

==========================================================================



======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        jade-cms.hip.fi:2811/nordugrid-GE-arc
Submitted:          Fri Sep  7 14:37:30 2012 CEST
==========================================================================


[cristofori@ui ~]$ glite-wms-job-output https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA

Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

                        JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA

================================================================================


[cristofori@ui ~]$ cat /tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA/stdout.log 
cmsuser07
[cristofori@ui ~]$ cat /tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA/stderr.log

===> Test PASSED

Jdl attributes - PASSED
Some of the tests failed at first submission so they have been repeated until successful execution.
Define the following variables in wms-command.conf:
# For Jdl attributes tests
SE=gridsrm.pi.infn.it
LFC=prod-lfc-shared-central.cern.ch
ISB_DEST_HOSTNAME=emi-demo11.cnaf.infn.it
ISB_DEST_USERNAME=root
ISB_DEST_PASSWORD=***
OSB_DEST_HOSTNAME=emi-demo11.cnaf.infn.it
OSB_DEST_USERNAME=root
OSB_DEST_PASSWORD=***

[capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 1,2,4,5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Jdl with AllowZippedISB 


 Test 2: Jdl with ExpiryTime 


 Test 4: Jdl with DataRequirements 


 Submit to CREAM CE 


 Submit to LCG CE 


 Test 5: Jdl with InputSandboxBaseURI 


 Submit to CREAM CE 


 Submit to LCG CE 


 Test 6: Jdl with OutputSandboxBaseDestURI 


 Please set the required variables for OSB node in test's configuration file 


 Test 7: Jdl with OutputSandboxDestURI 


 Please set the required variables for OSB node in test's configuration file 


[capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 6: Jdl with OutputSandboxBaseDestURI 


 Submit to CREAM CE 


 Submit to LCG CE 


 Test 7: Jdl with OutputSandboxDestURI 


 Submit to CREAM CE 

===> ERROR: Job finishes with status: Aborted cannot retrieve output

[capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 7: Jdl with OutputSandboxDestURI 


 Submit to CREAM CE 


 Submit to LCG CE 

===> 
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:07:57
===> Ended  : 12:28:46
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120907120757.log

Collection

Bulk submission - PASSED
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:26:13
===> Ended  : 15:35:35
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120907142613.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:26:31
===> Ended  : 15:06:12
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120907142631.log

[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ............................................................................................................................................. Done
Proxy Verify OK
Your proxy is valid until: Fri Sep 14 12:29:57 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy ......................................... Done

Your proxy is valid until Fri Sep  7 23:30:28 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:51
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:50
uri       : voms.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 2
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:30:53
===> Ended  : 13:18:02
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120907123053.log

All in a jdl - PASSED
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:08:24
===> Ended  : 14:47:11
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120910140824.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:08:06
===> Ended  : 14:46:54
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120910140806.log

[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ....................................................... Done
Contacting  voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy ........................................... Done

Your proxy is valid until Mon Sep 10 22:27:11 2012
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ...................................................................................... Done
Proxy Verify OK
Your proxy is valid until: Mon Sep 17 10:27:21 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ................... Done

Your proxy is valid until Mon Sep 10 21:27:40 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:53
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:53
uri       : voms2.hellasgrid.gr:15004

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:10:16
===> Ended  : 14:47:00
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120910141016.log
* all.tgz: all.tgz

Parametric job - PASSED

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 10:39:18
===> Ended  : 11:11:43
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120911103918.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu  -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 10:39:38
===> Ended  : 11:11:36
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120911103938.log

[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ................................................................................................................... Done
Contacting  voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy .................................................................. Done

Your proxy is valid until Tue Sep 11 22:40:17 2012
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ................................... Done
Proxy Verify OK
Your proxy is valid until: Tue Sep 18 10:40:27 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ............................................................................................................... Done

Your proxy is valid until Tue Sep 11 21:40:58 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:02
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:01
uri       : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 10:42:09
===> Ended  : 11:16:07
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120911104209.log

Dag - PASSED

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:29:46
===> Ended  : 11:40:04
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120911112946.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu  -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:30:06
===> Ended  : 11:40:23
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120911113006.log

[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:10:30
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:09:29
uri       : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:30:41
===> Ended  : 11:40:52
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120911113041.log

Parallel job - RANDOM FAILURES

For this test the DEFAULTREQ with "Testing" should be commented. For this reason a lot of jobs are aborted and it is difficult to come to a completion of the test.

Forwarding parameters for parallel jobs - PASSED
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 8 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 8: Testing forwarding parameters for parallel jobs 


 Test 8: Case 1 


 Test 8: Case 2 


 Test 8: Case 3 


 Test 8: Case 4 


 Test 8: Case 5 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 15:50:12
===> Ended  : 15:52:26
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120911155012.log

Perusal - FAILED

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 6: Submit a perusal job (2 cases LCG-CE,CREAM) 


 CASE A: Use LCG CE 

===> ERROR: Command glite-wms-job-perusal --get -f out.txt --dir /home/capannini/WMS-Test-Suite/WMS-service/WMSService-Test_20120911165612/jobOutput https://cert-13.cnaf.infn.it:9000/-4AKS693kkIhSsXsCK9xbw failed. Failure message: 
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server


Error - WMProxy Server Error
The Operation is not allowed: the job is not started
Error code: SOAP-ENV:Server


Traceback (most recent call last):
  File "WMS-job-cycle.py", line 734, in ?
    main()
  File "WMS-job-cycle.py", line 709, in main
    if perusal_submit(utils, tests[5]):
  File "WMS-job-cycle.py", line 392, in perusal_submit
    result=perusal_submit_test(utils,"2119/jobmanager")
  File "WMS-job-cycle.py", line 329, in perusal_submit_test
    utils.run_command_continue_on_error ("glite-wms-job-perusal --get -f out.txt --dir %s %s"%(utils.get_job_output_dir(),JOBID))
  File "/home/capannini/WMS-Test-Suite/WMS-service/Test_utils.py", line 1183, in run_command_continue_on_error
    raise RunCommandError(args,OUTPUT[1])
Exceptions.RunCommandError: '\nConnecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server\n\n\nError - WMProxy Server Error\nThe Operation is not allowed: the job is not started\nError code: SOAP-ENV:Server\n\n'

Delegation - PASSED

[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 Test 3: Try to delegate with a short proxy and check the validity 


 Test 4: Works with expired proxy 


 To run this test you have to set the ROLE attribute for user proxy role at configuration file 

===> 
===> Test: WMS-delegation-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 09:53:14
===> Ended  : 09:54:27
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912095314.log

[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 Test 3: Try to delegate with a short proxy and check the validity 


 Test 4: Works with expired proxy 


 To run this test you have to set the ROLE attribute for user proxy role at configuration file 

===> 
===> Test: WMS-delegation-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 09:53:32
===> Ended  : 09:54:44
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912095332.log

[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ..................................................... Done
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ................................................................ Done

Your proxy is valid until Wed Sep 12 21:53:08 2012
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ............................................ Done
Proxy Verify OK
Your proxy is valid until: Wed Sep 19 09:54:01 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ................................................................................................... Done

Your proxy is valid until Wed Sep 12 20:54:31 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:53
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:52
uri       : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 There are other three tests which require the user proxy password. Use -i option to enable them 

===> 
===> Test: WMS-delegation-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 09:54:55
===> Ended  : 09:54:57
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912095455.log
* deleg.tgz: deleg.tgz

List-match - PASSED

This test requires egee-bdii.cnaf.infn.it as the bdii, and therefore DEFAULTREQ=other.GlueCEStateStatus == "Testing" should not be defined.
[capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 


 Test 7: try a matching with data requirements 


 Test 8: try a gang-matching 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:03:58
===> Ended  : 11:04:53
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912110358.log

[capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 


 Test 7: try a matching with data requirements 


 Test 8: try a gang-matching 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:04:58
===> Ended  : 11:05:53
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912110458.log

[capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 


 Test 7: try a matching with data requirements 


 Test 8: try a gang-matching 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:05:12
===> Ended  : 11:06:02
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912110512.log

Prologue and epilogue jobs - PASSED

[capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V dteam -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:15:08
===> Ended  : 11:21:58
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912111508.log

[capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:15:26
===> Ended  : 11:21:46
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912111526.log

[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:43:04
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:42:04
uri       : voms.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:15:52
===> Ended  : 11:21:39
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912111552.log

Shallow and deep resubmission - PASSED

[capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try a shallow resubmission 


 Test 2: Try a deep resubmission 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:57:03
===> Ended  : 12:09:46
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912115703.log

[capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try a shallow resubmission 


 Test 2: Try a deep resubmission 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:57:26
===> Ended  : 12:10:07
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912115726.log

[capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Try a shallow resubmission 


 Test 2: Try a deep resubmission 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:57:55
===> Ended  : 12:12:02
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912115755.log
* resub.tgz: resub.tgz

Cancel - PASSED

Sometimes it can fail, in this case adjust the sleep time intervals appropriately in the script.
[capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V dteam -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Cancel Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try to cancel a normal job 


 Test 2: Try to cancel a DAG job 


 Test 3: Try to cancel one node of a DAG job 


 Test 4: Try to cancel a collection job 


 Test 5: Try to cancel one node of a collection job 


 Test 6: Try to cancel a parametric job 


 Test 7: Try to cancel one node of a parametric job 


 Test 8: Try to cancel a MPI job 

===> 
===> Test: WMS-job-cancel.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:16:28
===> Ended  : 12:27:50
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912121628.log

[capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Cancel Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try to cancel a normal job 



 Test 2: Try to cancel a DAG job 


 Test 3: Try to cancel one node of a DAG job 


 Test 4: Try to cancel a collection job 


 Test 5: Try to cancel one node of a collection job 


 Test 6: Try to cancel a parametric job 


 Test 7: Try to cancel one node of a parametric job 


 Test 8: Try to cancel a MPI job 

===> 
===> Test: WMS-job-cancel.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 15:31:38
===> Ended  : 16:04:31
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912153138.log

[capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -d 3 -l 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Cancel Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Try to cancel a normal job 


 Test 2: Try to cancel a DAG job 


 Test 3: Try to cancel one node of a DAG job 


 Test 4: Try to cancel a collection job 


 Test 5: Try to cancel one node of a collection job 


 Test 6: Try to cancel a parametric job 


 Test 7: Try to cancel one node of a parametric job 


 Test 8: Try to cancel a MPI job 

===> 
===> Test: WMS-job-cancel.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 15:31:32
===> Ended  : 16:04:35
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120912153132.log

Proxy renewal - PASSED

The myproxyserver (emitb2.ics.muni.cz) has to be configured in order to allow proxy renewal from the machine hosting the WMS. If this has not been previously done contact valtri@civ.zcu.cz.
It is necessary to clean the proxies from ice and proxyreneal:

[root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice stop
stopping ICE... ok
[root@emi-demo11 siteinfo]# rm -rf /var/ice/persist_dir/*
[root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice start
[root@emi-demo11 siteinfo]# rm -f /var/glite/spool/glite-renewd/*

then

Setting MYPROXYSERVER=emitb2.ics.muni.cz in wms-command.conf

[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ....................................... Done
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy .......................... Done

Your proxy is valid until Thu Sep 13 22:50:49 2012

[capannini@cert-17 WMS-service]$ myproxy-init -s emitb2.ics.muni.cz -d -n
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ............................. Done
Proxy Verify OK
Your proxy is valid until: Thu Sep 20 10:51:05 2012
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on emitb2.ics.muni.cz.

[capannini@cert-17 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test proxy renewal operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test proxy renewal with LCG CE 


 Test 2: Test proxy renewal with CREAM CE 


 Test 3: Test proxy renewal with LCG CE (without setting MYPROXYSERVER) 

===> 
===> Test: WMS-proxy-renewal.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 16:50:37
===> Ended  : 18:38:13
===> 
===>   *** Warning: Interrupted by user *** 
===> 
===> 
===> Test log file is WMSService-TS_20120913165037.log

[capannini@cert-17 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l  -i -t 3,4
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test proxy renewal operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 3: Test proxy renewal with LCG CE (without setting MYPROXYSERVER) 


 Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER) 

===> 
===> Test: WMS-proxy-renewal.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 18:31:37
===> Ended  : 18:51:25
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120913183137.log

Limiter mechanism - MOSTLY PASSED (SAME FAILURES AS IN EMI1)

Some of the tests fail. They have been excluded from the certification as they need further checking.
[capannini@cert-17 WMS-service]$ python WMS-limiter-mechanism.py -c wms-command.conf -V dteam -d 3 -l -t 1,2,3,4,6,7,8
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Limiter Mechanism 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Test option --load1 threshold for load average (1 min) 


 Test 2: Test option --load5 threshold for load average (5 min) 


 Test 3: Test option --load15 threshold for load average (15 min) 


 Test 4: Test option --memusage threshold for memory usage (%) 


 Test 6: Test option --ftpconn threshold for number of FTP connections 


 Test 7: Test option --diskusage threshold for disk usage (%) 


 Test 8: Test option --fdnum threshold for used file descriptor 

===> 
===> Test: WMS-limiter-mechanism.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 15:13:18
===> Ended  : 15:13:41
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120913151318.log

Job purge - PASSED

[capannini@cert-17 WMS-service]$ python WMS-check-purger.py -c wms-command.conf -V dteam -d 3 -l -t 1,2,3,4,5
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Purge Mechanism 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Test purge , normal job cycle ( Submit to LCG CE ) 


 Test 2: Test purge, normal job cycle ( Submit to CREAM CE ) 


 Test 3: Test proxy cache purging 


 Test 4: SandBoxDir cron purger ( Submit a job and force its purge before it finishes ) 


 Test 5: SandBoxDir cron purger ( Purge a DONE job ) 

===> 
===> Test: WMS-check-purger.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 17:10:57
===> Ended  : 17:47:25
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 3: Test proxy cache purging'] <<< 
===> 
===> Test log file is WMSService-TS_20120913171057.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite/WMS-service/WMSService-Test_20120913171057/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite/WMS-service/WMSService-Test_20120913171057 has not been cleaned for debug purpose

[capannini@cert-17 WMS-service]$ python WMS-check-purger.py -c wms-command.conf -V dteam -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Purge Mechanism 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 3: Test proxy cache purging 

===> 
===> Test: WMS-check-purger.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 18:01:39
===> Ended  : 18:01:53
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120913180139.log
- Purge only jobs older than 12 hours:
[root@cert-13 ~]# su - glite
-bash-3.2$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin +720
/var/SandboxDir/fB/https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2ffBlHdqaKz_5fXP8QiQ2LYEdQ

Try to purge:
-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/fB -t 43200
13 Sep, 18:07:04 -I: [Info] operator()(purger.cpp:359): https://cert-13.cnaf.infn.it:9000/fBlHdqaKz_XP8QiQ2LYEdQ: 3/3 nodes removed
13 Sep, 18:07:04 -I: [Info] operator()(purger.cpp:371): https://cert-13.cnaf.infn.it:9000/fBlHdqaKz_XP8QiQ2LYEdQ: removed ABORTED dag 
-bash-3.2$ ls -l /var/SandboxDir/fB
total 0

Find some directories that should not be purged:

-bash-3.2$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin -240
/var/SandboxDir/lV/https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2flVpIECmODh6MLWkgxnQSWg
-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/lV -t 43200
-bash-3.2$ 
-bash-3.2$ ls -l /var/SandboxDir/lV
total 4
drwxrwx--- 5 dteam023 glite 4096 Sep 13 14:30 https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2flVpIECmODh6MLWkgxnQSWg

===> Test PASSED

- Purge a job whose proxy is already expired

-bash-3.2$ openssl x509 -in /var/SandboxDir/qI/https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2fqIgvmTSwOLRTtlh2f4wS3w/user.proxy -noout -dates
notBefore=Sep 12 12:39:31 2012 GMT
notAfter=Sep 13 12:38:31 2012 GMT

[capannini@cert-17 WMS-service]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w
Current Status:     Done (Success)
Exit code:          0
Submitted:          Wed Sep 12 14:44:32 2012 CEST
==========================================================================

- Nodes information for: 
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/7XuugKoJCFVuMoc9IP8rUg
    Current Status:     Done (Success)
    Logged Reason(s):
        - job completed
        - Job Terminated Successfully
    Exit code:          0
    Status Reason:      Job Terminated Successfully
    Destination:        cream-20.pd.infn.it:8443/cream-lsf-creamcert2
    Submitted:          Wed Sep 12 14:44:32 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/Z-51Q0If9svoVLcrZUMdxw
    Current Status:     Done (Success)
    Logged Reason(s):
        - job completed
        - Job Terminated Successfully
    Exit code:          0
    Status Reason:      Job Terminated Successfully
    Destination:        cream-22.pd.infn.it:8443/cream-lsf-cert
    Submitted:          Wed Sep 12 14:44:32 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/f5YLP0g4Q4T3LND9rWZuDQ
    Current Status:     Done (Success)
    Logged Reason(s):
        - job completed
        - Job Terminated Successfully
    Exit code:          0
    Status Reason:      Job Terminated Successfully
    Destination:        cream-22.pd.infn.it:8443/cream-lsf-cert
    Submitted:          Wed Sep 12 14:44:32 2012 CEST
==========================================================================

Try to purge:

-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/qI -s
13 Sep, 18:14:25 -I: [Info] operator()(purger.cpp:359): https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w: 3/3 nodes removed
13 Sep, 18:14:25 -I: [Info] operator()(purger.cpp:371): https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w: removed DONE dag 

[capannini@cert-17 WMS-service]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w
Current Status:     Cleared 
Submitted:          Wed Sep 12 14:44:32 2012 CEST
==========================================================================

- Nodes information for: 
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/7XuugKoJCFVuMoc9IP8rUg
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Destination:        cream-20.pd.infn.it:8443/cream-lsf-creamcert2
    Submitted:          Wed Sep 12 14:44:32 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/Z-51Q0If9svoVLcrZUMdxw
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Destination:        cream-22.pd.infn.it:8443/cream-lsf-cert
    Submitted:          Wed Sep 12 14:44:32 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/f5YLP0g4Q4T3LND9rWZuDQ
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Destination:        cream-22.pd.infn.it:8443/cream-lsf-cert
    Submitted:          Wed Sep 12 14:44:32 2012 CEST
==========================================================================

===> Test PASSED

- Purge a dag job

[capannini@cert-17 dag]$ glite-wms-job-submit -a -c ~/wms_cert-13.conf dag.jdl 

Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g

==========================================================================

[capannini@cert-17 dag]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g
Current Status:     Running 
Destination:        dagman
Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================

- Nodes information for: 
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/1iezDtfnVhDA7BhvIbSB-A
    Current Status:     Submitted 
    Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/4TZsR-GgfbTsiLz0Fk-KxA
    Current Status:     Submitted 
    Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/8fhIDD_3wY3OXI0qlDdDcQ
    Current Status:     Submitted 
    Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/AXqc30ITnnuZ4wERXa0hAw
    Current Status:     Scheduled 
    Status Reason:      unavailable
    Destination:        ce01.oats.inaf.it:8443/cream-pbs-dteam
    Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/FO4ENta9_VilKmbcO4ZUuw
    Current Status:     Submitted 
    Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================

-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/yO -s
13 Sep, 18:20:14 -I: [Info] operator()(purger.cpp:359): https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g: 5/5 nodes removed
13 Sep, 18:20:14 -I: [Info] operator()(purger.cpp:371): https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g: removed RUNNING dag 
13 Sep, 18:20:14 -I: [Info] operator()(purger.cpp:452): https://cert-13.cnaf.infn.it:9000/yOCQWaS6hBp0ARJ1AU_Y5g: removed DONE job

[capannini@cert-17 dag]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g
Current Status:     Cleared 
Status Reason:      timed out, resource purge forced
Destination:        dagman
Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================

- Nodes information for: 
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/1iezDtfnVhDA7BhvIbSB-A
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/4TZsR-GgfbTsiLz0Fk-KxA
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/8fhIDD_3wY3OXI0qlDdDcQ
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/AXqc30ITnnuZ4wERXa0hAw
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Destination:        ce01.oats.inaf.it:8443/cream-pbs-dteam
    Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================
    
    Status info for the Job : https://cert-13.cnaf.infn.it:9000/FO4ENta9_VilKmbcO4ZUuw
    Current Status:     Cleared 
    Status Reason:      timed out, resource purge forced
    Submitted:          Thu Sep 13 18:18:43 2012 CEST
==========================================================================

===> Test PASSED

Configuration file - PASSED

[capannini@cert-17 WMS-service]$ python WMS-check-configuration.py -c wms-command.conf -d 3 -l -t 1-7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Check glite_wms.conf file 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Check common section 


 Test 2: Check JobController section 


 Test 3: Check NetworkServer section 


 Test 4: Check LogMonitor section 


 Test 5: Check WorkloadManager section 


 Test 6: Check WorkloadManagerProxy section 


 Test 7: Check ICE section 

===> 
===> Test: WMS-check-configuration.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 13:59:38
===> Ended  : 13:59:38
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120910135938.log

Feedback - PASSED WITH MANUAL INTERVENTION ON THE WMS CONF

The parameter EnableReplanner=true has been introduced but is not configured by yaim so it must be manually defined in glite_wms.conf (WorkloadManager section) before running the test. Moreover the test sometimes fails because the replanned job goes running instead of being replanned until reaching the maximum allowed number of replannings and then aborted.
[capannini@cert-17 WMS-service]$ python WMS-feedback-test.py -d3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Feedback 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test WMS feedback feature 

===> 
===> Test: WMS-feedback-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 16:34:52
===> Ended  : 16:36:14
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120914163452.log

Performance test

Stress test - PASSED

  • 2880 collection of 25 nodes each (total: 72000 jobs)
  • One collection every 60 seconds
  • one user
  • Use LCG-CEs and CREAM-CEs (with different batch systems)
  • Use automatic-delegation
  • The job is a `ls -l`
  • Resubmission is enabled
  • Enable proxy renewal

[capannini@cert-17 StressTest]$ ./StressTest.sh -t 2880 -n 25 -c ~/wms_cert-13.conf -j ls.jdl
Test starts on ven ago 31 17:32:10 CEST 2012: submit 2880 collections (of 25 nodes) with a frequency of 60 seconds using 1 users.

Results

2880 jobs submitted in 9286 seconds: 1/3/35 (min/avg/max)
Test finishes at dom set 2 17:31:34 CEST 2012

[capannini@cert-17 output]$ ../../loginfo.sh -e 57

 Results:
DONE   :      67701 
NOTDone:         13 
Aborted:        386 
------------------------
Total  :      68100 

[capannini@cert-17 output]$ cat *.done|wc -l
67701
[capannini@cert-17 output]$ cat *.done|grep '8443/cream' |wc -l
65744
[capannini@cert-17 output]$ cat *.done|grep '2119/jobmanager'|wc -l
1953

Done jobs on CREAM CE: 65744 (97.1%)
Done jobs on LCG CE: 1953 (2.9%)

Regression tests

Bugs attached to this task

See https://wiki.italiangrid.it/twiki/bin/view/WMS/WMS34_precertification_test for any details about the performed tests.

glite-wms-ice-proxy-renew can block undefinitely (https://savannah.cern.ch/bugs/?95584) - PASSED

Test conducted as in https://wiki.italiangrid.it/twiki/bin/view/WMS/WMS34_precertification_test except that:
- A short proxy was created:
[capannini@cert-17 ~]$ voms-proxy-init --voms dteam -valid 0:10

- The submitted jdl was the following:
[capannini@cert-17 ~]$ cat bug95584.jdl 
[
Executable = "/bin/sleep";
Arguments = "3600";
InputSandbox = {};
stdoutput="stdout";
stderror="stderr";
OutputSandbox = {"stdout","stderr"};
requirements = RegExp("cream.*", other.GlueCEUniqueID);
myproxyserver="emi-demo11.cnaf.infn.it:7000";
]
where emi-demo11.cnaf.infn.it can be substituted with any other public machine.

2012-09-17 16:52:39,400 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Contacting MyProxy server [emi-demo11.cnaf.infn.it:7000] for user dn [/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] with proxy certificate [/var/ice/persist_dir/B4868FD1ED5F88BE302618ECD3B6A0C39C3680C3.betterproxy] to renew it...
2012-09-17 16:53:39,471 ERROR - iceCommandDelegationRenewal::renewAllDelegations() - Proxy renewal failed: [ERROR - /usr/bin/glite-wms-ice-proxy-renew killed the renewal child after timeout of 60 seconds. The proxy /var/ice/persist_dir/B4868FD1ED5F88BE302618ECD3B6A0C39C3680C3.betterproxy has NOT been renewed! ]
2012-09-17 16:53:39,471 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Looking for the better proxy for DN [/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] MyProxy Server name [emi-demo11.cnaf.infn.it:7000]...
2012-09-17 16:53:39,471 INFO - iceCommandDelegationRenewal::renewAllDelegations() - Will Renew Delegation ID [13478935182E688731cert2D132Ecnaf2Einfn2Eit] with BetterProxy [/var/ice/persist_dir/B4868FD1ED5F88BE302618ECD3B6A0C39C3680C3.betterproxy] that will expire on [Tue Sep 18 04:38:13 2012]

-- FabioCapannini - 2012-09-11

Topic attachments
I Attachment Action Size Date Who CommentSorted ascending
Unknown file formatlog 20120831_151144_WMS3.4_SL5_EMI2INSTALL.log manage 529.0 K 2012-08-31 - 14:00 DaniloDongiovanni  
Unknown file formatlog 20120903_180452_TEST_EMI1TOEMI2UPDATE.log manage 778.7 K 2012-09-04 - 10:12 DaniloDongiovanni  
Unknown file formatlog WMSService-TS_20120831163229.log manage 40.0 K 2012-09-03 - 09:16 DaniloDongiovanni  
Unknown file formatlog WMSService-TS_20120903160648.log manage 42.8 K 2012-09-03 - 14:55 DaniloDongiovanni  
Unknown file formatlog WMSService-TS_20120904121133.log manage 71.2 K 2012-09-04 - 11:39 DaniloDongiovanni  
Unknown file formatlog WMSService-TS_20120910135938.log manage 2.1 K 2012-09-10 - 12:07 FabioCapannini  
Unknown file formatlog WMSService-TS_20120911155012.log manage 15.1 K 2012-09-11 - 14:08 FabioCapannini  
Unknown file formatlog WMSService-TS_20120913151318.log manage 29.7 K 2012-09-13 - 13:18 FabioCapannini  
Unknown file formatlog WMSService-TS_20120913165037.log manage 157.9 K 2012-09-13 - 16:40 FabioCapannini  
Unknown file formatlog WMSService-TS_20120913183137.log manage 32.5 K 2012-09-14 - 08:26 FabioCapannini  
Unknown file formatlog WMSService-TS_20120914124353.log manage 200.9 K 2012-09-14 - 13:08 FabioCapannini  
Unknown file formatlog WMSService-TS_20120914163452.log manage 53.9 K 2012-09-14 - 14:43 FabioCapannini  
Compressed Zip archivetgz all.tgz manage 10.4 K 2012-09-10 - 14:42 FabioCapannini  
Compressed Zip archivetgz cancel.tgz manage 11.3 K 2012-09-12 - 14:37 FabioCapannini  
Compressed Zip archivetgz coll.tgz manage 13.3 K 2012-09-07 - 14:05 FabioCapannini  
Compressed Zip archivetgz dag.tgz manage 3.1 K 2012-09-11 - 10:16 FabioCapannini  
Compressed Zip archivetgz deleg.tgz manage 2.0 K 2012-09-12 - 07:58 FabioCapannini  
Compressed Zip archivetgz epipro.tgz manage 3.2 K 2012-09-12 - 09:25 FabioCapannini  
Compressed Zip archivetgz jdl.tgz manage 13.3 K 2012-09-07 - 12:11 FabioCapannini  
Compressed Zip archivetgz list.tgz manage 2.2 K 2012-09-12 - 09:10 FabioCapannini  
Compressed Zip archivetgz param.tgz manage 9.4 K 2012-09-11 - 09:26 FabioCapannini  
Compressed Zip archivetgz purge.tgz manage 9.8 K 2012-09-13 - 16:04 FabioCapannini  
Compressed Zip archivetgz resub.tgz manage 3.8 K 2012-09-12 - 10:15 FabioCapannini  

This topic: IGIRelease > WMSTask21060 > WMSTask21060SL5
Topic revision: r30 - 2012-09-17 - FabioCapannini
 
This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback