WMS v. 3.4 test report
Summary
- ETICS Subsystem Configuration Name: emi-wms_R_3_4_0_7
- EMI Major Release: EMI 2 (KMatterhorn)
- Platform: SL5/x86_64 + EPEL
- Certification report: not yet available
- Outcome: Certification under way
Deployment Tests
Clean installation
- Starting from a SL5 x86_64 kernel machine:
[root@cert-13 ~]# cat /etc/redhat-release
Scientific Linux SL release 5.8 (Boron)
[root@cert13 ~]# uname -a
Linux cert-13.cnaf.infn.it 2.6.18-308.13.1.el5
INSTALL LOG : *
20120831_151144_WMS3.4_SL5_EMI2INSTALL.log: 20120831_151144_WMS3.4_SL5_EMI2INSTALL.log
COMMAND SEQUENCE:
wget http://emisoft.web.cern.ch/emisoft/dist/EMI/2/RPM-GPG-KEY-emi -P /etc/pki/rpm-gpg/
yum -y install yum-protectbase
yum -y install yum-priorities
rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/2/sl5/x86_64/base/emi-release-2.0.0-1.sl5.noarch.rpm
wget --no-check-certificate http://emisoft.web.cern.ch/emisoft/dist/EMI/certification/repos/emi2-cert-sl5-base.repo -O /etc/yum.repos.d/emi2-cert-sl5-base.repo
yum clean all
yum makecache
yum -y install emi-release
yum -y install yum-protectbase
yum -y install yum-priorities
yum -y install ca-policy-egi-core
yum -y install emi-wms
yum -y install condor-emi
/opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB
/opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB
chown root:root /var /var/log
source /usr/libexec/grid-env.sh; /usr/sbin/glite-wms-create-proxy.sh /var/glite/wms.proxy /var/log/wms/create_proxy.log
rpm -qa |grep emi |sort
service gLite stop
service gLite start
service gLite status
Update Installation
INSTALL LOG : *
20120903_180452_TEST_EMI1TOEMI2UPDATE.log: 20120903_180452_TEST_EMI1TOEMI2UPDATE.log
COMMAND SEQUENCE:
wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -P /etc/pki/rpm-gpg/
yum -y install yum-protectbase
yum -y install yum-priorities
rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/1/sl5/x86_64/base/emi-release-1.0.0-1.sl5.noarch.rpm
yum clean all
yum makecache
yum -y install emi-release
yum -y install yum-protectbase
yum -y install yum-priorities
yum -y install ca-policy-egi-core
yum -y install emi-wms
/opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB
/opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB
rpm -qa |grep emi
rpm -qa |grep wms
service gLite restart
rpm -e emi-release
rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/2/sl5/x86_64/base/emi-release-2.0.0-1.sl5.noarch.rpm
wget --no-check-certificate http://emisoft.web.cern.ch/emisoft/dist/EMI/certification/repos/emi2-cert-sl5-base.repo -O /etc/yum.repos.d/emi2-cert-sl5-base.repo
yum clean all
yum makecache
yum -y remove condor condor-lcg
yum -y install emi-wms condor-emi
yum -y update
rpm -qa |grep emi
rpm -qa |grep wms
chown root:root /var /var/log
source /usr/libexec/grid-env.sh; /usr/sbin/glite-wms-create-proxy.sh /var/glite/wms.proxy /var/log/wms/create_proxy.log
/opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB
/opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB
service gLite restart
chmod a+r /etc/nsswitch.conf
/sbin/restorecon /etc/nsswitch.conf
/etc/init.d/glite-wms-wmproxy restart
Unit Tests
N/A: Tests will be available with EMI-2.
Basic Functionality tests
Submission
Normal
[dongiovanni@emitestbed08 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/bJ-1NLTGcc3OjUldvbhZrg
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/bJ-1NLTGcc3OjUldvbhZrg
Current Status: Done (Success)
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: ctb04.gridctb.uoa.gr:8443/cream-pbs-emitesters
Submitted: Fri Aug 31 15:51:39 2012 CEST
==========================================================================
SUBMISSION TESTSUITE: *
WMSService-TS_20120831163229.log: WMSService-TS_20120831163229.log
[dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 16:32:29
===> Ended : 16:57:23
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120831163229.log
Normal on EMI1->EMI2 UPDATE Installation
[dongiovanni@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/4dapc9K3V1IWpGjjdREq2w
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/4dapc9K3V1IWpGjjdREq2w
Current Status: Scheduled
Status Reason: unavailable
Destination: ctb04.gridctb.uoa.gr:8443/cream-pbs-emitesters
Submitted: Tue Sep 4 12:06:01 2012 CEST
==========================================================================
SUBMISSION TESTSUITE: *
WMSService-TS_20120904121133.log: WMSService-TS_20120904121133.log
[dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===> ERROR: Command glite-wms-job-status --verbosity 0 https://cert-13.cnaf.infn.it:9000/8TrsHieqXo1ukD1Aaw9S2A failed. Failure message: **** Error: API_NATIVE_ERROR ****
Error while calling the "Job:getStatus" native api
Unable to retrieve the status for: https://cert-13.cnaf.infn.it:9000/8TrsHieqXo1ukD1Aaw9S2A
glite.lb.Exception: edg_wll_JobStatus: Connection refused: edg_wll_gss_connect()
at glite::lb::Job::status[./src/Job.cpp:87]
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:11:33
===> Ended : 12:58:05
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120904121133.log
Proxy Mode
SUBMISSION TESTLOG: *
WMSService-TS_20120903160648.log: WMSService-TS_20120903160648.log
[dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 16:06:48
===> Ended : 16:33:44
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120903160648.log
ARC CE
Job submitted on a production CE using the cms VO.
[capannini@cert-17 ~]$ lcg-infosites --is egee-bdii.cnaf.infn.it --vo cms ce |grep arc
68 0 10 2 10 arc.univ.kiev.ua:2811/nordugrid-torque-arc
768 0 909 600 309 gsiftp://jade-cms.hip.fi:2811/jobs?queue=arc
[cristofori@ui ~]$ glite-wms-job-submit -o test_Fabio.txt -e https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server -a -r jade-cms.hip.fi:2811/nordugrid-GE-arc firsttest.jdl
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA
The job identifier has been saved in the following file:
/home/GUEST/cristofori/test_Fabio.txt
==========================================================================
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA
Current Status: Done (Success)
Exit code: 0
Status Reason: Job terminated successfully
Destination: jade-cms.hip.fi:2811/nordugrid-GE-arc
Submitted: Fri Sep 7 14:37:30 2012 CEST
==========================================================================
[cristofori@ui ~]$ glite-wms-job-output https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
================================================================================
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA
================================================================================
[cristofori@ui ~]$ cat /tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA/stdout.log
cmsuser07
[cristofori@ui ~]$ cat /tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA/stderr.log
===> Test PASSED
Jdl attributes
Some of the tests failed at first submission so they have been repeated until successful execution.
Define the following variables in wms-command.conf:
# For Jdl attributes tests
SE=gridsrm.pi.infn.it
LFC=prod-lfc-shared-central.cern.ch
ISB_DEST_HOSTNAME=emi-demo11.cnaf.infn.it
ISB_DEST_USERNAME=root
ISB_DEST_PASSWORD=***
OSB_DEST_HOSTNAME=emi-demo11.cnaf.infn.it
OSB_DEST_USERNAME=root
OSB_DEST_PASSWORD=***
[capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 1,2,4,5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Jdl with AllowZippedISB
Test 2: Jdl with ExpiryTime
Test 4: Jdl with DataRequirements
Submit to CREAM CE
Submit to LCG CE
Test 5: Jdl with InputSandboxBaseURI
Submit to CREAM CE
Submit to LCG CE
Test 6: Jdl with OutputSandboxBaseDestURI
Please set the required variables for OSB node in test's configuration file
Test 7: Jdl with OutputSandboxDestURI
Please set the required variables for OSB node in test's configuration file
[capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 6: Jdl with OutputSandboxBaseDestURI
Submit to CREAM CE
Submit to LCG CE
Test 7: Jdl with OutputSandboxDestURI
Submit to CREAM CE
===> ERROR: Job finishes with status: Aborted cannot retrieve output
[capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 7: Jdl with OutputSandboxDestURI
Submit to CREAM CE
Submit to LCG CE
===>
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:07:57
===> Ended : 12:28:46
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120907120757.log
Collection
Bulk submission
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general)
Test 2A: Submit to an LCG-CE
Test 2B: Submit to a CREAM CE
Test 2C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:26:13
===> Ended : 15:35:35
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120907142613.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general)
Test 2A: Submit to an LCG-CE
Test 2B: Submit to a CREAM CE
Test 2C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:26:31
===> Ended : 15:06:12
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120907142631.log
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ............................................................................................................................................. Done
Proxy Verify OK
Your proxy is valid until: Fri Sep 14 12:29:57 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy ......................................... Done
Your proxy is valid until Fri Sep 7 23:30:28 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:59:51
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:58:50
uri : voms.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 2
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general)
Test 2A: Submit to an LCG-CE
Test 2B: Submit to a CREAM CE
Test 2C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:30:53
===> Ended : 13:18:02
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120907123053.log
All in a jdl
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes
Test 7A: Submit to an LCG-CE
Test 7B: Submit to a CREAM CE
Test 7C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:08:24
===> Ended : 14:47:11
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120910140824.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes
Test 7A: Submit to an LCG-CE
Test 7B: Submit to a CREAM CE
Test 7C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:08:06
===> Ended : 14:46:54
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120910140806.log
[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ....................................................... Done
Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy ........................................... Done
Your proxy is valid until Mon Sep 10 22:27:11 2012
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ...................................................................................... Done
Proxy Verify OK
Your proxy is valid until: Mon Sep 17 10:27:21 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ................... Done
Your proxy is valid until Mon Sep 10 21:27:40 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:59:53
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:58:53
uri : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes
Test 7A: Submit to an LCG-CE
Test 7B: Submit to a CREAM CE
Test 7C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:10:16
===> Ended : 14:47:00
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120910141016.log
*
all.tgz: all.tgz
Parametric job
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general)
Test 3A: Submit to an LCG-CE
Test 3B: Submit to a CREAM CE
Test 3C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 10:39:18
===> Ended : 11:11:43
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911103918.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general)
Test 3A: Submit to an LCG-CE
Test 3B: Submit to a CREAM CE
Test 3C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 10:39:38
===> Ended : 11:11:36
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911103938.log
[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ................................................................................................................... Done
Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy .................................................................. Done
Your proxy is valid until Tue Sep 11 22:40:17 2012
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ................................... Done
Proxy Verify OK
Your proxy is valid until: Tue Sep 18 10:40:27 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ............................................................................................................... Done
Your proxy is valid until Tue Sep 11 21:40:58 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:59:02
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:58:01
uri : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general)
Test 3A: Submit to an LCG-CE
Test 3B: Submit to a CREAM CE
Test 3C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 10:42:09
===> Ended : 11:16:07
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911104209.log
Dag
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 4: Submit a DAG job
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:29:46
===> Ended : 11:40:04
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911112946.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 4: Submit a DAG job
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:30:06
===> Ended : 11:40:23
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911113006.log
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:10:30
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:09:29
uri : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 4: Submit a DAG job
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:30:41
===> Ended : 11:40:52
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911113041.log
Parallel job
For this test the DEFAULTREQ with "Testing" should be commented. For this reason a lot of jobs are aborted and it is difficult to come to a completion of the test.
Forwarding parameters for parallel jobs
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 8 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 8: Testing forwarding parameters for parallel jobs
Test 8: Case 1
Test 8: Case 2
Test 8: Case 3
Test 8: Case 4
Test 8: Case 5
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 15:50:12
===> Ended : 15:52:26
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911155012.log
Configuration file
[capannini@cert-17 WMS-service]$ python WMS-check-configuration.py -c wms-command.conf -d 3 -l -t 1-7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Check glite_wms.conf file
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Check common section
Test 2: Check JobController section
Test 3: Check NetworkServer section
Test 4: Check LogMonitor section
Test 5: Check WorkloadManager section
Test 6: Check WorkloadManagerProxy section
Test 7: Check ICE section
===>
===> Test: WMS-check-configuration.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 13:59:38
===> Ended : 13:59:38
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120910135938.log
Performance test
Stress test
- 2880 collection of 25 nodes each (total: 72000 jobs)
- One collection every 60 seconds
- one user
- Use LCG-CEs and CREAM-CEs (with different batch systems)
- Use automatic-delegation
- The job is a `ls -l`
- Resubmission is enabled
- Enable proxy renewal
[capannini@cert-17 StressTest]$ ./StressTest.sh -t 2880 -n 25 -c ~/wms_cert-13.conf -j ls.jdl
Test starts on ven ago 31 17:32:10 CEST 2012: submit 2880 collections (of 25 nodes) with a frequency of 60 seconds using 1 users.
Results
2880 jobs submitted in 9286 seconds: 1/3/35 (min/avg/max)
Test finishes at dom set 2 17:31:34 CEST 2012
[capannini@cert-17 output]$ ../../loginfo.sh -e 57
Results:
DONE : 67701
NOTDone: 13
Aborted: 386
------------------------
Total : 68100
[capannini@cert-17 output]$ cat *.done|wc -l
67701
[capannini@cert-17 output]$ cat *.done|grep '8443/cream' |wc -l
65744
[capannini@cert-17 output]$ cat *.done|grep '2119/jobmanager'|wc -l
1953
Done jobs on CREAM CE: 65744 (97.1%)
Done jobs on LCG CE: 1953 (2.9%)
--
FabioCapannini - 2012-09-11