WMS v. 3.4 (SL5) test report
Summary
- ETICS Subsystem Configuration Name: emi-wms_R_3_4_0_7
- EMI Major Release: EMI 2 (KMatterhorn)
- Platform: SL5/x86_64 + EPEL
Deployment Tests
Clean installation - PASSED
- Starting from a SL5 x86_64 kernel machine:
[root@cert-13 ~]# cat /etc/redhat-release
Scientific Linux SL release 5.8 (Boron)
[root@cert13 ~]# uname -a
Linux cert-13.cnaf.infn.it 2.6.18-308.13.1.el5
INSTALL LOG : *
20120831_151144_WMS3.4_SL5_EMI2INSTALL.log: 20120831_151144_WMS3.4_SL5_EMI2INSTALL.log
COMMAND SEQUENCE:
wget http://emisoft.web.cern.ch/emisoft/dist/EMI/2/RPM-GPG-KEY-emi -P /etc/pki/rpm-gpg/
yum -y install yum-protectbase
yum -y install yum-priorities
rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/2/sl5/x86_64/base/emi-release-2.0.0-1.sl5.noarch.rpm
wget --no-check-certificate http://emisoft.web.cern.ch/emisoft/dist/EMI/certification/repos/emi2-cert-sl5-base.repo -O /etc/yum.repos.d/emi2-cert-sl5-base.repo
yum clean all
yum makecache
yum -y install emi-release
yum -y install yum-protectbase
yum -y install yum-priorities
yum -y install ca-policy-egi-core
yum -y install emi-wms
yum -y install condor-emi
/opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB
/opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB
chown root:root /var /var/log
source /usr/libexec/grid-env.sh; /usr/sbin/glite-wms-create-proxy.sh /var/glite/wms.proxy /var/log/wms/create_proxy.log
rpm -qa |grep emi |sort
service gLite stop
service gLite start
service gLite status
Update Installation - PASSED
INSTALL LOG : *
20120903_180452_TEST_EMI1TOEMI2UPDATE.log: 20120903_180452_TEST_EMI1TOEMI2UPDATE.log
COMMAND SEQUENCE:
wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -P /etc/pki/rpm-gpg/
yum -y install yum-protectbase
yum -y install yum-priorities
rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/1/sl5/x86_64/base/emi-release-1.0.0-1.sl5.noarch.rpm
yum clean all
yum makecache
yum -y install emi-release
yum -y install yum-protectbase
yum -y install yum-priorities
yum -y install ca-policy-egi-core
yum -y install emi-wms
/opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB
/opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB
rpm -qa |grep emi
rpm -qa |grep wms
service gLite restart
rpm -e emi-release
rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/2/sl5/x86_64/base/emi-release-2.0.0-1.sl5.noarch.rpm
wget --no-check-certificate http://emisoft.web.cern.ch/emisoft/dist/EMI/certification/repos/emi2-cert-sl5-base.repo -O /etc/yum.repos.d/emi2-cert-sl5-base.repo
yum clean all
yum makecache
yum -y remove condor condor-lcg
yum -y install condor-emi
yum -y update
rpm -qa |grep emi
rpm -qa |grep wms
chown root:root /var /var/log
source /usr/libexec/grid-env.sh; /usr/sbin/glite-wms-create-proxy.sh /var/glite/wms.proxy /var/log/wms/create_proxy.log
/opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB
/opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB
service gLite restart
chmod a+r /etc/nsswitch.conf
/sbin/restorecon /etc/nsswitch.conf
/etc/init.d/glite-wms-wmproxy restart
Unit Tests - PASSED
Basic Functionality tests
Submission
Normal - PASSED
[dongiovanni@emitestbed08 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/bJ-1NLTGcc3OjUldvbhZrg
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/bJ-1NLTGcc3OjUldvbhZrg
Current Status: Done (Success)
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: ctb04.gridctb.uoa.gr:8443/cream-pbs-emitesters
Submitted: Fri Aug 31 15:51:39 2012 CEST
==========================================================================
SUBMISSION TESTSUITE: *
WMSService-TS_20120831163229.log: WMSService-TS_20120831163229.log
[dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 16:32:29
===> Ended : 16:57:23
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120831163229.log
Normal on EMI1->EMI2 UPDATE Installation - PASSED
[dongiovanni@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/4dapc9K3V1IWpGjjdREq2w
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/4dapc9K3V1IWpGjjdREq2w
Current Status: Scheduled
Status Reason: unavailable
Destination: ctb04.gridctb.uoa.gr:8443/cream-pbs-emitesters
Submitted: Tue Sep 4 12:06:01 2012 CEST
==========================================================================
SUBMISSION TESTSUITE: *
WMSService-TS_20120904121133.log: WMSService-TS_20120904121133.log
[dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===> ERROR: Command glite-wms-job-status --verbosity 0 https://cert-13.cnaf.infn.it:9000/8TrsHieqXo1ukD1Aaw9S2A failed. Failure message: **** Error: API_NATIVE_ERROR ****
Error while calling the "Job:getStatus" native api
Unable to retrieve the status for: https://cert-13.cnaf.infn.it:9000/8TrsHieqXo1ukD1Aaw9S2A
glite.lb.Exception: edg_wll_JobStatus: Connection refused: edg_wll_gss_connect()
at glite::lb::Job::status[./src/Job.cpp:87]
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:11:33
===> Ended : 12:58:05
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120904121133.log
Proxy Mode - PASSED
SUBMISSION TESTLOG: *
WMSService-TS_20120903160648.log: WMSService-TS_20120903160648.log
[dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 16:06:48
===> Ended : 16:33:44
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120903160648.log
ARC CE - PASSED
Job submitted on a production CE using the cms VO.
During this test the following misbehavior was found:
https://ggus.eu/tech/ticket_show.php?ticket=86094
[capannini@cert-17 ~]$ lcg-infosites --is egee-bdii.cnaf.infn.it --vo cms ce |grep arc
68 0 10 2 10 arc.univ.kiev.ua:2811/nordugrid-torque-arc
768 0 909 600 309 gsiftp://jade-cms.hip.fi:2811/jobs?queue=arc
[cristofori@ui ~]$ glite-wms-job-submit -o test_Fabio.txt -e https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server -a -r jade-cms.hip.fi:2811/nordugrid-GE-arc firsttest.jdl
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA
The job identifier has been saved in the following file:
/home/GUEST/cristofori/test_Fabio.txt
==========================================================================
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA
Current Status: Done (Success)
Exit code: 0
Status Reason: Job terminated successfully
Destination: jade-cms.hip.fi:2811/nordugrid-GE-arc
Submitted: Fri Sep 7 14:37:30 2012 CEST
==========================================================================
[cristofori@ui ~]$ glite-wms-job-output https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
================================================================================
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA
================================================================================
[cristofori@ui ~]$ cat /tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA/stdout.log
cmsuser07
[cristofori@ui ~]$ cat /tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA/stderr.log
===> Test PASSED
Known ISSUE - the submit to an ARC 12.05 (EMI2 ARC) fails, for problems related to ARC. Please refer to:
task #27452
Failure log:
[capannini@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/ca724leNG1NAVyOlY1ryMw
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/ca724leNG1NAVyOlY1ryMw
Current Status: Aborted
Logged Reason(s):
- Got a job held event, reason: Unspecified gridmanager error
- Got a job held event, reason: Unspecified gridmanager error
- Job got an error while in the CondorG queue.
- Got a job held event, reason: Failed to parse job id
- Got a job held event, reason: Failed to parse job id
- Job got an error while in the CondorG queue.
- Got a job held event, reason: Failed to parse job id
- Got a job held event, reason: Failed to parse job id
- Job got an error while in the CondorG queue.
- Got a job held event, reason: Failed to parse job id
- Got a job held event, reason: Failed to parse job id
- Job got an error while in the CondorG queue.
Status Reason: hit job shallow retry count (3)
Destination: pgs03.grid.upjs.sk:2811/nordugrid-torque-gridlong
Submitted: Wed Sep 19 10:25:27 2012 CEST
==========================================================================
Jdl attributes - PASSED
Some of the tests failed at first submission so they have been repeated until successful execution.
Define the following variables in wms-command.conf:
# For Jdl attributes tests
SE=gridsrm.pi.infn.it
LFC=prod-lfc-shared-central.cern.ch
ISB_DEST_HOSTNAME=emi-demo11.cnaf.infn.it
ISB_DEST_USERNAME=root
ISB_DEST_PASSWORD=***
OSB_DEST_HOSTNAME=emi-demo11.cnaf.infn.it
OSB_DEST_USERNAME=root
OSB_DEST_PASSWORD=***
[capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 1,2,4,5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Jdl with AllowZippedISB
Test 2: Jdl with ExpiryTime
Test 4: Jdl with DataRequirements
Submit to CREAM CE
Submit to LCG CE
Test 5: Jdl with InputSandboxBaseURI
Submit to CREAM CE
Submit to LCG CE
Test 6: Jdl with OutputSandboxBaseDestURI
Please set the required variables for OSB node in test's configuration file
Test 7: Jdl with OutputSandboxDestURI
Please set the required variables for OSB node in test's configuration file
[capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 6: Jdl with OutputSandboxBaseDestURI
Submit to CREAM CE
Submit to LCG CE
Test 7: Jdl with OutputSandboxDestURI
Submit to CREAM CE
===> ERROR: Job finishes with status: Aborted cannot retrieve output
[capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 7: Jdl with OutputSandboxDestURI
Submit to CREAM CE
Submit to LCG CE
===>
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:07:57
===> Ended : 12:28:46
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120907120757.log
Collection
Bulk submission - PASSED
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general)
Test 2A: Submit to an LCG-CE
Test 2B: Submit to a CREAM CE
Test 2C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:26:13
===> Ended : 15:35:35
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120907142613.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general)
Test 2A: Submit to an LCG-CE
Test 2B: Submit to a CREAM CE
Test 2C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:26:31
===> Ended : 15:06:12
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120907142631.log
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ............................................................................................................................................. Done
Proxy Verify OK
Your proxy is valid until: Fri Sep 14 12:29:57 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy ......................................... Done
Your proxy is valid until Fri Sep 7 23:30:28 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:59:51
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:58:50
uri : voms.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 2
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general)
Test 2A: Submit to an LCG-CE
Test 2B: Submit to a CREAM CE
Test 2C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:30:53
===> Ended : 13:18:02
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120907123053.log
All in a jdl - PASSED
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes
Test 7A: Submit to an LCG-CE
Test 7B: Submit to a CREAM CE
Test 7C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:08:24
===> Ended : 14:47:11
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120910140824.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes
Test 7A: Submit to an LCG-CE
Test 7B: Submit to a CREAM CE
Test 7C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:08:06
===> Ended : 14:46:54
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120910140806.log
[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ....................................................... Done
Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy ........................................... Done
Your proxy is valid until Mon Sep 10 22:27:11 2012
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ...................................................................................... Done
Proxy Verify OK
Your proxy is valid until: Mon Sep 17 10:27:21 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ................... Done
Your proxy is valid until Mon Sep 10 21:27:40 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:59:53
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:58:53
uri : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes
Test 7A: Submit to an LCG-CE
Test 7B: Submit to a CREAM CE
Test 7C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 14:10:16
===> Ended : 14:47:00
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120910141016.log
*
all.tgz: all.tgz
Parametric job - PASSED
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general)
Test 3A: Submit to an LCG-CE
Test 3B: Submit to a CREAM CE
Test 3C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 10:39:18
===> Ended : 11:11:43
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911103918.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general)
Test 3A: Submit to an LCG-CE
Test 3B: Submit to a CREAM CE
Test 3C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 10:39:38
===> Ended : 11:11:36
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911103938.log
[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ................................................................................................................... Done
Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy .................................................................. Done
Your proxy is valid until Tue Sep 11 22:40:17 2012
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ................................... Done
Proxy Verify OK
Your proxy is valid until: Tue Sep 18 10:40:27 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ............................................................................................................... Done
Your proxy is valid until Tue Sep 11 21:40:58 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:59:02
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:58:01
uri : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general)
Test 3A: Submit to an LCG-CE
Test 3B: Submit to a CREAM CE
Test 3C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 10:42:09
===> Ended : 11:16:07
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911104209.log
Dag - PASSED
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 4: Submit a DAG job
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:29:46
===> Ended : 11:40:04
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911112946.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 4: Submit a DAG job
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:30:06
===> Ended : 11:40:23
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911113006.log
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:10:30
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:09:29
uri : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 4: Submit a DAG job
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:30:41
===> Ended : 11:40:52
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911113041.log
Parallel job - PASSED
/tmp/tmp.jjFYFp9625 ~/tests/emi/wms
### Check user proxy and renew/delegate at CE
### Submit parallel job 2 CPUs
### Job to be submitted:
Executable = "/usr/bin/mpi-start";
CPUNumber = 2;
Arguments = "-t dummy -- counter.sh cpus 2";
InputSandbox = {"counter.sh"};
OutputSandbox = {"std.out", "std.err"};
StdOutput = "std.out";
StdError = "std.err";
Requirements = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment)
&& other.GlueCEInfoJobManager == "pbs";
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://cert-13.cnaf.infn.it:9000/zhlWGdgtJadGI8mL0-mw5w
The job identifier has been saved in the following file:
/tmp/tmp.jjFYFp9625/jobid
==========================================================================
complete log at:
mpi_cert-13.cnaf.infn.it.log: MPI tests
Forwarding parameters for parallel jobs - PASSED
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 8 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 8: Testing forwarding parameters for parallel jobs
Test 8: Case 1
Test 8: Case 2
Test 8: Case 3
Test 8: Case 4
Test 8: Case 5
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 15:50:12
===> Ended : 15:52:26
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120911155012.log
Perusal - FAILED
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 6: Submit a perusal job (2 cases LCG-CE,CREAM)
CASE A: Use LCG CE
===> ERROR: Command glite-wms-job-perusal --get -f out.txt --dir /home/capannini/WMS-Test-Suite/WMS-service/WMSService-Test_20120911165612/jobOutput https://cert-13.cnaf.infn.it:9000/-4AKS693kkIhSsXsCK9xbw failed. Failure message:
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
Error - WMProxy Server Error
The Operation is not allowed: the job is not started
Error code: SOAP-ENV:Server
Traceback (most recent call last):
File "WMS-job-cycle.py", line 734, in ?
main()
File "WMS-job-cycle.py", line 709, in main
if perusal_submit(utils, tests[5]):
File "WMS-job-cycle.py", line 392, in perusal_submit
result=perusal_submit_test(utils,"2119/jobmanager")
File "WMS-job-cycle.py", line 329, in perusal_submit_test
utils.run_command_continue_on_error ("glite-wms-job-perusal --get -f out.txt --dir %s %s"%(utils.get_job_output_dir(),JOBID))
File "/home/capannini/WMS-Test-Suite/WMS-service/Test_utils.py", line 1183, in run_command_continue_on_error
raise RunCommandError(args,OUTPUT[1])
Exceptions.RunCommandError: '\nConnecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server\n\n\nError - WMProxy Server Error\nThe Operation is not allowed: the job is not started\nError code: SOAP-ENV:Server\n\n'
Delegation - PASSED
[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test delegation operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Check --autm-delegation option
Test 2: Check --delegationid option
Test 3: Try to delegate with a short proxy and check the validity
Test 4: Works with expired proxy
To run this test you have to set the ROLE attribute for user proxy role at configuration file
===>
===> Test: WMS-delegation-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 09:53:14
===> Ended : 09:54:27
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912095314.log
[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test delegation operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Check --autm-delegation option
Test 2: Check --delegationid option
Test 3: Try to delegate with a short proxy and check the validity
Test 4: Works with expired proxy
To run this test you have to set the ROLE attribute for user proxy role at configuration file
===>
===> Test: WMS-delegation-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 09:53:32
===> Ended : 09:54:44
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912095332.log
[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ..................................................... Done
Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ................................................................ Done
Your proxy is valid until Wed Sep 12 21:53:08 2012
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ............................................ Done
Proxy Verify OK
Your proxy is valid until: Wed Sep 19 09:54:01 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ................................................................................................... Done
Your proxy is valid until Wed Sep 12 20:54:31 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:59:53
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:58:52
uri : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test delegation operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Check --autm-delegation option
Test 2: Check --delegationid option
There are other three tests which require the user proxy password. Use -i option to enable them
===>
===> Test: WMS-delegation-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 09:54:55
===> Ended : 09:54:57
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912095455.log
*
deleg.tgz: deleg.tgz
List-match - PASSED
This test requires egee-bdii.cnaf.infn.it as the bdii, and therefore
DEFAULTREQ=other.GlueCEStateStatus == "Testing" should not be defined.
[capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job ListMatch Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: check if glite-wms-job-list-match command exists
Test 2: test a simple matching
Test 3: check --delegationid option
Test 4: exclude a CE from the match
Test 5: try a failure matching (Requirements == false)
Test 6: try a matching with EnableWMSFeedback attribute true
Test 7: try a matching with data requirements
Test 8: try a gang-matching
===>
===> Test: WMS-listmatch-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:03:58
===> Ended : 11:04:53
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912110358.log
[capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job ListMatch Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: check if glite-wms-job-list-match command exists
Test 2: test a simple matching
Test 3: check --delegationid option
Test 4: exclude a CE from the match
Test 5: try a failure matching (Requirements == false)
Test 6: try a matching with EnableWMSFeedback attribute true
Test 7: try a matching with data requirements
Test 8: try a gang-matching
===>
===> Test: WMS-listmatch-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:04:58
===> Ended : 11:05:53
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912110458.log
[capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job ListMatch Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: check if glite-wms-job-list-match command exists
Test 2: test a simple matching
Test 3: check --delegationid option
Test 4: exclude a CE from the match
Test 5: try a failure matching (Requirements == false)
Test 6: try a matching with EnableWMSFeedback attribute true
Test 7: try a matching with data requirements
Test 8: try a gang-matching
===>
===> Test: WMS-listmatch-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:05:12
===> Ended : 11:06:02
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912110512.log
Prologue and epilogue jobs - PASSED
[capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS test prologue and epilogue attributes
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Test prologue attribute
Test 2: Test epilogue attribute
Test 3: Test prologue and epilogue attributes
===>
===> Test: WMS-prologue-epilogue.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:15:08
===> Ended : 11:21:58
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912111508.log
[capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS test prologue and epilogue attributes
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Test prologue attribute
Test 2: Test epilogue attribute
Test 3: Test prologue and epilogue attributes
===>
===> Test: WMS-prologue-epilogue.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:15:26
===> Ended : 11:21:46
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912111526.log
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:43:04
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:42:04
uri : voms.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS test prologue and epilogue attributes
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Test prologue attribute
Test 2: Test epilogue attribute
Test 3: Test prologue and epilogue attributes
===>
===> Test: WMS-prologue-epilogue.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:15:52
===> Ended : 11:21:39
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912111552.log
Shallow and deep resubmission - PASSED
[capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Resubmission Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Try a shallow resubmission
Test 2: Try a deep resubmission
===>
===> Test: WMS-job-resubmit.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:57:03
===> Ended : 12:09:46
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912115703.log
[capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Resubmission Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Try a shallow resubmission
Test 2: Try a deep resubmission
===>
===> Test: WMS-job-resubmit.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:57:26
===> Ended : 12:10:07
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912115726.log
[capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Resubmission Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Try a shallow resubmission
Test 2: Try a deep resubmission
===>
===> Test: WMS-job-resubmit.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 11:57:55
===> Ended : 12:12:02
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912115755.log
*
resub.tgz: resub.tgz
Cancel - PASSED
Sometimes it can fail, in this case adjust the sleep time intervals appropriately in the script.
[capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Cancel Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Try to cancel a normal job
Test 2: Try to cancel a DAG job
Test 3: Try to cancel one node of a DAG job
Test 4: Try to cancel a collection job
Test 5: Try to cancel one node of a collection job
Test 6: Try to cancel a parametric job
Test 7: Try to cancel one node of a parametric job
Test 8: Try to cancel a MPI job
===>
===> Test: WMS-job-cancel.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 12:16:28
===> Ended : 12:27:50
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912121628.log
[capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Cancel Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Try to cancel a normal job
Test 2: Try to cancel a DAG job
Test 3: Try to cancel one node of a DAG job
Test 4: Try to cancel a collection job
Test 5: Try to cancel one node of a collection job
Test 6: Try to cancel a parametric job
Test 7: Try to cancel one node of a parametric job
Test 8: Try to cancel a MPI job
===>
===> Test: WMS-job-cancel.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 15:31:38
===> Ended : 16:04:31
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912153138.log
[capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Cancel Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Try to cancel a normal job
Test 2: Try to cancel a DAG job
Test 3: Try to cancel one node of a DAG job
Test 4: Try to cancel a collection job
Test 5: Try to cancel one node of a collection job
Test 6: Try to cancel a parametric job
Test 7: Try to cancel one node of a parametric job
Test 8: Try to cancel a MPI job
===>
===> Test: WMS-job-cancel.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 15:31:32
===> Ended : 16:04:35
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120912153132.log
Proxy renewal - PASSED
The myproxyserver (emitb2.ics.muni.cz) has to be configured in order to allow proxy renewal from the machine hosting the WMS.
If this has not been previously done contact
valtri@civ.zcu.cz.
It is necessary to clean the proxies from ice and proxyreneal:
[root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice stop
stopping ICE... ok
[root@emi-demo11 siteinfo]# rm -rf /var/ice/persist_dir/*
[root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice start
[root@emi-demo11 siteinfo]# rm -f /var/glite/spool/glite-renewd/*
then
Setting MYPROXYSERVER=emitb2.ics.muni.cz in wms-command.conf
[capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ....................................... Done
Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy .......................... Done
Your proxy is valid until Thu Sep 13 22:50:49 2012
[capannini@cert-17 WMS-service]$ myproxy-init -s emitb2.ics.muni.cz -d -n
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ............................. Done
Proxy Verify OK
Your proxy is valid until: Thu Sep 20 10:51:05 2012
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on emitb2.ics.muni.cz.
[capannini@cert-17 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS test proxy renewal operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Test proxy renewal with LCG CE
Test 2: Test proxy renewal with CREAM CE
Test 3: Test proxy renewal with LCG CE (without setting MYPROXYSERVER)
===>
===> Test: WMS-proxy-renewal.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 16:50:37
===> Ended : 18:38:13
===>
===> *** Warning: Interrupted by user ***
===>
===>
===> Test log file is WMSService-TS_20120913165037.log
[capannini@cert-17 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l -i -t 3,4
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS test proxy renewal operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 3: Test proxy renewal with LCG CE (without setting MYPROXYSERVER)
Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER)
===>
===> Test: WMS-proxy-renewal.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 18:31:37
===> Ended : 18:51:25
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120913183137.log
Limiter mechanism - MOSTLY PASSED (SAME FAILURES AS IN EMI1)
Some of the tests fail. They have been excluded from the certification as they need further checking.
[capannini@cert-17 WMS-service]$ python WMS-limiter-mechanism.py -c wms-command.conf -V dteam -d 3 -l -t 1,2,3,4,6,7,8
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Limiter Mechanism
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Test option --load1 threshold for load average (1 min)
Test 2: Test option --load5 threshold for load average (5 min)
Test 3: Test option --load15 threshold for load average (15 min)
Test 4: Test option --memusage threshold for memory usage (%)
Test 6: Test option --ftpconn threshold for number of FTP connections
Test 7: Test option --diskusage threshold for disk usage (%)
Test 8: Test option --fdnum threshold for used file descriptor
===>
===> Test: WMS-limiter-mechanism.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 15:13:18
===> Ended : 15:13:41
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120913151318.log
Job purge - PASSED
[capannini@cert-17 WMS-service]$ python WMS-check-purger.py -c wms-command.conf -V dteam -d 3 -l -t 1,2,3,4,5
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Purge Mechanism
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Test purge , normal job cycle ( Submit to LCG CE )
Test 2: Test purge, normal job cycle ( Submit to CREAM CE )
Test 3: Test proxy cache purging
Test 4: SandBoxDir cron purger ( Submit a job and force its purge before it finishes )
Test 5: SandBoxDir cron purger ( Purge a DONE job )
===>
===> Test: WMS-check-purger.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 17:10:57
===> Ended : 17:47:25
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Test 3: Test proxy cache purging'] <<<
===>
===> Test log file is WMSService-TS_20120913171057.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite/WMS-service/WMSService-Test_20120913171057/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite/WMS-service/WMSService-Test_20120913171057 has not been cleaned for debug purpose
[capannini@cert-17 WMS-service]$ python WMS-check-purger.py -c wms-command.conf -V dteam -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Purge Mechanism
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 3: Test proxy cache purging
===>
===> Test: WMS-check-purger.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 18:01:39
===> Ended : 18:01:53
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120913180139.log
- Purge only jobs older than 12 hours:
[root@cert-13 ~]# su - glite
-bash-3.2$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin +720
/var/SandboxDir/fB/https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2ffBlHdqaKz_5fXP8QiQ2LYEdQ
Try to purge:
-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/fB -t 43200
13 Sep, 18:07:04 -I: [Info] operator()(purger.cpp:359): https://cert-13.cnaf.infn.it:9000/fBlHdqaKz_XP8QiQ2LYEdQ: 3/3 nodes removed
13 Sep, 18:07:04 -I: [Info] operator()(purger.cpp:371): https://cert-13.cnaf.infn.it:9000/fBlHdqaKz_XP8QiQ2LYEdQ: removed ABORTED dag
-bash-3.2$ ls -l /var/SandboxDir/fB
total 0
Find some directories that should not be purged:
-bash-3.2$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin -240
/var/SandboxDir/lV/https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2flVpIECmODh6MLWkgxnQSWg
-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/lV -t 43200
-bash-3.2$
-bash-3.2$ ls -l /var/SandboxDir/lV
total 4
drwxrwx--- 5 dteam023 glite 4096 Sep 13 14:30 https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2flVpIECmODh6MLWkgxnQSWg
===> Test PASSED
- Purge a job whose proxy is already expired
-bash-3.2$ openssl x509 -in /var/SandboxDir/qI/https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2fqIgvmTSwOLRTtlh2f4wS3w/user.proxy -noout -dates
notBefore=Sep 12 12:39:31 2012 GMT
notAfter=Sep 13 12:38:31 2012 GMT
[capannini@cert-17 WMS-service]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w
Current Status: Done (Success)
Exit code: 0
Submitted: Wed Sep 12 14:44:32 2012 CEST
==========================================================================
- Nodes information for:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/7XuugKoJCFVuMoc9IP8rUg
Current Status: Done (Success)
Logged Reason(s):
- job completed
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: cream-20.pd.infn.it:8443/cream-lsf-creamcert2
Submitted: Wed Sep 12 14:44:32 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/Z-51Q0If9svoVLcrZUMdxw
Current Status: Done (Success)
Logged Reason(s):
- job completed
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: cream-22.pd.infn.it:8443/cream-lsf-cert
Submitted: Wed Sep 12 14:44:32 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/f5YLP0g4Q4T3LND9rWZuDQ
Current Status: Done (Success)
Logged Reason(s):
- job completed
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: cream-22.pd.infn.it:8443/cream-lsf-cert
Submitted: Wed Sep 12 14:44:32 2012 CEST
==========================================================================
Try to purge:
-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/qI -s
13 Sep, 18:14:25 -I: [Info] operator()(purger.cpp:359): https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w: 3/3 nodes removed
13 Sep, 18:14:25 -I: [Info] operator()(purger.cpp:371): https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w: removed DONE dag
[capannini@cert-17 WMS-service]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w
Current Status: Cleared
Submitted: Wed Sep 12 14:44:32 2012 CEST
==========================================================================
- Nodes information for:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/7XuugKoJCFVuMoc9IP8rUg
Current Status: Cleared
Status Reason: timed out, resource purge forced
Destination: cream-20.pd.infn.it:8443/cream-lsf-creamcert2
Submitted: Wed Sep 12 14:44:32 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/Z-51Q0If9svoVLcrZUMdxw
Current Status: Cleared
Status Reason: timed out, resource purge forced
Destination: cream-22.pd.infn.it:8443/cream-lsf-cert
Submitted: Wed Sep 12 14:44:32 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/f5YLP0g4Q4T3LND9rWZuDQ
Current Status: Cleared
Status Reason: timed out, resource purge forced
Destination: cream-22.pd.infn.it:8443/cream-lsf-cert
Submitted: Wed Sep 12 14:44:32 2012 CEST
==========================================================================
===> Test PASSED
- Purge a dag job
[capannini@cert-17 dag]$ glite-wms-job-submit -a -c ~/wms_cert-13.conf dag.jdl
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g
==========================================================================
[capannini@cert-17 dag]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g
Current Status: Running
Destination: dagman
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
- Nodes information for:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/1iezDtfnVhDA7BhvIbSB-A
Current Status: Submitted
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/4TZsR-GgfbTsiLz0Fk-KxA
Current Status: Submitted
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/8fhIDD_3wY3OXI0qlDdDcQ
Current Status: Submitted
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/AXqc30ITnnuZ4wERXa0hAw
Current Status: Scheduled
Status Reason: unavailable
Destination: ce01.oats.inaf.it:8443/cream-pbs-dteam
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/FO4ENta9_VilKmbcO4ZUuw
Current Status: Submitted
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/yO -s
13 Sep, 18:20:14 -I: [Info] operator()(purger.cpp:359): https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g: 5/5 nodes removed
13 Sep, 18:20:14 -I: [Info] operator()(purger.cpp:371): https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g: removed RUNNING dag
13 Sep, 18:20:14 -I: [Info] operator()(purger.cpp:452): https://cert-13.cnaf.infn.it:9000/yOCQWaS6hBp0ARJ1AU_Y5g: removed DONE job
[capannini@cert-17 dag]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g
Current Status: Cleared
Status Reason: timed out, resource purge forced
Destination: dagman
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
- Nodes information for:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/1iezDtfnVhDA7BhvIbSB-A
Current Status: Cleared
Status Reason: timed out, resource purge forced
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/4TZsR-GgfbTsiLz0Fk-KxA
Current Status: Cleared
Status Reason: timed out, resource purge forced
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/8fhIDD_3wY3OXI0qlDdDcQ
Current Status: Cleared
Status Reason: timed out, resource purge forced
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/AXqc30ITnnuZ4wERXa0hAw
Current Status: Cleared
Status Reason: timed out, resource purge forced
Destination: ce01.oats.inaf.it:8443/cream-pbs-dteam
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/FO4ENta9_VilKmbcO4ZUuw
Current Status: Cleared
Status Reason: timed out, resource purge forced
Submitted: Thu Sep 13 18:18:43 2012 CEST
==========================================================================
===> Test PASSED
Configuration file - PASSED
[capannini@cert-17 WMS-service]$ python WMS-check-configuration.py -c wms-command.conf -d 3 -l -t 1-7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Check glite_wms.conf file
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Check common section
Test 2: Check JobController section
Test 3: Check NetworkServer section
Test 4: Check LogMonitor section
Test 5: Check WorkloadManager section
Test 6: Check WorkloadManagerProxy section
Test 7: Check ICE section
===>
===> Test: WMS-check-configuration.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 13:59:38
===> Ended : 13:59:38
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120910135938.log
Feedback - PASSED
The parameter
EnableReplanner has been introduced but is not configured by yaim so it must be manually defined in glite_wms.conf (
WorkloadManager section) before running the test. If it is not set, the test fails as expected as the default is false; it must be set to true for this test to be run successfully.
In the previous version of the WMS the parameter didn't exist and the feedback was always working by default, so the test ran consistently.
Moreover the test sometimes fails because the replanned job goes running instead of being replanned until reaching the maximum allowed number of replannings and then aborted.
[capannini@cert-17 WMS-service]$ python WMS-feedback-test.py -d3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Feedback
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Test WMS feedback feature
===>
===> Test: WMS-feedback-test.py
===> WMS: cert-13.cnaf.infn.it
===> Started: 16:34:52
===> Ended : 16:36:14
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120914163452.log
Published information - PASSED
bdb database information
ldapsearch -x -H ldap://cert-13.cnaf.infn.it:2170 -b 'o=grid'
# extended LDIF
#
# LDAPv3
# base <o=grid> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#
# grid
dn: o=grid
objectClass: organization
o: grid
# local, grid
dn: Mds-Vo-name=local,o=grid
Mds-Vo-name: local
objectClass: Mds
# resource, grid
dn: Mds-Vo-name=resource,o=grid
Mds-Vo-name: resource
objectClass: Mds
# cert-13.cnaf.infn.it_org.glite.lb.Server_2310828617, resource, grid
dn: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.lb.Server_2310828617,Md
s-Vo-name=resource,o=grid
GlueServiceStatus: Critical
objectClass: GlueTop
objectClass: GlueService
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueServiceUniqueID: cert-13.cnaf.infn.it_org.glite.lb.Server_2310828617
GlueServiceEndpoint: https://cert-13.cnaf.infn.it:9003/
GlueServiceVersion: 2.3.6
GlueSchemaVersionMinor: 3
GlueServiceName: emi-testbed-cnaf-Server
GlueServiceType: org.glite.lb.Server
GlueServiceWSDL: http://egee.cesnet.cz/cms/export/sites/egee/en/WSDL/3.1/LB.ws
dl
GlueServiceSemantics: https://edms.cern.ch/file/571273/2/LB-guide.pdf
GlueForeignKey: GlueSiteUniqueID=emi-testbed-cnaf
GlueSchemaVersionMajor: 1
GlueServiceStartTime: 2012-10-03T12:15:02+02:00
GlueServiceStatusInfo: glite-lb-notif-interlogd not running (stale pidfile) gl
ite-lb-interlogd for proxy running as 13971 glite-lb-bkserverd running as 139
06 glite-jp-importer not running (disabled)
# cert-13.cnaf.infn.it_org.glite.wms.WMProxy_753962038, resource, grid
dn: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.wms.WMProxy_753962038,M
ds-Vo-name=resource,o=grid
GlueServiceAccessControlBaseRule: VO:testers.eu-emi.eu
GlueServiceAccessControlBaseRule: VO:testers2.eu-emi.eu
GlueServiceAccessControlBaseRule: VO:cms
GlueServiceAccessControlBaseRule: VO:dteam
GlueServiceAccessControlBaseRule: VO:infngrid
GlueServiceStatus: OK
GlueServiceStatusInfo: /usr/bin/glite_wms_wmproxy_server is running...
objectClass: GlueTop
objectClass: GlueService
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueServiceUniqueID: cert-13.cnaf.infn.it_org.glite.wms.WMProxy_753962038
GlueServiceAccessControlRule: testers.eu-emi.eu
GlueServiceAccessControlRule: testers2.eu-emi.eu
GlueServiceAccessControlRule: cms
GlueServiceAccessControlRule: dteam
GlueServiceAccessControlRule: infngrid
GlueServiceEndpoint: https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_serve
r
GlueServiceVersion: 3.4.0
GlueSchemaVersionMinor: 3
GlueServiceName: emi-testbed-cnaf-WMProxy
GlueServiceType: org.glite.wms.WMProxy
GlueServiceWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl
GlueServiceSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-guid
e.pdf
GlueForeignKey: GlueSiteUniqueID=emi-testbed-cnaf
GlueServiceOwner: testers.eu-emi.eu
GlueServiceOwner: testers2.eu-emi.eu
GlueServiceOwner: cms
GlueServiceOwner: dteam
GlueServiceOwner: infngrid
GlueSchemaVersionMajor: 1
GlueServiceStartTime: 2012-10-03T00:00:02+02:00
# DN, cert-13.cnaf.infn.it_org.glite.wms.WMProxy_753962038, resource, grid
dn: GlueServiceDataKey=DN,GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.w
ms.WMProxy_753962038,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: DN
GlueChunkKey: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.wms.WMProxy_7
53962038
GlueServiceDataValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=cert-13.cnaf.infn.it
# glite-info-service_version, cert-13.cnaf.infn.it_org.glite.lb.Server_231082
8617, resource, grid
dn: GlueServiceDataKey=glite-info-service_version,GlueServiceUniqueID=cert-13.
cnaf.infn.it_org.glite.lb.Server_2310828617,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_version
GlueChunkKey: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.lb.Server_231
0828617
GlueServiceDataValue: 1.6
# glite-info-service_version, cert-13.cnaf.infn.it_org.glite.wms.WMProxy_7539
62038, resource, grid
dn: GlueServiceDataKey=glite-info-service_version,GlueServiceUniqueID=cert-13.
cnaf.infn.it_org.glite.wms.WMProxy_753962038,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_version
GlueChunkKey: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.wms.WMProxy_7
53962038
GlueServiceDataValue: 1.6
# glite-info-service_hostname, cert-13.cnaf.infn.it_org.glite.lb.Server_23108
28617, resource, grid
dn: GlueServiceDataKey=glite-info-service_hostname,GlueServiceUniqueID=cert-13
.cnaf.infn.it_org.glite.lb.Server_2310828617,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_hostname
GlueChunkKey: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.lb.Server_231
0828617
GlueServiceDataValue: cert-13.cnaf.infn.it
# glite-info-service_hostname, cert-13.cnaf.infn.it_org.glite.wms.WMProxy_753
962038, resource, grid
dn: GlueServiceDataKey=glite-info-service_hostname,GlueServiceUniqueID=cert-13
.cnaf.infn.it_org.glite.wms.WMProxy_753962038,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_hostname
GlueChunkKey: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.wms.WMProxy_7
53962038
GlueServiceDataValue: cert-13.cnaf.infn.it
# search result
search: 2
result: 0 Success
# numResponses: 11
# numEntries: 10
Stats database definitions
ldapsearch -x -H ldap://cert-13.cnaf.infn.it:2170 -b 'o=infosys'
# extended LDIF
#
# LDAPv3
# base <o=infosys> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#
# infosys
dn: o=infosys
objectClass: organization
o: infosys
# zip, infosys
dn: CompressionType=zip,o=infosys
objectClass: CompressedContent
Hostname: localhost
CompressionType: zip
Data: file:///var/lib/bdii/archive/12-10-03-12-21-55-snapshot.gz
# localhost, infosys
dn: Hostname=localhost,o=infosys
objectClass: UpdateStats
Hostname: localhost
FailedDeletes: 0
ModifiedEntries: 9
DeletedEntries: 0
UpdateTime: 2
FailedAdds: 0
FailedModifies: 0
TotalEntries: 20
QueryTime: 0
NewEntries: 1
DBUpdateTime: 0
ReadTime: 0
PluginsTime: 0
ProvidersTime: 2
# search result
search: 2
result: 0 Success
# numResponses: 4
# numEntries: 3
###########################
ldapsearch -x -H ldap://cert-13.cnaf.infn.it:2170 -b 'o=glue'
# extended LDIF
#
# LDAPv3
# base <o=glue> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#
# glue
dn: o=glue
objectClass: organization
o: glue
# grid, glue
dn: GLUE2GroupID=grid,o=glue
objectClass: GLUE2Group
GLUE2GroupID: grid
# resource, glue
dn: GLUE2GroupID=resource,o=glue
objectClass: GLUE2Group
GLUE2GroupID: resource
# cert-13.cnaf.infn.it_wmproxy_13056159, resource, glue
dn: GLUE2ServiceID=cert-13.cnaf.infn.it_wmproxy_13056159,GLUE2GroupID=resource
,o=glue
GLUE2EntityValidity: 3600
GLUE2ServiceType: org.glite.wms.WMProxy
GLUE2ServiceID: cert-13.cnaf.infn.it_wmproxy_13056159
objectClass: GLUE2Service
GLUE2ServiceQualityLevel: production
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-service
GLUE2EntityOtherInfo: InfoProviderVersion=1.1
GLUE2EntityOtherInfo: InfoProviderHost=cert-13.cnaf.infn.it
GLUE2ServiceComplexity: endpointType=1, share=0, resource=0
GLUE2ServiceCapability: executionmanagement.candidatesetgenerator
GLUE2ServiceCapability: executionmanagement.jobdescription
GLUE2ServiceCapability: executionmanagement.jobmanager
GLUE2EntityName: emi-testbed-cnaf-WMProxy
GLUE2ServiceAdminDomainForeignKey: emi-testbed-cnaf
GLUE2EntityCreationTime: 2012-10-03T10:23:57Z
# cert-13.cnaf.infn.it_lbserver_201164012, resource, glue
dn: GLUE2ServiceID=cert-13.cnaf.infn.it_lbserver_201164012,GLUE2GroupID=resour
ce,o=glue
GLUE2EntityValidity: 3600
GLUE2ServiceType: org.glite.lb.Server
GLUE2ServiceID: cert-13.cnaf.infn.it_lbserver_201164012
objectClass: GLUE2Service
GLUE2ServiceQualityLevel: production
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-service
GLUE2EntityOtherInfo: InfoProviderVersion=1.1
GLUE2EntityOtherInfo: InfoProviderHost=cert-13.cnaf.infn.it
GLUE2ServiceComplexity: endpointType=1, share=0, resource=0
GLUE2ServiceCapability: information.logging
GLUE2EntityName: emi-testbed-cnaf-Server
GLUE2ServiceAdminDomainForeignKey: emi-testbed-cnaf
GLUE2EntityCreationTime: 2012-10-03T10:23:57Z
# cert-13.cnaf.infn.it_wmproxy_13056159_org.glite.wms.WMProxy_13056159, cert-
13.cnaf.infn.it_wmproxy_13056159, resource, glue
dn: GLUE2EndpointID=cert-13.cnaf.infn.it_wmproxy_13056159_org.glite.wms.WMProx
y_13056159,GLUE2ServiceID=cert-13.cnaf.infn.it_wmproxy_13056159,GLUE2GroupID=
resource,o=glue
GLUE2EntityValidity: 3600
GLUE2EndpointQualityLevel: production
GLUE2EndpointImplementor: gLite
GLUE2EndpointHealthStateInfo: /usr/bin/glite_wms_wmproxy_server is running...
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint
GLUE2EntityOtherInfo: InfoProviderVersion=1.2
GLUE2EntityOtherInfo: InfoProviderHost=cert-13.cnaf.infn.it
GLUE2EntityOtherInfo: MiddlewareName=EMI
GLUE2EntityOtherInfo: MiddlewareVersion=2.2.0-1
GLUE2EndpointCapability: executionmanagement.candidatesetgenerator
GLUE2EndpointCapability: executionmanagement.jobdescription
GLUE2EndpointCapability: executionmanagement.jobmanager
GLUE2EndpointHealthState: ok
GLUE2EndpointServiceForeignKey: cert-13.cnaf.infn.it_wmproxy_13056159
GLUE2EntityName: WMProxy endpoint for Service cert-13.cnaf.infn.it_wmproxy_130
56159
GLUE2EndpointTechnology: webservice
GLUE2EndpointWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl
GLUE2EndpointInterfaceName: org.glite.wms.WMProxy
GLUE2EndpointURL: https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
GLUE2EndpointDowntimeInfo: See the GOC DB for downtimes: https://goc.egi.eu/
GLUE2EndpointImplementationVersion: 3.4.0
GLUE2EndpointSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-gu
ide.pdf
GLUE2EndpointIssuerCA: /C=IT/O=INFN/CN=INFN CA
GLUE2EndpointServingState: production
objectClass: GLUE2Endpoint
GLUE2EndpointInterfaceVersion: 1.0
GLUE2EndpointImplementationName: WMS
GLUE2EndpointTrustedCA: IGTF
GLUE2EndpointID: cert-13.cnaf.infn.it_wmproxy_13056159_org.glite.wms.WMProxy_1
3056159
GLUE2EndpointStartTime: 2012-10-02T22:00:02Z
GLUE2EntityCreationTime: 2012-10-03T10:23:57Z
# cert-13.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_201164012, cert
-13.cnaf.infn.it_lbserver_201164012, resource, glue
dn: GLUE2EndpointID=cert-13.cnaf.infn.it_lbserver_201164012_org.glite.lb.Serve
r_201164012,GLUE2ServiceID=cert-13.cnaf.infn.it_lbserver_201164012,GLUE2Group
ID=resource,o=glue
GLUE2EntityValidity: 3600
GLUE2EndpointQualityLevel: production
GLUE2EndpointImplementor: gLite
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint
GLUE2EntityOtherInfo: InfoProviderVersion=1.2
GLUE2EntityOtherInfo: InfoProviderHost=cert-13.cnaf.infn.it
GLUE2EntityOtherInfo: MiddlewareName=EMI
GLUE2EntityOtherInfo: MiddlewareVersion=2.2.0-1
GLUE2EndpointCapability: information.logging
GLUE2EndpointHealthState: critical
GLUE2EndpointServiceForeignKey: cert-13.cnaf.infn.it_lbserver_201164012
GLUE2EntityName: Server endpoint for Service cert-13.cnaf.infn.it_lbserver_201
164012
GLUE2EndpointTechnology: webservice
GLUE2EndpointWSDL: http://egee.cesnet.cz/cms/export/sites/egee/en/WSDL/3.1/LB.
wsdl
GLUE2EndpointInterfaceName: org.glite.lb.Server
GLUE2EndpointURL: https://cert-13.cnaf.infn.it:9003/
GLUE2EndpointDowntimeInfo: See the GOC DB for downtimes: https://goc.egi.eu/
GLUE2EndpointImplementationVersion: 2.3.6
GLUE2EndpointSemantics: https://edms.cern.ch/file/571273/2/LB-guide.pdf
GLUE2EndpointIssuerCA: /C=IT/O=INFN/CN=INFN CA
GLUE2EndpointServingState: production
objectClass: GLUE2Endpoint
GLUE2EndpointInterfaceVersion: 3.3.1
GLUE2EndpointImplementationName: LB
GLUE2EndpointTrustedCA: IGTF
GLUE2EndpointID: cert-13.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_2
01164012
GLUE2EndpointHealthStateInfo: glite-lb-notif-interlogd not running (stale pidf
ile) glite-lb-interlogd for proxy running as 15023 glite-lb-bkserverd running
as 14958 glite-jp-importer not running (disabled)
GLUE2EndpointStartTime: 2012-10-03T10:20:02Z
GLUE2EntityCreationTime: 2012-10-03T10:23:57Z
# DN_1, cert-13.cnaf.infn.it_wmproxy_13056159_org.glite.wms.WMProxy_13056159,
cert-13.cnaf.infn.it_wmproxy_13056159, resource, glue
dn: GLUE2ExtensionLocalID=DN_1,GLUE2EndpointID=cert-13.cnaf.infn.it_wmproxy_13
056159_org.glite.wms.WMProxy_13056159,GLUE2ServiceID=cert-13.cnaf.infn.it_wmp
roxy_13056159,GLUE2GroupID=resource,o=glue
GLUE2ExtensionLocalID: DN_1
GLUE2ExtensionKey: DN
objectClass: GLUE2Extension
GLUE2ExtensionValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=cert-13.cnaf.infn.it
GLUE2ExtensionEntityForeignKey: cert-13.cnaf.infn.it_wmproxy_13056159_org.glit
e.wms.WMProxy_13056159
# cert-13.cnaf.infn.it_wmproxy_13056159_org.glite.wms.WMProxy_13056159_Policy
, cert-13.cnaf.infn.it_wmproxy_13056159_org.glite.wms.WMProxy_13056159, cert
-13.cnaf.infn.it_wmproxy_13056159, resource, glue
dn: GLUE2PolicyID=cert-13.cnaf.infn.it_wmproxy_13056159_org.glite.wms.WMProxy_
13056159_Policy,GLUE2EndpointID=cert-13.cnaf.infn.it_wmproxy_13056159_org.gli
te.wms.WMProxy_13056159,GLUE2ServiceID=cert-13.cnaf.infn.it_wmproxy_13056159,
GLUE2GroupID=resource,o=glue
GLUE2AccessPolicyEndpointForeignKey: cert-13.cnaf.infn.it_wmproxy_13056159_org
.glite.wms.WMProxy_13056159
GLUE2EntityValidity: 3600
objectClass: GLUE2Policy
objectClass: GLUE2AccessPolicy
GLUE2PolicyRule: VO:testers.eu-emi.eu
GLUE2PolicyRule: VO:testers2.eu-emi.eu
GLUE2PolicyRule: VO:cms
GLUE2PolicyRule: VO:dteam
GLUE2PolicyRule: VO:infngrid
GLUE2PolicyScheme: org.glite.standard
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint
GLUE2EntityOtherInfo: InfoProviderVersion=1.2
GLUE2EntityOtherInfo: InfoProviderHost=cert-13.cnaf.infn.it
GLUE2PolicyUserDomainForeignKey: testers.eu-emi.eu
GLUE2PolicyUserDomainForeignKey: testers2.eu-emi.eu
GLUE2PolicyUserDomainForeignKey: cms
GLUE2PolicyUserDomainForeignKey: dteam
GLUE2PolicyUserDomainForeignKey: infngrid
GLUE2PolicyID: cert-13.cnaf.infn.it_wmproxy_13056159_org.glite.wms.WMProxy_130
56159_Policy
GLUE2EntityName: Access control rules for Endpoint cert-13.cnaf.infn.it_wmprox
y_13056159_org.glite.wms.WMProxy_13056159
GLUE2EntityCreationTime: 2012-10-03T10:23:57Z
# cert-13.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_201164012_Polic
y, cert-13.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_201164012, ce
rt-13.cnaf.infn.it_lbserver_201164012, resource, glue
dn: GLUE2PolicyID=cert-13.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_
201164012_Policy,GLUE2EndpointID=cert-13.cnaf.infn.it_lbserver_201164012_org.
glite.lb.Server_201164012,GLUE2ServiceID=cert-13.cnaf.infn.it_lbserver_201164
012,GLUE2GroupID=resource,o=glue
GLUE2EntityValidity: 3600
objectClass: GLUE2Policy
objectClass: GLUE2AccessPolicy
GLUE2PolicyRule: ALL
GLUE2PolicyScheme: org.glite.standard
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint
GLUE2EntityOtherInfo: InfoProviderVersion=1.2
GLUE2EntityOtherInfo: InfoProviderHost=cert-13.cnaf.infn.it
GLUE2AccessPolicyEndpointForeignKey: cert-13.cnaf.infn.it_lbserver_201164012_o
rg.glite.lb.Server_201164012
GLUE2PolicyID: cert-13.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_201
164012_Policy
GLUE2EntityName: Access control rules for Endpoint cert-13.cnaf.infn.it_lbserv
er_201164012_org.glite.lb.Server_201164012
GLUE2EntityCreationTime: 2012-10-03T10:23:57Z
# search result
search: 2
result: 0 Success
# numResponses: 11
# numEntries: 10
Performance test
Stress test - PASSED
- 2880 collection of 25 nodes each (total: 72000 jobs)
- One collection every 60 seconds
- one user
- Use LCG-CEs and CREAM-CEs (with different batch systems)
- Use automatic-delegation
- The job is a `ls -l`
- Resubmission is enabled
- Enable proxy renewal
[capannini@cert-17 StressTest]$ ./StressTest.sh -t 2880 -n 25 -c ~/wms_cert-13.conf -j ls.jdl
Test starts on ven ago 31 17:32:10 CEST 2012: submit 2880 collections (of 25 nodes) with a frequency of 60 seconds using 1 users.
Results
2880 jobs submitted in 9286 seconds: 1/3/35 (min/avg/max)
Test finishes at dom set 2 17:31:34 CEST 2012
[capannini@cert-17 output]$ ../../loginfo.sh -e 57
Results:
DONE : 67701
NOTDone: 13
Aborted: 386
------------------------
Total : 68100
[capannini@cert-17 output]$ cat *.done|wc -l
67701
[capannini@cert-17 output]$ cat *.done|grep '8443/cream' |wc -l
65744
[capannini@cert-17 output]$ cat *.done|grep '2119/jobmanager'|wc -l
1953
Done jobs on CREAM CE: 65744 (97.1%)
Done jobs on LCG CE: 1953 (2.9%)
Regression tests
Bugs attached to this task
Vulnerability bug in ICE's proxy renewal (Advisory-SVG-2012-4073) - PASSED
Link to Advisory:
SVG:Advisory-SVG-2012-4073
Check:
[cert-13 ~]$ ll /var/ice/persist_dir/
total 532
-rw------- 1 glite glite 6901 Sep 25 12:35 7D5192F0AE706956CDCF6944E6103BC393FD7D71.proxy
-rw-r--r-- 1 glite glite 531456 Sep 26 15:23 ice.db
Vulnerability bug in ICE's proxy renewal (Advisory-SVG-2012-4039) - PASSED
Link to Advisory:
SVG:Advisory-SVG-2012-4039
Tested that proxy-renewal is working correctly.
2012-09-18 17:25:11,329 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - There are [1] Delegation(s) to check...
2012-09-18 17:25:11,329 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Contacting MyProxy server [emitb2.ics.muni.cz] for user dn [/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] with proxy certificate [/var/ice/persist_dir/899FDB7C8E0983614A314BDD4D565D2117AF5DC6.betterproxy] to renew it...
2012-09-18 17:25:12,849 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Proxy renewal successful for DN=[/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] MyProxyURL=[emitb2.ics.muni.cz]: new proxy is [/var/ice/persist_dir/899FDB7C8E0983614A314BDD4D565D2117AF5DC6.betterproxy.renewed]. It will overwrite the better one...
2012-09-18 17:25:12,864 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Looking for the better proxy for DN [/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] MyProxy Server name [emitb2.ics.muni.cz]...
2012-09-18 17:25:12,864 INFO - iceCommandDelegationRenewal::renewAllDelegations() - Will Renew Delegation ID [13479818552E316336cert2D132Ecnaf2Einfn2Eit] with BetterProxy [/var/ice/persist_dir/899FDB7C8E0983614A314BDD4D565D2117AF5DC6.betterproxy] that will expire on [Wed Sep 19 03:25:11 2012]
Tested that jdl with nasty commands is not exectued.
2012-10-08 11:58:17,632 INFO - proxyRenewal::body() - new iteration
2012-10-08 11:58:17,682 ERROR - iceCommandDelegationRenewal::renewAllDelegations() - Proxy renewal failed: [ERROR - /usr/bin/glite-wms-ice-proxy-renew: glite_renewal_core_renew() failed: Error connecting Myproxy server emitb-myproxy.civ.zcu.cz; echo MC was here > /tmp/intrusion; for proxy /var/ice/persist_dir/84EC42AD362E62283BE3B74622EA779A659F7F2C.betterproxy: Unknown host "emitb-myproxy.civ.zcu.cz; echo MC was here > /tmp/intrusion;"Unable to connect to emitb-myproxy.civ.zcu.cz; echo MC was here > /tmp/intrusion; - timeout=[120] - myproxyserver=[emitb-myproxy.civ.zcu.cz; echo MC was here > /tmp/intrusion;] - proxy=[/var/ice/persist_dir/84EC42AD362E62283BE3B74622EA779A659F7F2C.betterproxy] - HOSTCERT=/var/glite/wms.proxy - HOSTKEY=/var/glite/wms.proxy]
2012-10-08 11:58:17,683 WARN - iceCommandProxyRenewal::renewAllDelegations() - The better proxy [/var/ice/persist_dir/84EC42AD362E62283BE3B74622EA779A659F7F2C.betterproxy] is expiring NOT AFTER the current delegation [13496901582E488852cert2D132Ecnaf2Einfn2Eit]. Skipping ...
2012-10-08 12:09:44,718 ERROR - iceCommandSubmit::execute() - TID=[25977088] Error during submission of jdl= Transient Exception is:Failed to create a delegation
id for job https://cert-27.cnaf.infn.it:9000/NkVc8BIJMAXbjDGby9waeQ: reason is Authorization failure: Cannot map grid user onto a local account
2012-10-08 12:09:44,799 ERROR - iceThreadPoolWorker::body() - Command execution got FATAL exception: Error submitting job to CE [https://tutor04-cream.cnaf.infn.i
t:8443/ce-cream/services/CREAM2]: Failed to create a delegation id for job https://cert-27.cnaf.infn.it:9000/NkVc8BIJMAXbjDGby9waeQ: reason is Authorization failu
re: Cannot map grid user onto a local account
2012-10-08 12:09:54,706 ERROR - iceCommandDelegationRenewal::renewAllDelegations() - Proxy renewal failed: [ERROR - /usr/bin/glite-wms-ice-proxy-renew: glite_rene
wal_core_renew() failed: Error connecting Myproxy server emitb-myproxy.civ.zcu.cz; echo MC was here > /tmp/intrusion; for proxy /var/ice/persist_dir/84EC42AD362E6
2283BE3B74622EA779A659F7F2C.betterproxy: Unknown host "emitb-myproxy.civ.zcu.cz; echo MC was here > /tmp/intrusion;"Unable to connect to emitb-myproxy.civ.zcu.cz;
echo MC was here > /tmp/intrusion; - timeout=[120] - myproxyserver=[emitb-myproxy.civ.zcu.cz; echo MC was here > /tmp/intrusion;] - proxy=[/var/ice/persist_dir/8
4EC42AD362E62283BE3B74622EA779A659F7F2C.betterproxy] - HOSTCERT=/var/glite/wms.proxy - HOSTKEY=/var/glite/wms.proxy]
- A short proxy was created:
[capannini@cert-17 ~]$ voms-proxy-init --voms dteam -valid 0:10
- The submitted jdl was the following:
[capannini@cert-17 ~]$ cat bug95584.jdl
[
Executable = "/bin/sleep";
Arguments = "3600";
InputSandbox = {};
stdoutput="stdout";
stderror="stderr";
OutputSandbox = {"stdout","stderr"};
requirements = RegExp("cream.*", other.GlueCEUniqueID);
myproxyserver="emi-demo11.cnaf.infn.it:7000";
]
where emi-demo11.cnaf.infn.it can be substituted with any other public machine.
2012-09-17 16:52:39,400 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Contacting MyProxy server [emi-demo11.cnaf.infn.it:7000] for user dn [/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] with proxy certificate [/var/ice/persist_dir/B4868FD1ED5F88BE302618ECD3B6A0C39C3680C3.betterproxy] to renew it...
2012-09-17 16:53:39,471 ERROR - iceCommandDelegationRenewal::renewAllDelegations() - Proxy renewal failed: [ERROR - /usr/bin/glite-wms-ice-proxy-renew killed the renewal child after timeout of 60 seconds. The proxy /var/ice/persist_dir/B4868FD1ED5F88BE302618ECD3B6A0C39C3680C3.betterproxy has NOT been renewed! ]
2012-09-17 16:53:39,471 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Looking for the better proxy for DN [/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] MyProxy Server name [emi-demo11.cnaf.infn.it:7000]...
2012-09-17 16:53:39,471 INFO - iceCommandDelegationRenewal::renewAllDelegations() - Will Renew Delegation ID [13478935182E688731cert2D132Ecnaf2Einfn2Eit] with BetterProxy [/var/ice/persist_dir/B4868FD1ED5F88BE302618ECD3B6A0C39C3680C3.betterproxy] that will expire on [Tue Sep 18 04:38:13 2012]
Sep 18 10:37:23 cert-13 glite-proxy-renewd[29582]: Proxy /var/proxycache/%2FC%3DIT%2FO%3DINFN%2FOU%3DPersonal%20Certificate%2FL%3DCNAF%2FCN%3DFabio%20Capannini/5p2ARnwguGVEP-985Xf9tQ/userproxy.pem of job https://cert-13.cnaf.infn.it:9000/bLxDWTROQ-M-ffAPQ0iLuA has been registered as /var/glite/spool/glite-renewd/57e4376268ba19f67cb9a3d89fe1bed4.0
Sep 18 10:37:56 cert-13 glite-proxy-renewd[29582]: Proxy /var/glite/spool/glite-renewd/57e4376268ba19f67cb9a3d89fe1bed4.0 of job https://cert-13.cnaf.infn.it:9000/bLxDWTROQ-M-ffAPQ0iLuA has been unregistered
Sep 18 10:37:23 cert-13 glite_wms_wmproxy_server: submission from cert-17.cnaf.infn.it, DN=/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini, FQAN=/dteam/Role=NULL/Capability=NULL, userid=18699 for jobid=https://cert-13.cnaf.infn.it:9000/bLxDWTROQ-M-ffAPQ0iLuA
Sep 18 10:37:24 cert-13 glite-wms-workload_manager: jobid=https://cert-13.cnaf.infn.it:9000/bLxDWTROQ-M-ffAPQ0iLuA, destination=cream-19.pd.infn.it:8443/cream-lsf-cert
WMS UI emi-wmproxy-api-cpp and emi-wms-ui-api-python still use use gethostbyaddr/gethostbyname (https://savannah.cern.ch/bugs/?89668
) - PASSED
See differences in the code of the
example file glite-wmp-job-utilities.cpp
and ......
The test is passed also for LCG CE which is anomalous.
[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_cert-13.conf -r cream-18.pd.infn.it:8443/cream-lsf-cert ls.jdl
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://cert-13.cnaf.infn.it:9000/imAYqIe0msMvJAS961g38g
==========================================================================
[capannini@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/imAYqIe0msMvJAS961g38g
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/imAYqIe0msMvJAS961g38g
Current Status: Done (Success)
Logged Reason(s):
- job completed
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: cream-18.pd.infn.it:8443/cream-lsf-cert
Submitted: Tue Sep 18 13:07:00 2012 CEST
==========================================================================
[root@cert-13 ~]# ps -efwww|grep httpd
glite 2779 29351 0 00:00 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 2780 29351 0 00:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 2781 29351 0 00:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 2782 29351 0 00:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 2787 29351 0 00:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 6961 29351 0 14:20 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 17008 29351 0 00:30 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
root 21034 17632 0 15:30 pts/0 00:00:00 grep httpd
glite 22195 29351 0 03:40 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 22956 29351 0 01:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 23049 29351 0 01:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
root 29351 1 0 Sep12 ? 00:00:06 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 30085 29351 0 11:40 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
[root@cert-13 ~]#
[root@cert-13 ~]# /etc/init.d/glite-wms-wmproxy restart
Restarting /usr/bin/glite_wms_wmproxy_server... ok
[root@cert-13 ~]#
[root@cert-13 ~]#
[root@cert-13 ~]# ps -efwww|grep httpd
glite 21058 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 21059 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 21060 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 21061 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 21062 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
glite 21063 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
root 21065 17632 0 15:30 pts/0 00:00:00 grep httpd
root 29351 1 0 Sep12 ? 00:00:06 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf
[root@cert-13 ~]# /etc/init.d/glite-wms-wmproxy stop; /etc/init.d/glite-wms-wmproxy start
Stopping /usr/bin/glite_wms_wmproxy_server... ok
Starting /usr/bin/glite_wms_wmproxy_server... ok
[capannini@cert-17 ~]$ ssh root@cert-13 '/etc/init.d/glite-wms-wmproxy stop;/etc/init.d/glite-wms-wmproxy start'
root@cert-13's password:
Stopping /usr/bin/glite_wms_wmproxy_server... ok
Starting /usr/bin/glite_wms_wmproxy_server... ok
[root@cert-13 ~]# grep -1 chkconfig /etc/init.d/glite-wms-ice
# chkconfig: 345 95 06
# description: startup script for the ICE process
[root@cert-13 ~]#
[root@cert-13 ~]# grep -1 chkconfig /etc/init.d/glite-wms-wm
# chkconfig: 345 94 06
# description: WMS processing engine
Semi-automated service backends configuration for WMS (task #23845, EMI Development Tracker, Done) - PASSED
[root@cert-13 ~]# cat /etc/my.cnf
[mysqld]
innodb_flush_log_at_trx_commit=2
innodb_buffer_pool_size=500M
!includedir /etc/mysql/conf.d/
innodb_flush_log_at_trx_commit=2 and innodb_buffer_pool_size=500M are what is expected to be present
with:
<gacl version="0.0.1">
<entry> <voms> <fqan>/dtea*</fqan></voms> <allow> <exec/> </allow> </entry>
</gacl>
GRANT
<gacl version="0.0.1">
<entry> <voms> <fqan>/dteaM*</fqan></voms> <allow> <exec/> </allow> </entry>
</gacl>
DENY
<gacl version="0.0.1">
<entry> <voms> <fqan>/dteam</fqan></voms> <allow> <exec/> </allow> </entry>
</gacl>
DENY
<gacl version="0.0.1">
<entry> <voms> <fqan>/dteam</fqan></voms> <allow> <exec/> </allow> </entry>
<entry> <voms> <fqan>/dteam/*</fqan></voms> <allow> <exec/> </allow> </entry>
</gacl>
GRANT
[root@cert-13 ~]# grep -r rotate\ 90 /etc/logrotate.d/
/etc/logrotate.d/glite-wms-purger: rotate 90
/etc/logrotate.d/wm: rotate 90
/etc/logrotate.d/ice: rotate 90
/etc/logrotate.d/jc: rotate 90
/etc/logrotate.d/lm: rotate 90
/etc/logrotate.d/argus: rotate 90
/etc/logrotate.d/lcmaps: rotate 90
/etc/logrotate.d/globus-gridftp: rotate 90
/etc/logrotate.d/globus-gridftp: rotate 90
/etc/logrotate.d/wmproxy: rotate 90
[root@cert-13 ~]# grep -r daily /etc/logrotate.d/
/etc/logrotate.d/glite-wms-purger: daily
/etc/logrotate.d/wm: daily
/etc/logrotate.d/ice: daily
/etc/logrotate.d/glite-lb-server: daily
/etc/logrotate.d/jc: daily
/etc/logrotate.d/lm: daily
/etc/logrotate.d/argus: daily
/etc/logrotate.d/lcmaps: daily
/etc/logrotate.d/globus-gridftp: daily
/etc/logrotate.d/globus-gridftp: daily
/etc/logrotate.d/bdii: daily
/etc/logrotate.d/wmproxy: daily
Modified siteinfo.def with:
USE_ARGUS=yes
ARGUS_PEPD_ENDPOINTS="https://argus01.lcg.cscs.ch:8154/authz https://argus02.lcg.cscs.ch:8154/authz https://argus03.lcg.cscs.ch:8154/authz"
ran:
/opt/glite/yaim/bin/yaim -c -s siteinfo/site-info.def -n WMS
in glite_wms.conf:
ArgusAuthz = true;
ArgusPepdEndpoints = {"https://argus01.lcg.cscs.ch:8154/authz", "https://argus02.lcg.cscs.ch:8154/authz", "https://argus03.lcg.cscs.ch:8154/authz"};
glite-wms-check-daemons.sh should not restart daemons under the admin's nose (https://savannah.cern.ch/bugs/?89674
) - PASSED
[root@cert-13 siteinfo]# /etc/init.d/glite-wms-wm stop
stopping workload manager... ok
[root@cert-13 siteinfo]#
[root@cert-13 siteinfo]#
[root@cert-13 siteinfo]# /etc/init.d/glite-wms-wm status
/usr/bin/glite-wms-workload_manager is not running
[root@cert-13 siteinfo]#
[root@cert-13 siteinfo]#
[root@cert-13 siteinfo]# cat /etc/cron.d/glite-wms-check-daemons.cron
HOME=/
MAILTO=root@localhost
*/5 * * * * root . /usr/libexec/grid-env.sh ; sh /usr/libexec/glite-wms-check-daemons.sh > /dev/null 2>&1
[root@cert-13 siteinfo]# sh /usr/libexec/glite-wms-check-daemons.sh
Stopping glite-lb-notif-interlogd (786) .../etc/init.d/glite-lb-bkserverd: line 104: kill: (786) - No such process
done
Stopping glite-lb-bkserverd (744) ... done
glite-jp-importer not running
Stopping glite-lb-interlogd (809) ... done
Starting glite-lb-bkserver ... done
Starting glite-lb-notif-interlogd ... done
Starting glite-lb-interlog for proxy ... done
[root@cert-13 siteinfo]# /etc/init.d/glite-wms-wm status
/usr/bin/glite-wms-workload_manager is not running
[root@cert-13 siteinfo]# ps aux | grep workl
root 1823 0.0 0.0 63304 812 pts/0 S+ 11:54 0:00 grep workl
[root@cert-13 siteinfo]# /etc/init.d/glite-wms-wm start
starting workload manager... ok
[root@cert-13 siteinfo]# ps aux | grep workl
glite 1930 57.3 1.5 445008 94188 ? Ssl 11:54 0:04 /usr/bin/glite-wms-workload_manager --conf glite_wms.conf --daemon
root 1943 0.0 0.0 63304 808 pts/0 S+ 11:54 0:00 grep workl
[root@cert-13 siteinfo]# kill -9 1930
[root@cert-13 siteinfo]# sh /usr/libexec/glite-wms-check-daemons.sh
Stopping glite-lb-notif-interlogd (2065) .../etc/init.d/glite-lb-bkserverd: line 104: kill: (2065) - No such process
done
Stopping glite-lb-bkserverd (2023) ... done
glite-jp-importer not running
Stopping glite-lb-interlogd (2087) ... done
Starting glite-lb-bkserver ... done
Starting glite-lb-notif-interlogd ... done
Starting glite-lb-interlog for proxy ... done
[root@cert-13 siteinfo]# /etc/init.d/glite-wms-wm status
/usr/bin/glite-wms-workload_manager (pid 2213) is running...
[root@cert-13 siteinfo]# ps aux | grep workl
glite 2213 13.1 1.5 445008 94188 ? Ssl 11:55 0:04 /usr/bin/glite-wms-workload_manager --conf glite_wms.conf --daemon
root 2463 0.0 0.0 63308 820 pts/0 S+ 11:55 0:00 grep workl
[root@cert-13 siteinfo]# /etc/init.d/glite-wms-ice status
/usr/bin/glite-wms-ice-safe (pid 25505) is running...
[root@cert-13 siteinfo]# ll /var/run/glite-wms-ice-safe.pid
-rw-r--r-- 1 root root 6 21 set 11:12 /var/run/glite-wms-ice-safe.pid
[root@cert-13 siteinfo]# cat /var/run/glite-wms-ice-safe.pid
25505
[root@cert-13 siteinfo]# /etc/init.d/glite-wms-ice stop
stopping ICE... ok
[root@cert-13 siteinfo]# /etc/init.d/glite-wms-ice start
starting ICE... ok
[root@cert-13 siteinfo]# ll /var/run/glite-wms-ice-safe.pid
-rw-r--r-- 1 root root 5 21 set 12:10 /var/run/glite-wms-ice-safe.pid
[root@cert-13 siteinfo]# cat /var/run/glite-wms-ice-safe.pid
7429
[root@cert-13 siteinfo]# /etc/init.d/glite-wms-ice status
/usr/bin/glite-wms-ice-safe (pid 7429) is running...
[root@cert-13 siteinfo]# /etc/init.d/glite-wms-ice restart
stopping ICE... ok
starting ICE... ok
[root@cert-13 siteinfo]# ps -ef|grep ice
glite 7544 1 0 12:11 ? 00:00:00 /usr/bin/glite-wms-ice-safe --conf glite_wms.conf --daemon /var/run/glite-wms-ice-safe.pid
glite 7549 7544 0 12:11 ? 00:00:00 sh -c /usr/bin/glite-wms-ice --conf glite_wms.conf /var/log/wms/ice_console.log 2>&1
glite 7550 7549 0 12:11 ? 00:00:00 /usr/bin/glite-wms-ice --conf glite_wms.conf /var/log/wms/ice_console.log
root 7586 14289 0 12:11 pts/0 00:00:00 grep ice
EnableReplanner=true in the WM conf
21 Sep, 12:19:08 -I: [Info] operator()(/home/condor/execute/dir_3851/userdir/emi.wms.wms-manager/src/replanner.cpp:288): replanner in
action
EnableReplanner=false in the WM conf
No "replanner in action" message in the log.
[root@cert-13 siteinfo]# /var/lib/bdii/gip/provider/glite-info-provider-service-wmproxy-wrapper|grep -i servicestatusinfo
GlueServiceStatusInfo: /usr/bin/glite_wms_wmproxy_server is running...
24 Sep, 10:20:43 -I- PID: 7383 - "wmpgsoapoperations::ns1__jobRegister": Method: jobRegister
24 Sep, 10:20:43 -I- PID: 7383 - "wmpgsoapoperations::ns1__jobRegister": Code: 1228
24 Sep, 10:20:43 -I- PID: 7383 - "wmpgsoapoperations::ns1__jobRegister": Description: System load is too high:
2.4+ kernel w/o ELF notes? -- report this
Threshold for Load Average(1 min): 0 => Detected value for Load Average(1 min): 0.16
EMI WMS wmproxy rpm doesn't set execution permissions as it used to do in gLite (https://savannah.cern.ch/bugs/?89506
) - PASSED WITH SIDENOTE
Note: the test has been executed AFTER running yaim and not BEFORE.
[root@cert-13 ~]# ll /usr/libexec/glite_wms_wmproxy_dirmanager
-rwsr-xr-x 1 root root 22637 18 lug 13:57 /usr/libexec/glite_wms_wmproxy_dirmanager
[root@cert-13 ~]# ll /usr/sbin/glite_wms_wmproxy_load_monitor
-rwsr-xr-x 1 root root 22918 18 lug 13:57 /usr/sbin/glite_wms_wmproxy_load_monitor
yaim-wms: set ldap query filter expression for GLUE2 in WMS configuration (https://savannah.cern.ch/bugs/?91563
) - PASSED
[root@cert-13 ~]# grep G2LDAP /etc/glite-wms/glite_wms.conf
IsmIiG2LDAPCEFilterExt = "(|(&(objectclass=GLUE2ComputingService)(|(GLUE2ServiceType=org.glite.ce.ARC)(GLUE2ServiceType=org.glite.ce.CREAM)))(|(objectclass=GLUE2ComputingManager)(|(objectclass=GLUE2ComputingShare)(|(&(objectclass=GLUE2ComputingEndPoint)(GLUE2EndpointInterfaceName=org.glite.ce.CREAM))(|(objectclass=GLUE2ToStorageService)(|(&(objectclass=GLUE2MappingPolicy)(GLUE2PolicyScheme=org.glite.standard))(|(&(objectclass=GLUE2AccessPolicy)(GLUE2PolicyScheme=org.glite.standard))(|(objectclass=GLUE2ExecutionEnvironment)(|(objectclass=GLUE2ApplicationEnvironment)(|(objectclass=GLUE2Benchmark)))))))))))";
IsmIiG2LDAPSEFilterExt = "(|(objectclass=GLUE2StorageService)(|(objectclass=GLUE2StorageManager)(|(objectclass=GLUE2StorageShare)(|(objectclass=GLUE2StorageEndPoint)(|(objectclass=GLUE2MappingPolicy)(|(objectclass=GLUE2AccessPolicy)(|(objectclass=GLUE2DataStore)(|(objectclass=GLUE2StorageServiceCapacity)(|(objectclass=GLUE2StorageShareCapacity))))))))))";;
[root@cert-13 ~]# grep jobcontroller /etc/glite-wms/glite_wms.conf
LogFile = "${WMS_LOCATION_LOG}/jobcontroller_events.log";
glite-wms-job-submit doesn't always pick up other WMProxy endpoints if load on WMS is high (https://savannah.cern.ch/bugs/?40370
) - HOPEFULLY FIXED
[root@cert-13 ~]# /etc/init.d/glite-wms-wmproxy status
/usr/bin/glite_wms_wmproxy_server is running...
[root@cert-13 ~]# grep CeF /etc/glite-wms/glite_wms.conf
CeForwardParameters = {"GlueHostMainMemoryVirtualSize","GlueHostMainMemoryRAMSize","GlueCEPolicyMaxCPUTime", "GlueCEPolicyMaxObtainableCPUTime", "GlueCEPolicyMaxObtainableWallClockTime", "GlueCEPolicyMaxWallClockTime" };
There's an un-catched out_of_range exception in the ICE component (https://savannah.cern.ch/bugs/?75099
) - PASSED
[capannini@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/rW__zcb8CtHEe-vhJ40X-Q
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/rW__zcb8CtHEe-vhJ40X-Q
Current Status: Done (Success)
Logged Reason(s):
- job completed
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: cream-19.pd.infn.it:8443/cream-lsf-cert
Submitted: Mon Sep 24 12:20:30 2012 CEST
==========================================================================
Last LB event logged by ICE when job aborted for proxy expired should be ABORTED (https://savannah.cern.ch/bugs/?84839
) - PASSED
2012-09-24 12:48:40,035 INFO - iceLBLogger::logEvent() - Job Aborted Event, reason=[Proxy is expired; Job has been terminated (got SIGTERM)] - [GRIDJobID="https://cert-13.cnaf.infn.it:9000/e14r-KeN3xDuD8mZkU_q2w" CREAMJobID="https://cream-39.pd.infn.it:8443/CREAM768552230"]
[capannini@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/e14r-KeN3xDuD8mZkU_q2w
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/e14r-KeN3xDuD8mZkU_q2w
Current Status: Aborted
Logged Reason(s):
- Proxy is expired; Job has been terminated (got SIGTERM)
Status Reason: Proxy is expired; Job has been terminated (got SIGTERM)
Destination: cream-39.pd.infn.it:8443/cream-pbs-creamtest1
Submitted: Mon Sep 24 12:45:02 2012 CEST
==========================================================================
glite-wms-job-status needs a better handing of purged-related error code. (https://savannah.cern.ch/bugs/?85063
) - HOPEFULLY FIXED
[root@cert-13 ~]# /usr/bin/queryDb --conf glite_wms.conf -vSw -s RUNNING,REALLY-RUNNING
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
------------------------------------------------
25 item(s) found
[root@cert-13 ~]#
[root@cert-13 ~]#
[root@cert-13 ~]# /usr/bin/queryDb --conf glite_wms.conf -vSw -s IDLE
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
------------------------------------------------
34 item(s) found
[root@cert-13 ~]# /usr/bin/queryDb --conf glite_wms.conf -vSw
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[IDLE][N/A]
[IDLE][N/A]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[IDLE][N/A]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[IDLE][N/A]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[IDLE][N/A]
[IDLE][N/A]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[IDLE][N/A]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[IDLE][N/A]
[IDLE][N/A]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[REALLY-RUNNING][prod-wn-001.pn.pd.infn.it]
[IDLE][N/A]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[REALLY-RUNNING][cream-wn-032.pn.pd.infn.it]
[IDLE][N/A]
[IDLE][N/A]
[IDLE][N/A]
[REALLY-RUNNING][prod-wn-002.pn.pd.infn.it]
[IDLE][N/A]
[IDLE][N/A]
[REALLY-RUNNING][prod-wn-003.pn.pd.infn.it]
[IDLE][N/A]
[IDLE][N/A]
------------------------------------------------
59 item(s) found
EMI WMS wmproxy rpm doesn't set execution permissions as it used to do in gLite (https://savannah.cern.ch/bugs/?89506
) - FIXED
[root@cert-13 ~]# ll /usr/sbin/glite_wms_wmproxy_load_monitor /usr/bin/glite_wms_wmproxy_server /usr/bin/glite-wms-wmproxy-purge-proxycache /usr/libexec/glite_wms_wmproxy_dirmanager
-rwxr-xr-x 1 root root 1876 18 lug 13:57 /usr/bin/glite-wms-wmproxy-purge-proxycache
-rwxr-xr-x 1 root root 3059579 18 lug 13:57 /usr/bin/glite_wms_wmproxy_server
-rwsr-xr-x 1 root root 22637 18 lug 13:57 /usr/libexec/glite_wms_wmproxy_dirmanager
-rwsr-xr-x 1 root root 22918 18 lug 13:57 /usr/sbin/glite_wms_wmproxy_load_monitor
[root@cert-13 ~]# ll ${WMS_LOCATION_VAR}/glite/wms.proxy
-rw------- 1 glite glite 2670 25 set 06:03 /var/glite/wms.proxy
[root@cert-13 ~]# ll ${WMS_LOCATION_VAR}/wms.proxy
ls: /var/wms.proxy: No such file or directory
[root@cert-13 ~]# grep ice_log_level /etc/glite-wms/glite_wms.conf
ice_log_level = 300;
/var/log/wms/lcmaps.log exists but is empty. /var/log/glite/lcmaps.log also exists and is not empty.
[root@cert-13 ~]# ll $WMS_LOCATION_LOG/lcmaps.log ; ll /var/log/glite/lcmaps.log
-rw-r--r-- 1 glite glite 0 25 set 04:02 /var/log/wms/lcmaps.log
-rw-r--r-- 1 glite glite 399456 4 set 10:54 /var/log/glite/lcmaps.log
Also /etc/cron.d/wmproxy_logrotate is present.
[root@cert-13 ~]# grep -r rotate /etc/cron.d
/etc/cron.d/wmproxy_logrotate:0 */2 * * * root /usr/sbin/logrotate -v /etc/glite-wms/wmproxy_logrotate.conf >> /var/log/wms/wmproxy_logrotate.log 2>&1
[root@cert-13 ~]# rpm -qf /etc/cron.d/wmproxy_logrotate
il file /etc/cron.d/wmproxy_logrotate non è posseduto da alcun pacchetto
[root@cert-13 ~]# ll /etc/logrotate.d/
totale 120
-rw-r--r-- 1 root root 131 24 set 11:59 argus
-rw-r--r-- 1 root root 106 27 lug 15:13 bdii
-rw-r--r-- 1 root root 147 14 apr 2011 exim
-rw-r--r-- 1 root root 198 11 feb 2012 fail2ban
-rw-r--r-- 1 root root 109 24 set 11:58 fetch-crl
-rw-r--r-- 1 root root 194 30 lug 22:26 glite-lb-server
-rw-r--r-- 1 root root 148 24 set 11:59 glite-wms-purger
-rw-r--r-- 1 root root 240 10 mag 2011 globus-gridftp
-rw-r--r-- 1 root root 167 27 feb 2012 httpd
-rw-r--r-- 1 root root 129 24 set 11:59 ice
-rw-r--r-- 1 root root 173 21 feb 2012 iscsiuiolog
-rw-r--r-- 1 root root 146 24 set 11:59 jc
-rw-r--r-- 1 root root 132 24 set 11:59 lcmaps
-rw-r--r-- 1 root root 73 19 dic 2011 lemon-agent
-rw-r--r-- 1 root root 163 21 feb 2012 libvirtd
-rw-r--r-- 1 root root 143 24 set 11:59 lm
-rw-r--r-- 1 root root 264 21 ago 23:41 puppet
-rw-r--r-- 1 root root 61 3 apr 18:44 rpm
-rw-r--r-- 1 root root 167 21 feb 2012 snmpd
-rw-r--r-- 1 root root 306 31 mar 2010 syslog
-rw-r--r-- 1 root root 149 24 set 11:59 wm
-rw-r--r-- 1 root root 212 24 set 11:59 wmproxy
-rw-r--r-- 1 root root 100 28 feb 2012 yum
remove several dismissed parameters from the WMS configuration (https://savannah.cern.ch/bugs/?91488
) - PASSED
[root@cert-13 ~]# grep -iE 'log_file_max_size|log_rotation_base_file|log_rotation_max_file_number|ice.input_type|wmp.input_type|wmp.locallogger|wm.dispatcher_type|wm.enable_bulk_mm|wm.ism_ii_ldapsearch_async' /etc/glite-wms/glite_wms.conf
[root@cert-13 ~]#
[root@cert-13 ~]#
The rpm kill-stale-ftp has to be install explicitly on the wms as it is not specified in the dependencies of the metapackage.
An install note should be added to the release notes.
[root@cert-13 ~]# cat /etc/cron.d/kill-stale-ftp.cron
PATH=/sbin:/bin:/usr/sbin:/usr/bin
5,15,25,35,45,55 * * * * root /sbin/kill-stale-ftp.sh >> /var/log/kill-stale-ftp.log 2>&1
[root@cert-13 ~]# tail -2 /var/log/kill-stale-ftp.log
=== START Wed Sep 26 10:35:01 CEST 2012 PID 7722
=== READY Wed Sep 26 10:35:01 CEST 2012 PID 7722
[root@cert-13 ~]# grep -E 'persist_dir|Input|ice_host_cert|ice_host_key' /etc/glite-wms/glite_wms.conf
ice_host_cert = "${GLITE_HOST_CERT}";
Input = "${WMS_LOCATION_VAR}/ice/jobdir";
persist_dir = "${WMS_LOCATION_VAR}/ice/persist_dir";
ice_host_key = "${GLITE_HOST_KEY}";
MaxInputSandboxSize = 100000000;
MaxInputSandboxSize = 10000000;
Input = "${WMS_LOCATION_VAR}/workload_manager/jobdir";
Input = "${WMS_LOCATION_VAR}/jobcontrol/jobdir/";
[root@cert-13 ~]# grep proxycache /etc/cron.d/*
/etc/cron.d/glite-wms-wmproxy-purge-proxycache.cron:0 */6 * * * root . /usr/libexec/grid-env.sh ; /usr/bin/glite-wms-wmproxy-purge-proxycache /var/proxycache > /var/log/wms/glite-wms-wmproxy-purge-proxycache.log 2>&1
[root@cert-13 ~]# grep find /usr/bin/glite-wms-wmproxy-purge-proxycache
find $1 -mindepth 1 -cmin +60 > $tmp_file
[capannini@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/E78kEd9OOqxwHxRl9Op_BQ
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/E78kEd9OOqxwHxRl9Op_BQ
Current Status: Done (Exit Code !=0)
Exit code: 1
Status Reason: Warning: job exit code != 0
Destination: cream-26.pd.infn.it:2119/jobmanager-lcgpbs-creamtest1
Submitted: Wed Sep 26 12:04:59 2012 CEST
==========================================================================
glite_wms_wmproxy_server segfaults after job registration failure (https://savannah.cern.ch/bugs/?94845
) - PASSED
[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_cert-13.conf coll.jdl
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://cert-13.cnaf.infn.it:9000/dP-iqaengaXA-gNbKE43mA
==========================================================================
[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_cert-13.conf coll.jdl
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://cert-13.cnaf.infn.it:9000/1JYPH9lsU_MP6QZTZFcnPQ
==========================================================================
[capannini@cert-17 dag]$ glite-wms-job-cancel https://cert-13.cnaf.infn.it:9000/pm96__EY_PiF3FQtK1HKvw
Are you sure you want to remove specified job(s) [y/n]y : y
Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server
============================= glite-wms-job-cancel Success =============================
The cancellation request has been successfully submitted for the following job(s):
- https://cert-13.cnaf.infn.it:9000/pm96__EY_PiF3FQtK1HKvw
========================================================================================
[capannini@cert-17 dag]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/pm96__EY_PiF3FQtK1HKvw
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/pm96__EY_PiF3FQtK1HKvw
Current Status: Cancelled
Logged Reason(s):
- Aborted by user
Status Reason: Aborted by user
Destination: dagman
Submitted: Thu Sep 27 11:53:59 2012 CEST
==========================================================================
- Nodes information for:
Status info for the Job : https://cert-13.cnaf.infn.it:9000/-XWtP15lUvn4AwJjP6SNQA
Current Status: Cancelled
Logged Reason(s):
- Job has been terminated (got SIGTERM)
Destination: cmsrm-cream02.roma1.infn.it:8443/cream-lsf-cmsgcert
Submitted: Thu Sep 27 11:53:59 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/JG7bf-WUJI3GKR0UexOYTw
Current Status: Aborted
Logged Reason(s):
- Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://cert-13.cnaf.infn.it:9000/JG7bf-WUJI3GKR0UexOYTw: reason is User C=IT,O=INFN,OU=Personal Certificate,L=CNAF,CN=Fabio Capannini not authorized for operation {http://www.gridsite.org/namespaces/delegation-2}getProxyReq
Status Reason: failed (LB query failed)
Destination: grisuce.scope.unina.it:8443/cream-pbs-egeecert
Submitted: Thu Sep 27 11:53:59 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/r6FE2fuwd_vD2IGmrq70nA
Current Status: Cancelled
Logged Reason(s):
- Job Terminated Successfully
Destination: cccreamceli05.in2p3.fr:8443/cream-sge-medium
Submitted: Thu Sep 27 11:53:59 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/sAKrpePmoCy1ad88FOVdxw
Current Status: Aborted
Logged Reason(s):
- Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://cert-13.cnaf.infn.it:9000/sAKrpePmoCy1ad88FOVdxw: reason is User C=IT,O=INFN,OU=Personal Certificate,L=CNAF,CN=Fabio Capannini not authorized for operation {http://www.gridsite.org/namespaces/delegation-2}getProxyReq
Status Reason: failed (LB query failed)
Destination: grisuce.scope.unina.it:8443/cream-pbs-egeecert
Submitted: Thu Sep 27 11:53:59 2012 CEST
==========================================================================
Status info for the Job : https://cert-13.cnaf.infn.it:9000/yQW0dmv0PRSmDUd2QPfpbQ
Current Status: Cancelled
Submitted: Thu Sep 27 11:53:59 2012 CEST
==========================================================================
Apparently there is no CE which doesn't publish
GlueCEInfoHostName.
$ ldapsearch -x -H ldap://egee-bdii.cnaf.infn.it:2170 -b mds-vo-name=local,o=grid |egrep 'dn: GlueCEUniqueID|GlueCEInfoHostName' >pippo.txt
$ grep -c GlueCEInfoHostName pippo.txt
4348
$ grep -c GlueCEUniqueID pippo.txt
4348
$ ldapsearch -x -H ldap://cert-bdii-04.cnaf.infn.it:2170 -b mds-vo-name=local,o=grid |egrep 'dn: GlueCEUniqueID|GlueCEInfoHostName' >pluto.txt
$ grep -c GlueCEUniqueID pluto.txt
779
$ grep -c GlueCEInfoHostName pluto.txt
779
The WMP code has been changed as requested in the ticket
// gacl file has a valid entry for user proxy without fqan
if (execDN || execAU){
exec = execDN = execAU = true;
}
Certificates signed by Terena cause job submission from gLite WMS to ARC CE fail (https://savannah.cern.ch/bugs/?97185
) - HOPEFULLY FIXED
The test requires a proxy from the Terena VO which we don't have.
[root@cert-13 ~]# ll /var/run/glite-wms-ice-safe.pid /var/run/glite-wms-workload_manager.pid
-rw-r--r-- 1 root root 5 1 ott 12:10 /var/run/glite-wms-ice-safe.pid
-rw-r--r-- 1 root root 5 1 ott 12:07 /var/run/glite-wms-workload_manager.pid
getaddrinfo() sorts results according to RFC3484, but random ordering is lost (https://savannah.cern.ch/bugs/?82779
) - PASSED
[capannini@emitestbed16 ~]$ nslookup wms-cms-analysis.grid.cnaf.infn.it
Server: 131.154.3.1
Address: 131.154.3.1#53
Name: wms-cms-analysis.grid.cnaf.infn.it
Address: 131.154.101.15
Name: wms-cms-analysis.grid.cnaf.infn.it
Address: 131.154.101.25
Name: wms-cms-analysis.grid.cnaf.infn.it
Address: 131.154.101.83
Name: wms-cms-analysis.grid.cnaf.infn.it
Address: 131.154.101.3
Name: wms-cms-analysis.grid.cnaf.infn.it
Address: 131.154.101.8
[capannini@emitestbed16 ~]$ glite-wms-job-submit -a -e https://wms-cms-analysis.grid.cnaf.infn.it:7443/glite_wms_wmproxy_server ls.jdl
Connecting to the service https://wms012.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://wms012.cnaf.infn.it:9000/SkB_TFpuYZxmbFX14eq8fw
==========================================================================
[capannini@emitestbed16 ~]$
[capannini@emitestbed16 ~]$
[capannini@emitestbed16 ~]$ glite-wms-job-submit -a -e https://wms-cms-analysis.grid.cnaf.infn.it:7443/glite_wms_wmproxy_server ls.jdl
Connecting to the service https://wms003.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://wms003.cnaf.infn.it:9000/_QJzlxGF5JBdSRpr6NgD0Q
==========================================================================
[capannini@emitestbed16 ~]$
[capannini@emitestbed16 ~]$
[capannini@emitestbed16 ~]$ glite-wms-job-submit -a -e https://wms-cms-analysis.grid.cnaf.infn.it:7443/glite_wms_wmproxy_server ls.jdl
Connecting to the service https://wms019.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://wms019.cnaf.infn.it:9000/4tGQL5JJALyQJ5NlR6DHAw
==========================================================================
Files specified with absolute paths shouldn't be used with inputsandboxbaseuri (https://savannah.cern.ch/bugs/?74832
) - PASSED
Verified that JDL described in the bug is correctly handled by activating debug (--debug); the debug log showed that the file /etc/fstab is correctly staged from the UI node via gsiftp.
Verified with --debug that glite-wms-job-submit:
dorigoa@cream-01 11:00:47 ~/emi/wmsui_emi2>grep -i environment jdl2
environment = "FOO=bar";
dorigoa@cream-01 11:50:02 ~/emi/wmsui_emi2>stage/usr/bin/glite-wms-job-submit --debug -a -c ~/JDLs/WMS/wmp_gridit.conf jdl2
[...]
-----------------------------------------
07 March 2012, 11:50:45 -I- PID: 3397 (Debug) - Registering JDL [ stdoutput = "out3.out"; SignificantAttributes = { "Requirements","Rank" }; DefaultNodeRetryCount = 5; executable = "ssh1.sh"; Type = "job"; Environment = { "FOO=bar" }; AllowZippedISB = false; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; outputsandbox = { "out3.out","err2.err","fstab","grid-mapfile","groupmapfile"," passwd" }; InputSandbox = { "file:///etc/fstab","grid-mapfile","groupmapfile","gsiftp://cream-38.pd.infn.it/etc/passwd","file:///home/dorigoa/ssh1.sh" }; stderror = "err2.err"; inputsandboxbaseuri = "gsiftp://cream-38.pd.infn.it/etc/grid-security"; rank = -other.GlueCEStateEstimatedResponseTime; MyProxyServer = "myproxy.cern.ch"; requirements = other.GlueCEStateStatus == "Production" || other.GlueCEStateStatus == "testbedb" ]
[...]
So the mangling Environment = "FOO=bar"; -> Environment = { "FOO=bar" }; occurs correctly.
dorigoa@lxgrid05 14:20:13 ~/emi/wmsui_emi2>stage/usr/bin/glite-wms-job-status --json https://wms014.cnaf.infn.it:9000/pVQojatZbyoj_Pyab66_dw
{ "result": "success" , "https://wms014.cnaf.infn.it:9000/pVQojatZbyoj_Pyab66_dw": { "Current Status": "Done(Success)", "Logged Reason": {"0": "job completed","1": "Job Terminated Successfully"}, "Exit code": "0", "Status Reason": "Job Terminated Successfully", "Destination": "grive02.ibcp.fr:8443/cream-pbs-dteam", "Submitted": "Mon Mar 12 14:11:55 2012 CET", "Done": "1331558020"} }
[root@devel09 ~]# rpm -ql glite-wms-wmproxy-api-cpp-devel
/usr/include/glite
/usr/include/glite/wms
/usr/include/glite/wms/wmproxyapi
/usr/include/glite/wms/wmproxyapi/wmproxy_api.h
/usr/include/glite/wms/wmproxyapi/wmproxy_api_utilities.h
/usr/lib64/libglite_wms_wmproxy_api_cpp.so
/usr/lib64/pkgconfig/wmproxy-api-cpp.pc
[root@devel09 ~]# cat /usr/lib64/pkgconfig/wmproxy-api-cpp.pc
prefix=/usr
exec_prefix=${prefix}
libdir=${exec_prefix}/lib64
includedir=${prefix}/include
Name: wmproxy api cpp
Description: WMProxy C/C++ APIs
Version: 3.3.3
Requires: emi-gridsite-openssl
Libs: -L${libdir} -lglite_wms_wmproxy_api_cpp
Cflags: -I${includedir}
glite-wms-job-list-match --help show an un-implemented (and useless) option "--default-jdl" (https://savannah.cern.ch/bugs/?87444
) - PASSED
The command glite-wms-job-list-match --help doesn't show that option anymore.
WMS UI depends on a buggy libtar (on SL5 at least) (
https://savannah.cern.ch/bugs/?89443
) -
PASSED
dorigoa@lxgrid05 16:01:39 ~/emi/wmsui_emi2>cat ~/JDLs/WMS/wms_test_tar_bug.jdl
[
AllowZippedISB = true;
Executable = "/bin/ls" ;
Arguments = "-lha " ;
Stdoutput = "ls.out" ;
InputSandbox = {"isb1", "isb2","isb3", "temp/isb4"};
OutputSandbox = { ".BrokerInfo", "ls.out"} ;
Retrycount = 2;
ShallowRetryCount = -1;
usertags = [ bug = "#82687" ];
VirtualOrganisation="dteam";
]
dorigoa@lxgrid05 16:01:41 ~/emi/wmsui_emi2>stage/usr/bin/glite-wms-job-submit --debug -a -e https://devel09.cnaf.infn.it:7443/glite_wms_wmproxy_server ~/JDLs/WMS/wms_test_tar_bug.jdl
[ ... ]
28 March 2012, 16:02:21 -I- PID: 14236 (Debug) - File Transfer (gsiftp)
Command: /usr/bin/globus-url-copy
Source: file:///tmp/ISBfiles_YaMkV2gJJbddD38QUNR5DA_0.tar.gz
Destination: gsiftp://devel09.cnaf.infn.it:2811/var/SandboxDir/p_/https_3a_2f_2fdevel09.cnaf.infn.it_3a9000_2fp_5fNucDphCF_5fynIE-0XKnxg/input/ISBfiles_YaMkV2gJJbddD38QUNR5DA_0.tar.gz
-----------------------------------------
-----------------------------------------
28 March 2012, 16:02:22 -I- PID: 14236 (Debug) - File Transfer (gsiftp) Transfer successfully done
[ ... ]
Standard Conformance Tests
Glue 1 Compliance - PASSED
[caifti@cert-13 ~]$ glue-validator -t glue1 -h cert-13.cnaf.infn.it -p 2170 -b o=grid
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
----------------------------------------------------------------------
Ran 40 tests in 0.010s
OK
Glue 2 Compliance PASSED
[caifti@cert-13 ~]$ glue-validator -t glue2 -h cert-13.cnaf.infn.it -p 2170 -b o=glue
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
----------------------------------------------------------------------
Ran 40 tests in 0.009s
OK