Tags:
,
view all tags
---+ *WMS v. 3.4 test report* %TOC% ---++ Summary * Component: *WMS 3.4* * Savannah task: [[https://savannah.cern.ch/task/?21060][21060]] * ETICS Subsystem Configuration Name: *emi-wms_R_3_4_0_7* * VCS Tag: * EMI Major Release: *EMI 2 (KMatterhorn)* * Platform: SL5/x86_64 + EPEL * Certification report: not yet available * Outcome:<strong> %GREEN% *Certification under way* %ENDCOLOR% </strong> ---++ Deployment Tests ---+++ Clean installation - %GREEN%PASSED%ENDCOLOR% * Starting from a SL5 x86_64 kernel machine: <verbatim>[root@cert-13 ~]# cat /etc/redhat-release Scientific Linux SL release 5.8 (Boron) [root@cert13 ~]# uname -a Linux cert-13.cnaf.infn.it 2.6.18-308.13.1.el5 </verbatim> INSTALL LOG : * [[%ATTACHURL%/20120831_151144_WMS3.4_SL5_EMI2INSTALL.log][20120831_151144_WMS3.4_SL5_EMI2INSTALL.log]]: 20120831_151144_WMS3.4_SL5_EMI2INSTALL.log COMMAND SEQUENCE: <verbatim> wget http://emisoft.web.cern.ch/emisoft/dist/EMI/2/RPM-GPG-KEY-emi -P /etc/pki/rpm-gpg/ yum -y install yum-protectbase yum -y install yum-priorities rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/2/sl5/x86_64/base/emi-release-2.0.0-1.sl5.noarch.rpm wget --no-check-certificate http://emisoft.web.cern.ch/emisoft/dist/EMI/certification/repos/emi2-cert-sl5-base.repo -O /etc/yum.repos.d/emi2-cert-sl5-base.repo yum clean all yum makecache yum -y install emi-release yum -y install yum-protectbase yum -y install yum-priorities yum -y install ca-policy-egi-core yum -y install emi-wms yum -y install condor-emi /opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB /opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB chown root:root /var /var/log source /usr/libexec/grid-env.sh; /usr/sbin/glite-wms-create-proxy.sh /var/glite/wms.proxy /var/log/wms/create_proxy.log rpm -qa |grep emi |sort service gLite stop service gLite start service gLite status </verbatim> ---+++ Update Installation - %GREEN%PASSED%ENDCOLOR% * Starting from a production version, repo available at http://emisoft.web.cern.ch/emisoft/dist/EMI/1/sl5/x86_64/updates/emi-release-1.0.1-1.sl5.noarch.rpm INSTALL LOG : * [[%ATTACHURL%/20120903_180452_TEST_EMI1TOEMI2UPDATE.log][20120903_180452_TEST_EMI1TOEMI2UPDATE.log]]: 20120903_180452_TEST_EMI1TOEMI2UPDATE.log COMMAND SEQUENCE: <verbatim> wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -P /etc/pki/rpm-gpg/ yum -y install yum-protectbase yum -y install yum-priorities rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/1/sl5/x86_64/base/emi-release-1.0.0-1.sl5.noarch.rpm yum clean all yum makecache yum -y install emi-release yum -y install yum-protectbase yum -y install yum-priorities yum -y install ca-policy-egi-core yum -y install emi-wms /opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB /opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB rpm -qa |grep emi rpm -qa |grep wms service gLite restart rpm -e emi-release rpm -ivh http://emisoft.web.cern.ch/emisoft/dist/EMI/2/sl5/x86_64/base/emi-release-2.0.0-1.sl5.noarch.rpm wget --no-check-certificate http://emisoft.web.cern.ch/emisoft/dist/EMI/certification/repos/emi2-cert-sl5-base.repo -O /etc/yum.repos.d/emi2-cert-sl5-base.repo yum clean all yum makecache yum -y remove condor condor-lcg yum -y install emi-wms condor-emi yum -y update rpm -qa |grep emi rpm -qa |grep wms chown root:root /var /var/log source /usr/libexec/grid-env.sh; /usr/sbin/glite-wms-create-proxy.sh /var/glite/wms.proxy /var/log/wms/create_proxy.log /opt/glite/yaim/bin/yaim -v -s site-info.def -n WMS -n LB /opt/glite/yaim/bin/yaim -c -d 6 -s site-info.def -n WMS -n LB service gLite restart chmod a+r /etc/nsswitch.conf /sbin/restorecon /etc/nsswitch.conf /etc/init.d/glite-wms-wmproxy restart </verbatim> ---++ Unit Tests - %RED%NA%ENDCOLOR% *N/A*: Tests will be available with EMI-2. ---++ Basic Functionality tests ---+++ Submission ---++++ Normal - %GREEN%PASSED%ENDCOLOR% <verbatim> [dongiovanni@emitestbed08 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/bJ-1NLTGcc3OjUldvbhZrg ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/bJ-1NLTGcc3OjUldvbhZrg Current Status: Done (Success) Exit code: 0 Status Reason: Job Terminated Successfully Destination: ctb04.gridctb.uoa.gr:8443/cream-pbs-emitesters Submitted: Fri Aug 31 15:51:39 2012 CEST ========================================================================== </verbatim> SUBMISSION TESTSUITE: * [[%ATTACHURL%/WMSService-TS_20120831163229.log][WMSService-TS_20120831163229.log]]: WMSService-TS_20120831163229.log <verbatim> [dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) Test 1A: Submit to an LCG-CE Test 1B: Submit to a CREAM CE Test 1C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 16:32:29 ===> Ended : 16:57:23 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120831163229.log </verbatim> ---++++ Normal on EMI1->EMI2 UPDATE Installation - %GREEN%PASSED%ENDCOLOR% <verbatim> [dongiovanni@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/4dapc9K3V1IWpGjjdREq2w ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/4dapc9K3V1IWpGjjdREq2w Current Status: Scheduled Status Reason: unavailable Destination: ctb04.gridctb.uoa.gr:8443/cream-pbs-emitesters Submitted: Tue Sep 4 12:06:01 2012 CEST ========================================================================== </verbatim> SUBMISSION TESTSUITE: * [[%ATTACHURL%/WMSService-TS_20120904121133.log][WMSService-TS_20120904121133.log]]: WMSService-TS_20120904121133.log <verbatim> [dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) Test 1A: Submit to an LCG-CE Test 1B: Submit to a CREAM CE Test 1C: Submit without restrictions ===> ERROR: Command glite-wms-job-status --verbosity 0 https://cert-13.cnaf.infn.it:9000/8TrsHieqXo1ukD1Aaw9S2A failed. Failure message: **** Error: API_NATIVE_ERROR **** Error while calling the "Job:getStatus" native api Unable to retrieve the status for: https://cert-13.cnaf.infn.it:9000/8TrsHieqXo1ukD1Aaw9S2A glite.lb.Exception: edg_wll_JobStatus: Connection refused: edg_wll_gss_connect() at glite::lb::Job::status[./src/Job.cpp:87] ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 12:11:33 ===> Ended : 12:58:05 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120904121133.log </verbatim> ---+++++ Proxy Mode - %GREEN%PASSED%ENDCOLOR% SUBMISSION TESTLOG: * [[%ATTACHURL%/WMSService-TS_20120903160648.log][WMSService-TS_20120903160648.log]]: WMSService-TS_20120903160648.log <verbatim> [dongiovanni@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) Test 1A: Submit to an LCG-CE Test 1B: Submit to a CREAM CE Test 1C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 16:06:48 ===> Ended : 16:33:44 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120903160648.log </verbatim> ---+++++ ARC CE - %ORANGE%PASSED%ENDCOLOR% Job submitted on a production CE using the cms VO. During this test the following misbehavior was found: https://ggus.eu/tech/ticket_show.php?ticket=86094 <verbatim> [capannini@cert-17 ~]$ lcg-infosites --is egee-bdii.cnaf.infn.it --vo cms ce |grep arc 68 0 10 2 10 arc.univ.kiev.ua:2811/nordugrid-torque-arc 768 0 909 600 309 gsiftp://jade-cms.hip.fi:2811/jobs?queue=arc [cristofori@ui ~]$ glite-wms-job-submit -o test_Fabio.txt -e https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server -a -r jade-cms.hip.fi:2811/nordugrid-GE-arc firsttest.jdl Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA The job identifier has been saved in the following file: /home/GUEST/cristofori/test_Fabio.txt ========================================================================== ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: jade-cms.hip.fi:2811/nordugrid-GE-arc Submitted: Fri Sep 7 14:37:30 2012 CEST ========================================================================== [cristofori@ui ~]$ glite-wms-job-output https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the job: https://cert-13.cnaf.infn.it:9000/oyYzAY9lVqdmmg7K3sFgNA have been successfully retrieved and stored in the directory: /tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA ================================================================================ [cristofori@ui ~]$ cat /tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA/stdout.log cmsuser07 [cristofori@ui ~]$ cat /tmp/jobOutput/cristofori_oyYzAY9lVqdmmg7K3sFgNA/stderr.log ===> Test PASSED </verbatim> *Known ISSUE* - the submit to an ARC 12.05 (EMI2 ARC) fails, for problems related to ARC. Please refer to: [[https://savannah.cern.ch/task/index.php?27452][task #27452]] %BR% Failure log: <verbatim> [capannini@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/ca724leNG1NAVyOlY1ryMw ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/ca724leNG1NAVyOlY1ryMw Current Status: Aborted Logged Reason(s): - Got a job held event, reason: Unspecified gridmanager error - Got a job held event, reason: Unspecified gridmanager error - Job got an error while in the CondorG queue. - Got a job held event, reason: Failed to parse job id - Got a job held event, reason: Failed to parse job id - Job got an error while in the CondorG queue. - Got a job held event, reason: Failed to parse job id - Got a job held event, reason: Failed to parse job id - Job got an error while in the CondorG queue. - Got a job held event, reason: Failed to parse job id - Got a job held event, reason: Failed to parse job id - Job got an error while in the CondorG queue. Status Reason: hit job shallow retry count (3) Destination: pgs03.grid.upjs.sk:2811/nordugrid-torque-gridlong Submitted: Wed Sep 19 10:25:27 2012 CEST ========================================================================== </verbatim> ---+++++ Jdl attributes - %GREEN%PASSED%ENDCOLOR% Some of the tests failed at first submission so they have been repeated until successful execution. <verbatim> Define the following variables in wms-command.conf: # For Jdl attributes tests SE=gridsrm.pi.infn.it LFC=prod-lfc-shared-central.cern.ch ISB_DEST_HOSTNAME=emi-demo11.cnaf.infn.it ISB_DEST_USERNAME=root ISB_DEST_PASSWORD=*** OSB_DEST_HOSTNAME=emi-demo11.cnaf.infn.it OSB_DEST_USERNAME=root OSB_DEST_PASSWORD=*** [capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 1,2,4,5,6,7 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle for normal job with non default jdl files ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Jdl with AllowZippedISB Test 2: Jdl with ExpiryTime Test 4: Jdl with DataRequirements Submit to CREAM CE Submit to LCG CE Test 5: Jdl with InputSandboxBaseURI Submit to CREAM CE Submit to LCG CE Test 6: Jdl with OutputSandboxBaseDestURI Please set the required variables for OSB node in test's configuration file Test 7: Jdl with OutputSandboxDestURI Please set the required variables for OSB node in test's configuration file [capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 6,7 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle for normal job with non default jdl files ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 6: Jdl with OutputSandboxBaseDestURI Submit to CREAM CE Submit to LCG CE Test 7: Jdl with OutputSandboxDestURI Submit to CREAM CE ===> ERROR: Job finishes with status: Aborted cannot retrieve output [capannini@cert-17 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -i -t 7 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle for normal job with non default jdl files ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 7: Jdl with OutputSandboxDestURI Submit to CREAM CE Submit to LCG CE ===> ===> Test: WMS-jdl-attributes-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 12:07:57 ===> Ended : 12:28:46 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120907120757.log </verbatim> * [[%ATTACHURL%/jdl.tgz][jdl.tgz]]: jdl.tgz ---++++ Collection ---+++++ Bulk submission - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 2 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) Test 2A: Submit to an LCG-CE Test 2B: Submit to a CREAM CE Test 2C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 14:26:13 ===> Ended : 15:35:35 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120907142613.log [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) Test 2A: Submit to an LCG-CE Test 2B: Submit to a CREAM CE Test 2C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 14:26:31 ===> Ended : 15:06:12 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120907142631.log [capannini@cert-17 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy ............................................................................................................................................. Done Proxy Verify OK Your proxy is valid until: Fri Sep 14 12:29:57 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done Creating proxy ......................................... Done Your proxy is valid until Fri Sep 7 23:30:28 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@cert-17 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:51 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:50 uri : voms.hellasgrid.gr:15004 [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 2 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) Test 2A: Submit to an LCG-CE Test 2B: Submit to a CREAM CE Test 2C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 12:30:53 ===> Ended : 13:18:02 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120907123053.log </verbatim> * [[%ATTACHURL%/coll.tgz][coll.tgz]]: coll.tgz ---+++++ All in a jdl - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes Test 7A: Submit to an LCG-CE Test 7B: Submit to a CREAM CE Test 7C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 14:08:24 ===> Ended : 14:47:11 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120910140824.log [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes Test 7A: Submit to an LCG-CE Test 7B: Submit to a CREAM CE Test 7C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 14:08:06 ===> Ended : 14:46:54 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120910140806.log [capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam Enter GRID pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Creating temporary proxy ....................................................... Done Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done Creating proxy ........................................... Done Your proxy is valid until Mon Sep 10 22:27:11 2012 [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy ...................................................................................... Done Proxy Verify OK Your proxy is valid until: Mon Sep 17 10:27:21 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done Creating proxy ................... Done Your proxy is valid until Mon Sep 10 21:27:40 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@cert-17 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:53 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:53 uri : voms2.hellasgrid.gr:15004 [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes Test 7A: Submit to an LCG-CE Test 7B: Submit to a CREAM CE Test 7C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 14:10:16 ===> Ended : 14:47:00 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120910141016.log </verbatim> * [[%ATTACHURL%/all.tgz][all.tgz]]: all.tgz ---++++ Parametric job - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) Test 3A: Submit to an LCG-CE Test 3B: Submit to a CREAM CE Test 3C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 10:39:18 ===> Ended : 11:11:43 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120911103918.log [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) Test 3A: Submit to an LCG-CE Test 3B: Submit to a CREAM CE Test 3C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 10:39:38 ===> Ended : 11:11:36 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120911103938.log [capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam Enter GRID pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Creating temporary proxy ................................................................................................................... Done Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done Creating proxy .................................................................. Done Your proxy is valid until Tue Sep 11 22:40:17 2012 [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy ................................... Done Proxy Verify OK Your proxy is valid until: Tue Sep 18 10:40:27 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done Creating proxy ............................................................................................................... Done Your proxy is valid until Tue Sep 11 21:40:58 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:02 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:01 uri : voms2.hellasgrid.gr:15004 [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) Test 3A: Submit to an LCG-CE Test 3B: Submit to a CREAM CE Test 3C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 10:42:09 ===> Ended : 11:16:07 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120911104209.log </verbatim> * [[%ATTACHURL%/param.tgz][param.tgz]]: param.tgz ---++++ Dag - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 4: Submit a DAG job ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:29:46 ===> Ended : 11:40:04 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120911112946.log [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 4: Submit a DAG job ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:30:06 ===> Ended : 11:40:23 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120911113006.log [capannini@cert-17 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:10:30 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:09:29 uri : voms2.hellasgrid.gr:15004 [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 4: Submit a DAG job ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:30:41 ===> Ended : 11:40:52 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120911113041.log </verbatim> * [[%ATTACHURL%/dag.tgz][dag.tgz]]: dag.tgz ---++++ Parallel job - %ORANGE% *RANDOM FAILURES* %ENDCOLOR% For this test the DEFAULTREQ with "Testing" should be commented. For this reason a lot of jobs are aborted and it is difficult to come to a completion of the test. ---+++++ Forwarding parameters for parallel jobs - %GREEN% *PASSED* %ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 8 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 8: Testing forwarding parameters for parallel jobs Test 8: Case 1 Test 8: Case 2 Test 8: Case 3 Test 8: Case 4 Test 8: Case 5 ===> ===> Test: WMS-job-cycle.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 15:50:12 ===> Ended : 15:52:26 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120911155012.log </verbatim> * [[%ATTACHURL%/WMSService-TS_20120911155012.log][WMSService-TS_20120911155012.log]]: WMSService-TS_20120911155012.log ---++++ Perusal - %RED% *FAILED* %ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 6 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 6: Submit a perusal job (2 cases LCG-CE,CREAM) CASE A: Use LCG CE ===> ERROR: Command glite-wms-job-perusal --get -f out.txt --dir /home/capannini/WMS-Test-Suite/WMS-service/WMSService-Test_20120911165612/jobOutput https://cert-13.cnaf.infn.it:9000/-4AKS693kkIhSsXsCK9xbw failed. Failure message: Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server Error - WMProxy Server Error The Operation is not allowed: the job is not started Error code: SOAP-ENV:Server Traceback (most recent call last): File "WMS-job-cycle.py", line 734, in ? main() File "WMS-job-cycle.py", line 709, in main if perusal_submit(utils, tests[5]): File "WMS-job-cycle.py", line 392, in perusal_submit result=perusal_submit_test(utils,"2119/jobmanager") File "WMS-job-cycle.py", line 329, in perusal_submit_test utils.run_command_continue_on_error ("glite-wms-job-perusal --get -f out.txt --dir %s %s"%(utils.get_job_output_dir(),JOBID)) File "/home/capannini/WMS-Test-Suite/WMS-service/Test_utils.py", line 1183, in run_command_continue_on_error raise RunCommandError(args,OUTPUT[1]) Exceptions.RunCommandError: '\nConnecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server\n\n\nError - WMProxy Server Error\nThe Operation is not allowed: the job is not started\nError code: SOAP-ENV:Server\n\n' </verbatim> ---++++ Delegation - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test delegation operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Check --autm-delegation option Test 2: Check --delegationid option Test 3: Try to delegate with a short proxy and check the validity Test 4: Works with expired proxy To run this test you have to set the ROLE attribute for user proxy role at configuration file ===> ===> Test: WMS-delegation-test.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 09:53:14 ===> Ended : 09:54:27 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912095314.log [capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test delegation operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Check --autm-delegation option Test 2: Check --delegationid option Test 3: Try to delegate with a short proxy and check the validity Test 4: Works with expired proxy To run this test you have to set the ROLE attribute for user proxy role at configuration file ===> ===> Test: WMS-delegation-test.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 09:53:32 ===> Ended : 09:54:44 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912095332.log [capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam Enter GRID pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Creating temporary proxy ..................................................... Done Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done Creating proxy ................................................................ Done Your proxy is valid until Wed Sep 12 21:53:08 2012 [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy ............................................ Done Proxy Verify OK Your proxy is valid until: Wed Sep 19 09:54:01 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done Creating proxy ................................................................................................... Done Your proxy is valid until Wed Sep 12 20:54:31 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:53 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:52 uri : voms2.hellasgrid.gr:15004 [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test delegation operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Check --autm-delegation option Test 2: Check --delegationid option There are other three tests which require the user proxy password. Use -i option to enable them ===> ===> Test: WMS-delegation-test.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 09:54:55 ===> Ended : 09:54:57 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912095455.log </verbatim> * [[%ATTACHURL%/deleg.tgz][deleg.tgz]]: deleg.tgz ---++++ List-match - %GREEN%PASSED%ENDCOLOR% This test requires egee-bdii.cnaf.infn.it as the bdii, and therefore DEFAULTREQ=other.GlueCEStateStatus == "Testing" should not be defined. <verbatim> [capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job ListMatch Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: check if glite-wms-job-list-match command exists Test 2: test a simple matching Test 3: check --delegationid option Test 4: exclude a CE from the match Test 5: try a failure matching (Requirements == false) Test 6: try a matching with EnableWMSFeedback attribute true Test 7: try a matching with data requirements Test 8: try a gang-matching ===> ===> Test: WMS-listmatch-test.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:03:58 ===> Ended : 11:04:53 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912110358.log [capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job ListMatch Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: check if glite-wms-job-list-match command exists Test 2: test a simple matching Test 3: check --delegationid option Test 4: exclude a CE from the match Test 5: try a failure matching (Requirements == false) Test 6: try a matching with EnableWMSFeedback attribute true Test 7: try a matching with data requirements Test 8: try a gang-matching ===> ===> Test: WMS-listmatch-test.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:04:58 ===> Ended : 11:05:53 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912110458.log [capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job ListMatch Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: check if glite-wms-job-list-match command exists Test 2: test a simple matching Test 3: check --delegationid option Test 4: exclude a CE from the match Test 5: try a failure matching (Requirements == false) Test 6: try a matching with EnableWMSFeedback attribute true Test 7: try a matching with data requirements Test 8: try a gang-matching ===> ===> Test: WMS-listmatch-test.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:05:12 ===> Ended : 11:06:02 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912110512.log </verbatim> * [[%ATTACHURL%/list.tgz][list.tgz]]: list.tgz ---++++ Prologue and epilogue jobs - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test prologue and epilogue attributes ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test prologue attribute Test 2: Test epilogue attribute Test 3: Test prologue and epilogue attributes ===> ===> Test: WMS-prologue-epilogue.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:15:08 ===> Ended : 11:21:58 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912111508.log [capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test prologue and epilogue attributes ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test prologue attribute Test 2: Test epilogue attribute Test 3: Test prologue and epilogue attributes ===> ===> Test: WMS-prologue-epilogue.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:15:26 ===> Ended : 11:21:46 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912111526.log [capannini@cert-17 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:43:04 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:42:04 uri : voms.hellasgrid.gr:15004 [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test prologue and epilogue attributes ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Test prologue attribute Test 2: Test epilogue attribute Test 3: Test prologue and epilogue attributes ===> ===> Test: WMS-prologue-epilogue.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:15:52 ===> Ended : 11:21:39 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912111552.log </verbatim> * [[%ATTACHURL%/epipro.tgz][epipro.tgz]]: epipro.tgz ---++++ Shallow and deep resubmission - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Resubmission Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try a shallow resubmission Test 2: Try a deep resubmission ===> ===> Test: WMS-job-resubmit.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:57:03 ===> Ended : 12:09:46 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912115703.log [capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Resubmission Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try a shallow resubmission Test 2: Try a deep resubmission ===> ===> Test: WMS-job-resubmit.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:57:26 ===> Ended : 12:10:07 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912115726.log [capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Resubmission Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Try a shallow resubmission Test 2: Try a deep resubmission ===> ===> Test: WMS-job-resubmit.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 11:57:55 ===> Ended : 12:12:02 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912115755.log </verbatim> * [[%ATTACHURL%/resub.tgz][resub.tgz]]: resub.tgz ---++++ Cancel - %GREEN%PASSED%ENDCOLOR% Sometimes it can fail, in this case adjust the sleep time intervals appropriately in the script. <verbatim> [capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Cancel Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try to cancel a normal job Test 2: Try to cancel a DAG job Test 3: Try to cancel one node of a DAG job Test 4: Try to cancel a collection job Test 5: Try to cancel one node of a collection job Test 6: Try to cancel a parametric job Test 7: Try to cancel one node of a parametric job Test 8: Try to cancel a MPI job ===> ===> Test: WMS-job-cancel.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 12:16:28 ===> Ended : 12:27:50 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912121628.log [capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Cancel Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try to cancel a normal job Test 2: Try to cancel a DAG job Test 3: Try to cancel one node of a DAG job Test 4: Try to cancel a collection job Test 5: Try to cancel one node of a collection job Test 6: Try to cancel a parametric job Test 7: Try to cancel one node of a parametric job Test 8: Try to cancel a MPI job ===> ===> Test: WMS-job-cancel.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 15:31:38 ===> Ended : 16:04:31 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912153138.log [capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Cancel Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Try to cancel a normal job Test 2: Try to cancel a DAG job Test 3: Try to cancel one node of a DAG job Test 4: Try to cancel a collection job Test 5: Try to cancel one node of a collection job Test 6: Try to cancel a parametric job Test 7: Try to cancel one node of a parametric job Test 8: Try to cancel a MPI job ===> ===> Test: WMS-job-cancel.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 15:31:32 ===> Ended : 16:04:35 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120912153132.log </verbatim> * [[%ATTACHURL%/cancel.tgz][cancel.tgz]]: cancel.tgz ---++++ Proxy renewal - %GREEN%PASSED%ENDCOLOR% The myproxyserver (emitb2.ics.muni.cz) has to be configured in order to allow proxy renewal from the machine hosting the WMS. If this has not been previously done contact valtri@civ.zcu.cz. <verbatim> It is necessary to clean the proxies from ice and proxyreneal: [root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice stop stopping ICE... ok [root@emi-demo11 siteinfo]# rm -rf /var/ice/persist_dir/* [root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice start [root@emi-demo11 siteinfo]# rm -f /var/glite/spool/glite-renewd/* then Setting MYPROXYSERVER=emitb2.ics.muni.cz in wms-command.conf [capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam Enter GRID pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Creating temporary proxy ....................................... Done Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done Creating proxy .......................... Done Your proxy is valid until Thu Sep 13 22:50:49 2012 [capannini@cert-17 WMS-service]$ myproxy-init -s emitb2.ics.muni.cz -d -n Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy ............................. Done Proxy Verify OK Your proxy is valid until: Thu Sep 20 10:51:05 2012 A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on emitb2.ics.muni.cz. [capannini@cert-17 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test proxy renewal operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test proxy renewal with LCG CE Test 2: Test proxy renewal with CREAM CE Test 3: Test proxy renewal with LCG CE (without setting MYPROXYSERVER) ===> ===> Test: WMS-proxy-renewal.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 16:50:37 ===> Ended : 18:38:13 ===> ===> *** Warning: Interrupted by user *** ===> ===> ===> Test log file is WMSService-TS_20120913165037.log [capannini@cert-17 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l -i -t 3,4 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test proxy renewal operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 3: Test proxy renewal with LCG CE (without setting MYPROXYSERVER) Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER) ===> ===> Test: WMS-proxy-renewal.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 18:31:37 ===> Ended : 18:51:25 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120913183137.log </verbatim> * [[%ATTACHURL%/WMSService-TS_20120913165037.log][WMSService-TS_20120913165037.log]]: WMSService-TS_20120913165037.log * [[%ATTACHURL%/WMSService-TS_20120913183137.log][WMSService-TS_20120913183137.log]]: WMSService-TS_20120913183137.log ---++++ Limiter mechanism - %ORANGE%MOSTLY PASSED (SAME FAILURES AS IN EMI1)%ENDCOLOR% Some of the tests fail. They have been excluded from the certification as they need further checking. <verbatim> [capannini@cert-17 WMS-service]$ python WMS-limiter-mechanism.py -c wms-command.conf -V dteam -d 3 -l -t 1,2,3,4,6,7,8 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Limiter Mechanism ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Test option --load1 threshold for load average (1 min) Test 2: Test option --load5 threshold for load average (5 min) Test 3: Test option --load15 threshold for load average (15 min) Test 4: Test option --memusage threshold for memory usage (%) Test 6: Test option --ftpconn threshold for number of FTP connections Test 7: Test option --diskusage threshold for disk usage (%) Test 8: Test option --fdnum threshold for used file descriptor ===> ===> Test: WMS-limiter-mechanism.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 15:13:18 ===> Ended : 15:13:41 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120913151318.log </verbatim> * [[%ATTACHURL%/WMSService-TS_20120913151318.log][WMSService-TS_20120913151318.log]]: WMSService-TS_20120913151318.log ---++++ Job purge - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-check-purger.py -c wms-command.conf -V dteam -d 3 -l -t 1,2,3,4,5 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Purge Mechanism ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Test purge , normal job cycle ( Submit to LCG CE ) Test 2: Test purge, normal job cycle ( Submit to CREAM CE ) Test 3: Test proxy cache purging Test 4: SandBoxDir cron purger ( Submit a job and force its purge before it finishes ) Test 5: SandBoxDir cron purger ( Purge a DONE job ) ===> ===> Test: WMS-check-purger.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 17:10:57 ===> Ended : 17:47:25 ===> ===> >>> TEST FAILED <<< ===> ===> >>> failure reason: 1 test(s) fail(s): ['Test 3: Test proxy cache purging'] <<< ===> ===> Test log file is WMSService-TS_20120913171057.log ===> Error messages have been written in /home/capannini/WMS-Test-Suite/WMS-service/WMSService-Test_20120913171057/errors.log ===> ===> Test directory /home/capannini/WMS-Test-Suite/WMS-service/WMSService-Test_20120913171057 has not been cleaned for debug purpose [capannini@cert-17 WMS-service]$ python WMS-check-purger.py -c wms-command.conf -V dteam -d 3 -l -t 3 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Purge Mechanism ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 3: Test proxy cache purging ===> ===> Test: WMS-check-purger.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 18:01:39 ===> Ended : 18:01:53 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120913180139.log </verbatim> * [[%ATTACHURL%/purge.tgz][purge.tgz]]: purge.tgz <verbatim> - Purge only jobs older than 12 hours: [root@cert-13 ~]# su - glite -bash-3.2$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin +720 /var/SandboxDir/fB/https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2ffBlHdqaKz_5fXP8QiQ2LYEdQ Try to purge: -bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/fB -t 43200 13 Sep, 18:07:04 -I: [Info] operator()(purger.cpp:359): https://cert-13.cnaf.infn.it:9000/fBlHdqaKz_XP8QiQ2LYEdQ: 3/3 nodes removed 13 Sep, 18:07:04 -I: [Info] operator()(purger.cpp:371): https://cert-13.cnaf.infn.it:9000/fBlHdqaKz_XP8QiQ2LYEdQ: removed ABORTED dag -bash-3.2$ ls -l /var/SandboxDir/fB total 0 Find some directories that should not be purged: -bash-3.2$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin -240 /var/SandboxDir/lV/https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2flVpIECmODh6MLWkgxnQSWg -bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/lV -t 43200 -bash-3.2$ -bash-3.2$ ls -l /var/SandboxDir/lV total 4 drwxrwx--- 5 dteam023 glite 4096 Sep 13 14:30 https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2flVpIECmODh6MLWkgxnQSWg ===> Test PASSED - Purge a job whose proxy is already expired -bash-3.2$ openssl x509 -in /var/SandboxDir/qI/https_3a_2f_2fcert-13.cnaf.infn.it_3a9000_2fqIgvmTSwOLRTtlh2f4wS3w/user.proxy -noout -dates notBefore=Sep 12 12:39:31 2012 GMT notAfter=Sep 13 12:38:31 2012 GMT [capannini@cert-17 WMS-service]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w Current Status: Done (Success) Exit code: 0 Submitted: Wed Sep 12 14:44:32 2012 CEST ========================================================================== - Nodes information for: Status info for the Job : https://cert-13.cnaf.infn.it:9000/7XuugKoJCFVuMoc9IP8rUg Current Status: Done (Success) Logged Reason(s): - job completed - Job Terminated Successfully Exit code: 0 Status Reason: Job Terminated Successfully Destination: cream-20.pd.infn.it:8443/cream-lsf-creamcert2 Submitted: Wed Sep 12 14:44:32 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/Z-51Q0If9svoVLcrZUMdxw Current Status: Done (Success) Logged Reason(s): - job completed - Job Terminated Successfully Exit code: 0 Status Reason: Job Terminated Successfully Destination: cream-22.pd.infn.it:8443/cream-lsf-cert Submitted: Wed Sep 12 14:44:32 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/f5YLP0g4Q4T3LND9rWZuDQ Current Status: Done (Success) Logged Reason(s): - job completed - Job Terminated Successfully Exit code: 0 Status Reason: Job Terminated Successfully Destination: cream-22.pd.infn.it:8443/cream-lsf-cert Submitted: Wed Sep 12 14:44:32 2012 CEST ========================================================================== Try to purge: -bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/qI -s 13 Sep, 18:14:25 -I: [Info] operator()(purger.cpp:359): https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w: 3/3 nodes removed 13 Sep, 18:14:25 -I: [Info] operator()(purger.cpp:371): https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w: removed DONE dag [capannini@cert-17 WMS-service]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/qIgvmTSwOLRTtlh2f4wS3w Current Status: Cleared Submitted: Wed Sep 12 14:44:32 2012 CEST ========================================================================== - Nodes information for: Status info for the Job : https://cert-13.cnaf.infn.it:9000/7XuugKoJCFVuMoc9IP8rUg Current Status: Cleared Status Reason: timed out, resource purge forced Destination: cream-20.pd.infn.it:8443/cream-lsf-creamcert2 Submitted: Wed Sep 12 14:44:32 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/Z-51Q0If9svoVLcrZUMdxw Current Status: Cleared Status Reason: timed out, resource purge forced Destination: cream-22.pd.infn.it:8443/cream-lsf-cert Submitted: Wed Sep 12 14:44:32 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/f5YLP0g4Q4T3LND9rWZuDQ Current Status: Cleared Status Reason: timed out, resource purge forced Destination: cream-22.pd.infn.it:8443/cream-lsf-cert Submitted: Wed Sep 12 14:44:32 2012 CEST ========================================================================== ===> Test PASSED - Purge a dag job [capannini@cert-17 dag]$ glite-wms-job-submit -a -c ~/wms_cert-13.conf dag.jdl Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g ========================================================================== [capannini@cert-17 dag]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g Current Status: Running Destination: dagman Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== - Nodes information for: Status info for the Job : https://cert-13.cnaf.infn.it:9000/1iezDtfnVhDA7BhvIbSB-A Current Status: Submitted Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/4TZsR-GgfbTsiLz0Fk-KxA Current Status: Submitted Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/8fhIDD_3wY3OXI0qlDdDcQ Current Status: Submitted Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/AXqc30ITnnuZ4wERXa0hAw Current Status: Scheduled Status Reason: unavailable Destination: ce01.oats.inaf.it:8443/cream-pbs-dteam Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/FO4ENta9_VilKmbcO4ZUuw Current Status: Submitted Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== -bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/yO -s 13 Sep, 18:20:14 -I: [Info] operator()(purger.cpp:359): https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g: 5/5 nodes removed 13 Sep, 18:20:14 -I: [Info] operator()(purger.cpp:371): https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g: removed RUNNING dag 13 Sep, 18:20:14 -I: [Info] operator()(purger.cpp:452): https://cert-13.cnaf.infn.it:9000/yOCQWaS6hBp0ARJ1AU_Y5g: removed DONE job [capannini@cert-17 dag]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/yOrQP1vSfpn0u4BvZ4H99g Current Status: Cleared Status Reason: timed out, resource purge forced Destination: dagman Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== - Nodes information for: Status info for the Job : https://cert-13.cnaf.infn.it:9000/1iezDtfnVhDA7BhvIbSB-A Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/4TZsR-GgfbTsiLz0Fk-KxA Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/8fhIDD_3wY3OXI0qlDdDcQ Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/AXqc30ITnnuZ4wERXa0hAw Current Status: Cleared Status Reason: timed out, resource purge forced Destination: ce01.oats.inaf.it:8443/cream-pbs-dteam Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/FO4ENta9_VilKmbcO4ZUuw Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Thu Sep 13 18:18:43 2012 CEST ========================================================================== ===> Test PASSED </verbatim> ---++++ Configuration file - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 WMS-service]$ python WMS-check-configuration.py -c wms-command.conf -d 3 -l -t 1-7 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Check glite_wms.conf file ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Check common section Test 2: Check JobController section Test 3: Check NetworkServer section Test 4: Check LogMonitor section Test 5: Check WorkloadManager section Test 6: Check WorkloadManagerProxy section Test 7: Check ICE section ===> ===> Test: WMS-check-configuration.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 13:59:38 ===> Ended : 13:59:38 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120910135938.log </verbatim> * [[%ATTACHURL%/WMSService-TS_20120910135938.log][WMSService-TS_20120910135938.log]]: WMSService-TS_20120910135938.log ---++++ Feedback - %GREEN%PASSED%ENDCOLOR% The parameter EnableReplanner has been introduced but is not configured by yaim so it must be manually defined in glite_wms.conf (WorkloadManager section) before running the test. If it is not set, the test fails as expected as the default is false; it must be set to true for this test to be run successfully. %BR% In the previous version of the WMS the parameter didn't exist and the feedback was always working by default, so the test ran consistently. %BR% Moreover the test sometimes fails because the replanned job goes running instead of being replanned until reaching the maximum allowed number of replannings and then aborted. <verbatim> [capannini@cert-17 WMS-service]$ python WMS-feedback-test.py -d3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Feedback ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test WMS feedback feature ===> ===> Test: WMS-feedback-test.py ===> WMS: cert-13.cnaf.infn.it ===> Started: 16:34:52 ===> Ended : 16:36:14 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120914163452.log </verbatim> * [[%ATTACHURL%/WMSService-TS_20120914163452.log][WMSService-TS_20120914163452.log]]: WMSService-TS_20120914163452.log ---++ Performance test ---+++ Stress test - %GREEN%PASSED%ENDCOLOR% * 2880 collection of 25 nodes each (total: 72000 jobs) * One collection every 60 seconds * one user * Use LCG-CEs and CREAM-CEs (with different batch systems) * Use automatic-delegation * The job is a `ls -l` * Resubmission is enabled * Enable proxy renewal <verbatim> [capannini@cert-17 StressTest]$ ./StressTest.sh -t 2880 -n 25 -c ~/wms_cert-13.conf -j ls.jdl Test starts on ven ago 31 17:32:10 CEST 2012: submit 2880 collections (of 25 nodes) with a frequency of 60 seconds using 1 users. </verbatim> ---++++ Results <verbatim> 2880 jobs submitted in 9286 seconds: 1/3/35 (min/avg/max) Test finishes at dom set 2 17:31:34 CEST 2012 [capannini@cert-17 output]$ ../../loginfo.sh -e 57 Results: DONE : 67701 NOTDone: 13 Aborted: 386 ------------------------ Total : 68100 [capannini@cert-17 output]$ cat *.done|wc -l 67701 [capannini@cert-17 output]$ cat *.done|grep '8443/cream' |wc -l 65744 [capannini@cert-17 output]$ cat *.done|grep '2119/jobmanager'|wc -l 1953 Done jobs on CREAM CE: 65744 (97.1%) Done jobs on LCG CE: 1953 (2.9%) </verbatim> ---++ Regression tests ---+++ Bugs attached to this task ---++++ Vulnerability bug in ICE's proxy renewal (Advisory-SVG-2012-4073) - %GREEN%PASSED%ENDCOLOR% Link to Advisory: [[https://wiki.egi.eu/wiki/SVG:Advisory-SVG-2012-4073][SVG:Advisory-SVG-2012-4073]] Check: <verbatim> [cert-13 ~]$ ll /var/ice/persist_dir/ total 532 -rw------- 1 glite glite 6901 Sep 25 12:35 7D5192F0AE706956CDCF6944E6103BC393FD7D71.proxy -rw-r--r-- 1 glite glite 531456 Sep 26 15:23 ice.db </verbatim> ---++++ Vulnerability bug in ICE's proxy renewal (Advisory-SVG-2012-4039) - %ORANGE%PARTLY PASSED%ENDCOLOR% Link to Advisory: [[https://wiki.egi.eu/wiki/SVG:Advisory-SVG-2012-4039][SVG:Advisory-SVG-2012-4039]] Only tested that proxy-renewal is working correctly. <verbatim> 2012-09-18 17:25:11,329 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - There are [1] Delegation(s) to check... 2012-09-18 17:25:11,329 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Contacting MyProxy server [emitb2.ics.muni.cz] for user dn [/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] with proxy certificate [/var/ice/persist_dir/899FDB7C8E0983614A314BDD4D565D2117AF5DC6.betterproxy] to renew it... 2012-09-18 17:25:12,849 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Proxy renewal successful for DN=[/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] MyProxyURL=[emitb2.ics.muni.cz]: new proxy is [/var/ice/persist_dir/899FDB7C8E0983614A314BDD4D565D2117AF5DC6.betterproxy.renewed]. It will overwrite the better one... 2012-09-18 17:25:12,864 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Looking for the better proxy for DN [/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] MyProxy Server name [emitb2.ics.muni.cz]... 2012-09-18 17:25:12,864 INFO - iceCommandDelegationRenewal::renewAllDelegations() - Will Renew Delegation ID [13479818552E316336cert2D132Ecnaf2Einfn2Eit] with BetterProxy [/var/ice/persist_dir/899FDB7C8E0983614A314BDD4D565D2117AF5DC6.betterproxy] that will expire on [Wed Sep 19 03:25:11 2012] </verbatim> ---++++ glite-wms-ice-proxy-renew can block undefinitely (https://savannah.cern.ch/bugs/?95584) - %GREEN%PASSED%ENDCOLOR% <verbatim> - A short proxy was created: [capannini@cert-17 ~]$ voms-proxy-init --voms dteam -valid 0:10 - The submitted jdl was the following: [capannini@cert-17 ~]$ cat bug95584.jdl [ Executable = "/bin/sleep"; Arguments = "3600"; InputSandbox = {}; stdoutput="stdout"; stderror="stderr"; OutputSandbox = {"stdout","stderr"}; requirements = RegExp("cream.*", other.GlueCEUniqueID); myproxyserver="emi-demo11.cnaf.infn.it:7000"; ] where emi-demo11.cnaf.infn.it can be substituted with any other public machine. 2012-09-17 16:52:39,400 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Contacting MyProxy server [emi-demo11.cnaf.infn.it:7000] for user dn [/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] with proxy certificate [/var/ice/persist_dir/B4868FD1ED5F88BE302618ECD3B6A0C39C3680C3.betterproxy] to renew it... 2012-09-17 16:53:39,471 ERROR - iceCommandDelegationRenewal::renewAllDelegations() - Proxy renewal failed: [ERROR - /usr/bin/glite-wms-ice-proxy-renew killed the renewal child after timeout of 60 seconds. The proxy /var/ice/persist_dir/B4868FD1ED5F88BE302618ECD3B6A0C39C3680C3.betterproxy has NOT been renewed! ] 2012-09-17 16:53:39,471 DEBUG - iceCommandDelegationRenewal::renewAllDelegations() - Looking for the better proxy for DN [/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini-/dteam/Role=NULL/Capability=NULL] MyProxy Server name [emi-demo11.cnaf.infn.it:7000]... 2012-09-17 16:53:39,471 INFO - iceCommandDelegationRenewal::renewAllDelegations() - Will Renew Delegation ID [13478935182E688731cert2D132Ecnaf2Einfn2Eit] with BetterProxy [/var/ice/persist_dir/B4868FD1ED5F88BE302618ECD3B6A0C39C3680C3.betterproxy] that will expire on [Tue Sep 18 04:38:13 2012] </verbatim> ---++++ Deregistration of a proxy (2) (https://savannah.cern.ch/bugs/?83453) - %GREEN%PASSED%ENDCOLOR% <verbatim> Sep 18 10:37:23 cert-13 glite-proxy-renewd[29582]: Proxy /var/proxycache/%2FC%3DIT%2FO%3DINFN%2FOU%3DPersonal%20Certificate%2FL%3DCNAF%2FCN%3DFabio%20Capannini/5p2ARnwguGVEP-985Xf9tQ/userproxy.pem of job https://cert-13.cnaf.infn.it:9000/bLxDWTROQ-M-ffAPQ0iLuA has been registered as /var/glite/spool/glite-renewd/57e4376268ba19f67cb9a3d89fe1bed4.0 Sep 18 10:37:56 cert-13 glite-proxy-renewd[29582]: Proxy /var/glite/spool/glite-renewd/57e4376268ba19f67cb9a3d89fe1bed4.0 of job https://cert-13.cnaf.infn.it:9000/bLxDWTROQ-M-ffAPQ0iLuA has been unregistered </verbatim> ---++++ some sensible information should be logged on syslog (https://savannah.cern.ch/bugs/?92657) - %GREEN%PASSED%ENDCOLOR% <verbatim> Sep 18 10:37:23 cert-13 glite_wms_wmproxy_server: submission from cert-17.cnaf.infn.it, DN=/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini, FQAN=/dteam/Role=NULL/Capability=NULL, userid=18699 for jobid=https://cert-13.cnaf.infn.it:9000/bLxDWTROQ-M-ffAPQ0iLuA Sep 18 10:37:24 cert-13 glite-wms-workload_manager: jobid=https://cert-13.cnaf.infn.it:9000/bLxDWTROQ-M-ffAPQ0iLuA, destination=cream-19.pd.infn.it:8443/cream-lsf-cert </verbatim> ---++++ WMS UI emi-wmproxy-api-cpp and emi-wms-ui-api-python still use use gethostbyaddr/gethostbyname (https://savannah.cern.ch/bugs/?89668) - %ORANGE%PASSED%ENDCOLOR% See differences in the code of the [[http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.wms.wmproxy-api-cpp/examples/glite-wmp-job-utilities.cpp?r1=1.2.16.1&r2=1.2.16.1.2.1&pathrev=glite-wms-wmproxy-api-cpp_R_3_4_0_4][example file glite-wmp-job-utilities.cpp]] and ...... ---++++ Submission with rfc proxy doesn't work (https://savannah.cern.ch/bugs/?88128) - %ORANGE%PASSED WITH ANOMALY%ENDCOLOR% The test is passed also for LCG CE which is anomalous. <verbatim> [capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_cert-13.conf -r cream-18.pd.infn.it:8443/cream-lsf-cert ls.jdl Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://cert-13.cnaf.infn.it:9000/imAYqIe0msMvJAS961g38g ========================================================================== [capannini@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/imAYqIe0msMvJAS961g38g ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/imAYqIe0msMvJAS961g38g Current Status: Done (Success) Logged Reason(s): - job completed - Job Terminated Successfully Exit code: 0 Status Reason: Job Terminated Successfully Destination: cream-18.pd.infn.it:8443/cream-lsf-cert Submitted: Tue Sep 18 13:07:00 2012 CEST ========================================================================== </verbatim> ---++++ EMI WMS wmproxy init.d script stop/start problems (https://savannah.cern.ch/bugs/?89577) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# ps -efwww|grep httpd glite 2779 29351 0 00:00 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 2780 29351 0 00:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 2781 29351 0 00:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 2782 29351 0 00:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 2787 29351 0 00:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 6961 29351 0 14:20 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 17008 29351 0 00:30 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf root 21034 17632 0 15:30 pts/0 00:00:00 grep httpd glite 22195 29351 0 03:40 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 22956 29351 0 01:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 23049 29351 0 01:00 ? 00:00:01 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf root 29351 1 0 Sep12 ? 00:00:06 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 30085 29351 0 11:40 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf [root@cert-13 ~]# [root@cert-13 ~]# /etc/init.d/glite-wms-wmproxy restart Restarting /usr/bin/glite_wms_wmproxy_server... ok [root@cert-13 ~]# [root@cert-13 ~]# [root@cert-13 ~]# ps -efwww|grep httpd glite 21058 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 21059 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 21060 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 21061 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 21062 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf glite 21063 29351 0 15:30 ? 00:00:00 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf root 21065 17632 0 15:30 pts/0 00:00:00 grep httpd root 29351 1 0 Sep12 ? 00:00:06 /usr/sbin/httpd -k start -f /etc/glite-wms/glite_wms_wmproxy_httpd.conf [root@cert-13 ~]# /etc/init.d/glite-wms-wmproxy stop; /etc/init.d/glite-wms-wmproxy start Stopping /usr/bin/glite_wms_wmproxy_server... ok Starting /usr/bin/glite_wms_wmproxy_server... ok [capannini@cert-17 ~]$ ssh root@cert-13 '/etc/init.d/glite-wms-wmproxy stop;/etc/init.d/glite-wms-wmproxy start' root@cert-13's password: Stopping /usr/bin/glite_wms_wmproxy_server... ok Starting /usr/bin/glite_wms_wmproxy_server... ok </verbatim> ---++++ Make some WMS init scripts System V compatible (https://savannah.cern.ch/bugs/?91115) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# grep -1 chkconfig /etc/init.d/glite-wms-ice # chkconfig: 345 95 06 # description: startup script for the ICE process [root@cert-13 ~]# [root@cert-13 ~]# grep -1 chkconfig /etc/init.d/glite-wms-wm # chkconfig: 345 94 06 # description: WMS processing engine </verbatim> ---++++ Semi-automated service backends configuration for WMS (task #23845, EMI Development Tracker, Done) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# cat /etc/my.cnf [mysqld] innodb_flush_log_at_trx_commit=2 innodb_buffer_pool_size=500M !includedir /etc/mysql/conf.d/ </verbatim> innodb_flush_log_at_trx_commit=2 and innodb_buffer_pool_size=500M are what is expected to be present ---++++ WMproxy GACLs do not support wildcards (as they used to do) (https://savannah.cern.ch/bugs/?87261) - %GREEN%PASSED%ENDCOLOR% with: <verbatim> <gacl version="0.0.1"> <entry> <voms> <fqan>/dtea*</fqan></voms> <allow> <exec/> </allow> </entry> </gacl> </verbatim> %GREEN%GRANT%ENDCOLOR% <verbatim> <gacl version="0.0.1"> <entry> <voms> <fqan>/dteaM*</fqan></voms> <allow> <exec/> </allow> </entry> </gacl> </verbatim> %RED%DENY%ENDCOLOR% <verbatim> <gacl version="0.0.1"> <entry> <voms> <fqan>/dteam</fqan></voms> <allow> <exec/> </allow> </entry> </gacl> </verbatim> %RED%DENY%ENDCOLOR% <verbatim> <gacl version="0.0.1"> <entry> <voms> <fqan>/dteam</fqan></voms> <allow> <exec/> </allow> </entry> <entry> <voms> <fqan>/dteam/*</fqan></voms> <allow> <exec/> </allow> </entry> </gacl> </verbatim> %GREEN%GRANT%ENDCOLOR% ---++++ WMS logs should keep track of the last 90 days (https://savannah.cern.ch/bugs/?89871) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# grep -r rotate\ 90 /etc/logrotate.d/ /etc/logrotate.d/glite-wms-purger: rotate 90 /etc/logrotate.d/wm: rotate 90 /etc/logrotate.d/ice: rotate 90 /etc/logrotate.d/jc: rotate 90 /etc/logrotate.d/lm: rotate 90 /etc/logrotate.d/argus: rotate 90 /etc/logrotate.d/lcmaps: rotate 90 /etc/logrotate.d/globus-gridftp: rotate 90 /etc/logrotate.d/globus-gridftp: rotate 90 /etc/logrotate.d/wmproxy: rotate 90 [root@cert-13 ~]# grep -r daily /etc/logrotate.d/ /etc/logrotate.d/glite-wms-purger: daily /etc/logrotate.d/wm: daily /etc/logrotate.d/ice: daily /etc/logrotate.d/glite-lb-server: daily /etc/logrotate.d/jc: daily /etc/logrotate.d/lm: daily /etc/logrotate.d/argus: daily /etc/logrotate.d/lcmaps: daily /etc/logrotate.d/globus-gridftp: daily /etc/logrotate.d/globus-gridftp: daily /etc/logrotate.d/bdii: daily /etc/logrotate.d/wmproxy: daily </verbatim> ---++++ yaim-wms changes for Argus based authZ (https://savannah.cern.ch/bugs/?90760) - %GREEN%PASSED%ENDCOLOR% <verbatim> Modified siteinfo.def with: USE_ARGUS=yes ARGUS_PEPD_ENDPOINTS="https://argus01.lcg.cscs.ch:8154/authz https://argus02.lcg.cscs.ch:8154/authz https://argus03.lcg.cscs.ch:8154/authz" ran: /opt/glite/yaim/bin/yaim -c -s siteinfo/site-info.def -n WMS in glite_wms.conf: ArgusAuthz = true; ArgusPepdEndpoints = {"https://argus01.lcg.cscs.ch:8154/authz", "https://argus02.lcg.cscs.ch:8154/authz", "https://argus03.lcg.cscs.ch:8154/authz"}; </verbatim> ---++++ glite-wms-check-daemons.sh should not restart daemons under the admin's nose (https://savannah.cern.ch/bugs/?89674) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 siteinfo]# /etc/init.d/glite-wms-wm stop stopping workload manager... ok [root@cert-13 siteinfo]# [root@cert-13 siteinfo]# [root@cert-13 siteinfo]# /etc/init.d/glite-wms-wm status /usr/bin/glite-wms-workload_manager is not running [root@cert-13 siteinfo]# [root@cert-13 siteinfo]# [root@cert-13 siteinfo]# cat /etc/cron.d/glite-wms-check-daemons.cron HOME=/ MAILTO=root@localhost */5 * * * * root . /usr/libexec/grid-env.sh ; sh /usr/libexec/glite-wms-check-daemons.sh > /dev/null 2>&1 [root@cert-13 siteinfo]# sh /usr/libexec/glite-wms-check-daemons.sh Stopping glite-lb-notif-interlogd (786) .../etc/init.d/glite-lb-bkserverd: line 104: kill: (786) - No such process done Stopping glite-lb-bkserverd (744) ... done glite-jp-importer not running Stopping glite-lb-interlogd (809) ... done Starting glite-lb-bkserver ... done Starting glite-lb-notif-interlogd ... done Starting glite-lb-interlog for proxy ... done [root@cert-13 siteinfo]# /etc/init.d/glite-wms-wm status /usr/bin/glite-wms-workload_manager is not running [root@cert-13 siteinfo]# ps aux | grep workl root 1823 0.0 0.0 63304 812 pts/0 S+ 11:54 0:00 grep workl [root@cert-13 siteinfo]# /etc/init.d/glite-wms-wm start starting workload manager... ok [root@cert-13 siteinfo]# ps aux | grep workl glite 1930 57.3 1.5 445008 94188 ? Ssl 11:54 0:04 /usr/bin/glite-wms-workload_manager --conf glite_wms.conf --daemon root 1943 0.0 0.0 63304 808 pts/0 S+ 11:54 0:00 grep workl [root@cert-13 siteinfo]# kill -9 1930 [root@cert-13 siteinfo]# sh /usr/libexec/glite-wms-check-daemons.sh Stopping glite-lb-notif-interlogd (2065) .../etc/init.d/glite-lb-bkserverd: line 104: kill: (2065) - No such process done Stopping glite-lb-bkserverd (2023) ... done glite-jp-importer not running Stopping glite-lb-interlogd (2087) ... done Starting glite-lb-bkserver ... done Starting glite-lb-notif-interlogd ... done Starting glite-lb-interlog for proxy ... done [root@cert-13 siteinfo]# /etc/init.d/glite-wms-wm status /usr/bin/glite-wms-workload_manager (pid 2213) is running... [root@cert-13 siteinfo]# ps aux | grep workl glite 2213 13.1 1.5 445008 94188 ? Ssl 11:55 0:04 /usr/bin/glite-wms-workload_manager --conf glite_wms.conf --daemon root 2463 0.0 0.0 63308 820 pts/0 S+ 11:55 0:00 grep workl </verbatim> ---++++ Wrong location for PID file (https://savannah.cern.ch/bugs/?89857) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 siteinfo]# /etc/init.d/glite-wms-ice status /usr/bin/glite-wms-ice-safe (pid 25505) is running... [root@cert-13 siteinfo]# ll /var/run/glite-wms-ice-safe.pid -rw-r--r-- 1 root root 6 21 set 11:12 /var/run/glite-wms-ice-safe.pid [root@cert-13 siteinfo]# cat /var/run/glite-wms-ice-safe.pid 25505 [root@cert-13 siteinfo]# /etc/init.d/glite-wms-ice stop stopping ICE... ok [root@cert-13 siteinfo]# /etc/init.d/glite-wms-ice start starting ICE... ok [root@cert-13 siteinfo]# ll /var/run/glite-wms-ice-safe.pid -rw-r--r-- 1 root root 5 21 set 12:10 /var/run/glite-wms-ice-safe.pid [root@cert-13 siteinfo]# cat /var/run/glite-wms-ice-safe.pid 7429 [root@cert-13 siteinfo]# /etc/init.d/glite-wms-ice status /usr/bin/glite-wms-ice-safe (pid 7429) is running... [root@cert-13 siteinfo]# /etc/init.d/glite-wms-ice restart stopping ICE... ok starting ICE... ok [root@cert-13 siteinfo]# ps -ef|grep ice glite 7544 1 0 12:11 ? 00:00:00 /usr/bin/glite-wms-ice-safe --conf glite_wms.conf --daemon /var/run/glite-wms-ice-safe.pid glite 7549 7544 0 12:11 ? 00:00:00 sh -c /usr/bin/glite-wms-ice --conf glite_wms.conf /var/log/wms/ice_console.log 2>&1 glite 7550 7549 0 12:11 ? 00:00:00 /usr/bin/glite-wms-ice --conf glite_wms.conf /var/log/wms/ice_console.log root 7586 14289 0 12:11 pts/0 00:00:00 grep ice </verbatim> ---++++ The job replanner should be configurable (https://savannah.cern.ch/bugs/?91941) - %GREEN%PASSED%ENDCOLOR% EnableReplanner=true in the WM conf <verbatim> 21 Sep, 12:19:08 -I: [Info] operator()(/home/condor/execute/dir_3851/userdir/emi.wms.wms-manager/src/replanner.cpp:288): replanner in action </verbatim> EnableReplanner=false in the WM conf No "replanner in action" message in the log. ---++++ GlueServiceStatusInfo: ?? (https://savannah.cern.ch/bugs/?89435) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 siteinfo]# /var/lib/bdii/gip/provider/glite-info-provider-service-wmproxy-wrapper|grep -i servicestatusinfo GlueServiceStatusInfo: /usr/bin/glite_wms_wmproxy_server is running... </verbatim> ---++++ WMProxy limiter should log more at info level (https://savannah.cern.ch/bugs/?72280) - %GREEN%PASSED%ENDCOLOR% <verbatim> 24 Sep, 10:20:43 -I- PID: 7383 - "wmpgsoapoperations::ns1__jobRegister": Method: jobRegister 24 Sep, 10:20:43 -I- PID: 7383 - "wmpgsoapoperations::ns1__jobRegister": Code: 1228 24 Sep, 10:20:43 -I- PID: 7383 - "wmpgsoapoperations::ns1__jobRegister": Description: System load is too high: 2.4+ kernel w/o ELF notes? -- report this Threshold for Load Average(1 min): 0 => Detected value for Load Average(1 min): 0.16 </verbatim> ---++++ EMI WMS wmproxy rpm doesn't set execution permissions as it used to do in gLite (https://savannah.cern.ch/bugs/?89506) - %GREEN%PASSED WITH SIDENOTE%ENDCOLOR% Note: the test has been executed AFTER running yaim and not BEFORE. <verbatim> [root@cert-13 ~]# ll /usr/libexec/glite_wms_wmproxy_dirmanager -rwsr-xr-x 1 root root 22637 18 lug 13:57 /usr/libexec/glite_wms_wmproxy_dirmanager [root@cert-13 ~]# ll /usr/sbin/glite_wms_wmproxy_load_monitor -rwsr-xr-x 1 root root 22918 18 lug 13:57 /usr/sbin/glite_wms_wmproxy_load_monitor </verbatim> ---++++ yaim-wms: set ldap query filter expression for GLUE2 in WMS configuration (https://savannah.cern.ch/bugs/?91563) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# grep G2LDAP /etc/glite-wms/glite_wms.conf IsmIiG2LDAPCEFilterExt = "(|(&(objectclass=GLUE2ComputingService)(|(GLUE2ServiceType=org.glite.ce.ARC)(GLUE2ServiceType=org.glite.ce.CREAM)))(|(objectclass=GLUE2ComputingManager)(|(objectclass=GLUE2ComputingShare)(|(&(objectclass=GLUE2ComputingEndPoint)(GLUE2EndpointInterfaceName=org.glite.ce.CREAM))(|(objectclass=GLUE2ToStorageService)(|(&(objectclass=GLUE2MappingPolicy)(GLUE2PolicyScheme=org.glite.standard))(|(&(objectclass=GLUE2AccessPolicy)(GLUE2PolicyScheme=org.glite.standard))(|(objectclass=GLUE2ExecutionEnvironment)(|(objectclass=GLUE2ApplicationEnvironment)(|(objectclass=GLUE2Benchmark)))))))))))"; IsmIiG2LDAPSEFilterExt = "(|(objectclass=GLUE2StorageService)(|(objectclass=GLUE2StorageManager)(|(objectclass=GLUE2StorageShare)(|(objectclass=GLUE2StorageEndPoint)(|(objectclass=GLUE2MappingPolicy)(|(objectclass=GLUE2AccessPolicy)(|(objectclass=GLUE2DataStore)(|(objectclass=GLUE2StorageServiceCapacity)(|(objectclass=GLUE2StorageShareCapacity))))))))))";; </verbatim> ---++++ JobController logfile name is misspelled (https://savannah.cern.ch/bugs/?32611) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# grep jobcontroller /etc/glite-wms/glite_wms.conf LogFile = "${WMS_LOCATION_LOG}/jobcontroller_events.log"; </verbatim> ---++++ glite-wms-job-submit doesn't always pick up other WMProxy endpoints if load on WMS is high (https://savannah.cern.ch/bugs/?40370) - %ORANGE%HOPEFULLY FIXED%ENDCOLOR% ---++++ [wms] GlueServiceStatusInfo content is ugly (https://savannah.cern.ch/bugs/?48068) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# /etc/init.d/glite-wms-wmproxy status /usr/bin/glite_wms_wmproxy_server is running... </verbatim> ---++++ [ yaim-wms ] CeForwardParameters should include several more parameters (https://savannah.cern.ch/bugs/?61315) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# grep CeF /etc/glite-wms/glite_wms.conf CeForwardParameters = {"GlueHostMainMemoryVirtualSize","GlueHostMainMemoryRAMSize","GlueCEPolicyMaxCPUTime", "GlueCEPolicyMaxObtainableCPUTime", "GlueCEPolicyMaxObtainableWallClockTime", "GlueCEPolicyMaxWallClockTime" }; </verbatim> ---++++ There's an un-catched out_of_range exception in the ICE component (https://savannah.cern.ch/bugs/?75099) - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/rW__zcb8CtHEe-vhJ40X-Q ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/rW__zcb8CtHEe-vhJ40X-Q Current Status: Done (Success) Logged Reason(s): - job completed - Job Terminated Successfully Exit code: 0 Status Reason: Job Terminated Successfully Destination: cream-19.pd.infn.it:8443/cream-lsf-cert Submitted: Mon Sep 24 12:20:30 2012 CEST ========================================================================== </verbatim> ---++++ Last LB event logged by ICE when job aborted for proxy expired should be ABORTED (https://savannah.cern.ch/bugs/?84839) - %GREEN%PASSED%ENDCOLOR% <verbatim> 2012-09-24 12:48:40,035 INFO - iceLBLogger::logEvent() - Job Aborted Event, reason=[Proxy is expired; Job has been terminated (got SIGTERM)] - [GRIDJobID="https://cert-13.cnaf.infn.it:9000/e14r-KeN3xDuD8mZkU_q2w" CREAMJobID="https://cream-39.pd.infn.it:8443/CREAM768552230"] [capannini@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/e14r-KeN3xDuD8mZkU_q2w ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/e14r-KeN3xDuD8mZkU_q2w Current Status: Aborted Logged Reason(s): - Proxy is expired; Job has been terminated (got SIGTERM) Status Reason: Proxy is expired; Job has been terminated (got SIGTERM) Destination: cream-39.pd.infn.it:8443/cream-pbs-creamtest1 Submitted: Mon Sep 24 12:45:02 2012 CEST ========================================================================== </verbatim> ---++++ glite-wms-job-status needs a better handing of purged-related error code. (https://savannah.cern.ch/bugs/?85063) - %ORANGE%HOPEFULLY FIXED%ENDCOLOR% ---++++ queryDb has 2 handling user's options (https://savannah.cern.ch/bugs/?86267) - %GREEN%FIXED%ENDCOLOR% <verbatim> [root@cert-13 ~]# /usr/bin/queryDb --conf glite_wms.conf -vSw -s RUNNING,REALLY-RUNNING [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] ------------------------------------------------ 25 item(s) found [root@cert-13 ~]# [root@cert-13 ~]# [root@cert-13 ~]# /usr/bin/queryDb --conf glite_wms.conf -vSw -s IDLE [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] ------------------------------------------------ 34 item(s) found [root@cert-13 ~]# /usr/bin/queryDb --conf glite_wms.conf -vSw [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [IDLE][N/A] [IDLE][N/A] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [IDLE][N/A] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [IDLE][N/A] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [IDLE][N/A] [IDLE][N/A] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [IDLE][N/A] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [IDLE][N/A] [IDLE][N/A] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [REALLY-RUNNING][prod-wn-001.pn.pd.infn.it] [IDLE][N/A] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [REALLY-RUNNING][cream-wn-032.pn.pd.infn.it] [IDLE][N/A] [IDLE][N/A] [IDLE][N/A] [REALLY-RUNNING][prod-wn-002.pn.pd.infn.it] [IDLE][N/A] [IDLE][N/A] [REALLY-RUNNING][prod-wn-003.pn.pd.infn.it] [IDLE][N/A] [IDLE][N/A] ------------------------------------------------ 59 item(s) found </verbatim> ---++++ EMI WMS wmproxy rpm doesn't set execution permissions as it used to do in gLite (https://savannah.cern.ch/bugs/?89506) - %GREEN%FIXED%ENDCOLOR% <verbatim> [root@cert-13 ~]# ll /usr/sbin/glite_wms_wmproxy_load_monitor /usr/bin/glite_wms_wmproxy_server /usr/bin/glite-wms-wmproxy-purge-proxycache /usr/libexec/glite_wms_wmproxy_dirmanager -rwxr-xr-x 1 root root 1876 18 lug 13:57 /usr/bin/glite-wms-wmproxy-purge-proxycache -rwxr-xr-x 1 root root 3059579 18 lug 13:57 /usr/bin/glite_wms_wmproxy_server -rwsr-xr-x 1 root root 22637 18 lug 13:57 /usr/libexec/glite_wms_wmproxy_dirmanager -rwsr-xr-x 1 root root 22918 18 lug 13:57 /usr/sbin/glite_wms_wmproxy_load_monitor </verbatim> ---++++ yaim-wms creates wms.proxy in wrong path (https://savannah.cern.ch/bugs/?90129) - %GREEN%FIXED%ENDCOLOR% <verbatim> [root@cert-13 ~]# ll ${WMS_LOCATION_VAR}/glite/wms.proxy -rw------- 1 glite glite 2670 25 set 06:03 /var/glite/wms.proxy [root@cert-13 ~]# ll ${WMS_LOCATION_VAR}/wms.proxy ls: /var/wms.proxy: No such file or directory </verbatim> ---++++ ICE log verbosity should be reduced to 300 (https://savannah.cern.ch/bugs/?91078) - %GREEN%FIXED%ENDCOLOR% <verbatim> [root@cert-13 ~]# grep ice_log_level /etc/glite-wms/glite_wms.conf ice_log_level = 300; </verbatim> ---++++ move lcmaps.log from /var/log/glite to WMS_LOCATION_LOG (https://savannah.cern.ch/bugs/?91484) - %ORANGE%ANOMALY%ENDCOLOR% /var/log/wms/lcmaps.log exists but is empty. /var/log/glite/lcmaps.log also exists and is not empty. <verbatim> [root@cert-13 ~]# ll $WMS_LOCATION_LOG/lcmaps.log ; ll /var/log/glite/lcmaps.log -rw-r--r-- 1 glite glite 0 25 set 04:02 /var/log/wms/lcmaps.log -rw-r--r-- 1 glite glite 399456 4 set 10:54 /var/log/glite/lcmaps.log </verbatim> ---++++ WMS: use logrotate uniformly in ice, lm, jc, wm, wmp (https://savannah.cern.ch/bugs/?91486) - %ORANGE%ANOMALY%ENDCOLOR% Also /etc/cron.d/wmproxy_logrotate is present. <verbatim> [root@cert-13 ~]# grep -r rotate /etc/cron.d /etc/cron.d/wmproxy_logrotate:0 */2 * * * root /usr/sbin/logrotate -v /etc/glite-wms/wmproxy_logrotate.conf >> /var/log/wms/wmproxy_logrotate.log 2>&1 [root@cert-13 ~]# rpm -qf /etc/cron.d/wmproxy_logrotate il file /etc/cron.d/wmproxy_logrotate non è posseduto da alcun pacchetto [root@cert-13 ~]# ll /etc/logrotate.d/ totale 120 -rw-r--r-- 1 root root 131 24 set 11:59 argus -rw-r--r-- 1 root root 106 27 lug 15:13 bdii -rw-r--r-- 1 root root 147 14 apr 2011 exim -rw-r--r-- 1 root root 198 11 feb 2012 fail2ban -rw-r--r-- 1 root root 109 24 set 11:58 fetch-crl -rw-r--r-- 1 root root 194 30 lug 22:26 glite-lb-server -rw-r--r-- 1 root root 148 24 set 11:59 glite-wms-purger -rw-r--r-- 1 root root 240 10 mag 2011 globus-gridftp -rw-r--r-- 1 root root 167 27 feb 2012 httpd -rw-r--r-- 1 root root 129 24 set 11:59 ice -rw-r--r-- 1 root root 173 21 feb 2012 iscsiuiolog -rw-r--r-- 1 root root 146 24 set 11:59 jc -rw-r--r-- 1 root root 132 24 set 11:59 lcmaps -rw-r--r-- 1 root root 73 19 dic 2011 lemon-agent -rw-r--r-- 1 root root 163 21 feb 2012 libvirtd -rw-r--r-- 1 root root 143 24 set 11:59 lm -rw-r--r-- 1 root root 264 21 ago 23:41 puppet -rw-r--r-- 1 root root 61 3 apr 18:44 rpm -rw-r--r-- 1 root root 167 21 feb 2012 snmpd -rw-r--r-- 1 root root 306 31 mar 2010 syslog -rw-r--r-- 1 root root 149 24 set 11:59 wm -rw-r--r-- 1 root root 212 24 set 11:59 wmproxy -rw-r--r-- 1 root root 100 28 feb 2012 yum </verbatim> ---++++ remove several dismissed parameters from the WMS configuration (https://savannah.cern.ch/bugs/?91488) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# grep -iE 'log_file_max_size|log_rotation_base_file|log_rotation_max_file_number|ice.input_type|wmp.input_type|wmp.locallogger|wm.dispatcher_type|wm.enable_bulk_mm|wm.ism_ii_ldapsearch_async' /etc/glite-wms/glite_wms.conf [root@cert-13 ~]# [root@cert-13 ~]# </verbatim> ---++++ WMS needs cron job to kill stale GridFTP processes (https://savannah.cern.ch/bugs/?67489) - %GREEN%PASSED WITH NOTE IN THE RELNOTES%ENDCOLOR% The rpm kill-stale-ftp has to be install explicitly on the wms as it is not specified in the dependencies of the metapackage. %BR%An install note should be added to the release notes. <verbatim> [root@cert-13 ~]# cat /etc/cron.d/kill-stale-ftp.cron PATH=/sbin:/bin:/usr/sbin:/usr/bin 5,15,25,35,45,55 * * * * root /sbin/kill-stale-ftp.sh >> /var/log/kill-stale-ftp.log 2>&1 [root@cert-13 ~]# tail -2 /var/log/kill-stale-ftp.log === START Wed Sep 26 10:35:01 CEST 2012 PID 7722 === READY Wed Sep 26 10:35:01 CEST 2012 PID 7722 </verbatim> ---++++ ICE should use env vars in its configuration (https://savannah.cern.ch/bugs/?90830) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# grep -E 'persist_dir|Input|ice_host_cert|ice_host_key' /etc/glite-wms/glite_wms.conf ice_host_cert = "${GLITE_HOST_CERT}"; Input = "${WMS_LOCATION_VAR}/ice/jobdir"; persist_dir = "${WMS_LOCATION_VAR}/ice/persist_dir"; ice_host_key = "${GLITE_HOST_KEY}"; MaxInputSandboxSize = 100000000; MaxInputSandboxSize = 10000000; Input = "${WMS_LOCATION_VAR}/workload_manager/jobdir"; Input = "${WMS_LOCATION_VAR}/jobcontrol/jobdir/"; </verbatim> ---++++ cron job deletes /var/proxycache (https://savannah.cern.ch/bugs/?90640) - %GREEN%PASSED%ENDCOLOR% <verbatim> [root@cert-13 ~]# grep proxycache /etc/cron.d/* /etc/cron.d/glite-wms-wmproxy-purge-proxycache.cron:0 */6 * * * root . /usr/libexec/grid-env.sh ; /usr/bin/glite-wms-wmproxy-purge-proxycache /var/proxycache > /var/log/wms/glite-wms-wmproxy-purge-proxycache.log 2>&1 [root@cert-13 ~]# grep find /usr/bin/glite-wms-wmproxy-purge-proxycache find $1 -mindepth 1 -cmin +60 > $tmp_file </verbatim> ---++++ ICE jobdir issue - 1 bad CE can block all jobs (https://savannah.cern.ch/bugs/?80751) - %ORANGE%HOPEFULLY FIXED%ENDCOLOR% ---++++ EMI-1 WMS does not propagate user job exit code (https://savannah.cern.ch/bugs/?92922) - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 ~]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/E78kEd9OOqxwHxRl9Op_BQ ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/E78kEd9OOqxwHxRl9Op_BQ Current Status: Done (Exit Code !=0) Exit code: 1 Status Reason: Warning: job exit code != 0 Destination: cream-26.pd.infn.it:2119/jobmanager-lcgpbs-creamtest1 Submitted: Wed Sep 26 12:04:59 2012 CEST ========================================================================== </verbatim> ---++++ glite_wms_wmproxy_server segfaults after job registration failure (https://savannah.cern.ch/bugs/?94845) - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_cert-13.conf coll.jdl Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://cert-13.cnaf.infn.it:9000/dP-iqaengaXA-gNbKE43mA ========================================================================== </verbatim> ---++++ LB failover mechanism in WMproxy needs to be reviewed (https://savannah.cern.ch/bugs/?90034) - %GREEN%PASSED%ENDCOLOR% <verbatim> [capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_cert-13.conf coll.jdl Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://cert-13.cnaf.infn.it:9000/1JYPH9lsU_MP6QZTZFcnPQ ========================================================================== </verbatim> ---++++ Cancellation of a dag's node doesn't work (https://savannah.cern.ch/bugs/?81651) - %GREEN%PASSED%GREEN% <verbatim> [capannini@cert-17 dag]$ glite-wms-job-cancel https://cert-13.cnaf.infn.it:9000/pm96__EY_PiF3FQtK1HKvw Are you sure you want to remove specified job(s) [y/n]y : y Connecting to the service https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_server ============================= glite-wms-job-cancel Success ============================= The cancellation request has been successfully submitted for the following job(s): - https://cert-13.cnaf.infn.it:9000/pm96__EY_PiF3FQtK1HKvw ======================================================================================== [capannini@cert-17 dag]$ glite-wms-job-status https://cert-13.cnaf.infn.it:9000/pm96__EY_PiF3FQtK1HKvw ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://cert-13.cnaf.infn.it:9000/pm96__EY_PiF3FQtK1HKvw Current Status: Cancelled Logged Reason(s): - Aborted by user Status Reason: Aborted by user Destination: dagman Submitted: Thu Sep 27 11:53:59 2012 CEST ========================================================================== - Nodes information for: Status info for the Job : https://cert-13.cnaf.infn.it:9000/-XWtP15lUvn4AwJjP6SNQA Current Status: Cancelled Logged Reason(s): - Job has been terminated (got SIGTERM) Destination: cmsrm-cream02.roma1.infn.it:8443/cream-lsf-cmsgcert Submitted: Thu Sep 27 11:53:59 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/JG7bf-WUJI3GKR0UexOYTw Current Status: Aborted Logged Reason(s): - Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://cert-13.cnaf.infn.it:9000/JG7bf-WUJI3GKR0UexOYTw: reason is User C=IT,O=INFN,OU=Personal Certificate,L=CNAF,CN=Fabio Capannini not authorized for operation {http://www.gridsite.org/namespaces/delegation-2}getProxyReq Status Reason: failed (LB query failed) Destination: grisuce.scope.unina.it:8443/cream-pbs-egeecert Submitted: Thu Sep 27 11:53:59 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/r6FE2fuwd_vD2IGmrq70nA Current Status: Cancelled Logged Reason(s): - Job Terminated Successfully Destination: cccreamceli05.in2p3.fr:8443/cream-sge-medium Submitted: Thu Sep 27 11:53:59 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/sAKrpePmoCy1ad88FOVdxw Current Status: Aborted Logged Reason(s): - Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://cert-13.cnaf.infn.it:9000/sAKrpePmoCy1ad88FOVdxw: reason is User C=IT,O=INFN,OU=Personal Certificate,L=CNAF,CN=Fabio Capannini not authorized for operation {http://www.gridsite.org/namespaces/delegation-2}getProxyReq Status Reason: failed (LB query failed) Destination: grisuce.scope.unina.it:8443/cream-pbs-egeecert Submitted: Thu Sep 27 11:53:59 2012 CEST ========================================================================== Status info for the Job : https://cert-13.cnaf.infn.it:9000/yQW0dmv0PRSmDUd2QPfpbQ Current Status: Cancelled Submitted: Thu Sep 27 11:53:59 2012 CEST ========================================================================== </verbatim> ---++++ EMI WMS WM might abort resubmitted jobs (https://savannah.cern.ch/bugs/?89508) - %ORANGE%HOPEFULLY FIXED%ENDCOLOR% Apparently there is no CE which doesn't publish GlueCEInfoHostName. <verbatim> $ ldapsearch -x -H ldap://egee-bdii.cnaf.infn.it:2170 -b mds-vo-name=local,o=grid |egrep 'dn: GlueCEUniqueID|GlueCEInfoHostName' >pippo.txt $ grep -c GlueCEInfoHostName pippo.txt 4348 $ grep -c GlueCEUniqueID pippo.txt 4348 $ ldapsearch -x -H ldap://cert-bdii-04.cnaf.infn.it:2170 -b mds-vo-name=local,o=grid |egrep 'dn: GlueCEUniqueID|GlueCEInfoHostName' >pluto.txt $ grep -c GlueCEUniqueID pluto.txt 779 $ grep -c GlueCEInfoHostName pluto.txt 779 </verbatim> ---++++ WMProxy code requires FQANs (https://savannah.cern.ch/bugs/?72169) - %ORANGE%HOPEFULLY FIXED%ENDCOLOR% The WMP code has been changed as requested in the ticket <verbatim> // gacl file has a valid entry for user proxy without fqan if (execDN || execAU){ exec = execDN = execAU = true; } </verbatim> ---++++ Certificates signed by Terena cause job submission from gLite WMS to ARC CE fail (https://savannah.cern.ch/bugs/?97185) - %ORANGE%HOPEFULLY FIXED%ENDCOLOR% The test requires a proxy from the Terena VO which we don't have. ---++++ Pid file of ICE and WM has glite ownership (https://savannah.cern.ch/bugs/?91834) -- Main.FabioCapannini - 2012-09-25
Attachments
Attachments
Topic attachments
I
Attachment
Action
Size
Date
Who
Comment
log
20120831_151144_WMS3.4_SL5_EMI2INSTALL.log
manage
529.0 K
2012-08-31 - 14:00
DaniloDongiovanni
log
20120903_180452_TEST_EMI1TOEMI2UPDATE.log
manage
778.7 K
2012-09-04 - 10:12
DaniloDongiovanni
log
WMSService-TS_20120831163229.log
manage
40.0 K
2012-09-03 - 09:16
DaniloDongiovanni
log
WMSService-TS_20120903160648.log
manage
42.8 K
2012-09-03 - 14:55
DaniloDongiovanni
log
WMSService-TS_20120904121133.log
manage
71.2 K
2012-09-04 - 11:39
DaniloDongiovanni
log
WMSService-TS_20120910135938.log
manage
2.1 K
2012-09-10 - 12:07
FabioCapannini
log
WMSService-TS_20120911155012.log
manage
15.1 K
2012-09-11 - 14:08
FabioCapannini
log
WMSService-TS_20120913151318.log
manage
29.7 K
2012-09-13 - 13:18
FabioCapannini
log
WMSService-TS_20120913165037.log
manage
157.9 K
2012-09-13 - 16:40
FabioCapannini
log
WMSService-TS_20120913183137.log
manage
32.5 K
2012-09-14 - 08:26
FabioCapannini
log
WMSService-TS_20120914124353.log
manage
200.9 K
2012-09-14 - 13:08
FabioCapannini
log
WMSService-TS_20120914163452.log
manage
53.9 K
2012-09-14 - 14:43
FabioCapannini
tgz
all.tgz
manage
10.4 K
2012-09-10 - 14:42
FabioCapannini
tgz
cancel.tgz
manage
11.3 K
2012-09-12 - 14:37
FabioCapannini
tgz
coll.tgz
manage
13.3 K
2012-09-07 - 14:05
FabioCapannini
tgz
dag.tgz
manage
3.1 K
2012-09-11 - 10:16
FabioCapannini
tgz
deleg.tgz
manage
2.0 K
2012-09-12 - 07:58
FabioCapannini
tgz
epipro.tgz
manage
3.2 K
2012-09-12 - 09:25
FabioCapannini
tgz
jdl.tgz
manage
13.3 K
2012-09-07 - 12:11
FabioCapannini
tgz
list.tgz
manage
2.2 K
2012-09-12 - 09:10
FabioCapannini
tgz
param.tgz
manage
9.4 K
2012-09-11 - 09:26
FabioCapannini
tgz
purge.tgz
manage
9.8 K
2012-09-13 - 16:04
FabioCapannini
tgz
resub.tgz
manage
3.8 K
2012-09-12 - 10:15
FabioCapannini
Edit
|
Attach
|
PDF
|
H
istory
:
r54
|
r49
<
r48
<
r47
<
r46
|
B
acklinks
|
V
iew topic
|
More topic actions...
Topic revision: r47 - 2012-10-01
-
FabioCapannini
Home
Site map
CEMon web
CREAM web
Cloud web
Cyclops web
DGAS web
EgeeJra1It web
Gows web
GridOversight web
IGIPortal web
IGIRelease web
MPI web
Main web
MarcheCloud web
MarcheCloudPilotaCNAF web
Middleware web
Operations web
Sandbox web
Security web
SiteAdminCorner web
TWiki web
Training web
UserSupport web
VOMS web
WMS web
WMSMonitor web
WeNMR web
IGI Documentation
Repositories specifications
Installation and Configuration Guides
Updates Guides
Services/Node Types List
IGI Updates Calendar
Tips & Tricks
Use Cases & Troubleshooting
Site Admin Corner
IGI Release Management
Integration Process
TODO List
IGI Testing & Certification
Certification Testbed
Blah testing
CREAM testing
HLR testing
Storm testing
UI testing
VOMS testing
WMS testing
WN testing
IGIRelease Web
Create New Topic
Index
Search
Changes
Notifications
RSS Feed
Statistics
Preferences
P
View
Raw View
Print version
Find backlinks
History
More topic actions
Edit
Raw edit
Attach file or image
Edit topic preference settings
Set new parent
More topic actions
Account
Log In
Edit
Attach
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback