WMS v. 3.5 (SL6) test report
Summary
- ETICS Subsystem Configuration Name: emi-wms_R_3_5_0
- Platform: SL6/x86_64 + EPEL
Deployment Tests
Clean installation - PASSED
[root@emitestbed44 ~]# cat /etc/yum.repos.d/emi-3-rc-sl6.repo
###################################
# File managed by puppet
# it will be overwritten by puppet
###################################
[EMI-3-testing-base]
name=EMI 3 Testing Base Repository
baseurl=http://emisoft.web.cern.ch/emisoft/dist/EMI/testing/3/sl6/$basearch/base
#gpgkey=http://emisoft.web.cern.ch/emisoft/dist/EMI/3/RPM-GPG-KEY-emi
priority=45
protect=1
enabled=1
gpgcheck=0
[EMI-3-testing-third-party]
name=EMI 3 Testing Third-Party Repository
baseurl=http://emisoft.web.cern.ch/emisoft/dist/EMI/testing/3/sl6/$basearch/third-party
#gpgkey=http://emisoft.web.cern.ch/emisoft/dist/EMI/3/RPM-GPG-KEY-emi
protect=1
enabled=1
priority=45
gpgcheck=0
[Oracle-11]
name=Oracle Repository (not for distribution)
baseurl=http://emisoft.web.cern.ch/emisoft/dist/elcaro/oracle-instantclient/11/repo/sl6/$basearch
gpgcheck=0
protect=1
enabled=1
priority=45
Configuration
export GLITE_LB_MSG_BROKER=false
/opt/glite/yaim/bin/yaim -c -s site-info.def -n WMS
Unit Tests -
- Report available at [[][WMS 3.5 unit tests]]
Basic Functionality tests
Submission
Normal - PASSED
$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 14:57:09
===> Ended : 14:58:20
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130215145709.log
Proxy Mode - PASSED
$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 15:14:46
===> Ended : 15:16:24
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130215151446.log
Jdl attributes - FAILED
Test 4 fails because lxbra1910.cern.ch is not published in the top bdii.
$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 1,2,4,5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Jdl with AllowZippedISB - CE_CREAM
===> ERROR: Message Archiving the ISB files not found
Test 2: Jdl with ExpiryTime
Test 4: Jdl with DataRequirements
===> ERROR: Command lfc-mkdir /grid/testers.eu-emi.eu/20130219133021 failed. Failure message: cannot create /grid/testers.eu-emi.eu/20130219133021: Could not secure the connection
Test 5: Jdl with InputSandboxBaseURI
Test 5: Jdl with InputSandboxBaseURI - CE_CREAM
Test 6: Jdl with OutputSandboxBaseDestURI
Test 6: Jdl with OutputSandboxBaseDestURI - CE_CREAM
Test 7: Jdl with OutputSandboxDestURI
Test 7: Jdl with OutputSandboxDestURI - CE_CREAM
===>
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 13:30:21
===> Ended : 13:40:47
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 2 test(s) fail(s): ['Test 1: Jdl with AllowZippedISB', 'Test 4: Jdl with DataRequirements'] <<<
===>
===> Test log file is WMSService-TS_20130219133021.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219133021/errors.log
===>
===> Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219133021 has not been cleaned for debug purpose
Collection
Bulk submission - PASSED
$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 2: Submit a bulk of jobs - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 16:54:41
===> Ended : 16:55:52
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130215165441.log
All in a jdl - PASSED
$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 7: Submit a bulk of jobs using a single jdl with al the jdls of nodes - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 17:00:14
===> Ended : 17:01:57
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130215170014.log
Parametric job - PASSED
$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 3: Submit a parametric job - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 17:17:01
===> Ended : 17:19:18
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130215171701.log
Dag - PASSED
$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 4: Submit a DAG job
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 17:23:27
===> Ended : 17:33:46
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130215172327.log
Parallel job - PASSED
# cat wms_emitestbed44.conf
WmsClient = [
ErrorStorage="/var/tmp";
OutputStorage= "/tmp";
ListenerStorage="/tmp";
virtualorganisation="testers.eu-emi.eu";
#requirements = other.GlueCEStateStatus == "Production";
RetryCount = 0;
WMProxyEndPoints = {"https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server"};
rank = -other.GlueCEStateEstimatedResponseTime;
];
# cat mpijob.jdl
### Submit parallel job 2 CPUs
### Job to be submitted:
Executable = "/usr/bin/mpi-start";
CPUNumber = 2;
Arguments = "-t dummy -- counter.sh cpus 2";
InputSandbox = {"counter.sh"};
OutputSandbox = {"std.out", "std.err"};
StdOutput = "std.out";
StdError = "std.err";
Requirements = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment)
&& other.GlueCEInfoJobManager == "pbs";
$ glite-wms-job-submit -a -c wms_emitestbed44.conf mpijob.jdl
Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emitbrc-lamb4.civ.zcu.cz:9000/Q2dNhH-vwdk1FBxeyp1w5w
==========================================================================
$ glite-wms-job-status https://emitbrc-lamb4.civ.zcu.cz:9000/Q2dNhH-vwdk1FBxeyp1w5w
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emitbrc-lamb4.civ.zcu.cz:9000/Q2dNhH-vwdk1FBxeyp1w5w
Current Status: Done(Success)
Logged Reason(s):
- job completed
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: emitestbed29.cnaf.infn.it:8443/cream-pbs-demo
Submitted: Mon Feb 18 11:42:05 2013 CET
==========================================================================
Forwarding parameters for parallel jobs - PASSED
Test 4 fails because there are no compatible resources.
$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 8 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 8: Testing forwarding parameters for parallel jobs Case 1 - CE_CREAM
Set 8: Testing forwarding parameters for parallel jobs Case 2 - CE_CREAM
Set 8: Testing forwarding parameters for parallel jobs Case 3 - CE_CREAM
Set 8: Testing forwarding parameters for parallel jobs Case 4 - CE_CREAM
===> ERROR: Command glite-wms-job-logging-info -v 2 --event Transfer https://emitbrc-lamb4.civ.zcu.cz:9000/bnhcXU2AzUBuJJUtGuVXpA failed. Failure message: **** Warning: API_NATIVE_ERROR ****
Error while calling the "Eve::queryEvents" native api
Unable to retrieve any status information from: emitbrc-lamb4.civ.zcu.cz: glite.lb.Exception: edg_wll_QueryEvents: No such file or directory: no matching events found
at glite::lb::ServerConnection::queryEvents[./src/ServerConnection.cpp:848]
**** Warning: API_NATIVE_ERROR ****
Error while calling the "Eve::queryEvents" native api
Unable to retrieve any matching information for jobid: https://emitbrc-lamb4.civ.zcu.cz:9000/bnhcXU2AzUBuJJUtGuVXpA
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 11:27:18
===> Ended : 12:03:22
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Set 8: Testing forwarding parameters for parallel jobs'] <<<
===>
===> Test log file is WMSService-TS_20130219112718.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219112718/errors.log
===>
===> Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219112718 has not been cleaned for debug purpose
Perusal - PASSED
$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 6: Submit a perusal job - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 12:23:54
===> Ended : 12:58:11
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218122354.log
Delegation - PASSED
Test 4 fails because the failure message has changed. Now it is 'Proxy exception: the proxy has expired'.
$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test delegation operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Check --autm-delegation option
Test 2: Check --delegationid option
Test 3: Try to delegate with a short proxy and check the validity
Test 4: Works with expired proxy
===> ERROR: TEST FAILS. Job has been submitted with the expired delegation
To run this test you have to set the ROLE attribute for user proxy role at configuration file
===>
===> Test: WMS-delegation-test.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 12:16:33
===> Ended : 12:17:42
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Test 4: Works with expired proxy'] <<<
===>
===> Test log file is WMSService-TS_20130219121633.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219121633/errors.log
===>
===> Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219121633 has not been cleaned for debug purpose
List-match - PASSED
$ python WMS-listmatch-test.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job ListMatch Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: check if glite-wms-job-list-match command exists
Test 2: test a simple matching
Test 3: check --delegationid option
Test 4: exclude a CE from the match
Test 5: try a failure matching (Requirements == false)
Test 6: try a matching with EnableWMSFeedback attribute true
Test 7: try a matching with data requirements
Test 8: try a gang-matching
===>
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 14:39:45
===> Ended : 14:40:06
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218143945.log
$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job ListMatch Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: check if glite-wms-job-list-match command exists
Test 2: test a simple matching
Test 3: check --delegationid option
Test 4: exclude a CE from the match
Test 5: try a failure matching (Requirements == false)
Test 6: try a matching with EnableWMSFeedback attribute true
Test 7: try a matching with data requirements
Test 8: try a gang-matching
===>
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 14:43:06
===> Ended : 14:43:28
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218144306.log
[bertocco@emitestbed16 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
Creating proxy ....................................................................................... Done
Proxy Verify OK
Your proxy is valid until: Mon Feb 25 14:52:04 2013
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco now exists on emitb2.ics.muni.cz.
[bertocco@emitestbed16 WMS-service]$ myproxy-logon -d --voms testers.eu-emi.eu
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy/CN=proxy/CN=proxy
Contacting emitestbed01.cnaf.infn.it:15002 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed01.cnaf.infn.it] "testers.eu-emi.eu" Done
Creating proxy ........................................................................................................ Done
Your proxy is valid until Tue Feb 19 02:50:28 2013
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco in /tmp/x509up_u509.
[bertocco@emitestbed16 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u509
timeleft : 11:57:50
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO testers.eu-emi.eu extension information ===
VO : testers.eu-emi.eu
subject : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
issuer : /C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed01.cnaf.infn.it
attribute : /testers.eu-emi.eu/Role=NULL/Capability=NULL
timeleft : 11:57:50
uri : emitestbed01.cnaf.infn.it:15002
$ python WMS-listmatch-test.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job ListMatch Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: check if glite-wms-job-list-match command exists
Test 2: test a simple matching
Test 3: check --delegationid option
Test 4: exclude a CE from the match
Test 5: try a failure matching (Requirements == false)
Test 6: try a matching with EnableWMSFeedback attribute true
Test 7: try a matching with data requirements
Test 8: try a gang-matching
===>
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 14:52:44
===> Ended : 14:53:03
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218145244.log
Prologue and epilogue jobs - FAILED
$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS test prologue and epilogue attributes
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Test prologue attribute - CE_CREAM
===> ERROR: TEST FAILS. Job finishes with status: Done(Success) cannot retrieve output
Test 2: Test epilogue attribute - CE_CREAM
===> ERROR: TEST FAILS. Job finishes with status: Done(Success) cannot retrieve output
Test 3: Test prologue and epilogue attributes - CE_CREAM
===> ERROR: TEST FAILS. Job finishes with status: Done(Success) cannot retrieve output
===>
===> Test: WMS-prologue-epilogue.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 14:23:06
===> Ended : 14:28:48
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 3 test(s) fail(s): ['Test 1: Test prologue attribute', 'Test 2: Test epilogue attribute', 'Test 3: Test prologue and epilogue attributes'] <<<
===>
===> Test log file is WMSService-TS_20130219142306.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/c
===>
===> Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219142306 has not been cleaned for debug purpose
Shallow and deep resubmission - PASSED
$ python WMS-job-resubmit.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Resubmission Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Try a shallow resubmission - CE_CREAM
Test 2: Try a deep resubmission - CE_CREAM
===>
===> Test: WMS-job-resubmit.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 15:10:53
===> Ended : 15:23:07
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218151053.log
$ python WMS-job-resubmit.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Resubmission Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Try a shallow resubmission - CE_CREAM
Test 2: Try a deep resubmission - CE_CREAM
===>
===> Test: WMS-job-resubmit.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 15:25:17
===> Ended : 15:40:02
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218152517.log
$ python WMS-job-resubmit.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Resubmission Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Try a shallow resubmission - CE_CREAM
Test 2: Try a deep resubmission - CE_CREAM
===>
===> Test: WMS-job-resubmit.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 15:28:53
===> Ended : 15:42:37
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218152853.log
Cancel - PASSED
Cancel operation sometimes fail. It is due to the testsuite implementation: the test waits that the job is in a final status for a fixed period of time, if it is not in a final state after X time it fails. The right implementation should be "wait until a final status is riched and then try to cancel".
$ python WMS-job-cancel.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Cancel Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Try to cancel a normal job
Test 2: Try to cancel a DAG job
Test 3: Try to cancel one node of a DAG job
Test 4: Try to cancel a collection job
Test 5: Try to cancel one node of a collection job
===> ERROR: TEST FAILS. Job's https://emitbrc-lamb4.civ.zcu.cz:9000/c43G-mrOKhsJ4oXqoX19KQ status is wrong: Running
Test 6: Try to cancel a parametric job
Test 7: Try to cancel one node of a parametric job
Test 8: Try to cancel a MPI job
===>
===> Test: WMS-job-cancel.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 16:16:31
===> Ended : 16:35:56
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Test 5: Try to cancel one node of a collection job'] <<<
===>
===> Test log file is WMSService-TS_20130218161631.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218161631/errors.log
===>
===> Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218161631 has not been cleaned for debug purpose
$ python WMS-job-cancel.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Cancel Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Try to cancel a normal job
Test 2: Try to cancel a DAG job
Test 3: Try to cancel one node of a DAG job
Test 4: Try to cancel a collection job
Test 5: Try to cancel one node of a collection job
Test 6: Try to cancel a parametric job
Test 7: Try to cancel one node of a parametric job
===> ERROR: TEST FAILS. Job's https://emitbrc-lamb4.civ.zcu.cz:9000/1a9gSpo8WUBuVPz0wXmpIw status is wrong: Running
Test 8: Try to cancel a MPI job
===>
===> Test: WMS-job-cancel.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 17:10:03
===> Ended : 17:37:11
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Test 7: Try to cancel one node of a parametric job'] <<<
===>
===> Test log file is WMSService-TS_20130218171003.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218171003/errors.log
===>
===> Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218171003 has not been cleaned for debug purpose
Proxy renewal - PASSED
On WMS:
[root@emitestbed44 siteinfo]# /etc/init.d/glite-wms-ice stop
stopping ICE... ok
[root@emitestbed44 siteinfo]# rm -rf /var/ice/persist_dir/*
[root@emitestbed44 siteinfo]# /etc/init.d/glite-wms-ice start
starting ICE... ok
[root@emitestbed44 siteinfo]# rm -f /var/glite/spool/glite-renewd/*
On UI:
[bertocco@emitestbed16 WMS-service]$ voms-proxy-init --voms testers.eu-emi.eu
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
Creating temporary proxy ......................... Done
Contacting emitestbed07.cnaf.infn.it:15002 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed07.cnaf.infn.it] "testers.eu-emi.eu" Done
Creating proxy .............................................................. Done
Your proxy is valid until Wed Feb 20 03:08:48 2013
[bertocco@emitestbed16 WMS-service]$ myproxy-init -s emitb2.ics.muni.cz -d -n
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
Creating proxy ..................... Done
Proxy Verify OK
Your proxy is valid until: Tue Feb 26 15:08:58 2013
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco now exists on emitb2.ics.muni.cz.
$ python WMS-proxy-renewal.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS test proxy renewal operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Test proxy renewal - CE_CREAM
Test 2: Test proxy renewal without setting MYPROXYSERVER - CE_CREAM
===>
===> Test: WMS-proxy-renewal.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 15:09:08
===> Ended : 15:40:09
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130219150908.log
Limiter mechanism - Not working
Not able to make the testsuite running. It seems to be a problem in the parsing of the return value of submission command.
$ python WMS-limiter-mechanism.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1,2,3,4,6,7,8
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Limiter Mechanism
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Test option --load1 threshold for load average (1 min)
===> ERROR: Faulure reason is not 'System load is too high:' as expected.
Test 2: Test option --load5 threshold for load average (5 min)
===> ERROR: Faulure reason is not 'System load is too high:' as expected.
Test 3: Test option --load15 threshold for load average (15 min)
===> ERROR: Faulure reason is not 'System load is too high:' as expected.
Test 4: Test option --memusage threshold for memory usage (%)
===> ERROR: Faulure reason is not 'System load is too high:' as expected.
Test 6: Test option --ftpconn threshold for number of FTP connections
===> ERROR: Faulure reason is not 'System load is too high:' as expected.
Test 7: Test option --diskusage threshold for disk usage (%)
===> ERROR: Faulure reason is not 'System load is too high:' as expected.
Test 8: Test option --fdnum threshold for used file descriptor
===> ERROR: Faulure reason is not 'System load is too high:' as expected.
===>
===> Test: WMS-limiter-mechanism.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 13:46:10
===> Ended : 13:46:52
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 7 test(s) fail(s): ['Test 1: Test option --load1 threshold for load average (1 min)', 'Test 2: Test option --load5 threshold for load average (5 min)', 'Test 3: Test option --load15 threshold for load average (15 min)', 'Test 4: Test option --memusage threshold for memory usage (%)', 'Test 6: Test option --ftpconn threshold for number of FTP connections', 'Test 7: Test option --diskusage threshold for disk usage (%)', 'Test 8: Test option --fdnum threshold for used file descriptor'] <<<
===>
===> Test log file is WMSService-TS_20130220134610.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130220134610/errors.log
===>
===> Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130220134610 has not been cleaned for debug purpose
Job purge - PASSED
$ python WMS-check-purger.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Purge Mechanism
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 3: Test proxy cache purging
===>
===> Test: WMS-check-purger.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 16:23:43
===> Ended : 16:23:48
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218162343.log
Configuration file - Skip
It does not exist a wms 3.5 configuration test
Feedback -
Performance test -
Stress test -
Results -
Regression tests
Bugs attached to this task
++++ Bug #96136: WMS: stops accepting submissions when no swap is available -
PASSED
[root@emitestbed44 ~]# /usr/sbin/glite_wms_wmproxy_load_monitor --oper jobSubmit |grep -i swap
Threshold for Swap Usage: 95 => Detected value for Swap Usage: 0.00%
[root@emitestbed44 ~]# cat /proc/swaps
Filename Type Size Used Priority
/dev/dm-1 partition 8388600 0 -1
[root@emitestbed44 ~]# swapoff /dev/dm-1
[root@emitestbed44 ~]# cat /proc/swaps
Filename Type Size Used Priority
[root@emitestbed44 ~]# /usr/sbin/glite_wms_wmproxy_load_monitor --oper jobSubmit|grep -i swap
Threshold for Swap Usage: 95 => Detected value for Swap Usage: 0.00%
On UI:
$ glite-wms-job-submit -a --config /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130220112411/wms.conf /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130220112411/example.jdl
Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emitbrc-lamb4.civ.zcu.cz:9000/_xxDxiDioX1t1Ifr0XN48A
==========================================================================
[root@emitestbed44 ~]# grep -i asyncj /etc/glite-wms/glite_wms.conf
AsyncJobStart = false;
List-match for the following jdl:
[
Executable = "/bin/echo";
Arguments = "Hello";
StdOutput = "out.log";
StdError = "err.log";
InputSandbox = {};
OutputSandbox = {"out.log", "err.log"};
leftVOMS_FQAN="/gridit/ansys/Role=NULL/Capability=NULL";
rightGlueCEACBR= { "VOMS:/gridit/ansys", "VOMS:/gridit/ansys/Role=SoftwareManager"};
requirements = fqanMember(strcat("VOMS:", leftVOMS_FQAN), rightGlueCEACBR) is true;
myproxyserver="";
ShallowRetryCount = -1;
]
if the number of returned queues is more than 0 then the bug is fixed.
$ glite-wms-job-list-match -a --config /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130220112411/wms.conf /home/bertocco/jdl/100176.jdl
Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server
==========================================================================
COMPUTING ELEMENT IDs LIST
The following CE(s) matching your job requirements have been found:
*CEId*
- emi-demo08.cnaf.infn.it:8443/cream-lsf-cert
- emi-demo08.cnaf.infn.it:8443/cream-lsf-demo
- emi-demo08.cnaf.infn.it:8443/cream-lsf-testers
- emi-demo13.cnaf.infn.it:8443/cream-pbs-demo
- emitestbed29.cnaf.infn.it:8443/cream-pbs-demo
- emitestbed32.cnaf.infn.it:8443/cream-lsf-cert
- emitestbed32.cnaf.infn.it:8443/cream-lsf-demo
- emitestbed32.cnaf.infn.it:8443/cream-lsf-testers
- emitestbed02.cnaf.infn.it:8443/cream-sge-emitesters
- emitestbed09.cnaf.infn.it:8443/cream-sge-emitesters
==========================================================================
[root@emitestbed44 ~]# ps -ef|grep ice
root 1741 31503 0 12:41 pts/1 00:00:00 grep ice
[root@emitestbed44 ~]# /etc/init.d/glite-wms-ice start
starting ICE... ok
[root@emitestbed44 ~]# ll /var/run/glite-wms-ice-safe.pid
-rw-r--r-- 1 root root 5 Feb 21 12:41 /var/run/glite-wms-ice-safe.pid
[root@emitestbed44 ~]# ps -ef|grep ice
glite 1768 1 0 12:41 ? 00:00:00 /usr/bin/glite-wms-ice-safe --conf glite_wms.conf --daemon /var/run/glite-wms-ice-safe.pid
glite 1773 1768 0 12:41 ? 00:00:00 sh -c /usr/bin/glite-wms-ice --conf glite_wms.conf /var/log/wms/ice_console.log 2>&1
glite 1774 1773 0 12:41 ? 00:00:00 /usr/bin/glite-wms-ice --conf glite_wms.conf /var/log/wms/ice_console.log
root 1988 31503 0 12:41 pts/1 00:00:00 grep ice
[root@emitestbed44 ~]# /etc/init.d/glite-wms-ice stop
stopping ICE... ok
[root@emitestbed44 ~]# ps -ef|grep ice
root 2026 31503 0 12:42 pts/1 00:00:00 grep ice
[root@emitestbed44 ~]# ll /var/run/glite-wms-ice-safe.pid
ls: cannot access /var/run/glite-wms-ice-safe.pid: No such file or directory
A bug should be filed because the script script
/etc/cron.hourly/purge_proxycache
is not installed.
[root@emitestbed44 ~]# ll /var/proxycache/cache/
total 4
drwx------ 4 glite glite 4096 Feb 21 12:39 %2FC%3DIT%2FO%3DINFN%2FOU%3DPersonal%20Certificate%2FL%3DPadova%2FCN%3DSara%20Bertocco
[root@emitestbed44 ~]# sh /usr/bin/glite-wms-wmproxy-purge-proxycache_keys
Thu Feb 21 12:47:59 CET 2013: proxy cache leftover private keys cleaner started
=== %2FC%3DIT%2FO%3DINFN%2FOU%3DPersonal%20Certificate%2FL%3DPadova%2FCN%3DSara%20Bertocco
403232 4 drwx------ 2 glite glite 4096 Feb 21 12:28 ./OGydCZ_VyBaS9JqmTQ3Jew
403220 4 drwx------ 2 glite glite 4096 Feb 21 12:39 ./MKcag-WAEfKL_mcekieBbQ
Thu Feb 21 12:47:59 CET 2013: finished cleaning keys
[root@emitestbed44 ~]# ll /var/proxycache/cache/
total 4
drwx------ 2 glite glite 4096 Feb 21 12:47 %2FC%3DIT%2FO%3DINFN%2FOU%3DPersonal%20Certificate%2FL%3DPadova%2FCN%3DSara%20Bertocco
[root@emitestbed44 ~]# ll /var/proxycache/cache/%2FC%3DIT%2FO%3DINFN%2FOU%3DPersonal%20Certificate%2FL%3DPadova%2FCN%3DSara%20Bertocco
total 0
[root@emitestbed44 ~]# /etc/init.d/glite-wms-wmproxy stop
Stopping /usr/bin/glite_wms_wmproxy_server... ok
[root@emitestbed44 ~]# /etc/init.d/glite-wms-wmproxy status
/usr/bin/glite_wms_wmproxy_server is not running
[root@emitestbed44 ~]# echo $?
1
[bertocco@emitestbed16 WMS-service]$ glite-wms-job-submit -a -c wms_emitestbed44.conf /home/bertocco/jdl/file.jdl
Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emitbrc-lamb4.civ.zcu.cz:9000/jeTgqTkhcF2cn3XaPfxvJw
==========================================================================
[bertocco@emitestbed16 WMS-service]$ glite-wms-job-status https://emitbrc-lamb4.civ.zcu.cz:9000/jeTgqTkhcF2cn3XaPfxvJw
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emitbrc-lamb4.civ.zcu.cz:9000/jeTgqTkhcF2cn3XaPfxvJw
Current Status: Done(Success)
Logged Reason(s):
- job completed
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: emi-demo08.cnaf.infn.it:8443/cream-lsf-testers
Submitted: Thu Feb 21 12:59:59 2013 CET
==========================================================================
[root@emitestbed44 ~]# ls -trl /var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/
total 24
lrwxrwxrwx 1 glite glite 64 Feb 21 12:59 user.proxy -> /var/glite/spool/glite-renewd/b0070d5845b6e21cc5371cc35e95e37e.0
drwxrwx--- 2 tst10 glite 4096 Feb 21 12:59 peek
-rw-r--r-- 1 glite glite 668 Feb 21 12:59 JDLOriginal
-rw-r--r-- 1 glite glite 2976 Feb 21 13:00 JDLStarted
drwxrwxr-x 2 tst10 glite 4096 Feb 21 13:00 input
drwxrwx--- 2 tst10 glite 4096 Feb 21 13:00 output
[root@emitestbed44 ~]# find /var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/ -iname "*proxy*"
/var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/user.proxy
/var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/.user.proxy.bak
rm -f /var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/user.proxy
rm -f /var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/.user.proxy.bak
[root@emitestbed44 ~]# ls -trl /var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/
total 20
drwxrwx--- 2 tst10 glite 4096 Feb 21 12:59 peek
-rw-r--r-- 1 glite glite 668 Feb 21 12:59 JDLOriginal
-rw-r--r-- 1 glite glite 2976 Feb 21 13:00 JDLStarted
drwxrwxr-x 2 tst10 glite 4096 Feb 21 13:00 input
drwxrwx--- 2 tst10 glite 4096 Feb 21 13:00 output
[bertocco@emitestbed16 WMS-service]$ glite-wms-job-output https://emitbrc-lamb4.civ.zcu.cz:9000/jeTgqTkhcF2cn3XaPfxvJw
Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server
================================================================================
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
https://emitbrc-lamb4.civ.zcu.cz:9000/jeTgqTkhcF2cn3XaPfxvJw
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/bertocco_jeTgqTkhcF2cn3XaPfxvJw
================================================================================
[bertocco@emitestbed16 WMS-service]$ ls -l /tmp/jobOutput/bertocco_jeTgqTkhcF2cn3XaPfxvJw
total 0
-rw-rw-r-- 1 bertocco bertocco 0 Feb 21 13:06 pippo
-rw-rw-r-- 1 bertocco bertocco 0 Feb 21 13:06 std.err
-rw-rw-r-- 1 bertocco bertocco 0 Feb 21 13:06 std.out
Standard Conformance Tests
Glue 1 Compliance -
Glue 2 Compliance
--
SaraBertocco - 2013-02-15