WMS v. 3.6.0 (SL5) test report - CNAF UPDATE
Summary
- Platform: SL5/x86_64 + EPEL
Deployment Tests
Upgrade - PASSED
It is necessary to downgrade gridsite, as there is a known issue in version 2.1.0:
Delegation IDs containing non-alphanumeric characters other than a dot, coma or underscore are rejected.
yum downgrade gridsite\*
Unit Tests - PASSED
Basic Functionality tests
Submission
Normal - PASSED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:15:29
===> Ended : 11:16:45
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130729111529.log
Proxy Mode - PASSED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:30:59
===> Ended : 10:37:26
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130729103059.log
Jdl attributes - MOSTLY PASSED
[capannini@emitestbed54 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 1,2,4,5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Jdl with AllowZippedISB - CE_CREAM
===> ERROR: Message Archiving the ISB files not found
Test 2: Jdl with ExpiryTime
Test 4: Jdl with DataRequirements
===>
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:11:03
===> Ended : 14:55:49
===>
===> *** Warning: Interrupted by user ***
===>
===>
===> Test log file is WMSService-TS_20130729141103.log
[capannini@emitestbed54 WMS-service]$
[capannini@emitestbed54 WMS-service]$
[capannini@emitestbed54 WMS-service]$
[capannini@emitestbed54 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 5: Jdl with InputSandboxBaseURI
Test 5: Jdl with InputSandboxBaseURI - CE_CREAM
Test 6: Jdl with OutputSandboxBaseDestURI
Test 6: Jdl with OutputSandboxBaseDestURI - CE_CREAM
===>
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:55:58
===> Ended : 15:26:17
===>
===> *** Warning: Interrupted by user ***
===>
===>
===> Test log file is WMSService-TS_20130729145558.log
[capannini@emitestbed54 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 6: Jdl with OutputSandboxBaseDestURI
Test 6: Jdl with OutputSandboxBaseDestURI - CE_CREAM
Test 7: Jdl with OutputSandboxDestURI
Test 7: Jdl with OutputSandboxDestURI - CE_CREAM
===>
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:26:29
===> Ended : 15:31:18
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130729152629.log
*
WMSService-TS_20130729141103.log: WMSService-TS_20130729141103.log
Collection
Bulk submission - FAILED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 2: Submit a bulk of jobs - CE_CREAM
===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710/jobOutput https://emitestbed41.cnaf.infn.it:9000/WSmq8zYC9HkfEDiQI8jjtQ >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710/file.tmp failed. Failure message:
Error - Error parsing Job's JDL! Aobrting...
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:27:10
===> Ended : 10:28:23
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Set 2: Submit a bulk of jobs'] <<<
===>
===> Test log file is WMSService-TS_20130730102710.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710 has not been cleaned for debug purpose
All in a jdl - FAILED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 7: Submit a bulk of jobs using a single jdl with al the jdls of nodes - CE_CREAM
===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738/jobOutput https://emitestbed41.cnaf.infn.it:9000/9Jm1B29N7Kdz4Y8-lM5D5w >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738/file.tmp failed. Failure message:
Error - Error parsing Job's JDL! Aobrting...
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:57:38
===> Ended : 10:58:51
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Set 7: Submit a bulk of jobs using a single jdl with al the jdls of nodes'] <<<
===>
===> Test log file is WMSService-TS_20130730105738.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738 has not been cleaned for debug purpose
Parametric job - FAILED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 3: Submit a parametric job - CE_CREAM
===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152/jobOutput https://emitestbed41.cnaf.infn.it:9000/pkysdZovOiZcZiTTcf7h-Q >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152/file.tmp failed. Failure message:
Error - Error parsing Job's JDL! Aobrting...
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:11:52
===> Ended : 11:14:37
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Set 3: Submit a parametric job'] <<<
===>
===> Test log file is WMSService-TS_20130730111152.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152 has not been cleaned for debug purpose
Dag - FAILED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 4: Submit a DAG job
===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911/jobOutput https://emitestbed41.cnaf.infn.it:9000/sgmceSWtXJxO2Z893fBMUA >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911/file.tmp failed. Failure message:
Error - Error parsing Job's JDL! Aobrting...
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:39:11
===> Ended : 11:49:21
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Set 4: Submit a DAG job'] <<<
===>
===> Test log file is WMSService-TS_20130730113911.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911 has not been cleaned for debug purpose
Parallel job - PASSED
### Submit parallel job 2 CPUs
### Job to be submitted:
Executable = "/usr/bin/mpi-start";
CPUNumber = 2;
Arguments = "-t dummy -- counter.sh cpus 2";
InputSandbox = {"counter.sh"};
OutputSandbox = {"std.out", "std.err"};
StdOutput = "std.out";
StdError = "std.err";
Requirements = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment)
&& other.GlueCEInfoJobManager == "pbs";
[capannini@emitestbed54 ~]$ glite-wms-job-submit -a -c wms_emitestbed41.conf mpijob.jdl
Connecting to the service https://emitestbed41.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emitestbed41.cnaf.infn.it:9000/tUfcEQK8vP4DwaWhngPQkw
==========================================================================
[capannini@emitestbed54 ~]$ glite-wms-job-status https://emitestbed41.cnaf.infn.it:9000/tUfcEQK8vP4DwaWhngPQkw
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emitestbed41.cnaf.infn.it:9000/tUfcEQK8vP4DwaWhngPQkw
Current Status: Done(Success)
Logged Reason(s):
- job completed
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: emi-demo13.cnaf.infn.it:8443/cream-pbs-demo
Submitted: Tue Jul 30 12:23:53 2013 CEST
==========================================================================
Forwarding parameters for parallel jobs - PASSED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 8 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 8: Testing forwarding parameters for parallel jobs Case 1 - CE_CREAM
Set 8: Testing forwarding parameters for parallel jobs Case 2 - CE_CREAM
Set 8: Testing forwarding parameters for parallel jobs Case 3 - CE_CREAM
Set 8: Testing forwarding parameters for parallel jobs Case 4 - CE_CREAM
Set 8: Testing forwarding parameters for parallel jobs Case 5 - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:43:34
===> Ended : 14:45:50
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130730144334.log
Perusal - FAILED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 6: Submit a perusal job - CE_CREAM
===> ERROR: TEST FAILS. No chunks have been retrieved
===> ERROR: No chunks have been retrieved.
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:50:59
===> Ended : 15:25:21
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Set 6: Submit a perusal job'] <<<
===>
===> Test log file is WMSService-TS_20130730145059.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730145059/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730145059 has not been cleaned for debug purpose
Delegation - PASSED
Test 4 fails because the failure message has changed. Now it is 'Proxy exception: the proxy has expired'.
[capannini@emitestbed54 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test delegation operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Check --autm-delegation option
Test 2: Check --delegationid option
Test 3: Try to delegate with a short proxy and check the validity
Test 4: Works with expired proxy
===> ERROR: TEST FAILS. Job has been submitted with the expired delegation
To run this test you have to set the ROLE attribute for user proxy role at configuration file
===>
===> Test: WMS-delegation-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:30:25
===> Ended : 15:31:37
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Test 4: Works with expired proxy'] <<<
===>
===> Test log file is WMSService-TS_20130730153025.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730153025/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730153025 has not been cleaned for debug purpose
List-match - PASSED
Test 7 fails because there are no suitable CEs.
[capannini@emitestbed54 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job ListMatch Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: check if glite-wms-job-list-match command exists
Test 2: test a simple matching
Test 3: check --delegationid option
Test 4: exclude a CE from the match
Test 5: try a failure matching (Requirements == false)
Test 6: try a matching with EnableWMSFeedback attribute true
Test 7: try a matching with data requirements
===> ERROR: Command lcg-infosites -v 1 --vo testers.eu-emi.eu lfc failed. Failure message: lcg-infosites: no BDII could be contacted
lcg-infosites: last BDII tried was 'certtbrc-bdii.cern.ch:2170'
lcg-infosites: IO::Socket::INET: connect: timeout
Test 8: try a gang-matching
===>
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:44:22
===> Ended : 15:46:35
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Test 7: try a matching with data requirements'] <<<
===>
===> Test log file is WMSService-TS_20130730154422.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730154422/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730154422 has not been cleaned for debug purpose
Prologue and epilogue jobs -
Shallow and deep resubmission -
Cancel -
Limiter mechanism - MOSTLY PASSED (SAME FAILURES AS IN EMI1)
Job purge -
Configuration file -
Proxy renewal -
Feedback -
Published information -
bdb database information
Stats database definitions
Performance test
Stress test
Regression tests
Bugs attached to this task