Tags:
, view all tags

WMS v. 3.6.0 (SL5) test report - CNAF UPDATE

Summary

  • Component: WMS 3.6.0

  • VCS Tag:

  • EMI Major Release: EMI 3

  • Platform: SL5/x86_64 + EPEL

  • Outcome: Ongoing

Deployment Tests

Upgrade - PASSED

It is necessary to downgrade gridsite, as there is a known issue in version 2.1.0:
Delegation IDs containing non-alphanumeric characters other than a dot, coma or underscore are rejected.

yum downgrade gridsite\*

Unit Tests - PASSED

Basic Functionality tests

Submission

Normal - PASSED

[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:15:29
===> Ended  : 11:16:45
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130729111529.log

Proxy Mode - PASSED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:30:59
===> Ended  : 10:37:26
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130729103059.log
Jdl attributes - MOSTLY PASSED
[capannini@emitestbed54 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 1,2,4,5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Jdl with AllowZippedISB - CE_CREAM 

===> ERROR: Message Archiving the ISB files not found

 Test 2: Jdl with ExpiryTime 


 Test 4: Jdl with DataRequirements 

===> 
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:11:03
===> Ended  : 14:55:49
===> 
===>   *** Warning: Interrupted by user *** 
===> 
===> 
===> Test log file is WMSService-TS_20130729141103.log
[capannini@emitestbed54 WMS-service]$ 
[capannini@emitestbed54 WMS-service]$ 
[capannini@emitestbed54 WMS-service]$ 
[capannini@emitestbed54 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 5: Jdl with InputSandboxBaseURI 


 Test 5: Jdl with InputSandboxBaseURI - CE_CREAM 


 Test 6: Jdl with OutputSandboxBaseDestURI 


 Test 6: Jdl with OutputSandboxBaseDestURI - CE_CREAM 

===> 
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:55:58
===> Ended  : 15:26:17
===> 
===>   *** Warning: Interrupted by user *** 
===> 
===> 
===> Test log file is WMSService-TS_20130729145558.log
[capannini@emitestbed54 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 6: Jdl with OutputSandboxBaseDestURI 


 Test 6: Jdl with OutputSandboxBaseDestURI - CE_CREAM 


 Test 7: Jdl with OutputSandboxDestURI 


 Test 7: Jdl with OutputSandboxDestURI - CE_CREAM 

===> 
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:26:29
===> Ended  : 15:31:18
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130729152629.log
* WMSService-TS_20130729141103.log: WMSService-TS_20130729141103.log

Collection

Bulk submission - FAILED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs - CE_CREAM 

===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710/jobOutput https://emitestbed41.cnaf.infn.it:9000/WSmq8zYC9HkfEDiQI8jjtQ >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710/file.tmp failed. Failure message: 
Error - Error parsing Job's JDL! Aobrting...


===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:27:10
===> Ended  : 10:28:23
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 2: Submit a bulk of jobs'] <<< 
===> 
===> Test log file is WMSService-TS_20130730102710.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710 has not been cleaned for debug purpose

All in a jdl - FAILED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs using a single jdl with al the jdls of nodes - CE_CREAM 

===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738/jobOutput https://emitestbed41.cnaf.infn.it:9000/9Jm1B29N7Kdz4Y8-lM5D5w >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738/file.tmp failed. Failure message: 
Error - Error parsing Job's JDL! Aobrting...


===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:57:38
===> Ended  : 10:58:51
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 7: Submit a bulk of jobs using a single jdl with al the jdls of nodes'] <<< 
===> 
===> Test log file is WMSService-TS_20130730105738.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738 has not been cleaned for debug purpose

Parametric job - FAILED

[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 3: Submit a parametric job - CE_CREAM 

===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152/jobOutput https://emitestbed41.cnaf.infn.it:9000/pkysdZovOiZcZiTTcf7h-Q >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152/file.tmp failed. Failure message: 
Error - Error parsing Job's JDL! Aobrting...


===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:11:52
===> Ended  : 11:14:37
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 3: Submit a parametric job'] <<< 
===> 
===> Test log file is WMSService-TS_20130730111152.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152 has not been cleaned for debug purpose

Dag - FAILED

[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911/jobOutput https://emitestbed41.cnaf.infn.it:9000/sgmceSWtXJxO2Z893fBMUA >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911/file.tmp failed. Failure message: 
Error - Error parsing Job's JDL! Aobrting...


===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:39:11
===> Ended  : 11:49:21
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 4: Submit a DAG job'] <<< 
===> 
===> Test log file is WMSService-TS_20130730113911.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911 has not been cleaned for debug purpose

Parallel job - PASSED

### Submit parallel job 2 CPUs
### Job to be submitted:
Executable = "/usr/bin/mpi-start";
CPUNumber  = 2;
Arguments  = "-t dummy -- counter.sh cpus 2";
InputSandbox = {"counter.sh"};
OutputSandbox = {"std.out", "std.err"};
StdOutput = "std.out";
StdError = "std.err";
Requirements = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment)
               && other.GlueCEInfoJobManager == "pbs";

[capannini@emitestbed54 ~]$ glite-wms-job-submit -a -c wms_emitestbed41.conf mpijob.jdl 

Connecting to the service https://emitestbed41.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emitestbed41.cnaf.infn.it:9000/tUfcEQK8vP4DwaWhngPQkw

==========================================================================


[capannini@emitestbed54 ~]$ glite-wms-job-status https://emitestbed41.cnaf.infn.it:9000/tUfcEQK8vP4DwaWhngPQkw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emitestbed41.cnaf.infn.it:9000/tUfcEQK8vP4DwaWhngPQkw
Current Status:     Done(Success)
Logged Reason(s):
    - job completed
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        emi-demo13.cnaf.infn.it:8443/cream-pbs-demo
Submitted:          Tue Jul 30 12:23:53 2013 CEST
==========================================================================

Forwarding parameters for parallel jobs - PASSED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 8 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 8: Testing forwarding parameters for parallel jobs  Case 1 - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 2 - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 3  - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 4 - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 5 - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:43:34
===> Ended  : 14:45:50
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130730144334.log

Perusal - FAILED

[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 6: Submit a perusal job - CE_CREAM 

===> ERROR: TEST FAILS. No chunks have been retrieved
===> ERROR: No chunks have been retrieved.
===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:50:59
===> Ended  : 15:25:21
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 6: Submit a perusal job'] <<< 
===> 
===> Test log file is WMSService-TS_20130730145059.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730145059/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730145059 has not been cleaned for debug purpose

Delegation - PASSED

Test 4 fails because the failure message has changed. Now it is 'Proxy exception: the proxy has expired'.
[capannini@emitestbed54 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 Test 3: Try to delegate with a short proxy and check the validity 


 Test 4: Works with expired proxy 

===> ERROR: TEST FAILS. Job has been submitted with the expired delegation

 To run this test you have to set the ROLE attribute for user proxy role at configuration file 

===> 
===> Test: WMS-delegation-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:30:25
===> Ended  : 15:31:37
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 4: Works with expired proxy'] <<< 
===> 
===> Test log file is WMSService-TS_20130730153025.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730153025/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730153025 has not been cleaned for debug purpose

List-match - PASSED

Test 7 fails because there are no suitable CEs.
[capannini@emitestbed54 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 


 Test 7: try a matching with data requirements 

===> ERROR: Command lcg-infosites -v 1 --vo testers.eu-emi.eu lfc failed. Failure message: lcg-infosites: no BDII could be contacted
lcg-infosites: last BDII tried was 'certtbrc-bdii.cern.ch:2170'
lcg-infosites: IO::Socket::INET: connect: timeout

 Test 8: try a gang-matching 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:44:22
===> Ended  : 15:46:35
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 7: try a matching with data requirements'] <<< 
===> 
===> Test log file is WMSService-TS_20130730154422.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730154422/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730154422 has not been cleaned for debug purpose

Prologue and epilogue jobs -

Shallow and deep resubmission -

Cancel -

Limiter mechanism - MOSTLY PASSED (SAME FAILURES AS IN EMI1)

Job purge -

Configuration file -

Proxy renewal -

Feedback -

Published information -

bdb database information

Stats database definitions

Performance test

Stress test

Regression tests

Bugs attached to this task

Topic attachments
ISorted ascending Attachment Action Size Date Who Comment
Unknown file formatlog WMSService-TS_20130729103059.log manage 10.9 K 2013-07-29 - 09:11 FabioCapannini  
Unknown file formatlog WMSService-TS_20130729111529.log manage 3.7 K 2013-07-29 - 09:20 FabioCapannini  
Unknown file formatlog WMSService-TS_20130729141103.log manage 12.6 K 2013-07-29 - 13:36 FabioCapannini  
Unknown file formatlog WMSService-TS_20130729145558.log manage 51.2 K 2013-07-29 - 13:36 FabioCapannini  
Unknown file formatlog WMSService-TS_20130729152629.log manage 15.6 K 2013-07-29 - 13:36 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730102710.log manage 3.5 K 2013-07-30 - 08:50 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730105738.log manage 3.5 K 2013-07-30 - 09:00 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730111152.log manage 5.6 K 2013-07-30 - 09:19 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730113911.log manage 16.3 K 2013-07-30 - 09:53 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730144334.log manage 15.3 K 2013-07-30 - 12:50 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730145059.log manage 3.8 K 2013-07-30 - 13:27 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730153025.log manage 6.9 K 2013-07-30 - 13:40 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730154422.log manage 6.2 K 2013-07-30 - 13:54 FabioCapannini  
Unknown file formatlog sl5update.log manage 57.8 K 2013-07-24 - 10:14 FabioCapannini  
Unknown file formatlog yaim.log manage 7.4 K 2013-07-24 - 12:44 FabioCapannini  
Edit | Attach | PDF | History: r14 | r12 < r11 < r10 < r9 | Backlinks | Raw View | More topic actions...
Topic revision: r10 - 2013-07-30 - FabioCapannini
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback