Tags:
, view all tags

WMS v. 3.6.0 (SL5) test report - CNAF UPDATE

Summary

  • Component: WMS 3.6.0

  • VCS Tag:

  • EMI Major Release: EMI 3

  • Platform: SL5/x86_64 + EPEL

  • Outcome: Ongoing

Deployment Tests

Upgrade - PASSED

It is necessary to downgrade gridsite, as there is a known issue in version 2.1.0:
Delegation IDs containing non-alphanumeric characters other than a dot, coma or underscore are rejected.

yum downgrade gridsite\*

Unit Tests - PASSED

Basic Functionality tests

Submission

Normal - PASSED

[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:15:29
===> Ended  : 11:16:45
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130729111529.log

Proxy Mode - PASSED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:30:59
===> Ended  : 10:37:26
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130729103059.log
Jdl attributes - MOSTLY PASSED
[capannini@emitestbed54 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 1,2,4,5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Jdl with AllowZippedISB - CE_CREAM 

===> ERROR: Message Archiving the ISB files not found

 Test 2: Jdl with ExpiryTime 


 Test 4: Jdl with DataRequirements 

===> 
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:11:03
===> Ended  : 14:55:49
===> 
===>   *** Warning: Interrupted by user *** 
===> 
===> 
===> Test log file is WMSService-TS_20130729141103.log
[capannini@emitestbed54 WMS-service]$ 
[capannini@emitestbed54 WMS-service]$ 
[capannini@emitestbed54 WMS-service]$ 
[capannini@emitestbed54 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 5: Jdl with InputSandboxBaseURI 


 Test 5: Jdl with InputSandboxBaseURI - CE_CREAM 


 Test 6: Jdl with OutputSandboxBaseDestURI 


 Test 6: Jdl with OutputSandboxBaseDestURI - CE_CREAM 

===> 
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:55:58
===> Ended  : 15:26:17
===> 
===>   *** Warning: Interrupted by user *** 
===> 
===> 
===> Test log file is WMSService-TS_20130729145558.log
[capannini@emitestbed54 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 6: Jdl with OutputSandboxBaseDestURI 


 Test 6: Jdl with OutputSandboxBaseDestURI - CE_CREAM 


 Test 7: Jdl with OutputSandboxDestURI 


 Test 7: Jdl with OutputSandboxDestURI - CE_CREAM 

===> 
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:26:29
===> Ended  : 15:31:18
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130729152629.log
* WMSService-TS_20130729141103.log: WMSService-TS_20130729141103.log

Collection

Bulk submission - FAILED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs - CE_CREAM 

===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710/jobOutput https://emitestbed41.cnaf.infn.it:9000/WSmq8zYC9HkfEDiQI8jjtQ >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710/file.tmp failed. Failure message: 
Error - Error parsing Job's JDL! Aobrting...


===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:27:10
===> Ended  : 10:28:23
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 2: Submit a bulk of jobs'] <<< 
===> 
===> Test log file is WMSService-TS_20130730102710.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730102710 has not been cleaned for debug purpose

All in a jdl - FAILED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs using a single jdl with al the jdls of nodes - CE_CREAM 

===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738/jobOutput https://emitestbed41.cnaf.infn.it:9000/9Jm1B29N7Kdz4Y8-lM5D5w >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738/file.tmp failed. Failure message: 
Error - Error parsing Job's JDL! Aobrting...


===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:57:38
===> Ended  : 10:58:51
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 7: Submit a bulk of jobs using a single jdl with al the jdls of nodes'] <<< 
===> 
===> Test log file is WMSService-TS_20130730105738.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730105738 has not been cleaned for debug purpose

Parametric job - FAILED

[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 3: Submit a parametric job - CE_CREAM 

===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152/jobOutput https://emitestbed41.cnaf.infn.it:9000/pkysdZovOiZcZiTTcf7h-Q >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152/file.tmp failed. Failure message: 
Error - Error parsing Job's JDL! Aobrting...


===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:11:52
===> Ended  : 11:14:37
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 3: Submit a parametric job'] <<< 
===> 
===> Test log file is WMSService-TS_20130730111152.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730111152 has not been cleaned for debug purpose

Dag - FAILED

[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> ERROR: Command glite-wms-job-output --noint --dir /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911/jobOutput https://emitestbed41.cnaf.infn.it:9000/sgmceSWtXJxO2Z893fBMUA >> /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911/file.tmp failed. Failure message: 
Error - Error parsing Job's JDL! Aobrting...


===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:39:11
===> Ended  : 11:49:21
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 4: Submit a DAG job'] <<< 
===> 
===> Test log file is WMSService-TS_20130730113911.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730113911 has not been cleaned for debug purpose

Parallel job - PASSED

### Submit parallel job 2 CPUs
### Job to be submitted:
Executable = "/usr/bin/mpi-start";
CPUNumber  = 2;
Arguments  = "-t dummy -- counter.sh cpus 2";
InputSandbox = {"counter.sh"};
OutputSandbox = {"std.out", "std.err"};
StdOutput = "std.out";
StdError = "std.err";
Requirements = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment)
               && other.GlueCEInfoJobManager == "pbs";

[capannini@emitestbed54 ~]$ glite-wms-job-submit -a -c wms_emitestbed41.conf mpijob.jdl 

Connecting to the service https://emitestbed41.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emitestbed41.cnaf.infn.it:9000/tUfcEQK8vP4DwaWhngPQkw

==========================================================================


[capannini@emitestbed54 ~]$ glite-wms-job-status https://emitestbed41.cnaf.infn.it:9000/tUfcEQK8vP4DwaWhngPQkw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emitestbed41.cnaf.infn.it:9000/tUfcEQK8vP4DwaWhngPQkw
Current Status:     Done(Success)
Logged Reason(s):
    - job completed
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        emi-demo13.cnaf.infn.it:8443/cream-pbs-demo
Submitted:          Tue Jul 30 12:23:53 2013 CEST
==========================================================================

Forwarding parameters for parallel jobs - PASSED
[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 8 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 8: Testing forwarding parameters for parallel jobs  Case 1 - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 2 - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 3  - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 4 - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 5 - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:43:34
===> Ended  : 14:45:50
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130730144334.log

Perusal - FAILED

[capannini@emitestbed54 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 6: Submit a perusal job - CE_CREAM 

===> ERROR: TEST FAILS. No chunks have been retrieved
===> ERROR: No chunks have been retrieved.
===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 14:50:59
===> Ended  : 15:25:21
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 6: Submit a perusal job'] <<< 
===> 
===> Test log file is WMSService-TS_20130730145059.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730145059/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730145059 has not been cleaned for debug purpose

Delegation - PASSED

Test 4 fails because the failure message has changed. Now it is 'Proxy exception: the proxy has expired'.
[capannini@emitestbed54 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 Test 3: Try to delegate with a short proxy and check the validity 


 Test 4: Works with expired proxy 

===> ERROR: TEST FAILS. Job has been submitted with the expired delegation

 To run this test you have to set the ROLE attribute for user proxy role at configuration file 

===> 
===> Test: WMS-delegation-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:30:25
===> Ended  : 15:31:37
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 4: Works with expired proxy'] <<< 
===> 
===> Test log file is WMSService-TS_20130730153025.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730153025/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730153025 has not been cleaned for debug purpose

List-match - PASSED

Test 7 fails because there are no suitable CEs.
[capannini@emitestbed54 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 


 Test 7: try a matching with data requirements 

===> ERROR: Command lcg-infosites -v 1 --vo testers.eu-emi.eu lfc failed. Failure message: lcg-infosites: no BDII could be contacted
lcg-infosites: last BDII tried was 'certtbrc-bdii.cern.ch:2170'
lcg-infosites: IO::Socket::INET: connect: timeout

 Test 8: try a gang-matching 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:44:22
===> Ended  : 15:46:35
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 7: try a matching with data requirements'] <<< 
===> 
===> Test log file is WMSService-TS_20130730154422.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730154422/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130730154422 has not been cleaned for debug purpose

Prologue and epilogue jobs -

Shallow and deep resubmission -

Cancel -

Limiter mechanism - MOSTLY PASSED (SAME FAILURES AS IN EMI1)

Job purge -

Configuration file -

Proxy renewal -

Feedback -

Published information -

bdb database information

Stats database definitions

Performance test

Stress test

Regression tests

Bugs attached to this task

Topic attachments
I Attachment Action SizeSorted ascending Date Who Comment
Unknown file formatlog WMSService-TS_20130730102710.log manage 3.5 K 2013-07-30 - 08:50 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730105738.log manage 3.5 K 2013-07-30 - 09:00 FabioCapannini  
Unknown file formatlog WMSService-TS_20130729111529.log manage 3.7 K 2013-07-29 - 09:20 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730145059.log manage 3.8 K 2013-07-30 - 13:27 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730111152.log manage 5.6 K 2013-07-30 - 09:19 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730154422.log manage 6.2 K 2013-07-30 - 13:54 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730153025.log manage 6.9 K 2013-07-30 - 13:40 FabioCapannini  
Unknown file formatlog yaim.log manage 7.4 K 2013-07-24 - 12:44 FabioCapannini  
Unknown file formatlog WMSService-TS_20130729103059.log manage 10.9 K 2013-07-29 - 09:11 FabioCapannini  
Unknown file formatlog WMSService-TS_20130729141103.log manage 12.6 K 2013-07-29 - 13:36 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730144334.log manage 15.3 K 2013-07-30 - 12:50 FabioCapannini  
Unknown file formatlog WMSService-TS_20130729152629.log manage 15.6 K 2013-07-29 - 13:36 FabioCapannini  
Unknown file formatlog WMSService-TS_20130730113911.log manage 16.3 K 2013-07-30 - 09:53 FabioCapannini  
Unknown file formatlog WMSService-TS_20130729145558.log manage 51.2 K 2013-07-29 - 13:36 FabioCapannini  
Unknown file formatlog sl5update.log manage 57.8 K 2013-07-24 - 10:14 FabioCapannini  
Edit | Attach | PDF | History: r14 | r12 < r11 < r10 < r9 | Backlinks | Raw View | More topic actions...
Topic revision: r10 - 2013-07-30 - FabioCapannini
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback