Tags:
, view all tags

WMS v. 3.5 (SL5) test report

Summary

  • Component: WMS 3.5

  • ETICS Subsystem Configuration Name: emi-wms_R_3_5_0

  • VCS Tag:

  • EMI Major Release: EMI 3

  • Platform: SL5/x86_64 + EPEL

  • Outcome: Ongoing

Deployment Tests

Clean installation - PASSED

Unit Tests - PASSED

Basic Functionality tests

Submission

Normal - PASSED

[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 17:49:12
===> Ended  : 17:50:22
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130214174912.log

Proxy Mode - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 17:49:12
===> Ended  : 17:50:22
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130214174912.log

Jdl attributes - PASSED
Test 4 fails because lxbra1910.cern.ch is not published in the top bdii.

Define the following variables in wms-command.conf:
# For Jdl attributes tests
SE=lxbra1910.cern.ch
LFC=emi2rc-sl5-lfc.cern.ch
ISB_DEST_HOSTNAME=emitestbed44.cnaf.infn.it
ISB_DEST_USERNAME=root
ISB_DEST_PASSWORD=***
OSB_DEST_HOSTNAME=emitestbed44.cnaf.infn.it
OSB_DEST_USERNAME=root
OSB_DEST_PASSWORD=***

[capannini@emitestbed08 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 1,2,4,5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Jdl with AllowZippedISB - CE_CREAM 


 Test 2: Jdl with ExpiryTime 


 Test 4: Jdl with DataRequirements 

===> ERROR: Command lfc-mkdir /grid/testers.eu-emi.eu/20130215110949 failed. Failure message: cannot create /grid/testers.eu-emi.eu/20130215110949: Could not secure the connection

 Test 5: Jdl with InputSandboxBaseURI 


 Test 5: Jdl with InputSandboxBaseURI - CE_CREAM 


 Test 6: Jdl with OutputSandboxBaseDestURI 


 Test 6: Jdl with OutputSandboxBaseDestURI - CE_CREAM 


 Test 7: Jdl with OutputSandboxDestURI 


 Test 7: Jdl with OutputSandboxDestURI - CE_CREAM 

===> 
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:09:49
===> Ended  : 11:20:55
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 4: Jdl with DataRequirements'] <<< 
===> 
===> Test log file is WMSService-TS_20130215110949.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130215110949/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130215110949 has not been cleaned for debug purpose

Collection

Bulk submission - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:58:06
===> Ended  : 12:01:22
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130215115806.log

All in a jdl - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs using a single jdl with al the jdls of nodes - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 12:23:46
===> Ended  : 12:26:04
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130215122346.log

Parametric job - PASSED

[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 3: Submit a parametric job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:13:54
===> Ended  : 15:17:48
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130215151354.log

Dag - PASSED

[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:32:46
===> Ended  : 15:43:08
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130215153246.log

Parallel job - PASSED

### Submit parallel job 2 CPUs
### Job to be submitted:
Executable = "/usr/bin/mpi-start";
CPUNumber  = 2;
Arguments  = "-t dummy -- counter.sh cpus 2";
InputSandbox = {"counter.sh"};
OutputSandbox = {"std.out", "std.err"};
StdOutput = "std.out";
StdError = "std.err";
Requirements = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment)
               && other.GlueCEInfoJobManager == "pbs";

[capannini@emitestbed08 ~]$ glite-wms-job-submit -a -c wms_emitestbed41.conf mpijob.jdl 

Connecting to the service https://emitestbed41.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emitbrc-lamb4.civ.zcu.cz:9000/bE4XxarMfefsMCDlz4l2Gw

==========================================================================


[capannini@emitestbed08 ~]$ glite-wms-job-status https://emitbrc-lamb4.civ.zcu.cz:9000/bE4XxarMfefsMCDlz4l2Gw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emitbrc-lamb4.civ.zcu.cz:9000/bE4XxarMfefsMCDlz4l2Gw
Current Status:     Done (Success)
Logged Reason(s):
    - job completed
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        emitestbed29.cnaf.infn.it:8443/cream-pbs-demo
Submitted:          Fri Feb 15 16:08:55 2013 CET
==========================================================================

Forwarding parameters for parallel jobs - PASSED
Test 4 fails because there are no compatible resources.

[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 8 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 8: Testing forwarding parameters for parallel jobs  Case 1 - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 2 - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 3  - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 4 - CE_CREAM 

===> ERROR: Timeout reached while waiting the job https://emitbrc-lamb4.civ.zcu.cz:9000/zq5m0gmKRNL8DZaOE94dhw to transfered to CE
Traceback (most recent call last):
  File "WMS-job-cycle.py", line 618, in ?
    main()
  File "WMS-job-cycle.py", line 606, in main
    if forward_parameters_parallel_jobs(utils, tests[7]):
  File "WMS-job-cycle.py", line 458, in forward_parameters_parallel_jobs
    utils.wait_until_job_transfered(JOBID)
  File "/home/capannini/WMS-Test-Suite-new/WMS-service/Test_utils.py", line 1237, in wait_until_job_transfered
    raise TimeOutError("","Timeout reached while waiting the job %s to transfered to CE"%(jobid))
Exceptions.TimeOutError: 'Timeout reached while waiting the job https://emitbrc-lamb4.civ.zcu.cz:9000/zq5m0gmKRNL8DZaOE94dhw to transfered to CE'

Perusal - PASSED

[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 6: Submit a perusal job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:41:20
===> Ended  : 11:16:15
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218104120.log

Delegation - PASSED

Test 4 fails because the failure message has changed. Now it is 'Proxy exception: the proxy has expired'.

[capannini@emitestbed08 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 Test 3: Try to delegate with a short proxy and check the validity 


 Test 4: Works with expired proxy 

===> ERROR: TEST FAILS. Job has been submitted with the expired delegation

 To run this test you have to set the ROLE attribute for user proxy role at configuration file 

===> 
===> Test: WMS-delegation-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:32:34
===> Ended  : 11:33:49
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 4: Works with expired proxy'] <<< 
===> 
===> Test log file is WMSService-TS_20130218113234.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218113234/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218113234 has not been cleaned for debug purpose

List-match - PASSED

Test 7 fails because there are no suitable CEs.

[capannini@emitestbed08 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 


 Test 7: try a matching with data requirements 

===> ERROR: Unable to find any CEs mathing the job requirements

 Test 8: try a gang-matching 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:49:34
===> Ended  : 11:49:58
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 7: try a matching with data requirements'] <<< 
===> 
===> Test log file is WMSService-TS_20130218114934.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218114934/errors.log
===> 
===>  Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218114934 has not been cleaned for debug purpose

Prologue and epilogue jobs - PASSED

[capannini@emitestbed08 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test prologue attribute - CE_CREAM 


 Test 2: Test epilogue attribute - CE_CREAM 


 Test 3: Test prologue and epilogue attributes - CE_CREAM 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:53:01
===> Ended  : 11:58:58
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218115301.log

Shallow and deep resubmission - PASSED

[capannini@emitestbed08 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try a shallow resubmission - CE_CREAM 


 Test 2: Try a deep resubmission - CE_CREAM 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 12:03:51
===> Ended  : 12:15:39
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218120351.log

Cancel -

-- FabioCapannini - 2013-02-14

Topic attachments
I Attachment Action Size Date Who Comment
Unknown file formatlog WMSService-TS_20130214174912.log manage 3.7 K 2013-02-14 - 16:54 FabioCapannini  
Unknown file formatlog WMSService-TS_20130215110949.log manage 37.1 K 2013-02-15 - 10:56 FabioCapannini  
Unknown file formatlog WMSService-TS_20130215115806.log manage 6.4 K 2013-02-15 - 11:04 FabioCapannini  
Unknown file formatlog WMSService-TS_20130215122346.log manage 4.9 K 2013-02-15 - 11:35 FabioCapannini  
Unknown file formatlog WMSService-TS_20130215151354.log manage 7.0 K 2013-02-15 - 14:30 FabioCapannini  
Unknown file formatlog WMSService-TS_20130215153246.log manage 16.2 K 2013-02-15 - 14:49 FabioCapannini  
Unknown file formatlog WMSService-TS_20130218104120.log manage 5.0 K 2013-02-18 - 10:31 FabioCapannini  
Unknown file formatlog WMSService-TS_20130218113234.log manage 6.9 K 2013-02-18 - 10:48 FabioCapannini  
Unknown file formatlog WMSService-TS_20130218114934.log manage 6.8 K 2013-02-18 - 10:52 FabioCapannini  
Unknown file formatlog WMSService-TS_20130218115301.log manage 14.8 K 2013-02-18 - 11:02 FabioCapannini  
Unknown file formatlog WMSService-TS_20130218120351.log manage 20.4 K 2013-02-18 - 11:20 FabioCapannini  
Edit | Attach | PDF | History: r13 | r7 < r6 < r5 < r4 | Backlinks | Raw View | More topic actions...
Topic revision: r5 - 2013-02-18 - FabioCapannini
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback