WMS test report

Summary

• Component: WMS 3.3.2

• Savannah task: 20812

• ETICS Subsystem Configuration Name: emi-wms_R_3_3_3_0

• VCS Tag: emi-wmproxy_R_3_3_2_0 emi-wms-common_R_3_3_2_0 emi-wms-helper_R_3_3_2_0 emi-yaim-wms_R_4_1_3_0

• EMI Major Release: EMI 1 (Kebnekaise)

• Platform: sl5 epel

• Build reports:

• Repository:

• Certification

• Author: Alessio Gianelle

• Outcome: In certification

Clean installation

• cd /etc/yum.repos.d/
• wget --no-check-certificate https://twiki.cern.ch/twiki/pub/EMI/EMI1Updates/testing.repo
• yum clean all
• yum install ca-policy-egi-core
• yum install emi-wms
• /opt/glite/yaim/bin/yaim -c -s /usr/local/nfs1/jra1_test/cream-44/site-info_wms.def -n WMS

• See log file

Update

• Starting from a released version:

  [root@devel11 ~]# cat /etc/emi-release
  EMI release 1.0 (Kebnekaise)
  [root@devel11 ~]# cat /etc/emi-version
  1.0.2-1

• yum update
• /opt/glite/yaim/bin/yaim -c -s site-info.def -n WMS

• See log file

Test Report

List Match

List match without data

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: devel11.cnaf.infn.it
===> Started: 16:56:28
===> Ended  : 16:56:42
===> 
===>     === test PASSED === 

Test log file is WMSService-TS_20110701165628.log

List match with data

[ale@cream-12 DataReq]$ glite-wms-job-list-match -a -c ../etc/wmp_devel11.conf data-req.jdl

Connecting to the service https://devel11.cnaf.infn.it:7443/glite_wms_wmproxy_server

==========================================================================

             COMPUTING ELEMENT IDs LIST 
 The following CE(s) matching your job requirements have been found:

    *CEId*
 - cert-15.pd.infn.it:8443/cream-lsf-cert
 - cert-37.pd.infn.it:8443/cream-lsf-cert
 - grid010.ct.infn.it:2119/jobmanager-lcgpbs-cert
 - prod-ce-01.pd.infn.it:8443/cream-lsf-cert
 - prod-ce-02.pd.infn.it:2119/jobmanager-lcglsf-cert

==========================================================================

Submission

Normal job

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cream-44.pd.infn.it
===> Started: 16:53:19
===> Ended  : 17:00:06
===> 
===>     === test PASSED ===

Test log file is WMSService-TS_20110705165319.log

Collection job

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cream-44.pd.infn.it
===> Started: 17:36:59
===> Ended  : 17:46:57
===> 
===>     === test PASSED ===

Test log file is WMSService-TS_20110705173659.log

Parametric job

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cream-44.pd.infn.it
===> Started: 17:49:13
===> Ended  : 17:56:05
===> 
===>     === test PASSED ===

Test log file is WMSService-TS_20110705174913.log

Cancel

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Cancel Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Try to cancel a normal job 


 Test 2: Try to cancel a DAG job 


 Test 3: Try to cancel one node of a DAG job 


 Test 4: Try to cancel a collection job 


 Test 5: Try to cancel one node of a collection job 


 Test 6: Try to cancel a parametric job 


 Test 7: Try to cancel one node of a parametric job 


 Test 8: Try to cancel a MPI job 

===> 
===> Test: WMS-job-cancel.py
===> WMS: devel11.cnaf.infn.it
===> Started: 17:24:54
===> Ended  : 17:28:51
===> 
===>     === test PASSED ===

Test log file is WMSService-TS_20110704172454.log

Others

Delegation

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 Test 3: Try to delegate with a short proxy and check the validity 


 Test 4: Works with expired proxy 

===> 
===> Test: WMS-delegation-test.py
===> WMS: devel11.cnaf.infn.it
===> Started: 11:26:43
===> Ended  : 11:27:59
===> 
===>     === test PASSED ===

Test log file is WMSService-TS_20110704112643.log

Prologue/Epilogue

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: cream-44.pd.infn.it
===> Started: 18:30:58
===> Ended  : 18:36:53
===> 
===>     === test PASSED ===

Test log file is WMSService-TS_20110705183058.log

Test proxy renewal

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test proxy renewal operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test proxy renewal with LCG CE 


 Test 2: Test proxy renewal with CREAM CE 


 Test 3: Test proxy renewal with LCG CE (without setting MYPROXYSERVER) 


 Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER) 

===> 
===> Test: WMS-proxy-renewal.py
===> WMS: devel11.cnaf.infn.it
===> Started: 17:56:06
===> Ended  : 18:48:50
===> 
===>     === test PASSED ===

Test log file is WMSService-TS_20110701175606.log

Shallow/Deep Resubmission

===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Try a shallow resubmission 


 Test 2: Try a deep resubmission 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: cream-44.pd.infn.it
===> Started: 15:17:25
===> Ended  : 15:29:02
===> 
===>     === test PASSED ==

Test log file is WMSService-TS_20110705151725.log

Check Bugs

Bugs #82687: emi WMS problems with ISB tar file handling FIXED

Submit a jdl like this one:

[ale@cream-12 UI]$ cat 82687.jdl 
[
Executable = "/bin/ls" ;
Arguments = "-lha " ;
Stdoutput = "ls.out" ;
InputSandbox = { "supercalifragilistichespiralidose.txt", "82687.jdl"} ;
OutputSandbox = { ".BrokerInfo", "ls.out"} ;
Retrycount = 2;
ShallowRetryCount = -1;
usertags = [ bug = "#82687" ];
VirtualOrganisation="dteam";
]

With a long file name as input file (and at least two files as input):

[ale@cream-12 UI]$ glite-wms-job-submit -a -c etc/wmp_cream-44.conf 82687.jdl

Connecting to the service https://cream-44.pd.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://cream-44.pd.infn.it:9000/50rMqKVPm3Qe1cYH1L3Wmw

==========================================================================

When the job arrives to Done (Success):

[ale@cream-12 UI]$ glite-wms-job-status https://cream-44.pd.infn.it:9000/50rMqKVPm3Qe1cYH1L3Wmw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cream-44.pd.infn.it:9000/50rMqKVPm3Qe1cYH1L3Wmw
Current Status:     Done (Success)
Logged Reason(s):
    - job completed
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-19.pd.infn.it:8443/cream-lsf-creamcert2
Submitted:          Fri Jul  1 14:01:41 2011 CEST
==========================================================================

Check in the output file of the job if all the input files are listed:

[ale@cream-12 UI]$ glite-wms-job-output https://cream-44.pd.infn.it:9000/50rMqKVPm3Qe1cYH1L3Wmw

Connecting to the service https://cream-44.pd.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://cream-44.pd.infn.it:9000/50rMqKVPm3Qe1cYH1L3Wmw
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/ale_50rMqKVPm3Qe1cYH1L3Wmw

================================================================================


[ale@cream-12 UI]$ cat /tmp/jobOutput/ale_50rMqKVPm3Qe1cYH1L3Wmw/ls.out 
total 20K
drwxr-xr-x 2 dteam017 dteam 4.0K Jul  1 14:01 .
drwxr-xr-x 3 dteam017 dteam 4.0K Jul  1 14:01 ..
-rw-r--r-- 1 dteam017 dteam  293 Jul  1 14:01 82687.jdl
-rw-r--r-- 1 dteam017 dteam 2.3K Jul  1 14:01 .BrokerInfo
-rw-r--r-- 1 dteam017 dteam    0 Jul  1 14:01 ls.out
-rw-r--r-- 1 dteam017 dteam   17 Jul  1 14:01 supercalifragilistichespiralidose.txt
-rw-r--r-- 1 dteam017 dteam    0 Jul  1 14:01 .tmp_file

Bugs #82776: typo in WMS jobwrapper FIXED

Simply check the JobWrapper template on the WMS:

[root@cream-44 ~]# cat  /usr/share/glite-wms/jobwrapper.template.sh  | grep "Taken token ${__shallow_resubmission_token}"
      push_in_LM_done_reason "Taken token ${__shallow_resubmission_token}"

Bugs #82983: [yaim-wms] authorization problem in WMS EMI-1 FIXED

Simply check that in the file glite_wms_wmproxy.gacl file there are not entry with the word ROLE in upper case:

[root@devel11 ~]# grep ROLE /etc/glite-wms/glite_wms_wmproxy.gacl 
[root@devel11 ~]#

-- AlessioGianelle - 2011-07-01