Tags:
, view all tags

WMS test report

Summary

  • Component: WMS 3.3.4

  • ETICS Subsystem Configuration Name: emi-wms_R_3_3_6_3 emi-jdl_R_3_2_6_1

  • VCS Tag: emi-ice_R_3_3_4_1, emi-wms-manager_R_3_3_1_4, emi-jobsubmission_R_3_3_2_1, emi-wmproxy_R_3_3_4_2, emi-wms-brokerinfo_R_3_3_2_1, emi-wms-configuration_R_3_3_2_1, emi-wms-ism_R_3_3_2_1, emi-wms-matchmaking_R_3_3_2_1, emi-wms-purger_R_3_3_2_1, emi-yaim-wms_R_4_1_4_3, emi-jdl-api-cpp_R_3_2_6_1, emi-wms-nagios_R_1_0_0_0, emi-wms-mp_R_1_0_2_0

  • EMI Major Release: EMI 1 (Kebnekaise)

  • Platform: sl5 epel

  • Certification report: not yet available

  • Outcome: Certification under way

Deployment Tests

Clean installation

  • Starting from a SL5 x86_64 kernel machine:

[root@emi-demo11 ~]# cat /etc/redhat-release 
Scientific Linux SL release 5.7 (Boron)
[root@emi-demo11 ~]# uname -a
Linux emi-demo11.cnaf.infn.it 2.6.18-274.12.1.el5 #1 SMP Tue Nov 29 11:14:39 EST 2011 x86_64 x86_64 x86_64 GNU/Linux

  • Import EMI rpm gpg key
[root@emi-demo11 ~]# wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -O /tmp/emi-key_gd.asc
[root@emi-demo11 ~]# rpm --import /tmp/emi-key_gd.asc

Update

[root@emi-demo12 yum.repos.d]# rpm -qa|grep wms-manager
glite-wms-manager-3.3.1-3.sl5

Unit Tests

N/A: Tests will be available with EMI-2.

Basic Functionality tests

Submission

Normal

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 17:09:32
===> Ended  : 17:21:55
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20111228170932.log

[capannini@devel15 WMS-service]$ voms-proxy-init --voms dteam:/dteam/NGI_IT:operator
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy .................................................................. Done
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ........................................................................... Done

Your proxy is valid until Thu Dec 29 23:31:47 2011
[capannini@devel15 WMS-service]$ voms-proxy-info --all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
type      : proxy
strength  : 1024 bits
path      : /tmp/x509up_u504
timeleft  : 11:59:51
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/NGI_IT/Role=operator/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
attribute : /dteam/Role=NULL/Capability=NULL
timeleft  : 11:59:51
uri       : voms2.hellasgrid.gr:15004
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:32:22
===> Ended  : 11:40:10
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20111229113222.log

[capannini@devel15 WMS-service]$ voms-proxy-init --voms testers.eu-emi.eu
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ................................... Done
Contacting  emitestbed07.cnaf.infn.it:15002 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed07.cnaf.infn.it] "testers.eu-emi.eu" Done
Creating proxy ...................................................... Done

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:45:01
===> Ended  : 11:52:20
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20111229114501.log

[fabiok@ui WMS-service]$ voms-proxy-init --voms infngrid
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ..................................................... Done
Contacting  voms.cnaf.infn.it:15000 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=voms.cnaf.infn.it] "infngrid" Done
Creating proxy .................................................... Done
Your proxy is valid until Thu Dec 29 23:45:58 2011
[fabiok@ui WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V infngrid -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:46:25
===> Ended  : 11:52:40
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20111229114625.log
See submit.log.tgz: Normal submission logs

Jdl with DataRequirements

Jdl with ISBBaseURI and OSBDestURI

Test on CREAM ce:

[capannini@devel15 certificazione]$ cat URI.jdl 
###########################################
#      JDL with ISBURI & OSBDestURI       #
###########################################

Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";

InputSandboxBaseURI = "gsiftp://devel11.cnaf.infn.it:2811/tmp";

FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxDestURI = {"gsiftp://devel09.cnaf.infn.it:2811/tmp/myjobOutput", "std.err"};


#requirements = other.GlueCEStateStatus == "Testing" &&  regexp("/cream", other.GlueCEUniqueID);
requirements = regexp("/cream", other.GlueCEUniqueID);
DataAccessProtocol = "gsiftp";
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@devel15 certificazione]$ cat tmp/exe.sh 
#!/bin/sh

NAME=`echo $GLITE_WMS_JOBID | sed -e 's/.*\///'`

echo $NAME 

ls -l

[capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg

==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        inaf-ce-01.ct.pi2s2.it:8443/cream-lsf-cert
Submitted:          Thu Dec 29 16:20:11 2011 CET
==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_NAwVzPxlPqGYz-Kf2xWLNg

================================================================================


[capannini@devel15 certificazione]$ ls /tmp/jobOutput/capannini_NAwVzPxlPqGYz-Kf2xWLNg
std.err

Log on devel09.cnaf.infn.it:

[root@devel09 ~]# cat /tmp/myjobOutput 
NAwVzPxlPqGYz-Kf2xWLNg
total 16
-rwxr-xr-x 1 dteam002 dteam 80 Dec 29 16:20 exe.sh
-rw-r--r-- 1 dteam002 dteam  0 Dec 29 16:20 std.err
-rw-r--r-- 1 dteam002 dteam 23 Dec 29 16:20 std.out
-rw-r--r-- 1 dteam002 dteam  6 Dec 29 16:20 test1
-rw-r--r-- 1 dteam002 dteam  6 Dec 29 16:20 test2

===>   test PASSED


Same process with an LCG CE:

[capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA

==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA
Current Status:     Done (Success)
Logged Reason(s):
    - Job got an error while in the CondorG queue.
    - Job terminated successfully
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        gridce.sns.it:2119/jobmanager-lcgpbs-cert
Submitted:          Fri Dec 30 11:43:28 2011 CET
==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_d4akLe8H2jynZpCPe5jGxA

================================================================================


[capannini@devel15 certificazione]$ ls -l /tmp/jobOutput/capannini_d4akLe8H2jynZpCPe5jGxA
total 0
-rw-r--r-- 1 capannini emitestbed 0 Dec 30 13:08 std.err

Log on devel09.cnaf.infn.it:

[root@devel09 tmp]# ls -l myjobOutput 
-rw-r--r-- 1 dteam042 dteam 714 30 dic 13:01 myjobOutput
[root@devel09 tmp]# cat myjobOutput 
d4akLe8H2jynZpCPe5jGxA
total 36
-rwxr-xr-x 1 dteam003 dteam  80 Dec 30 13:00 exe.sh
-rw-r--r-- 1 dteam003 dteam 154 Dec 30 13:01 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fd4akLe8H2jynZpCPe5jGxA.output
-rw-r--r-- 1 dteam003 dteam   0 Dec 30 13:01 std.err
-rw-r--r-- 1 dteam003 dteam  23 Dec 30 13:01 std.out
-rw-r--r-- 1 dteam003 dteam   6 Dec 30 13:00 test1
-rw-r--r-- 1 dteam003 dteam   6 Dec 30 13:00 test2
-rw------- 1 dteam003 dteam   2 Dec 30 13:01 tmp.GPdus14280
-rw------- 1 dteam003 dteam   2 Dec 30 13:01 tmp.OAref14000
-rw------- 1 dteam003 dteam 103 Dec 30 13:01 tmp.QtSZI14001
-rw------- 1 dteam003 dteam   0 Dec 30 13:01 tmp.vFipq14279
-rw------- 1 dteam003 dteam 103 Dec 30 13:01 tmp.YUTON14281

===>   test PASSED

Jdl with ISBBaseURI and OSBBaseDestURI

Submit to CREAM CE

[capannini@devel15 certificazione]$ cat BaseURI.jdl 
###########################################
#  JDL with ISBURI & OSBBaseDestURI       #
###########################################

Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";

InputSandboxBaseURI = "gsiftp://devel11.cnaf.infn.it:2811/tmp";

FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxBaseDestURI="gsiftp://devel09.cnaf.infn.it:2811/tmp";

#requirements = other.GlueCEStateStatus == "Testing" &&  regexp("/cream", other.GlueCEUniqueID);
requirements = regexp("/cream", other.GlueCEUniqueID);

RetryCount = 1;
ShallowRetryCount = 2;

[capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf BaseURI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ

==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        t2-ce-01.to.infn.it:8443/cream-pbs-short
Submitted:          Fri Dec 30 12:47:43 2011 CET
==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

No output files to be retrieved for the job:
https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ

================================================================================

[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ
Current Status:     Cleared 
Status Reason:      user retrieved output sandbox
Destination:        t2-ce-01.to.infn.it:8443/cream-pbs-short
Submitted:          Fri Dec 30 12:47:43 2011 CET
==========================================================================

Log on devel09.cnaf.infn.it:

[root@devel09 tmp]# ls std*
std.err  std.out

[root@devel09 tmp]# cat std.out 
bRxuYfMUA79tvRXdrpgJdQ
total 16
-rwxr-xr-x 1 dteam029 dteam 80 Dec 30 12:48 exe.sh
-rw-r--r-- 1 dteam029 dteam  0 Dec 30 12:48 std.err
-rw-r--r-- 1 dteam029 dteam 23 Dec 30 12:48 std.out
-rw-r--r-- 1 dteam029 dteam  6 Dec 30 12:48 test1
-rw-r--r-- 1 dteam029 dteam  6 Dec 30 12:48 test2

===>     === test PASSED === 

Submit to an LCG CE:

[capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf BaseURI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg

==========================================================================


[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        grid-ce.lns.infn.it:2119/jobmanager-lcgpbs-short
Submitted:          Fri Dec 30 13:18:38 2011 CET
==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

No output files to be retrieved for the job:
https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg

================================================================================


[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg
Current Status:     Cleared 
Status Reason:      user retrieved output sandbox
Destination:        grid-ce.lns.infn.it:2119/jobmanager-lcgpbs-short
Submitted:          Fri Dec 30 13:18:38 2011 CET
==========================================================================

Log on devel09.cnaf.infn.it:

[root@devel09 tmp]# ls -l std*
-rw-r--r-- 1 dteam042 dteam   0 30 dic 13:19 std.err
-rw-r--r-- 1 dteam042 dteam 727 30 dic 13:19 std.out

[root@devel09 tmp]# cat std.out
pX2yRjupthmRSr8bqf5_Bg
total 36
-rwxr-xr-x  1 dteam050 dteam  80 Dec 30 13:19 exe.sh
-rw-r--r--  1 dteam050 dteam 118 Dec 30 13:19 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fpX2yRjupthmRSr8bqf5_5fBg.output
-rw-r--r--  1 dteam050 dteam   0 Dec 30 13:19 std.err
-rw-r--r--  1 dteam050 dteam  23 Dec 30 13:19 std.out
-rw-r--r--  1 dteam050 dteam   6 Dec 30 13:19 test1
-rw-r--r--  1 dteam050 dteam   6 Dec 30 13:19 test2
-rw-------  1 dteam050 dteam 103 Dec 30 13:19 tmp.csGdY18153
-rw-------  1 dteam050 dteam   0 Dec 30 13:19 tmp.FBSue18151
-rw-------  1 dteam050 dteam   2 Dec 30 13:19 tmp.FZDLk18152
-rw-------  1 dteam050 dteam   2 Dec 30 13:19 tmp.HdslV18137
-rw-------  1 dteam050 dteam 103 Dec 30 13:19 tmp.hSlSL18138

-- FabioCapannini - 2011-12-28

Topic attachments
I Attachment ActionSorted ascending Size Date Who Comment
Unknown file formatlog install.log manage 124.2 K 2011-12-28 - 11:04 FabioCapannini Clean install log
Compressed Zip archivetgz submit.log.tgz manage 5.1 K 2011-12-29 - 11:06 FabioCapannini Normal submission logs
Unknown file formatlog update.log manage 37.6 K 2011-12-28 - 14:31 FabioCapannini Update log
Unknown file formatlog yaim-install.log manage 9.0 K 2011-12-28 - 11:30 FabioCapannini yaim install log
Edit | Attach | PDF | History: r34 | r8 < r7 < r6 < r5 | Backlinks | Raw View | More topic actions...
Topic revision: r6 - 2011-12-30 - FabioCapannini
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback