(r4) WMSTask32312 < IGIRelease

Tags: , view all tags
%TOC%

---+ *WMS test report*

---++ Summary

   * Component: *WMS 3.3.5-2*

   * Savannah task: [[https://savannah.cern.ch/task/index.php?32312][32312]]

   * ETICS Subsystem Configuration Name: *emi-wms_R_3_3_9_0*

   * VCS Tag: _emi-ice_R_3_3_5_4_, _emi-wms-manager_R_3_3_1_3_, _emi-jobsubmission_R_3_3_2_1_, _emi-wmproxy_R_3_3_5_1_, _emi-wms-brokerinfo_R_3_3_2_1_, _emi-wms-configuration_R_3_3_2_1_, _emi-wms-ism_R_3_3_2_1_, _emi-wms-matchmaking_R_3_3_2_1_, _emi-wms-purger_R_3_3_2_1_, _emi-yaim-wms_R_4_1_5_1_, _emi-jdl-api-cpp_R_3_2_6_1_, _emi-wms-nagios_R_1_0_0_0_, _emi-wms-mp_R_1_0_2_0_

   * EMI Major Release: *EMI 1 (Kebnekaise)*

   * Platform: sl5 epel

   * Certification report: not yet available

   * Outcome:<strong> %GREEN% *Certification under way* %ENDCOLOR% </strong>

---++ Deployment Tests 

---+++ Clean installation
   * [[%ATTACHURL%/20120726_171444_EMI1_CERT_INSTALL_SL5-64_WMS.log][20120726_171444_EMI1_CERT_INSTALL_SL5-64_WMS.log]]: 20120726_171444_EMI1_CERT_INSTALL_SL5-64_WMS.log
---+++ Update
   * [[%ATTACHURL%/20120719_160232_WMS-EMI1_UPDATE_SL5x64.log][20120719_160232_WMS-EMI1_UPDATE_SL5x64.log]]: 20120719_160232_WMS-EMI1_UPDATE_SL5x64.log
---++ Unit Tests 

*N/A*: Tests will be available with EMI-2.

---++ Basic Functionality tests

---+++ Submission
Where possible the tests should use internal testbed CEs (located in Padova).
This is accomplished by adding the following line to wms-command.conf:
<verbatim>
DEFAULTREQ= other.GlueCEStateStatus == "Testing"
</verbatim>
This is not possible, for example, for parallel jobs.

---++++ Normal
<verbatim>
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 17:36:32
===> Ended  : 18:09:56
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120726173632.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 10:23:56
===> Ended  : 10:42:16
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727102356.log

[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating proxy ................................ Done
Proxy Verify OK
Your proxy is valid until: Fri Aug  3 10:27:41 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ..................................................................................... Done

Your proxy is valid until Fri Jul 27 21:28:11 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:49
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:49
uri       : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 1
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 10:28:59
===> Ended  : 10:56:20
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727102859.log
</verbatim>
   * [[%ATTACHURL%/WMSService-TS_20120726173632.log][WMSService-TS_20120726173632.log]]: WMSService-TS_20120726173632.log
   * [[%ATTACHURL%/submit.tgz][submit.tgz]]: submit.tgz
---+++++ Proxy mode
Pointing the testsuite at cert-26:
<verbatim>
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-26.cnaf.infn.it
===> Started: 11:05:43
===> Ended  : 11:25:33
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727110543.log
</verbatim>
   * [[%ATTACHURL%/WMSService-TS_20120727110543.log][WMSService-TS_20120727110543.log]]: WMSService-TS_20120727110543.log

---+++++ Jdl with _DataRequirements_
Disabling the requirement DEFAULTREQ= other.GlueCEStateStatus == "Testing":
<verbatim>
[capannini@cert-17 WMS-service]$ cat JDLs/data-req.jdl 
###########################################
#      JDL with Data Requirements         #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";

FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};

DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; 
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};

DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i -j JDLs/data-req.jdl
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 11:53:40
===> Ended  : 12:05:04
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727115340.log
</verbatim>
   * [[%ATTACHURL%/WMSService-TS_20120727115340.log][WMSService-TS_20120727115340.log]]: WMSService-TS_20120727115340.log

---+++++ Jdl with _ISBBaseURI_ and _OSBDestURI_
Test on CREAM ce:

<verbatim>
[capannini@cert-17 certification]$ cat URI.jdl 
###########################################
#      JDL with ISBURI & OSBDestURI       #
###########################################

Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";

InputSandboxBaseURI = "gsiftp://emi-demo12.cnaf.infn.it:2811/tmp";

FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxDestURI = {"gsiftp://cert-26.cnaf.infn.it:2811/tmp/myjobOutput", "std.err"};


requirements = ( other.GlueCEStateStatus == "Testing" ) &&  regexp("/cream", other.GlueCEUniqueID);
#requirements = !regexp("/cream", other.GlueCEUniqueID);
DataAccessProtocol = "gsiftp";
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_cert-25.conf URI.jdl 

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw

==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-status https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
Current Status:     Done (Success)
Logged Reason(s):
    - Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw: reason is Received NULL fault; the error is due to another cause: FaultString=[connection error] - FaultCode=[SOAP-ENV:Client] - FaultSubCode=[SOAP-ENV:Client] - FaultDetail=[Connection timed out]
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-39.pd.infn.it:8443/cream-pbs-cert
Submitted:          Fri Jul 27 12:15:36 2012 CEST
==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-output https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

			JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_7NcVgYqFmRlwMVOFPKlsfw

================================================================================

[capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_7NcVgYqFmRlwMVOFPKlsfw
std.err

Log on cert-26:

[root@cert-26 tmp]# cat /tmp/myjobOutput 
7NcVgYqFmRlwMVOFPKlsfw
total 16
-rwxr-xr-x 1 dteam026 dteam 80 Jul 27 12:16 exe.sh
-rw-r--r-- 1 dteam026 dteam  0 Jul 27 12:16 std.err
-rw-r--r-- 1 dteam026 dteam 23 Jul 27 12:16 std.out
-rw-r--r-- 1 dteam026 dteam  6 Jul 27 12:16 test1
-rw-r--r-- 1 dteam026 dteam  6 Jul 27 12:16 test2
</verbatim>
===> Test PASSED

On an LCG-CE:


-- Main.FabioCapannini - 2012-07-19
Attachments
Topic attachments
I	Attachment	Action	Size	Date	Who
log	20120719_153058_WMS-EMI1_INSTALL_SL5x64-RC4_DEPLOYMENT_TEST.log	manage	515.5 K	2012-07-19 - 13:52	FabioCapannini
log	20120719_160232_WMS-EMI1_UPDATE_SL5x64-RC4_DEPLOYMENT_TEST.log	manage	521.9 K	2012-07-19 - 14:36	FabioCapannini
log	20120719_160232_WMS-EMI1_UPDATE_SL5x64.log	manage	521.9 K	2012-07-26 - 15:30	FabioCapannini
log	20120726_171444_EMI1_CERT_INSTALL_SL5-64_WMS.log	manage	516.2 K	2012-07-26 - 15:28	FabioCapannini
log	WMSService-TS_20120726173632.log	manage	51.9 K	2012-07-27 - 08:36	FabioCapannini
log	WMSService-TS_20120727110543.log	manage	32.9 K	2012-07-27 - 09:29	FabioCapannini
log	WMSService-TS_20120727115340.log	manage	20.8 K	2012-07-27 - 10:10	FabioCapannini
tgz	submit.tgz	manage	5.1 K	2012-07-27 - 09:04	FabioCapannini
Topic revision: r4 - 2012-07-27 - FabioCapannini
Account
- Log In
~~Edit~~
~~Attach~~