Tags:
, view all tags

WMS test report

Summary

  • Component: WMS 3.3.5-2

  • ETICS Subsystem Configuration Name: emi-wms_R_3_3_9_0

  • VCS Tag: emi-ice_R_3_3_5_4, emi-wms-manager_R_3_3_1_3, emi-jobsubmission_R_3_3_2_1, emi-wmproxy_R_3_3_5_1, emi-wms-brokerinfo_R_3_3_2_1, emi-wms-configuration_R_3_3_2_1, emi-wms-ism_R_3_3_2_1, emi-wms-matchmaking_R_3_3_2_1, emi-wms-purger_R_3_3_2_1, emi-yaim-wms_R_4_1_5_1, emi-jdl-api-cpp_R_3_2_6_1, emi-wms-nagios_R_1_0_0_0, emi-wms-mp_R_1_0_2_0

  • EMI Major Release: EMI 1 (Kebnekaise)

  • Platform: sl5 epel

  • Certification report: not yet available

  • Outcome: Certification under way

Deployment Tests

Clean installation

Update

Unit Tests

N/A: Tests will be available with EMI-2.

Basic Functionality tests

Submission

Where possible the tests should use internal testbed CEs (located in Padova). This is accomplished by adding the following line to wms-command.conf:
DEFAULTREQ= other.GlueCEStateStatus == "Testing"
This is not possible, for example, for parallel jobs.

Normal

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 17:36:32
===> Ended  : 18:09:56
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120726173632.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 10:23:56
===> Ended  : 10:42:16
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727102356.log

[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating proxy ................................ Done
Proxy Verify OK
Your proxy is valid until: Fri Aug  3 10:27:41 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ..................................................................................... Done

Your proxy is valid until Fri Jul 27 21:28:11 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:49
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:49
uri       : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 1
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 10:28:59
===> Ended  : 10:56:20
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727102859.log
Proxy mode
Pointing the testsuite at cert-26:
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-26.cnaf.infn.it
===> Started: 11:05:43
===> Ended  : 11:25:33
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727110543.log

Jdl with DataRequirements
Disabling the requirement DEFAULTREQ= other.GlueCEStateStatus == "Testing":
[capannini@cert-17 WMS-service]$ cat JDLs/data-req.jdl 
###########################################
#      JDL with Data Requirements         #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";

FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};

DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; 
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};

DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i -j JDLs/data-req.jdl
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 11:53:40
===> Ended  : 12:05:04
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727115340.log

Jdl with ISBBaseURI and OSBDestURI
Test on CREAM ce:

[capannini@cert-17 certification]$ cat URI.jdl 
###########################################
#      JDL with ISBURI & OSBDestURI       #
###########################################

Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";

InputSandboxBaseURI = "gsiftp://emi-demo12.cnaf.infn.it:2811/tmp";

FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxDestURI = {"gsiftp://cert-26.cnaf.infn.it:2811/tmp/myjobOutput", "std.err"};


requirements = ( other.GlueCEStateStatus == "Testing" ) &&  regexp("/cream", other.GlueCEUniqueID);
#requirements = !regexp("/cream", other.GlueCEUniqueID);
DataAccessProtocol = "gsiftp";
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_cert-25.conf URI.jdl 

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw

==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-status https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
Current Status:     Done (Success)
Logged Reason(s):
    - Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw: reason is Received NULL fault; the error is due to another cause: FaultString=[connection error] - FaultCode=[SOAP-ENV:Client] - FaultSubCode=[SOAP-ENV:Client] - FaultDetail=[Connection timed out]
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-39.pd.infn.it:8443/cream-pbs-cert
Submitted:          Fri Jul 27 12:15:36 2012 CEST
==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-output https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_7NcVgYqFmRlwMVOFPKlsfw

================================================================================

[capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_7NcVgYqFmRlwMVOFPKlsfw
std.err

Log on cert-26:

[root@cert-26 tmp]# cat /tmp/myjobOutput 
7NcVgYqFmRlwMVOFPKlsfw
total 16
-rwxr-xr-x 1 dteam026 dteam 80 Jul 27 12:16 exe.sh
-rw-r--r-- 1 dteam026 dteam  0 Jul 27 12:16 std.err
-rw-r--r-- 1 dteam026 dteam 23 Jul 27 12:16 std.out
-rw-r--r-- 1 dteam026 dteam  6 Jul 27 12:16 test1
-rw-r--r-- 1 dteam026 dteam  6 Jul 27 12:16 test2
===> Test PASSED

On an LCG-CE:

-- FabioCapannini - 2012-07-19

Edit | Attach | PDF | History: r9 | r6 < r5 < r4 < r3 | Backlinks | Raw View | More topic actions...
Topic revision: r4 - 2012-07-27 - FabioCapannini
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback