WMS test report
Summary
- ETICS Subsystem Configuration Name: emi-wms_R_3_3_9_0
- VCS Tag: emi-ice_R_3_3_5_4, emi-wms-manager_R_3_3_1_3, emi-jobsubmission_R_3_3_2_1, emi-wmproxy_R_3_3_5_1, emi-wms-brokerinfo_R_3_3_2_1, emi-wms-configuration_R_3_3_2_1, emi-wms-ism_R_3_3_2_1, emi-wms-matchmaking_R_3_3_2_1, emi-wms-purger_R_3_3_2_1, emi-yaim-wms_R_4_1_5_1, emi-jdl-api-cpp_R_3_2_6_1, emi-wms-nagios_R_1_0_0_0, emi-wms-mp_R_1_0_2_0
- EMI Major Release: EMI 1 (Kebnekaise)
- Certification report: not yet available
- Outcome: Certification under way
Deployment Tests
Clean installation
Update
Unit Tests
N/A: Tests will be available with EMI-2.
Basic Functionality tests
Submission
Where possible the tests should use internal testbed CEs (located in Padova).
This is accomplished by adding the following line to wms-command.conf:
DEFAULTREQ= other.GlueCEStateStatus == "Testing"
This is not possible, for example, for parallel jobs.
Normal
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 17:36:32
===> Ended : 18:09:56
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120726173632.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 10:23:56
===> Ended : 10:42:16
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120727102356.log
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating proxy ................................ Done
Proxy Verify OK
Your proxy is valid until: Fri Aug 3 10:27:41 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ..................................................................................... Done
Your proxy is valid until Fri Jul 27 21:28:11 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 10:59:49
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 11:58:49
uri : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 1
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 10:28:59
===> Ended : 10:56:20
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120727102859.log
Proxy mode
Pointing the testsuite at cert-26:
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-26.cnaf.infn.it
===> Started: 11:05:43
===> Ended : 11:25:33
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120727110543.log
Jdl with DataRequirements
Disabling the requirement DEFAULTREQ= other.GlueCEStateStatus == "Testing":
[capannini@cert-17 WMS-service]$ cat JDLs/data-req.jdl
###########################################
# JDL with Data Requirements #
###########################################
Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";
FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};
DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/";
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};
DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i -j JDLs/data-req.jdl
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 11:53:40
===> Ended : 12:05:04
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120727115340.log
Jdl with ISBBaseURI and OSBDestURI
Test on CREAM ce:
[capannini@cert-17 certification]$ cat URI.jdl
###########################################
# JDL with ISBURI & OSBDestURI #
###########################################
Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";
InputSandboxBaseURI = "gsiftp://emi-demo12.cnaf.infn.it:2811/tmp";
FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxDestURI = {"gsiftp://cert-26.cnaf.infn.it:2811/tmp/myjobOutput", "std.err"};
requirements = ( other.GlueCEStateStatus == "Testing" ) && regexp("/cream", other.GlueCEUniqueID);
#requirements = !regexp("/cream", other.GlueCEUniqueID);
DataAccessProtocol = "gsiftp";
RetryCount = 1;
ShallowRetryCount = 2;
[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_cert-25.conf URI.jdl
Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
==========================================================================
[capannini@cert-17 certification]$ glite-wms-job-status https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
Current Status: Done (Success)
Logged Reason(s):
- Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw: reason is Received NULL fault; the error is due to another cause: FaultString=[connection error] - FaultCode=[SOAP-ENV:Client] - FaultSubCode=[SOAP-ENV:Client] - FaultDetail=[Connection timed out]
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: cream-39.pd.infn.it:8443/cream-pbs-cert
Submitted: Fri Jul 27 12:15:36 2012 CEST
==========================================================================
[capannini@cert-17 certification]$ glite-wms-job-output https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server
================================================================================
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_7NcVgYqFmRlwMVOFPKlsfw
================================================================================
[capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_7NcVgYqFmRlwMVOFPKlsfw
std.err
Log on cert-26:
[root@cert-26 tmp]# cat /tmp/myjobOutput
7NcVgYqFmRlwMVOFPKlsfw
total 16
-rwxr-xr-x 1 dteam026 dteam 80 Jul 27 12:16 exe.sh
-rw-r--r-- 1 dteam026 dteam 0 Jul 27 12:16 std.err
-rw-r--r-- 1 dteam026 dteam 23 Jul 27 12:16 std.out
-rw-r--r-- 1 dteam026 dteam 6 Jul 27 12:16 test1
-rw-r--r-- 1 dteam026 dteam 6 Jul 27 12:16 test2
===> Test PASSED
On an LCG-CE:
--
FabioCapannini - 2012-07-19