WMS test report
Summary
- ETICS Subsystem Configuration Name: emi-wms_R_3_3_7_1 emi-jdl_R_3_2_6_1
- VCS Tag: emi-ice_R_3_3_4_1, emi-wms-manager_R_3_3_1_4, emi-jobsubmission_R_3_3_2_1, emi-wmproxy_R_3_3_5_1, emi-wms-brokerinfo_R_3_3_2_1, emi-wms-configuration_R_3_3_2_1, emi-wms-ism_R_3_3_2_1, emi-wms-matchmaking_R_3_3_2_1, emi-wms-purger_R_3_3_2_1, emi-yaim-wms_R_4_1_5_1, emi-jdl-api-cpp_R_3_2_6_1, emi-wms-nagios_R_1_0_0_0, emi-wms-mp_R_1_0_2_0
- EMI Major Release: EMI 1 (Kebnekaise)
- Certification report: not yet available
- Outcome: Certification under way
Deployment Tests
Clean installation
- Starting from a SL5 x86_64 kernel machine:
[root@emi-demo11 ~]# cat /etc/redhat-release
Scientific Linux SL release 5.7 (Boron)
[root@emi-demo11 ~]# uname -a
Linux emi-demo11.cnaf.infn.it 2.6.18-274.18.1.el5 #1 SMP Thu Feb 9 12:20:03 EST 2012 x86_64 x86_64 x86_64 GNU/Linux
[root@emi-demo11 ~]# wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -O /tmp/emi-key_gd.asc
[root@emi-demo11 ~]# rpm --import /tmp/emi-key_gd.asc
Update
[root@emi-demo12 yum.repos.d]# rpm -qa|grep wms-manager
glite-wms-manager-3.3.1-3.sl5
The wms emi-demo12 is configured in proxy mode, pointing to the LB devel17.cnaf.infn.it
Unit Tests
N/A: Tests will be available with EMI-2.
Basic Functionality tests
Submission
Where possible the tests should use internal testbed CEs (located in Padova).
This is accomplished by adding the following line to wms-command.conf:
DEFAULTREQ= other.GlueCEStateStatus == "Testing"
This is not possible, for example, for parallel jobs.
Normal
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:28:22
===> Ended : 10:32:49
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120316102822.log
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:30:51
===> Ended : 10:35:08
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120316103051.log
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V infngrid -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:31:52
===> Ended : 10:37:14
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120316103152.log
*
submit.tgz: submit.tgz
Proxy mode
Pointing the testsuite at emi-demo12:
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 10:50:40
===> Ended : 10:56:37
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120316105040.log
*
WMSService-TS_20120316105040.log: WMSService-TS_20120316105040.log
Jdl with DataRequirements
[capannini@devel15 WMS-service]$ cat ~/certification/data-req.jdl
###########################################
# JDL with Data Requirements #
###########################################
Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";
FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};
DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/";
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};
DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i -j ~/certification/data-req.jdl
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:33:22
===> Ended : 11:54:21
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20120316113322.log
*
WMSService-TS_20120316113322.log: WMSService-TS_20120316113322.log
Jdl with ISBBaseURI and OSBDestURI
Test on CREAM ce:
[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl
Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA
==========================================================================
[capannini@cert-17 certification]$
[capannini@cert-17 certification]$
[capannini@cert-17 certification]$
[capannini@cert-17 certification]$
[capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA
Current Status: Done (Success)
Logged Reason(s):
- Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA: reason is User C=IT,O=INFN,OU=Personal Certificate,L=CNAF,CN=Fabio Capannini not authorized for operation {http://www.gridsite.org/namespaces/delegation-2}getProxyReq
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: cccreamceli10.in2p3.fr:8443/cream-sge-short
Submitted: Fri Mar 16 14:29:07 2012 CET
==========================================================================
[capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA
Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server
================================================================================
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_FNmMujUg_2yIhS0iY8h9YA
================================================================================
[capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_FNmMujUg_2yIhS0iY8h9YA
std.err
Log on devel09.cnaf.infn.it:
[root@devel09 ~]# cat /tmp/myjobOutput
FNmMujUg_2yIhS0iY8h9YA
total 76
-rwxr-xr-x 1 dteam009 dteam 80 Mar 16 14:33 exe.sh
-rw-r--r-- 1 dteam009 dteam 0 Mar 16 14:33 std.err
-rw-r--r-- 1 dteam009 dteam 23 Mar 16 14:33 std.out
-rw-r--r-- 1 dteam009 dteam 6 Mar 16 14:33 test1
-rw-r--r-- 1 dteam009 dteam 6 Mar 16 14:33 test2
===> test PASSED
Same process with an LCG CE:
--
FabioCapannini - 2012-03-15