(r15) WMSCertificationExercise < WMS

Tags: , view all tags
%TOC%

---+ *WMS test report*

---++ Summary

   * Component: *WMS 3.3.4*

   * Savannah task: [[https://savannah.cern.ch/task/index.php?22847][22847]]

   * ETICS Subsystem Configuration Name: *emi-wms_R_3_3_6_3* *emi-jdl_R_3_2_6_1*

   * VCS Tag: _emi-ice_R_3_3_4_1_, _emi-wms-manager_R_3_3_1_4_, _emi-jobsubmission_R_3_3_2_1_, _emi-wmproxy_R_3_3_4_2_, _emi-wms-brokerinfo_R_3_3_2_1_, _emi-wms-configuration_R_3_3_2_1_, _emi-wms-ism_R_3_3_2_1_, _emi-wms-matchmaking_R_3_3_2_1_, _emi-wms-purger_R_3_3_2_1_, _emi-yaim-wms_R_4_1_4_3_, _emi-jdl-api-cpp_R_3_2_6_1_, _emi-wms-nagios_R_1_0_0_0_, _emi-wms-mp_R_1_0_2_0_

   * EMI Major Release: *EMI 1 (Kebnekaise)*

   * Platform: sl5 epel

   * Certification report: not yet available

   * Outcome:<strong> %GREEN% *Certification under way* %ENDCOLOR% </strong>

---++ Deployment Tests 

---+++ Clean installation

   * Starting from a SL5 x86_64 kernel machine:

<verbatim>[root@emi-demo11 ~]# cat /etc/redhat-release 
Scientific Linux SL release 5.7 (Boron)
[root@emi-demo11 ~]# uname -a
Linux emi-demo11.cnaf.infn.it 2.6.18-274.12.1.el5 #1 SMP Tue Nov 29 11:14:39 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
</verbatim>

   * Import EMI rpm gpg key
<verbatim>[root@emi-demo11 ~]# wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -O /tmp/emi-key_gd.asc
[root@emi-demo11 ~]# rpm --import /tmp/emi-key_gd.asc</verbatim>

   * cd /etc/yum.repos.d/
   * wget --no-check-certificate https://twiki.cern.ch/twiki/pub/EMI/EMI1Updates/testing.repo
   * yum clean all
   * yum install ca-policy-egi-core
   * yum install emi-wms 
      * See [[%ATTACHURL%/install.log][install.log]]: Clean install log
   * /opt/glite/yaim/bin/yaim -c -s siteinfo/site-info.def -n WMS
      * See [[%ATTACHURL%/yaim-install.log][yaim-install.log]]: yaim install log

---+++ Update
   * Starting from a production version, repo available at http://emisoft.web.cern.ch/emisoft/dist/EMI/1/sl5/x86_64/updates/emi-release-1.0.1-1.sl5.noarch.rpm
<verbatim>[root@emi-demo12 yum.repos.d]# rpm -qa|grep wms-manager
glite-wms-manager-3.3.1-3.sl5
</verbatim>

   * wget --no-check-certificate https://twiki.cern.ch/twiki/pub/EMI/EMI1Updates/testing.repo -O /etc/yum.repos.d/testing.repo
   * yum clean all
   * service gLite stop
   * yum update
   * /opt/glite/yaim/bin/yaim -c -s site-info.def -n WMS 
      * [[%ATTACHURL%/update.log][update.log]]: Update log
   * Check final version: <verbatim>[root@emi-demo12 siteinfo]# rpm -qa|grep wms-manager
glite-wms-manager-3.3.1-4.sl5
</verbatim>

---++++ Proxy mode
The same update procedure has been applied on a wms configured in proxy mode. emi-demo12 being the wms and emi-demo11 the LB server.
In order to configure emi-demo12 in proxy mode the following lines have been defined in the site-info.def file:
<verbatim>
# Hostname of the WMS
WMS_HOST=emi-demo12.$MY_DOMAIN
LB_HOST=emi-demo11.$MY_DOMAIN
</verbatim>

and the following lines in siteinfo/services/glite-wms :
<verbatim>
LB_HOST="emi-demo11.cnaf.infn.it:9000"
#GLITE_LB_TYPE=both
GLITE_LB_TYPE=proxy
</verbatim>

On emi-demo11 the following lines have been defined in the site-info.def file:
<verbatim>
GLITE_LB_WMS_DN="/C=IT/O=INFN/OU=Host/L=CNAF/CN=emi-demo12.cnaf.infn.it"
GLITE_LB_AUTHZ_REGISTER_JOBS=".*"
</verbatim>

---++ Unit Tests 

*N/A*: Tests will be available with EMI-2.

---++ Basic Functionality tests

---+++ Submission
Where possible the tests should use internal testbed CEs (located in Padova).
This is accomplished by adding the following line to wms-command.conf:
<verbatim>
DEFAULTREQ= other.GlueCEStateStatus == "Testing"
</verbatim>
This is not possible, for example, for parallel jobs.

---++++ Normal
<verbatim>[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 17:09:32
===> Ended  : 17:21:55
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20111228170932.log

[capannini@devel15 WMS-service]$ voms-proxy-init --voms dteam:/dteam/NGI_IT:operator
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy .................................................................. Done
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ........................................................................... Done

Your proxy is valid until Thu Dec 29 23:31:47 2011
[capannini@devel15 WMS-service]$ voms-proxy-info --all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
type      : proxy
strength  : 1024 bits
path      : /tmp/x509up_u504
timeleft  : 11:59:51
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/NGI_IT/Role=operator/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
attribute : /dteam/Role=NULL/Capability=NULL
timeleft  : 11:59:51
uri       : voms2.hellasgrid.gr:15004
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:32:22
===> Ended  : 11:40:10
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20111229113222.log

[capannini@devel15 WMS-service]$ voms-proxy-init --voms testers.eu-emi.eu
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ................................... Done
Contacting  emitestbed07.cnaf.infn.it:15002 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed07.cnaf.infn.it] "testers.eu-emi.eu" Done
Creating proxy ...................................................... Done

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:45:01
===> Ended  : 11:52:20
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20111229114501.log

[fabiok@ui WMS-service]$ voms-proxy-init --voms infngrid
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ..................................................... Done
Contacting  voms.cnaf.infn.it:15000 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=voms.cnaf.infn.it] "infngrid" Done
Creating proxy .................................................... Done
Your proxy is valid until Thu Dec 29 23:45:58 2011
[fabiok@ui WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V infngrid -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:46:25
===> Ended  : 11:52:40
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20111229114625.log
</verbatim>
See [[%ATTACHURL%/submit.log.tgz][submit.log.tgz]]: Normal submission logs

---++++++ Proxy mode
There is a problem with the configuration of emi-demo12 (wms in proxy mode) pointing to emi-demo11 (wms in both mode): the events Running,ReallyRunning and Done Ok are not logged by emi-demo11 (and don't appear in the logging-info), even if they are present in the lbserver20 db of emi-demo12. These events are instead correctly logged if emi-demo11 is configured as LB in server mode. Thus, in order to properly test a wms in proxy mode, then it should point to a LB server not in both mode.
 
---+++++ Jdl with _DataRequirements_
In case of problems with lcg-ce, it i possible to create replicas of the file on other SEs close to different lcg-ces.
<verbatim>
[capannini@devel15 WMS-service]$ lcg-rep --vo dteam -d srm://gridsrm.pi.infn.it:8444/dteam/fcapanni/e-2M.txt lfn:/grid/dteam/fcapanni/e-2M.txt
GSIFTP: source: set up FTP mode. DCAU disabled. Streams =  1, Tcp BS = 0
GSIFTP: dest: set up FTP mode. DCAU disabled. Streams =  1, Tcp BS = 0
Transfer completed succesfully
[capannini@devel15 WMS-service]$ lcg-rep --vo dteam -d srm://gridsrm.pi.infn.it:8444/dteam/fcapanni/PI_1M.txt lfn:/grid/dteam/fcapanni/PI_1M.txt
GSIFTP: source: set up FTP mode. DCAU disabled. Streams =  1, Tcp BS = 0
GSIFTP: dest: set up FTP mode. DCAU disabled. Streams =  1, Tcp BS = 0
Transfer completed succesfully

The ce/se couple can be found looking for "/jobmanager" in the output of the following command:
[capannini@devel15 WMS-service]$ lcg-infosites --vo dteam closeSE

The GlueVOInfoPath of the storage area to be used in the srm surl after the endpoint can be found with the following search:
ldapsearch -x -LLL -H  ldap://egee-bdii.cnaf.infn.it:2170 -b mds-vo-name=local,o=grid '(&(objectClass=GlueVOInfo)(GlueChunkKey=GlueSEUniqueID=gridsrm.pi.infn.it))' GlueVOInfoPath
(/dteam was picked up in this test)

the lcg-ce to be excluded can be specified in the testsuite configuration file (wms-command.conf) with the following attribute:
DEFAULTREQ=!regexp(".*ce130.*", other.GlueCEUniqueID) && !regexp(".*ce131.*", other.GlueCEUniqueID) && !regexp(".*ce133.*", other.GlueCEUniqueID)

In the following test the lcg-ce was the following (by inspecting the log):
Destination CE is ce132.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam

[capannini@devel15 WMS-service]$ cat JDLs/data-req.jdl 
###########################################
#      JDL with Data Requirements         #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";

FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};

DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; 
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};

DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i -j JDLs/data-req.jdl
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 12:24:32
===> Ended  : 12:36:28
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120110122432.log

</verbatim>

---+++++ Jdl with _ISBBaseURI_ and _OSBDestURI_

Test on CREAM ce:

<verbatim>
[capannini@devel15 certificazione]$ cat URI.jdl 
###########################################
#      JDL with ISBURI & OSBDestURI       #
###########################################

Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";

InputSandboxBaseURI = "gsiftp://devel11.cnaf.infn.it:2811/tmp";

FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxDestURI = {"gsiftp://devel09.cnaf.infn.it:2811/tmp/myjobOutput", "std.err"};


#requirements = other.GlueCEStateStatus == "Testing" &&  regexp("/cream", other.GlueCEUniqueID);
requirements = regexp("/cream", other.GlueCEUniqueID);
DataAccessProtocol = "gsiftp";
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@devel15 certificazione]$ cat tmp/exe.sh 
#!/bin/sh

NAME=`echo $GLITE_WMS_JOBID | sed -e 's/.*\///'`

echo $NAME 

ls -l

[capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg

==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        inaf-ce-01.ct.pi2s2.it:8443/cream-lsf-cert
Submitted:          Thu Dec 29 16:20:11 2011 CET
==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

			JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_NAwVzPxlPqGYz-Kf2xWLNg

================================================================================


[capannini@devel15 certificazione]$ ls /tmp/jobOutput/capannini_NAwVzPxlPqGYz-Kf2xWLNg
std.err

Log on devel09.cnaf.infn.it:

[root@devel09 ~]# cat /tmp/myjobOutput 
NAwVzPxlPqGYz-Kf2xWLNg
total 16
-rwxr-xr-x 1 dteam002 dteam 80 Dec 29 16:20 exe.sh
-rw-r--r-- 1 dteam002 dteam  0 Dec 29 16:20 std.err
-rw-r--r-- 1 dteam002 dteam 23 Dec 29 16:20 std.out
-rw-r--r-- 1 dteam002 dteam  6 Dec 29 16:20 test1
-rw-r--r-- 1 dteam002 dteam  6 Dec 29 16:20 test2

===>   test PASSED


</verbatim>

Same process with an LCG CE:

<verbatim>
[capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA

==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA
Current Status:     Done (Success)
Logged Reason(s):
    - Job got an error while in the CondorG queue.
    - Job terminated successfully
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        gridce.sns.it:2119/jobmanager-lcgpbs-cert
Submitted:          Fri Dec 30 11:43:28 2011 CET
==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

			JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_d4akLe8H2jynZpCPe5jGxA

================================================================================


[capannini@devel15 certificazione]$ ls -l /tmp/jobOutput/capannini_d4akLe8H2jynZpCPe5jGxA
total 0
-rw-r--r-- 1 capannini emitestbed 0 Dec 30 13:08 std.err

Log on devel09.cnaf.infn.it:

[root@devel09 tmp]# ls -l myjobOutput 
-rw-r--r-- 1 dteam042 dteam 714 30 dic 13:01 myjobOutput
[root@devel09 tmp]# cat myjobOutput 
d4akLe8H2jynZpCPe5jGxA
total 36
-rwxr-xr-x 1 dteam003 dteam  80 Dec 30 13:00 exe.sh
-rw-r--r-- 1 dteam003 dteam 154 Dec 30 13:01 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fd4akLe8H2jynZpCPe5jGxA.output
-rw-r--r-- 1 dteam003 dteam   0 Dec 30 13:01 std.err
-rw-r--r-- 1 dteam003 dteam  23 Dec 30 13:01 std.out
-rw-r--r-- 1 dteam003 dteam   6 Dec 30 13:00 test1
-rw-r--r-- 1 dteam003 dteam   6 Dec 30 13:00 test2
-rw------- 1 dteam003 dteam   2 Dec 30 13:01 tmp.GPdus14280
-rw------- 1 dteam003 dteam   2 Dec 30 13:01 tmp.OAref14000
-rw------- 1 dteam003 dteam 103 Dec 30 13:01 tmp.QtSZI14001
-rw------- 1 dteam003 dteam   0 Dec 30 13:01 tmp.vFipq14279
-rw------- 1 dteam003 dteam 103 Dec 30 13:01 tmp.YUTON14281

===>   test PASSED
</verbatim>

---+++++ Jdl with _ISBBaseURI_ and _OSBBaseDestURI_

Submit to CREAM CE
<verbatim>
[capannini@devel15 certificazione]$ cat BaseURI.jdl 
###########################################
#  JDL with ISBURI & OSBBaseDestURI       #
###########################################

Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";

InputSandboxBaseURI = "gsiftp://devel11.cnaf.infn.it:2811/tmp";

FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxBaseDestURI="gsiftp://devel09.cnaf.infn.it:2811/tmp";

#requirements = other.GlueCEStateStatus == "Testing" &&  regexp("/cream", other.GlueCEUniqueID);
requirements = regexp("/cream", other.GlueCEUniqueID);

RetryCount = 1;
ShallowRetryCount = 2;

[capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf BaseURI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ

==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        t2-ce-01.to.infn.it:8443/cream-pbs-short
Submitted:          Fri Dec 30 12:47:43 2011 CET
==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

			JOB GET OUTPUT OUTCOME

No output files to be retrieved for the job:
https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ

================================================================================

[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ
Current Status:     Cleared 
Status Reason:      user retrieved output sandbox
Destination:        t2-ce-01.to.infn.it:8443/cream-pbs-short
Submitted:          Fri Dec 30 12:47:43 2011 CET
==========================================================================

Log on devel09.cnaf.infn.it:

[root@devel09 tmp]# ls std*
std.err  std.out

[root@devel09 tmp]# cat std.out 
bRxuYfMUA79tvRXdrpgJdQ
total 16
-rwxr-xr-x 1 dteam029 dteam 80 Dec 30 12:48 exe.sh
-rw-r--r-- 1 dteam029 dteam  0 Dec 30 12:48 std.err
-rw-r--r-- 1 dteam029 dteam 23 Dec 30 12:48 std.out
-rw-r--r-- 1 dteam029 dteam  6 Dec 30 12:48 test1
-rw-r--r-- 1 dteam029 dteam  6 Dec 30 12:48 test2

===>     === test PASSED === 

</verbatim>

Submit to an LCG CE:

<verbatim>
[capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf BaseURI.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg

==========================================================================


[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        grid-ce.lns.infn.it:2119/jobmanager-lcgpbs-short
Submitted:          Fri Dec 30 13:18:38 2011 CET
==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

			JOB GET OUTPUT OUTCOME

No output files to be retrieved for the job:
https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg

================================================================================


[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg
Current Status:     Cleared 
Status Reason:      user retrieved output sandbox
Destination:        grid-ce.lns.infn.it:2119/jobmanager-lcgpbs-short
Submitted:          Fri Dec 30 13:18:38 2011 CET
==========================================================================

Log on devel09.cnaf.infn.it:

[root@devel09 tmp]# ls -l std*
-rw-r--r-- 1 dteam042 dteam   0 30 dic 13:19 std.err
-rw-r--r-- 1 dteam042 dteam 727 30 dic 13:19 std.out

[root@devel09 tmp]# cat std.out
pX2yRjupthmRSr8bqf5_Bg
total 36
-rwxr-xr-x  1 dteam050 dteam  80 Dec 30 13:19 exe.sh
-rw-r--r--  1 dteam050 dteam 118 Dec 30 13:19 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fpX2yRjupthmRSr8bqf5_5fBg.output
-rw-r--r--  1 dteam050 dteam   0 Dec 30 13:19 std.err
-rw-r--r--  1 dteam050 dteam  23 Dec 30 13:19 std.out
-rw-r--r--  1 dteam050 dteam   6 Dec 30 13:19 test1
-rw-r--r--  1 dteam050 dteam   6 Dec 30 13:19 test2
-rw-------  1 dteam050 dteam 103 Dec 30 13:19 tmp.csGdY18153
-rw-------  1 dteam050 dteam   0 Dec 30 13:19 tmp.FBSue18151
-rw-------  1 dteam050 dteam   2 Dec 30 13:19 tmp.FZDLk18152
-rw-------  1 dteam050 dteam   2 Dec 30 13:19 tmp.HdslV18137
-rw-------  1 dteam050 dteam 103 Dec 30 13:19 tmp.hSlSL18138
</verbatim>

---+++++ Jdl with _AllowZippedISB_

<verbatim>
[capannini@devel15 certificazione]$ cat AllowZIP.jdl 
###########################################
#   JDL with AllowZippedISB attribute     #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";

InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"};
OutputSandbox = {"std.out", "std.err"};

#requirements = other.GlueCEStateStatus == "Testing" &&  regexp("/cream", other.GlueCEUniqueID);
requirements = regexp("/cream", other.GlueCEUniqueID);

AllowZippedISB=true;

RetryCount = 1;
ShallowRetryCount = 2;

[capannini@devel15 certificazione]$ glite-wms-job-submit --debug -a -c ~/wms_emi-demo11.conf AllowZIP.jdl 
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Vo read from proxy certificate extension
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - VirtualOrganisation value : dteam
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Configuration file: /home/capannini/wms_emi-demo11.conf - VirtualOrganisation, RetryCount, rank, requirements attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes"
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Loaded user configuration file:
 /home/capannini/wms_emi-demo11.conf
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Configuration file: //etc/glite-wms/dteam/glite_wmsui.conf - VirtualOrganisation, MyProxyServer attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes"
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Loaded Vo specific configuration file:
 //etc/glite-wms/dteam/glite_wmsui.conf
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Loaded Configuration values: 
 [
  JdlDefaultAttributes = 
   [
    PerusalFileEnable = false; 
    ShallowRetryCount = 10; 
    SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; 
    RetryCount = 3; 
    AllowZippedISB = true; 
    VirtualOrganisation = "dteam"; 
    rank =  -other.GlueCEStateEstimatedResponseTime; 
    MyProxyServer = "myproxy.cnaf.infn.it"; 
    requirements = other.GlueCEStateStatus == "Production"
   ]; 
  OutputStorage = "/tmp"; 
  ListenerStorage = "/tmp"; 
  ErrorStorage = "/var/tmp"; 
  WmProxyEndPoints = { "https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server" }
 ]
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Getting Endpoint URL from configuration file 
-----------------------------------------

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Calling the WMProxy getVersion service
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - WMProxy Version: 3.3.4 
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Sending Proxy Request to https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Calling the WMProxy delegationns__getProxyReq service
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - delegationns__getProxyReq -  The proxy has been successfully retrieved
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Calling the WMProxy delegationns__putProxyReq service
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - The proxy has been successfully delegated with the identifier: oHGkZ5pxjZH7-LDxL2NIMw
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Calling the WMProxy getTransferProtocols service
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - getTransferProtocols -  Available protocols: gsiftp, https
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - FileTransferProtocol not specified; using the default protocol: gsiftp
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - The JDL file is: /home/capannini/certificazione/AllowZIP.jdl
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Retrieving the list of the local ISB files from the user JDL 
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Total size of the ISB file(s) to be transferred to: 1126406
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Max single job size of the ISB file(s) to be transferred to: 1024000
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Checking the User-FreeQuota on the server 
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Calling the WMProxy getFreeQuota service
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - getFreeQuota -  User freequota not set on the server
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Getting the max ISB size from the server https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Calling the WMProxy getMaxInputSandboxSize service
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - getMaxInputSandboxSize -  Max ISB size information successfully retrieved
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - The max job size (1024000 bytes) doesn't exceed the max size limit of 100000000 bytes: File transfer is allowed
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - File archiving and file compression allowed by user in the JDL
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Registering JDL [ StdOutput = "std.out"; ShallowRetryCount = 2; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 1; Executable = "/bin/ls"; Type = "job"; Arguments = "-la"; AllowZippedISB = true; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank =  -other.GlueCEStateEstimatedResponseTime; ZippedISB = { "ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar.gz" }; OutputSandbox = { "std.out","std.err" }; InputSandbox = { "file:///home/capannini/certificazione/fileA","file:///home/capannini/certificazione/fileB","file:///home/capannini/certificazione/fileC","file:///home/capannini/certificazione/fileD","file:///home/capannini/certificazione/fileE" }; StdError = "std.err"; rank =  -other.GlueCEStateEstimatedResponseTime; MyProxyServer = "myproxy.cnaf.infn.it"; requirements = ( regexp("/cream",other.GlueCEUniqueID) ) && ( other.GlueCEStateStatus == "Production" ) ]
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Registering the job to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Calling the WMProxy jobRegister service
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - The JobId is:  https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Archiving the ISB files: /tmp/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - This archive file has been successfully created: /tmp/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Compressing the file (.gz): /tmp/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - ISB ZIPPED file successfully created: /tmp/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar.gz
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Getting the SandboxDestinationURI from the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Calling the WMProxy getSandboxDestURI service with gsiftp protocol 
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - getSandboxDestURI -  Destination URIs sucessfully retrieved
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - DestinationURI: gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/nG/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fnGo2GsPtKD3urj66sBnHLA/input
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - FileTransfer (gsiftp): using globus-url-copy to transfer the local InputSandBox file(s) to the submission endpoint
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - File Transfer (gsiftp) 
 Command: /usr/bin/globus-url-copy
Source: file:///tmp/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar.gz
Destination: gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/nG/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fnGo2GsPtKD3urj66sBnHLA/input/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar.gz
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - File Transfer (gsiftp) Transfer successfully done
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Starting the job:  https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Calling the WMProxy jobStart service
-----------------------------------------
-----------------------------------------
30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - jobStart -  The job has been successfully started
-----------------------------------------

====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA

==========================================================================

		*** Log file created ***
Possible Errors and Debug messages have been printed in the following file:
/var/tmp/glite-wms-job-submit_504_23649_20111230_16-54-29.log

Check if AllowZippedISB has been included in the jdl:

[capannini@devel15 certificazione]$ glite-wms-job-info --jdl https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA|grep Allow
  AllowZippedISB = true;

[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cremino.cnaf.infn.it:8443/cream-pbs-cert
Submitted:          Fri Dec 30 16:54:30 2011 CET
==========================================================================

[capannini@devel15 certificazione]$ 
[capannini@devel15 certificazione]$ 
[capannini@devel15 certificazione]$ 
[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

			JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_nGo2GsPtKD3urj66sBnHLA

================================================================================


[capannini@devel15 certificazione]$ ls -l /tmp/jobOutput/capannini_nGo2GsPtKD3urj66sBnHLA
total 4
-rw-r--r-- 1 capannini emitestbed   0 Dec 30 17:00 std.err
-rw-r--r-- 1 capannini emitestbed 623 Dec 30 17:00 std.out
[capannini@devel15 certificazione]$ cat /tmp/jobOutput/capannini_nGo2GsPtKD3urj66sBnHLA/std.out 
total 1132
drwxr-xr-x 2 dteam011 dteam    4096 Dec 30 16:54 .
drwxr-xr-x 3 dteam011 dteam    4096 Dec 30 16:54 ..
-rw-r--r-- 1 dteam011 dteam    4037 Dec 30 16:54 .BrokerInfo
-rw-r--r-- 1 dteam011 dteam       2 Dec 30 16:54 fileA
-rw-r--r-- 1 dteam011 dteam       2 Dec 30 16:54 fileB
-rw-r--r-- 1 dteam011 dteam 1024000 Dec 30 16:54 fileC
-rw-r--r-- 1 dteam011 dteam  102400 Dec 30 16:54 fileD
-rw-r--r-- 1 dteam011 dteam       2 Dec 30 16:54 fileE
-rw-r--r-- 1 dteam011 dteam       0 Dec 30 16:54 std.err
-rw-r--r-- 1 dteam011 dteam       0 Dec 30 16:54 std.out
-rw-r--r-- 1 dteam011 dteam       0 Dec 30 16:54 .tmp_file

===>     === test PASSED === 
</verbatim>

---+++++ Jdl with _ExpiryTime_

<verbatim>
[capannini@devel15 certificazione]$ cat ExpiryTime.jdl 
###########################################
#       JDL with ExpiryTime attribute     #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";

InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"};
OutputSandbox = {"std.out", "std.err"};

requirements = false;

ExpiryTime = 1325261887;

RetryCount = 1;
ShallowRetryCount = 2;

[capannini@devel15 certificazione]$ date +%s
1325261324

[capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ExpiryTime.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/O6MWj0UPsVQblxDjgmo-gQ

==========================================================================

[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/O6MWj0UPsVQblxDjgmo-gQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/O6MWj0UPsVQblxDjgmo-gQ
Current Status:     Waiting 
Status Reason:      BrokerHelper: no compatible resources
Submitted:          Fri Dec 30 17:08:58 2011 CET
==========================================================================

[capannini@devel15 certificazione]$ date +%s
1325261928
[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/O6MWj0UPsVQblxDjgmo-gQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/O6MWj0UPsVQblxDjgmo-gQ
Current Status:     Aborted 
Status Reason:      request expired
Submitted:          Fri Dec 30 17:08:58 2011 CET
==========================================================================

===>     === test PASSED === 

</verbatim>

---+++++ Jdl with _ShortDeadlineJob_
To test SDJs the following bdii must be used: egee-bdii.cnaf.infn.it

<verbatim>
[capannini@devel15 certificazione]$ cat SDLJ.jdl 
###########################################
# JDL with ShortDeadlineJob attribute     #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";

InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"};
OutputSandbox = {"std.out", "std.err"};

requirements = true;

ShortDeadlineJob = true;

RetryCount = 1;
ShallowRetryCount = 2;

[capannini@devel15 certificazione]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf SDLJ.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

==========================================================================

		     COMPUTING ELEMENT IDs LIST 
 The following CE(s) matching your job requirements have been found:

	*CEId*
 - ce01.marie.hellasgrid.gr:2119/jobmanager-pbs-sdj
 - cream-ce01.marie.hellasgrid.gr:8443/cream-pbs-sdj
 - grid4.mif.vu.lt:2119/jobmanager-lcgpbs-sdj
 - grive02.ibcp.fr:8443/cream-pbs-sdj
 - mario.univ-lille1.fr:8443/cream-pbs-sdj
 - ce01.ariagni.hellasgrid.gr:2119/jobmanager-pbs-dteam.sdj
 - cream-ce01.ariagni.hellasgrid.gr:8443/cream-pbs-dteam.sdj

==========================================================================

[capannini@devel15 certificazione]$ python ~/wms_tests/WMS-service/WMS-job-cycle.py -c ~/wms_tests/WMS-service/wms-command.conf -V dteam -d 3 -l -t 1 -i -j SDLJ.jdl 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: /home/capannini/wms_tests/WMS-service/WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:58:16
===> Ended  : 12:04:06
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120116115816.log

</verbatim>
Log is here: [[%ATTACHURL%/WMSService-TS_20120116115816.log][WMSService-TS_20120116115816.log]]: sdj log

---++++ Collection

---+++++ Bulk submission

<verbatim>
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 15:15:00
===> Ended  : 15:24:31
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120116151500.log
</verbatim>
See log: [[%ATTACHURL%/WMSService-TS_20120116151500.log][WMSService-TS_20120116151500.log]]: bulk collection log

<verbatim>
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 15:46:24
===> Ended  : 15:56:56
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120116154624.log
</verbatim>
See log: [[%ATTACHURL%/WMSService-TS_20120116154624.log][WMSService-TS_20120116154624.log]]: bulk collection log

<verbatim>
[capannini@devel15 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy .................................................................. Done
Proxy Verify OK
Your proxy is valid until: Mon Jan 23 16:04:28 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.

[capannini@devel15 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy ......................................................................................................................... Done

Your proxy is valid until Tue Jan 17 03:32:47 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.

[capannini@devel15 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:54:56
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:53:55
uri       : voms.hellasgrid.gr:15004

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 2
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:32:57
===> Ended  : 16:41:22
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120116163257.log

</verbatim>
See log: [[%ATTACHURL%/WMSService-TS_20120116163257.log][WMSService-TS_20120116163257.log]]: bulk collection log

---+++++ All in a jdl 
<verbatim>
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:04:17
===> Ended  : 10:36:27
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120117100417.log

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:24:08
===> Ended  : 10:38:44
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120117102408.log

[capannini@devel15 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ..................................................................................................................................................................................................... Done
Proxy Verify OK
Your proxy is valid until: Tue Jan 24 11:18:37 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@devel15 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ............................................................................................................................................................................................................................................. Done

Your proxy is valid until Tue Jan 17 22:19:16 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@devel15 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:33
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:32
uri       : voms2.hellasgrid.gr:15004

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:19:59
===> Ended  : 11:29:26
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120117111959.log

</verbatim>
See logs: [[%ATTACHURL%/coll.tgz][coll.tgz]]: all in a jdl collection logs

---++++ Parametric job
<verbatim>
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:46:35
===> Ended  : 10:53:22
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120118104635.log

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu  -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:47:30
===> Ended  : 10:53:46
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120118104730.log

[capannini@devel15 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Enter GRID pass phrase for this identity:
Creating proxy ............... Done
Proxy Verify OK
Your proxy is valid until: Wed Jan 25 10:48:21 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@devel15 WMS-service]$ 
[capannini@devel15 WMS-service]$ 
[capannini@devel15 WMS-service]$ 
[capannini@devel15 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done
Creating proxy ................................................................................................................................................ Done

Your proxy is valid until Wed Jan 18 21:48:49 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@devel15 WMS-service]$ 
[capannini@devel15 WMS-service]$ 
[capannini@devel15 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:51
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:50
uri       : voms.hellasgrid.gr:15004
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) 


 Test 3A: Submit to an LCG-CE 


 Test 3B: Submit to a CREAM CE 


 Test 3C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 10:49:51
===> Ended  : 10:55:10
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120118104951.log

</verbatim>
See logs: [[%ATTACHURL%/parametric.tgz][parametric.tgz]]: parametric logs

---++++ DAG job
<verbatim>
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 12:05:40
===> Ended  : 12:10:56
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120118120540.log

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu  -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 12:06:00
===> Ended  : 12:11:15
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120118120600.log

[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 12:06:30
===> Ended  : 12:12:39
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120118120630.log
</verbatim>
See logs: [[%ATTACHURL%/dag.tgz][dag.tgz]]: dag logs
-- Main.FabioCapannini - 2011-12-28
Attachments
Topic attachments
I	Attachment	Action	Size	Date	Who	Comment
log	install.log	manage	124.2 K	2011-12-28 - 11:04	FabioCapannini	Clean install log
log	update.log	manage	37.6 K	2011-12-28 - 14:31	FabioCapannini	Update log
log	WMSService-TS_20120116154624.log	manage	19.2 K	2012-01-16 - 15:01	FabioCapannini	bulk collection log
log	WMSService-TS_20120116151500.log	manage	17.8 K	2012-01-16 - 14:45	FabioCapannini	bulk collection log
log	WMSService-TS_20120116163257.log	manage	16.1 K	2012-01-16 - 15:42	FabioCapannini	bulk collection log
log	WMSService-TS_20120116115816.log	manage	13.0 K	2012-01-16 - 11:18	FabioCapannini	sdj log
log	yaim-install.log	manage	9.0 K	2011-12-28 - 11:30	FabioCapannini	yaim install log
tgz	coll.tgz	manage	5.8 K	2012-01-17 - 10:35	FabioCapannini	all in a jdl collection logs
tgz	submit.log.tgz	manage	5.1 K	2011-12-29 - 11:06	FabioCapannini	Normal submission logs
tgz	parametric.tgz	manage	3.1 K	2012-01-18 - 11:03	FabioCapannini	parametric logs
tgz	dag.tgz	manage	2.2 K	2012-01-18 - 11:17	FabioCapannini	dag logs
Topic revision: r15 - 2012-01-18 - FabioCapannini
Account
- Log In
~~Edit~~
~~Attach~~