Tags:
, view all tags

WMS test report

Summary

  • Component: WMS 3.3.5-2

  • ETICS Subsystem Configuration Name: emi-wms_R_3_3_9_0

  • VCS Tag: emi-ice_R_3_3_5_4, emi-wms-manager_R_3_3_1_3, emi-jobsubmission_R_3_3_2_1, emi-wmproxy_R_3_3_5_1, emi-wms-brokerinfo_R_3_3_2_1, emi-wms-configuration_R_3_3_2_1, emi-wms-ism_R_3_3_2_1, emi-wms-matchmaking_R_3_3_2_1, emi-wms-purger_R_3_3_2_1, emi-yaim-wms_R_4_1_5_1, emi-jdl-api-cpp_R_3_2_6_1, emi-wms-nagios_R_1_0_0_0, emi-wms-mp_R_1_0_2_0

  • EMI Major Release: EMI 1 (Kebnekaise)

  • Platform: sl5 epel

  • Certification report: not yet available

  • Outcome: Certification under way

Deployment Tests

Clean installation

Update

Unit Tests

N/A: Tests will be available with EMI-2.

Basic Functionality tests

Submission

Where possible the tests should use internal testbed CEs (located in Padova). This is accomplished by adding the following line to wms-command.conf: 
DEFAULTREQ= other.GlueCEStateStatus == "Testing"
This is not possible, for example, for parallel jobs.

Normal 

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 17:36:32
===> Ended  : 18:09:56
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120726173632.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 10:23:56
===> Ended  : 10:42:16
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727102356.log

[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating proxy ................................ Done
Proxy Verify OK
Your proxy is valid until: Fri Aug  3 10:27:41 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ..................................................................................... Done

Your proxy is valid until Fri Jul 27 21:28:11 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:49
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:49
uri       : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 1
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 10:28:59
===> Ended  : 10:56:20
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727102859.log
Proxy mode
Pointing the testsuite at cert-26: 
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-26.cnaf.infn.it
===> Started: 11:05:43
===> Ended  : 11:25:33
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727110543.log

Jdl with DataRequirements
Disabling the requirement DEFAULTREQ= other.GlueCEStateStatus == "Testing": 
[capannini@cert-17 WMS-service]$ cat JDLs/data-req.jdl 
###########################################
#      JDL with Data Requirements         #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";

FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};

DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; 
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};

DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i -j JDLs/data-req.jdl
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-25.cnaf.infn.it
===> Started: 11:53:40
===> Ended  : 12:05:04
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120727115340.log

Jdl with ISBBaseURI and OSBDestURI
Test on CREAM ce: 

[capannini@cert-17 certification]$ cat URI.jdl 
###########################################
#      JDL with ISBURI & OSBDestURI       #
###########################################

Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";

InputSandboxBaseURI = "gsiftp://emi-demo12.cnaf.infn.it:2811/tmp";

FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxDestURI = {"gsiftp://cert-26.cnaf.infn.it:2811/tmp/myjobOutput", "std.err"};


requirements = ( other.GlueCEStateStatus == "Testing" ) &&  regexp("/cream", other.GlueCEUniqueID);
#requirements = !regexp("/cream", other.GlueCEUniqueID);
DataAccessProtocol = "gsiftp";
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_cert-25.conf URI.jdl 

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw

==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-status https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
Current Status:     Done (Success)
Logged Reason(s):
    - Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw: reason is Received NULL fault; the error is due to another cause: FaultString=[connection error] - FaultCode=[SOAP-ENV:Client] - FaultSubCode=[SOAP-ENV:Client] - FaultDetail=[Connection timed out]
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-39.pd.infn.it:8443/cream-pbs-cert
Submitted:          Fri Jul 27 12:15:36 2012 CEST
==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-output https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://cert-25.cnaf.infn.it:9000/7NcVgYqFmRlwMVOFPKlsfw
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_7NcVgYqFmRlwMVOFPKlsfw

================================================================================

[capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_7NcVgYqFmRlwMVOFPKlsfw
std.err

Log on cert-26:

[root@cert-26 tmp]# cat /tmp/myjobOutput 
7NcVgYqFmRlwMVOFPKlsfw
total 16
-rwxr-xr-x 1 dteam026 dteam 80 Jul 27 12:16 exe.sh
-rw-r--r-- 1 dteam026 dteam  0 Jul 27 12:16 std.err
-rw-r--r-- 1 dteam026 dteam 23 Jul 27 12:16 std.out
-rw-r--r-- 1 dteam026 dteam  6 Jul 27 12:16 test1
-rw-r--r-- 1 dteam026 dteam  6 Jul 27 12:16 test2
===> Test PASSED

On an LCG-CE: 

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_cert-25.conf URI.jdl 

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://cert-25.cnaf.infn.it:9000/gDxF05JrP_3MyS6sPt-hDQ

==========================================================================


[capannini@cert-17 certification]$ glite-wms-job-status https://cert-25.cnaf.infn.it:9000/gDxF05JrP_3MyS6sPt-hDQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-25.cnaf.infn.it:9000/gDxF05JrP_3MyS6sPt-hDQ
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        cream-26.pd.infn.it:2119/jobmanager-lcgpbs-creamtest1
Submitted:          Fri Jul 27 12:25:38 2012 CEST
==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-output https://cert-25.cnaf.infn.it:9000/gDxF05JrP_3MyS6sPt-hDQ

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://cert-25.cnaf.infn.it:9000/gDxF05JrP_3MyS6sPt-hDQ
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_gDxF05JrP_3MyS6sPt-hDQ

================================================================================


[capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_gDxF05JrP_3MyS6sPt-hDQ
std.err

Log on cert-26:

[root@cert-26 tmp]# cat /tmp/myjobOutput 
gDxF05JrP_3MyS6sPt-hDQ
total 36
-rwxr-xr-x  1 dteam022 dteam  80 Jul 27 12:26 exe.sh
-rw-r--r--  1 dteam022 dteam 118 Jul 27 12:26 https_3a_2f_2fcert-25.cnaf.infn.it_3a9000_2fgDxF05JrP_5f3MyS6sPt-hDQ.output
-rw-r--r--  1 dteam022 dteam   0 Jul 27 12:26 std.err
-rw-r--r--  1 dteam022 dteam  23 Jul 27 12:26 std.out
-rw-r--r--  1 dteam022 dteam   6 Jul 27 12:26 test1
-rw-r--r--  1 dteam022 dteam   6 Jul 27 12:26 test2
-rw-------  1 dteam022 dteam 103 Jul 27 12:26 tmp.cPOtjVv997
-rw-------  1 dteam022 dteam   0 Jul 27 12:26 tmp.RRmVxO1010
-rw-------  1 dteam022 dteam   2 Jul 27 12:26 tmp.RrrMIn1011
-rw-------  1 dteam022 dteam   2 Jul 27 12:26 tmp.ToUGiKN996
-rw-------  1 dteam022 dteam 103 Jul 27 12:26 tmp.wWmweN1012

===> Test PASSED

Jdl with ISBBaseURI and OSBBaseDestURI

Submit to CREAM CE 

[capannini@cert-17 certification]$ cat BaseURI.jdl 
###########################################
#  JDL with ISBURI & OSBBaseDestURI       #
###########################################

Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";

InputSandboxBaseURI = "gsiftp://emi-demo12.cnaf.infn.it:2811/tmp";

FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxBaseDestURI="gsiftp://devel20.cnaf.infn.it:2811/tmp";

requirements = other.GlueCEStateStatus == "Testing" &&  !regexp("/cream", other.GlueCEUniqueID);

RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_cert-25.conf BaseURI.jdl 

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://cert-25.cnaf.infn.it:9000/l3pwc0eaoOK3M4xdB0UI4Q

==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-status https://cert-25.cnaf.infn.it:9000/l3pwc0eaoOK3M4xdB0UI4Q


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-25.cnaf.infn.it:9000/l3pwc0eaoOK3M4xdB0UI4Q
Current Status:     Done (Success)
Logged Reason(s):
    - job completed
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-23.pd.infn.it:8443/cream-lsf-cert
Submitted:          Fri Jul 27 14:14:28 2012 CEST
==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-output https://cert-25.cnaf.infn.it:9000/l3pwc0eaoOK3M4xdB0UI4Q

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

No output files to be retrieved for the job:
https://cert-25.cnaf.infn.it:9000/l3pwc0eaoOK3M4xdB0UI4Q

================================================================================

Log on devel20:

[root@devel20 ~]# ls /tmp/std*
/tmp/std.err  /tmp/std.out
[root@devel20 ~]# cat /tmp/std.out 
l3pwc0eaoOK3M4xdB0UI4Q
total 16
-rwxr-xr-x 1 dteam003 dteam 80 Jul 27 14:14 exe.sh
-rw-r--r-- 1 dteam003 dteam  0 Jul 27 14:14 std.err
-rw-r--r-- 1 dteam003 dteam 23 Jul 27 14:14 std.out
-rw-r--r-- 1 dteam003 dteam  6 Jul 27 14:14 test1
-rw-r--r-- 1 dteam003 dteam  6 Jul 27 14:14 test2

===> Test PASSED

Submit to an LCG-CE: 

[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_cert-25.conf BaseURI.jdl 

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://cert-25.cnaf.infn.it:9000/oKS2LzwymNeWdncCEsNzzw

==========================================================================


[capannini@cert-17 certification]$ glite-wms-job-status https://cert-25.cnaf.infn.it:9000/oKS2LzwymNeWdncCEsNzzw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-25.cnaf.infn.it:9000/oKS2LzwymNeWdncCEsNzzw
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        cream-26.pd.infn.it:2119/jobmanager-lcgpbs-cert
Submitted:          Fri Jul 27 14:47:53 2012 CEST
==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-output https://cert-25.cnaf.infn.it:9000/oKS2LzwymNeWdncCEsNzzw

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

No output files to be retrieved for the job:
https://cert-25.cnaf.infn.it:9000/oKS2LzwymNeWdncCEsNzzw

================================================================================

Log on devel20:

[root@devel20 ~]# ls /tmp/std*
/tmp/std.err  /tmp/std.out
You have new mail in /var/spool/mail/root
[root@devel20 ~]# 
[root@devel20 ~]# cat /tmp/std.out 
oKS2LzwymNeWdncCEsNzzw
total 36
-rwxr-xr-x  1 dteam022 dteam  80 Jul 27 14:48 exe.sh
-rw-r--r--  1 dteam022 dteam 118 Jul 27 14:48 https_3a_2f_2fcert-25.cnaf.infn.it_3a9000_2foKS2LzwymNeWdncCEsNzzw.output
-rw-r--r--  1 dteam022 dteam   0 Jul 27 14:48 std.err
-rw-r--r--  1 dteam022 dteam  23 Jul 27 14:48 std.out
-rw-r--r--  1 dteam022 dteam   6 Jul 27 14:48 test1
-rw-r--r--  1 dteam022 dteam   6 Jul 27 14:48 test2
-rw-------  1 dteam022 dteam   2 Jul 27 14:48 tmp.bEAsLQ1695
-rw-------  1 dteam022 dteam 103 Jul 27 14:48 tmp.CNbVyt1681
-rw-------  1 dteam022 dteam   0 Jul 27 14:48 tmp.JHlHdY1694
-rw-------  1 dteam022 dteam   2 Jul 27 14:48 tmp.kBAxQZ1680
-rw-------  1 dteam022 dteam 103 Jul 27 14:48 tmp.qArurr1696

===> Test PASSED

Jdl with AllowZippedISB 
[capannini@cert-17 certification]$ glite-wms-job-submit --debug -a -c ~/wms_cert-25.conf AllowZIP.jdl 
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Vo read from proxy certificate extension
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - VirtualOrganisation value : dteam
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Configuration file: /home/capannini/wms_cert-25.conf - VirtualOrganisation, RetryCount, rank, requirements attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes"
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Loaded user configuration file:
 /home/capannini/wms_cert-25.conf
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Configuration file: //etc/glite-wms/dteam/glite_wmsui.conf - VirtualOrganisation, MyProxyServer attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes"
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Loaded Vo specific configuration file:
 //etc/glite-wms/dteam/glite_wmsui.conf
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Loaded Configuration values: 
 [
  JdlDefaultAttributes = 
   [
    PerusalFileEnable = false; 
    ShallowRetryCount = 10; 
    SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; 
    RetryCount = 3; 
    AllowZippedISB = true; 
    VirtualOrganisation = "dteam"; 
    rank =  -other.GlueCEStateEstimatedResponseTime; 
    MyProxyServer = "myproxy.cnaf.infn.it"; 
    requirements = true
   ]; 
  OutputStorage = "/tmp"; 
  ListenerStorage = "/tmp"; 
  ErrorStorage = "/var/tmp"; 
  WmProxyEndPoints = { "https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server" }
 ]
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Getting Endpoint URL from configuration file 
-----------------------------------------

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server

-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Calling the WMProxy getVersion service
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - WMProxy Version: 3.3.5 
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Sending Proxy Request to https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Calling the WMProxy delegationns__getProxyReq service
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - delegationns__getProxyReq -  The proxy has been successfully retrieved
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Calling the WMProxy delegationns__putProxyReq service
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - The proxy has been successfully delegated with the identifier: rixnrBo3fnN4FRrCIgxqPw
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Calling the WMProxy getTransferProtocols service
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - getTransferProtocols -  Available protocols: gsiftp, https
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - FileTransferProtocol not specified; using the default protocol: gsiftp
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - The JDL file is: /home/capannini/certification/AllowZIP.jdl
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Retrieving the list of the local ISB files from the user JDL 
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Total size of the ISB file(s) to be transferred to: 1126406
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Max single job size of the ISB file(s) to be transferred to: 1024000
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Checking the User-FreeQuota on the server 
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:58 -I- PID: 26711 (Debug) - Calling the WMProxy getFreeQuota service
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - getFreeQuota -  User freequota not set on the server
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Getting the max ISB size from the server https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Calling the WMProxy getMaxInputSandboxSize service
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - getMaxInputSandboxSize -  Max ISB size information successfully retrieved
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - The max job size (1024000 bytes) doesn't exceed the max size limit of 100000000 bytes: File transfer is allowed
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - File archiving and file compression allowed by user in the JDL
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Registering JDL [ StdOutput = "std.out"; ShallowRetryCount = 2; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 1; Executable = "/bin/ls"; Type = "job"; Arguments = "-la"; AllowZippedISB = true; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank =  -other.GlueCEStateEstimatedResponseTime; ZippedISB = { "ISBfiles_BVObvn-V6ZiMX0xFBKaJ_g_0.tar.gz" }; OutputSandbox = { "std.out","std.err" }; InputSandbox = { "file:///home/capannini/certification/fileA","file:///home/capannini/certification/fileB","file:///home/capannini/certification/fileC","file:///home/capannini/certification/fileD","file:///home/capannini/certification/fileE" }; StdError = "std.err"; rank =  -other.GlueCEStateEstimatedResponseTime; MyProxyServer = "myproxy.cnaf.infn.it"; requirements = ( other.GlueCEStateStatus == "Testing" && regexp("/cream",other.GlueCEUniqueID) ) && ( true ) ]
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Registering the job to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Calling the WMProxy jobRegister service
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - The JobId is:  https://cert-25.cnaf.infn.it:9000/uEzlm01BfJx1VkZlBB2ZgA
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Archiving the ISB files: /tmp/ISBfiles_BVObvn-V6ZiMX0xFBKaJ_g_0.tar
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - This archive file has been successfully created: /tmp/ISBfiles_BVObvn-V6ZiMX0xFBKaJ_g_0.tar
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Compressing the file (.gz): /tmp/ISBfiles_BVObvn-V6ZiMX0xFBKaJ_g_0.tar
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - ISB ZIPPED file successfully created: /tmp/ISBfiles_BVObvn-V6ZiMX0xFBKaJ_g_0.tar.gz
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Getting the SandboxDestinationURI from the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Calling the WMProxy getSandboxDestURI service with gsiftp protocol 
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - getSandboxDestURI -  Destination URIs sucessfully retrieved
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - DestinationURI: gsiftp://cert-25.cnaf.infn.it:2811/var/SandboxDir/uE/https_3a_2f_2fcert-25.cnaf.infn.it_3a9000_2fuEzlm01BfJx1VkZlBB2ZgA/input
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - FileTransfer (gsiftp): using globus-url-copy to transfer the local InputSandBox file(s) to the submission endpoint
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - File Transfer (gsiftp) 
 Command: /usr/bin/globus-url-copy
Source: file:///tmp/ISBfiles_BVObvn-V6ZiMX0xFBKaJ_g_0.tar.gz
Destination: gsiftp://cert-25.cnaf.infn.it:2811/var/SandboxDir/uE/https_3a_2f_2fcert-25.cnaf.infn.it_3a9000_2fuEzlm01BfJx1VkZlBB2ZgA/input/ISBfiles_BVObvn-V6ZiMX0xFBKaJ_g_0.tar.gz
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - File Transfer (gsiftp) Transfer successfully done
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Starting the job:  https://cert-25.cnaf.infn.it:9000/uEzlm01BfJx1VkZlBB2ZgA
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - Calling the WMProxy jobStart service
-----------------------------------------
-----------------------------------------
27 July 2012, 15:30:59 -I- PID: 26711 (Debug) - jobStart -  The job has been successfully started
-----------------------------------------

====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://cert-25.cnaf.infn.it:9000/uEzlm01BfJx1VkZlBB2ZgA

==========================================================================

      *** Log file created ***
Possible Errors and Debug messages have been printed in the following file:
/var/tmp/glite-wms-job-submit_504_26711_20120727_15-30-58.log

Check if AllowZippedISB has been included in the jdl:

[capannini@cert-17 certification]$ glite-wms-job-info --jdl https://cert-25.cnaf.infn.it:9000/uEzlm01BfJx1VkZlBB2ZgA|grep Allow
  AllowZippedISB = true; 

[capannini@cert-17 certification]$ glite-wms-job-status https://cert-25.cnaf.infn.it:9000/uEzlm01BfJx1VkZlBB2ZgA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://cert-25.cnaf.infn.it:9000/uEzlm01BfJx1VkZlBB2ZgA
Current Status:     Done (Success)
Logged Reason(s):
    - job completed
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-23.pd.infn.it:8443/cream-lsf-creamcert1
Submitted:          Fri Jul 27 15:30:59 2012 CEST
==========================================================================

[capannini@cert-17 certification]$ glite-wms-job-output https://cert-25.cnaf.infn.it:9000/uEzlm01BfJx1VkZlBB2ZgA

Connecting to the service https://cert-25.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://cert-25.cnaf.infn.it:9000/uEzlm01BfJx1VkZlBB2ZgA
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_uEzlm01BfJx1VkZlBB2ZgA

================================================================================


[capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_uEzlm01BfJx1VkZlBB2ZgA
std.err  std.out
[capannini@cert-17 certification]$ cat /tmp/jobOutput/capannini_uEzlm01BfJx1VkZlBB2ZgA/std.out 
total 1132
drwxr-xr-x 2 dteam003 dteam    4096 Jul 27 15:31 .
drwxr-xr-x 3 dteam003 dteam    4096 Jul 27 15:31 ..
-rw-r--r-- 1 dteam003 dteam    2282 Jul 27 15:31 .BrokerInfo
-rw-r--r-- 1 dteam003 dteam       2 Jul 27 15:31 fileA
-rw-r--r-- 1 dteam003 dteam       2 Jul 27 15:31 fileB
-rw-r--r-- 1 dteam003 dteam 1024000 Jul 27 15:31 fileC
-rw-r--r-- 1 dteam003 dteam  102400 Jul 27 15:31 fileD
-rw-r--r-- 1 dteam003 dteam       2 Jul 27 15:31 fileE
-rw-r--r-- 1 dteam003 dteam       0 Jul 27 15:31 std.err
-rw-r--r-- 1 dteam003 dteam       0 Jul 27 15:31 std.out
-rw-r--r-- 1 dteam003 dteam       0 Jul 27 15:31 .tmp_file

===> Test PASSED

Jdl with ExpiryTime
-- FabioCapannini - 2012-07-19

Attachments Attachments
Edit | Attach | PDF | History: r9 | r7 < r6 < r5 < r4 | Backlinks | Raw View | More topic actions...
Topic revision: r5 - 2012-07-27 - FabioCapannini
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback