Tags:
, view all tags

WMS test report

Summary

  • Component: WMS 3.3.6

  • ETICS Subsystem Configuration Name: *emi-wms_R_3_3_8_3 *

  • VCS Tag: emi-ice_R_3_3_5_1, emi-jobsubmission_R_3_3_3_3, emi-wmproxy_R_3_3_6_1 emi-wms-broker_R_3_3_1_3, emi-wms-brokerinfo_R_3_3_2_1, emi-wms-classad-plugin_R_3_3_1_3 emi-wms-common_R_3_3_2_0 emi-wms-configuration_R_3_3_3_2 emi-wms-helper_R_3_3_3_2 emi-wms-ism_R_3_3_2_1 emi-wms-manager_R_3_3_2_2 emi-wms-matchmaking_R_3_3_2_1 emi-wms-mp_R_1_0_3_0 emi-wms-nagios_R_1_0_0_3 emi-wms-purger_R_3_3_2_1 emi-yaim-wms_R_4_1_6_1 glite-wms-utils-exception_R_3_2_2_2 glite-jobid-api-cpp_R_1_1_3_1 glite-wms-utils-classad_R_3_2_2_2 glite-jdl-api-cpp_R_3_2_6_1

  • EMI Major Release: EMI 1 (Kebnekaise)

  • Platform: sl5 epel

  • Certification report: not yet available

  • Outcome: Certification under way

Deployment Tests

Clean installation

  • Starting from a SL5 x86_64 kernel machine:
[root@emi-demo12 ~]# cat /etc/redhat-release 
Scientific Linux SL release 5.7 (Boron)
[root@emi-demo12 ~]# uname -a
Linux emi-demo12.cnaf.infn.it 2.6.18-274.12.1.el5 #1 SMP Tue Nov 29 11:14:39 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
[root@emi-demo12 ~]# wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -O /tmp/emi-key_gd.asc
[root@emi-demo12 ~]# rpm --import /tmp/emi-key_gd.asc

Update

[root@cert-26 ~]# cat /etc/redhat-release
Scientific Linux release 5.8 (Boron)
[root@cert-26 ~]# uname -a
Linux cert-26.cnaf.infn.it 2.6.18-308.8.2.el5 #1 SMP Tue Jun 12 11:25:25 EDT 2012 x86_64 x86_64 x86_64 GNU/Linux
[root@cert-26 ~]# wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -O /tmp/emi-key_gd.asc
--2012-06-28 15:15:46--  http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi
Risoluzione di emisoft.web.cern.ch... 137.138.139.27
Connessione a emisoft.web.cern.ch|137.138.139.27|:80... connesso.
HTTP richiesta inviata, in attesa di risposta... 200 OK
Lunghezza: 1726 (1,7K) [text/plain]
Salvataggio in: "/tmp/emi-key_gd.asc"

100%[===================================================================================================>] 1.726       --.-K/s   in 0s      

2012-06-28 15:15:46 (183 MB/s) - "/tmp/emi-key_gd.asc" salvato [1726/1726]

[root@cert-26 ~]# rpm --import /tmp/emi-key_gd.asc

LB_HOST="devel17.cnaf.infn.it:9000"
GLITE_LB_TYPE=proxy
  • /opt/glite/yaim/bin/yaim -c -s siteinfo/site-info.def -n WMS

Unit Tests

N/A: Tests will be available with EMI-2.

Basic Functionality tests

As ice doesn't start, the tests will only envisage submission to LCG-CEs.

Submission

Normal

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 15:27:37
===> Ended  : 15:30:17
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120625152737.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 15:57:22
===> Ended  : 16:07:35
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120625155722.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers2.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 16:05:58
===> Ended  : 16:37:49
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120625160558.log
[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating proxy ................................................................................ Done
Proxy Verify OK
Your proxy is valid until: Mon Jul  2 16:08:41 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ...................................................... Done

Your proxy is valid until Tue Jun 26 03:09:22 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:43
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:43
uri       : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 1
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 16:16:37
===> Ended  : 16:52:55
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120625161637.log

Proxy mode

Pointing the testsuite at cert-26.cnaf.infn.it:
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 


 Test 1B: Submit to a CREAM CE 


 Test 1C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: cert-26.cnaf.infn.it
===> Started: 17:24:15
===> Ended  : 17:57:55
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120628172415.log

ARC CE

[cristofori@ui ~]$ lcg-infosites --is egee-bdii.cnaf.infn.it --vo cms ce 
|grep arc
      68       0         16            4      16 
arc.univ.kiev.ua:2811/nordugrid-torque-arc
     768     408       3605          360    3605 
jade-cms.hip.fi:2811/nordugrid-GE-arc

[cristofori@ui ~]$ glite-wms-job-submit -e 
https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server -a -r 
jade-cms.hip.fi:2811/nordugrid-GE-arc firsttest.jdl

Connecting to the service 
https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo12.cnaf.infn.it:9000/qVg5rOfrToEKWFrVFbRgHg

==========================================================================


[cristofori@ui ~]$ glite-wms-job-status 
https://emi-demo12.cnaf.infn.it:9000/qVg5rOfrToEKWFrVFbRgHg


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : 
https://emi-demo12.cnaf.infn.it:9000/qVg5rOfrToEKWFrVFbRgHg
Current Status:     Scheduled
Status Reason:      Job successfully submitted over the Grid
Destination:        jade-cms.hip.fi:2811/nordugrid-GE-arc
Submitted:          Thu Jun 28 17:17:29 2012 CEST
==========================================================================


[cristofori@ui ~]$ glite-wms-job-status 
https://emi-demo12.cnaf.infn.it:9000/qVg5rOfrToEKWFrVFbRgHg


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : 
https://emi-demo12.cnaf.infn.it:9000/qVg5rOfrToEKWFrVFbRgHg
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        jade-cms.hip.fi:2811/nordugrid-GE-arc
Submitted:          Thu Jun 28 17:17:29 2012 CEST
==========================================================================

[cristofori@ui ~]$  glite-wms-job-output --dir ./ 
https://emi-demo12.cnaf.infn.it:9000/qVg5rOfrToEKWFrVFbRgHg

Connecting to the service 
https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

                         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo12.cnaf.infn.it:9000/qVg5rOfrToEKWFrVFbRgHg
have been successfully retrieved and stored in the directory:
/home/GUEST/cristofori/cristofori_qVg5rOfrToEKWFrVFbRgHg

================================================================================


[cristofori@ui ~]$ cat 
/home/GUEST/cristofori/cristofori_qVg5rOfrToEKWFrVFbRgHg/stderr.log
[cristofori@ui ~]$ cat 
/home/GUEST/cristofori/cristofori_qVg5rOfrToEKWFrVFbRgHg/stdout.log
cmsuser07

Jdl with DataRequirements

[capannini@cert-17 WMS-service]$ cat JDLs/data-req.jdl 
###########################################
#      JDL with Data Requirements         #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";

FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};

DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; 
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};

DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;
requirements = !RegExp(".*cream.*", other.GlueCEUniqueID);
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i -j JDLs/data-req.jdl
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) 


 Test 1A: Submit to an LCG-CE 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 17:22:13
===> Ended  : 17:26:54
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120625172213.log

Jdl with ISBBaseURI and OSBDestURI

[capannini@cert-17 certification.nocream]$ cat URI.jdl 
###########################################
#      JDL with ISBURI & OSBDestURI       #
###########################################

Executable = "exe.sh";
StdOutput = "std.out";
StdError = "std.err";

InputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/tmp";

FuzzyRank = true;
InputSandbox = {"exe.sh", "test1", "test2"};
OutputSandbox = {"std.out", "std.err"};
OutputSandboxDestURI = {"gsiftp://emi-demo11.cnaf.infn.it:2811/tmp/myjobOutput", "std.err"};


#requirements = ( other.GlueCEStateStatus == "Testing" ) &&  regexp("/cream", other.GlueCEUniqueID);
requirements = !regexp("/cream", other.GlueCEUniqueID);
DataAccessProtocol = "gsiftp";
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@cert-17 certification.nocream]$ scp tmp/exe.sh test1 test2 root@emi-demo11:/tmp
root@emi-demo11's password: 
exe.sh                                                                                                     100%   80     0.1KB/s   00:00    
test1                                                                                                      100%    6     0.0KB/s   00:00    
test2                                                                                                      100%    6     0.0KB/s   00:00    

[capannini@cert-17 certification.nocream]$ glite-wms-job-submit -a -c ~/wms_emi-demo12.conf URI.jdl 

Connecting to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo12.cnaf.infn.it:9000/6gZT7jcwMdEfFELEi3dDpA

==========================================================================

[capannini@cert-17 certification.nocream]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/6gZT7jcwMdEfFELEi3dDpA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/6gZT7jcwMdEfFELEi3dDpA
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        prod-ce-02.pd.infn.it:2119/jobmanager-lcglsf-cert
Submitted:          Tue Jun 26 11:34:18 2012 CEST
==========================================================================

[capannini@cert-17 certification.nocream]$ glite-wms-job-output https://emi-demo12.cnaf.infn.it:9000/6gZT7jcwMdEfFELEi3dDpA

Connecting to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo12.cnaf.infn.it:9000/6gZT7jcwMdEfFELEi3dDpA
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_6gZT7jcwMdEfFELEi3dDpA

================================================================================


[capannini@cert-17 certification.nocream]$ ls -l /tmp/jobOutput/capannini_6gZT7jcwMdEfFELEi3dDpA
totale 0
-rw-r--r-- 1 capannini emitestbed 0 26 giu 11:54 std.err

Log on emi-demo11:

[root@emi-demo11 siteinfoBKP]# cat /tmp/myjobOutput
6gZT7jcwMdEfFELEi3dDpA
total 36
-rwxr-xr-x 1 dteam021 dteam  80 Jun 26 11:35 exe.sh
-rw-r--r-- 1 dteam021 dteam 118 Jun 26 11:36 https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2f6gZT7jcwMdEfFELEi3dDpA.output
-rw-r--r-- 1 dteam021 dteam   0 Jun 26 11:36 std.err
-rw-r--r-- 1 dteam021 dteam  23 Jun 26 11:36 std.out
-rw-r--r-- 1 dteam021 dteam   6 Jun 26 11:35 test1
-rw-r--r-- 1 dteam021 dteam   6 Jun 26 11:35 test2
-rw------- 1 dteam021 dteam 103 Jun 26 11:35 tmp.dcIJc30890
-rw------- 1 dteam021 dteam   0 Jun 26 11:36 tmp.fEchX31965
-rw------- 1 dteam021 dteam   2 Jun 26 11:35 tmp.NjTgx30889
-rw------- 1 dteam021 dteam 103 Jun 26 11:36 tmp.rUzky31978
-rw------- 1 dteam021 dteam   2 Jun 26 11:36 tmp.sGHmx31972

===> Test PASSED

Jdl with ISBBaseURI and OSBBaseDestURI

[capannini@cert-17 certification.nocream]$ glite-wms-job-submit -a -c ~/wms_emi-demo12.conf BaseURI.jdl 

Connecting to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo12.cnaf.infn.it:9000/akrnbb99GGh4yRiZ7g5Ktw

==========================================================================

[capannini@cert-17 certification.nocream]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/akrnbb99GGh4yRiZ7g5Ktw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/akrnbb99GGh4yRiZ7g5Ktw
Current Status:     Done (Success)
Logged Reason(s):
    - 
    - Job terminated successfully
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        cmsrm-ce02.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert
Submitted:          Tue Jun 26 12:00:47 2012 CEST
==========================================================================

[capannini@cert-17 certification.nocream]$ glite-wms-job-output https://emi-demo12.cnaf.infn.it:9000/akrnbb99GGh4yRiZ7g5Ktw

Connecting to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

No output files to be retrieved for the job:
https://emi-demo12.cnaf.infn.it:9000/akrnbb99GGh4yRiZ7g5Ktw

================================================================================

On devel20:
[root@devel20 ~]# ls -lrt /tmp/
totale 16
drwxr-xr-x 2 root     root  4096 21 mar 11:32 hsperfdata_root
-rw-r--r-- 1 glite    glite    4 16 mag 10:36 glite-wms-workload_manager.pid
srwx------ 1 glite    glite    0 16 mag 10:36 lb_proxy_store.sock
srwx------ 1 glite    glite    0 16 mag 10:36 lb_proxy_serve.sock
srw------- 1 glite    glite    0 16 mag 10:36 dgpr_renew_155
drwxr-xr-x 2 glite    glite 4096 16 mag 10:36 condor-lock.devel200.38608921117066
-rw-r--r-- 1 dteam005 dteam  714 26 giu 12:16 std.out
-rw-r--r-- 1 dteam005 dteam    0 26 giu 12:16 std.err
srwx------ 1 glite    glite    0 26 giu 14:08 glite-lbproxy-ilog.sock
srwx------ 1 glite    glite    0 26 giu 14:08 glite-lb-notif.sock
===> Test PASSED

Jdl with AllowZippedISB

[capannini@cert-17 certification.nocream]$ glite-wms-job-submit --debug -a -c ~/wms_emi-demo12.conf AllowZIP.jdl 
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Vo read from proxy certificate extension
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - VirtualOrganisation value : dteam
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Configuration file: /home/capannini/wms_emi-demo12.conf - VirtualOrganisation, RetryCount, rank, requirements attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes"
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Loaded user configuration file:
 /home/capannini/wms_emi-demo12.conf
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Configuration file: //etc/glite-wms/dteam/glite_wmsui.conf - VirtualOrganisation, MyProxyServer attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes"
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Loaded Vo specific configuration file:
 //etc/glite-wms/dteam/glite_wmsui.conf
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Loaded Configuration values: 
 [
  JdlDefaultAttributes = 
   [
    PerusalFileEnable = false; 
    ShallowRetryCount = 10; 
    SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; 
    RetryCount = 3; 
    AllowZippedISB = true; 
    VirtualOrganisation = "dteam"; 
    rank =  -other.GlueCEStateEstimatedResponseTime; 
    MyProxyServer = "myproxy.cnaf.infn.it"; 
    requirements = true
   ]; 
  OutputStorage = "/tmp"; 
  ListenerStorage = "/tmp"; 
  ErrorStorage = "/var/tmp"; 
  WmProxyEndPoints = { "https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server" }
 ]
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Getting Endpoint URL from configuration file 
-----------------------------------------

Connecting to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server

-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Calling the WMProxy getVersion service
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - WMProxy Version: 3.3.6 
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Sending Proxy Request to https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Calling the WMProxy delegationns__getProxyReq service
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - delegationns__getProxyReq -  The proxy has been successfully retrieved
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Calling the WMProxy delegationns__putProxyReq service
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - The proxy has been successfully delegated with the identifier: n1u9-0gvhYUxoNK568Q38g
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Calling the WMProxy getTransferProtocols service
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - getTransferProtocols -  Available protocols: gsiftp, https
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - FileTransferProtocol not specified; using the default protocol: gsiftp
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - The JDL file is: /home/capannini/certification.nocream/AllowZIP.jdl
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Retrieving the list of the local ISB files from the user JDL 
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Total size of the ISB file(s) to be transferred to: 1126406
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Max single job size of the ISB file(s) to be transferred to: 1024000
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Checking the User-FreeQuota on the server 
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Calling the WMProxy getFreeQuota service
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - getFreeQuota -  User freequota not set on the server
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Getting the max ISB size from the server https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Calling the WMProxy getMaxInputSandboxSize service
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - getMaxInputSandboxSize -  Max ISB size information successfully retrieved
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - The max job size (1024000 bytes) doesn't exceed the max size limit of 100000000 bytes: File transfer is allowed
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - File archiving and file compression allowed by user in the JDL
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Registering JDL [ StdOutput = "std.out"; ShallowRetryCount = 2; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 1; Executable = "/bin/ls"; Type = "job"; Arguments = "-la"; AllowZippedISB = true; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank =  -other.GlueCEStateEstimatedResponseTime; ZippedISB = { "ISBfiles_ghd5_W4ac7r1ov9MxINSSw_0.tar.gz" }; OutputSandbox = { "std.out","std.err" }; InputSandbox = { "file:///home/capannini/certification.nocream/fileA","file:///home/capannini/certification.nocream/fileB","file:///home/capannini/certification.nocream/fileC","file:///home/capannini/certification.nocream/fileD","file:///home/capannini/certification.nocream/fileE" }; StdError = "std.err"; rank =  -other.GlueCEStateEstimatedResponseTime; MyProxyServer = "myproxy.cnaf.infn.it"; requirements = (  !regexp("/cream",other.GlueCEUniqueID) ) && ( true ) ]
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Registering the job to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Calling the WMProxy jobRegister service
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - The JobId is:  https://emi-demo12.cnaf.infn.it:9000/GsZGTdUyc4ywimUFlJBWiw
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Archiving the ISB files: /tmp/ISBfiles_ghd5_W4ac7r1ov9MxINSSw_0.tar
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - This archive file has been successfully created: /tmp/ISBfiles_ghd5_W4ac7r1ov9MxINSSw_0.tar
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:47 -I- PID: 5554 (Debug) - Compressing the file (.gz): /tmp/ISBfiles_ghd5_W4ac7r1ov9MxINSSw_0.tar
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - ISB ZIPPED file successfully created: /tmp/ISBfiles_ghd5_W4ac7r1ov9MxINSSw_0.tar.gz
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - Getting the SandboxDestinationURI from the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - Calling the WMProxy getSandboxDestURI service with gsiftp protocol 
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - getSandboxDestURI -  Destination URIs sucessfully retrieved
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - DestinationURI: gsiftp://emi-demo12.cnaf.infn.it:2811/var/SandboxDir/Gs/https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fGsZGTdUyc4ywimUFlJBWiw/input
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - FileTransfer (gsiftp): using globus-url-copy to transfer the local InputSandBox file(s) to the submission endpoint
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - File Transfer (gsiftp) 
 Command: /usr/bin/globus-url-copy
Source: file:///tmp/ISBfiles_ghd5_W4ac7r1ov9MxINSSw_0.tar.gz
Destination: gsiftp://emi-demo12.cnaf.infn.it:2811/var/SandboxDir/Gs/https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fGsZGTdUyc4ywimUFlJBWiw/input/ISBfiles_ghd5_W4ac7r1ov9MxINSSw_0.tar.gz
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - File Transfer (gsiftp) Transfer successfully done
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - Starting the job:  https://emi-demo12.cnaf.infn.it:9000/GsZGTdUyc4ywimUFlJBWiw
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - Calling the WMProxy jobStart service
-----------------------------------------
-----------------------------------------
26 June 2012, 14:15:48 -I- PID: 5554 (Debug) - jobStart -  The job has been successfully started
-----------------------------------------

====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo12.cnaf.infn.it:9000/GsZGTdUyc4ywimUFlJBWiw

==========================================================================

      *** Log file created ***
Possible Errors and Debug messages have been printed in the following file:
/var/tmp/glite-wms-job-submit_504_5554_20120626_14-15-47.log


[capannini@cert-17 certification.nocream]$ glite-wms-job-info --jdl https://emi-demo12.cnaf.infn.it:9000/GsZGTdUyc4ywimUFlJBWiw|grep Allow
  AllowZippedISB = true; 

[capannini@cert-17 certification.nocream]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/GsZGTdUyc4ywimUFlJBWiw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/GsZGTdUyc4ywimUFlJBWiw
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job terminated successfully
Destination:        grid-ce.lns.infn.it:2119/jobmanager-lcgpbs-cert
Submitted:          Tue Jun 26 14:15:43 2012 CEST
==========================================================================

[capannini@cert-17 certification.nocream]$ glite-wms-job-output https://emi-demo12.cnaf.infn.it:9000/GsZGTdUyc4ywimUFlJBWiw

Connecting to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emi-demo12.cnaf.infn.it:9000/GsZGTdUyc4ywimUFlJBWiw
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/capannini_GsZGTdUyc4ywimUFlJBWiw

================================================================================


[capannini@cert-17 certification.nocream]$ ls -l /tmp/jobOutput/capannini_GsZGTdUyc4ywimUFlJBWiw
totale 4
-rw-r--r-- 1 capannini emitestbed    0 26 giu 14:57 std.err
-rw-r--r-- 1 capannini emitestbed 1026 26 giu 14:58 std.out
[capannini@cert-17 certification.nocream]$ cat /tmp/jobOutput/capannini_GsZGTdUyc4ywimUFlJBWiw/std.out 
total 1152
drwxr-xr-x  2 dteam050 dteam    4096 Jun 26 14:16 .
drwx------  5 dteam050 dteam    4096 Jun 26 14:16 ..
-rw-r--r--  1 dteam050 dteam    2083 Jun 26 14:16 .BrokerInfo
-rw-r--r--  1 dteam050 dteam       2 Jun 26 14:16 fileA
-rw-r--r--  1 dteam050 dteam       2 Jun 26 14:16 fileB
-rw-r--r--  1 dteam050 dteam 1024000 Jun 26 14:16 fileC
-rw-r--r--  1 dteam050 dteam  102400 Jun 26 14:16 fileD
-rw-r--r--  1 dteam050 dteam       2 Jun 26 14:16 fileE
-rw-r--r--  1 dteam050 dteam     118 Jun 26 14:16 https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fGsZGTdUyc4ywimUFlJBWiw.output
-rw-r--r--  1 dteam050 dteam       0 Jun 26 14:16 std.err
-rw-r--r--  1 dteam050 dteam       0 Jun 26 14:16 std.out
-rw-------  1 dteam050 dteam     103 Jun 26 14:16 tmp.QpWko27495
-rw-------  1 dteam050 dteam       0 Jun 26 14:16 tmp.RPbTB27493
-rw-------  1 dteam050 dteam     103 Jun 26 14:16 tmp.UeDcI27480
-rw-------  1 dteam050 dteam       2 Jun 26 14:16 tmp.wmahM27479
-rw-------  1 dteam050 dteam       2 Jun 26 14:16 tmp.WStXL27494
====> Test PASSED

Jdl with ExpiryTime

[capannini@cert-17 certification.nocream]$ date +%s
1340716614

[capannini@cert-17 certification.nocream]$ cat ExpiryTime.jdl 
###########################################
#       JDL with ExpiryTime attribute     #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";

InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"};
OutputSandbox = {"std.out", "std.err"};

requirements = false;

ExpiryTime = 1340716700;

RetryCount = 1;
ShallowRetryCount = 2;
[capannini@cert-17 certification.nocream]$ glite-wms-job-submit -a -c ~/wms_emi-demo12.conf ExpiryTime.jdl 

Connecting to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo12.cnaf.infn.it:9000/t3PS5qg5zqD0SeI0cMKqmQ

==========================================================================

[capannini@cert-17 certification.nocream]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/t3PS5qg5zqD0SeI0cMKqmQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/t3PS5qg5zqD0SeI0cMKqmQ
Current Status:     Waiting 
Status Reason:      BrokerHelper: no compatible resources
Submitted:          Tue Jun 26 15:17:36 2012 CEST
==========================================================================

[capannini@cert-17 certification.nocream]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/t3PS5qg5zqD0SeI0cMKqmQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/t3PS5qg5zqD0SeI0cMKqmQ
Current Status:     Aborted 
Status Reason:      request expired
Submitted:          Tue Jun 26 15:17:36 2012 CEST
==========================================================================
===> Test PASSED

Collection

Bulk submission

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 12:34:29
===> Ended  : 13:23:54
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120628123429.log
You have new mail in /var/spool/mail/capannini
[capannini@cert-17 WMS-service]$ 
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 14:02:01
===> Ended  : 14:30:49
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120628140201.log

[capannini@cert-17 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating proxy ........................................................................................................ Done
Proxy Verify OK
Your proxy is valid until: Thu Jul  5 14:13:06 2012
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it.
[capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
Contacting  voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ........................................................................................... Done

Your proxy is valid until Fri Jun 29 01:13:41 2012
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504.
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 10:59:49
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 11:58:48
uri       : voms2.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 2
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) 


 Test 2A: Submit to an LCG-CE 


 Test 2B: Submit to a CREAM CE 


 Test 2C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 14:14:05
===> Ended  : 14:27:05
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120628141405.log

All in a jdl

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 14:38:29
===> Ended  : 16:18:33
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120628143829.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes 


 Test 7A: Submit to an LCG-CE 


 Test 7B: Submit to a CREAM CE 


 Test 7C: Submit without restrictions 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 16:23:24
===> Ended  : 17:07:42
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120628162324.log

Dag job

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 10:59:01
===> Ended  : 12:02:52
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120702105901.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu  -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 10:59:21
===> Ended  : 12:03:00
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120702105921.log

[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 10:59:49
===> Ended  : 12:02:53
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120702105949.log

Regression tests

Bugs attached to the task

bug #92657: some sensible information should be logged on syslog Fix certified

Submitting a job to emi-demo12:
[root@emi-demo12 ~]# tail -f /var/log/messages|egrep "wmproxy|manager"
Jun 29 11:02:44 emi-demo12 glite_wms_wmproxy_server[1901]: submission from cert-17.cnaf.infn.it, DN=/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini, FQAN=/dteam/Role=NULL/Capability=NULL, userid=18705 for jobid=https://emi-demo12.cnaf.infn.it:9000/WRz5e73vqS_RobvGQeDI1g
Jun 29 11:02:46 emi-demo12 glite-wms-workload_manager: jobid https://emi-demo12.cnaf.infn.it:9000/WRz5e73vqS_RobvGQeDI1g was matched to destination prod-ce-02.pd.infn.it:2119/jobmanager-lcglsf-cert

bug #92742: submission to ARC broken again Fix certified

See ARC CE section.

bug #92922: EMI-1 WMS does not propagate user job exit code Fix certified

[capannini@cert-17 ~]$ cat touch.jdl 
[ 
Executable = "/bin/touch" ; 
Arguments = "/foo" ; 
Retrycount = 2; 
usertags = [ exe = "touch" ]; 
VirtualOrganisation="dteam"; 
requirements = ! RegExp("cream.*", other.GlueCEUniqueID); 
] 

[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/-fsmLpeNqrNVwSkXj1aBBw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/-fsmLpeNqrNVwSkXj1aBBw
Current Status:     Done (Exit Code !=0)
Exit code:          1
Status Reason:      Warning: job exit code != 0
Destination:        virgo-ce.roma1.infn.it:2119/jobmanager-lcgpbs-cert
Submitted:          Fri Jun 29 11:09:07 2012 CEST
==========================================================================

bug #92924: Condor gridmanager keeps crashing on wrong assertions about some ldap attributes ordering Fix certified

[cristofori@ui ~]$ glite-wms-job-submit -e 
https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server -a -r 
korundi.grid.helsinki.fi:2811/nordugrid-GE-mgrid firsttest.jdl

Connecting to the service 
https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo12.cnaf.infn.it:9000/CeHAR7n8Ubmh5dOCaKXYCg

==========================================================================



[root@emi-demo12 ~]# grep STARTING 
/var/local/condor/log/GridmanagerLog.glite |tail
06/28 19:43:07 ** condor_gridmanager (CONDOR_GRIDMANAGER) STARTING UP
06/28 21:43:43 ** condor_gridmanager (CONDOR_GRIDMANAGER) STARTING UP
06/28 23:44:14 ** condor_gridmanager (CONDOR_GRIDMANAGER) STARTING UP
06/29 01:44:36 ** condor_gridmanager (CONDOR_GRIDMANAGER) STARTING UP
06/29 03:45:05 ** condor_gridmanager (CONDOR_GRIDMANAGER) STARTING UP
06/29 05:45:36 ** condor_gridmanager (CONDOR_GRIDMANAGER) STARTING UP
06/29 07:45:58 ** condor_gridmanager (CONDOR_GRIDMANAGER) STARTING UP
06/29 09:46:26 ** condor_gridmanager (CONDOR_GRIDMANAGER) STARTING UP
06/29 11:46:59 ** condor_gridmanager (CONDOR_GRIDMANAGER) STARTING UP
06/29 13:47:30 ** condor_gridmanager (CONDOR_GRIDMANAGER) STARTING UP


[root@emi-demo12 ~]# locate grid_monitor.sh|xargs  ls -lu
-rwxr-xr-x 1 root root 42728 Jun  6 17:44 
/opt/condor-7.4.2/libexec/glite/grid_monitor.sh
-rwxr-xr-x 1 root root 41918 Jun 29 11:09 
/opt/condor-7.4.2/sbin/grid_monitor.sh
lrwxrwxrwx 1 root root    29 Jun 29 15:26 /usr/sbin/grid_monitor.sh -> 
/opt/lcg/sbin/grid_monitor.sh

[root@emi-demo12 ~]# date
ven giu 29 15:31:09 CEST 2012

bug #93673: In some circumstances ICE's threads can block Fix not certified

-- CristinaAiftimiei - 2012-06-19

Topic attachments
ISorted ascending Attachment Action Size Date Who Comment
Unknown file formatlog WMSService-TS_20120625152737.log manage 6.0 K 2012-06-25 - 14:01 FabioCapannini  
Unknown file formatlog WMSService-TS_20120625155722.log manage 16.8 K 2012-06-25 - 14:27 FabioCapannini  
Unknown file formatlog WMSService-TS_20120625160558.log manage 47.7 K 2012-06-25 - 14:48 FabioCapannini  
Unknown file formatlog WMSService-TS_20120625161637.log manage 53.9 K 2012-06-25 - 15:16 FabioCapannini  
Unknown file formatlog WMSService-TS_20120625172213.log manage 8.8 K 2012-06-25 - 15:37 FabioCapannini  
Unknown file formatlog WMSService-TS_20120628172415.log manage 51.8 K 2012-06-29 - 08:41 FabioCapannini  
Unknown file formatlog config.log manage 9.1 K 2012-06-28 - 10:31 FabioCapannini  
Unknown file formatlog config1.log manage 8.5 K 2012-06-28 - 14:49 FabioCapannini  
Unknown file formatlog configure.log manage 6.1 K 2012-06-25 - 10:06 FabioCapannini  
Unknown file formatlog install.log manage 123.3 K 2012-06-28 - 10:04 FabioCapannini  
Unknown file formatlog update.log manage 17.0 K 2012-06-28 - 13:39 FabioCapannini  
Compressed Zip archivetgz all.tgz manage 11.4 K 2012-06-28 - 15:21 FabioCapannini  
Compressed Zip archivetgz coll.tgz manage 8.9 K 2012-06-28 - 12:37 FabioCapannini  
Compressed Zip archivetgz dag.tgz manage 13.4 K 2012-07-02 - 10:32 FabioCapannini  
Edit | Attach | PDF | History: r27 | r17 < r16 < r15 < r14 | Backlinks | Raw View | More topic actions...
Topic revision: r15 - 2012-07-02 - FabioCapannini
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback