WMS v. 3.5 (SL6) test report

Summary

• Component: WMS 3.5

• Savannah task: 34080

• ETICS Subsystem Configuration Name: emi-wms_R_3_5_0

• VCS Tag:

• EMI Major Release: EMI 3

• Platform: SL6/x86_64 + EPEL

• Outcome: Ongoing

Deployment Tests

Clean installation

Installation - PASSED

[root@emitestbed44 ~]# cat /etc/yum.repos.d/emi-3-rc-sl6.repo 
###################################
# File managed by puppet
# it will be overwritten by puppet
###################################


[EMI-3-testing-base]
name=EMI 3 Testing Base Repository
baseurl=http://emisoft.web.cern.ch/emisoft/dist/EMI/testing/3/sl6/$basearch/base
#gpgkey=http://emisoft.web.cern.ch/emisoft/dist/EMI/3/RPM-GPG-KEY-emi
priority=45
protect=1
enabled=1
gpgcheck=0

[EMI-3-testing-third-party]
name=EMI 3 Testing Third-Party Repository
baseurl=http://emisoft.web.cern.ch/emisoft/dist/EMI/testing/3/sl6/$basearch/third-party
#gpgkey=http://emisoft.web.cern.ch/emisoft/dist/EMI/3/RPM-GPG-KEY-emi
protect=1
enabled=1
priority=45
gpgcheck=0

[Oracle-11]
name=Oracle Repository (not for distribution)
baseurl=http://emisoft.web.cern.ch/emisoft/dist/elcaro/oracle-instantclient/11/repo/sl6/$basearch
gpgcheck=0
protect=1
enabled=1
priority=45

• install.sl6.log: install.sl6.log

Configuration - PASSED

export GLITE_LB_MSG_BROKER=false
/opt/glite/yaim/bin/yaim -c -s site-info.def -n WMS

• yaimlog.sl6: yaimlog.sl6

Upgrade - PASSED

• update_wms_3.5.0_sl6.txt: Update log

Unit Tests -

• Report available at [[][WMS 3.5 unit tests]]

Basic Functionality tests

Submission

Normal - PASSED

$  python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 14:57:09
===> Ended  : 14:58:20
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130215145709.log

• WMSService-TS_20130215145709.log

Proxy Mode - PASSED

$  python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 1: Submit a normal job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 15:14:46
===> Ended  : 15:16:24
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130215151446.log

• WMSService-TS_20130215151446.log:

Jdl attributes - FAILED

Test 4 fails because lxbra1910.cern.ch is not published in the top bdii.

$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 1,2,4,5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle for normal job with non default jdl files 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Jdl with AllowZippedISB - CE_CREAM 

===> ERROR: Message Archiving the ISB files not found

 Test 2: Jdl with ExpiryTime 


 Test 4: Jdl with DataRequirements 

===> ERROR: Command lfc-mkdir /grid/testers.eu-emi.eu/20130219133021 failed. Failure message: cannot create /grid/testers.eu-emi.eu/20130219133021: Could not secure the connection

 Test 5: Jdl with InputSandboxBaseURI 


 Test 5: Jdl with InputSandboxBaseURI - CE_CREAM 


 Test 6: Jdl with OutputSandboxBaseDestURI 


 Test 6: Jdl with OutputSandboxBaseDestURI - CE_CREAM 


 Test 7: Jdl with OutputSandboxDestURI 


 Test 7: Jdl with OutputSandboxDestURI - CE_CREAM 

===> 
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 13:30:21
===> Ended  : 13:40:47
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 2 test(s) fail(s): ['Test 1: Jdl with AllowZippedISB', 'Test 4: Jdl with DataRequirements'] <<< 
===> 
===> Test log file is WMSService-TS_20130219133021.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219133021/errors.log
===> 
===>  Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219133021 has not been cleaned for debug purpose

• WMSService-Test_20130219133021_errors.log:

Collection

Bulk submission - PASSED

$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 2: Submit a bulk of jobs - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 16:54:41
===> Ended  : 16:55:52
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130215165441.log

• WMSService-TS_20130215165441.log

All in a jdl - PASSED

$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 7: Submit a bulk of jobs using a single jdl with al the jdls of nodes - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 17:00:14
===> Ended  : 17:01:57
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130215170014.log

• WMSService-TS_20130215170014.log

Parametric job - PASSED

$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 3: Submit a parametric job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 17:17:01
===> Ended  : 17:19:18
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130215171701.log

• WMSService-TS_20130215171701.log

Dag - PASSED

$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 4: Submit a DAG job 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 17:23:27
===> Ended  : 17:33:46
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130215172327.log

• WMSService-TS_20130215172327.log

Parallel job - PASSED

# cat wms_emitestbed44.conf
WmsClient = [
ErrorStorage="/var/tmp";
OutputStorage=  "/tmp";
ListenerStorage="/tmp";
virtualorganisation="testers.eu-emi.eu";
#requirements = other.GlueCEStateStatus == "Production";
RetryCount = 0;
WMProxyEndPoints = {"https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server"};
rank = -other.GlueCEStateEstimatedResponseTime;
];

# cat mpijob.jdl
### Submit parallel job 2 CPUs
### Job to be submitted:
Executable = "/usr/bin/mpi-start";
CPUNumber  = 2;
Arguments  = "-t dummy -- counter.sh cpus 2";
InputSandbox = {"counter.sh"};
OutputSandbox = {"std.out", "std.err"};
StdOutput = "std.out";
StdError = "std.err";
Requirements = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment)
               && other.GlueCEInfoJobManager == "pbs";

$ glite-wms-job-submit -a -c wms_emitestbed44.conf mpijob.jdl

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emitbrc-lamb4.civ.zcu.cz:9000/Q2dNhH-vwdk1FBxeyp1w5w

==========================================================================

$  glite-wms-job-status https://emitbrc-lamb4.civ.zcu.cz:9000/Q2dNhH-vwdk1FBxeyp1w5w


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emitbrc-lamb4.civ.zcu.cz:9000/Q2dNhH-vwdk1FBxeyp1w5w
Current Status:     Done(Success)
Logged Reason(s):
    - job completed
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        emitestbed29.cnaf.infn.it:8443/cream-pbs-demo
Submitted:          Mon Feb 18 11:42:05 2013 CET
==========================================================================

Forwarding parameters for parallel jobs - PASSED

Test 4 fails because there are no compatible resources.

$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 8 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 8: Testing forwarding parameters for parallel jobs  Case 1 - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 2 - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 3  - CE_CREAM 


 Set 8: Testing forwarding parameters for parallel jobs Case 4 - CE_CREAM 

===> ERROR: Command glite-wms-job-logging-info -v 2 --event Transfer https://emitbrc-lamb4.civ.zcu.cz:9000/bnhcXU2AzUBuJJUtGuVXpA failed. Failure message: **** Warning: API_NATIVE_ERROR ****  
Error while calling the "Eve::queryEvents" native api 
Unable to retrieve any status information from: emitbrc-lamb4.civ.zcu.cz: glite.lb.Exception: edg_wll_QueryEvents: No such file or directory: no matching events found
   at glite::lb::ServerConnection::queryEvents[./src/ServerConnection.cpp:848]


**** Warning: API_NATIVE_ERROR ****  
Error while calling the "Eve::queryEvents" native api 
Unable to retrieve any matching information for jobid: https://emitbrc-lamb4.civ.zcu.cz:9000/bnhcXU2AzUBuJJUtGuVXpA


===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 11:27:18
===> Ended  : 12:03:22
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Set 8: Testing forwarding parameters for parallel jobs'] <<< 
===> 
===> Test log file is WMSService-TS_20130219112718.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219112718/errors.log
===> 
===>  Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219112718 has not been cleaned for debug purpose

• WMSService-Test_20130219112718_errors.log

Perusal - PASSED

$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test a complete job cycle: from submission to get output 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Set 6: Submit a perusal job - CE_CREAM 

===> 
===> Test: WMS-job-cycle.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 12:23:54
===> Ended  : 12:58:11
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218122354.log

• WMSService-TS_20130218122354.log

Delegation - PASSED

Test 4 fails because the failure message has changed. Now it is 'Proxy exception: the proxy has expired'.

$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: Test delegation operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Check --autm-delegation option 


 Test 2: Check --delegationid option 


 Test 3: Try to delegate with a short proxy and check the validity 


 Test 4: Works with expired proxy 

===> ERROR: TEST FAILS. Job has been submitted with the expired delegation

 To run this test you have to set the ROLE attribute for user proxy role at configuration file 

===> 
===> Test: WMS-delegation-test.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 12:16:33
===> Ended  : 12:17:42
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 4: Works with expired proxy'] <<< 
===> 
===> Test log file is WMSService-TS_20130219121633.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219121633/errors.log
===> 
===>  Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219121633 has not been cleaned for debug purpose

• WMSService-Test_20130219121633_errors.lo

List-match - PASSED

$ python WMS-listmatch-test.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 


 Test 7: try a matching with data requirements 


 Test 8: try a gang-matching 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 14:39:45
===> Ended  : 14:40:06
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218143945.log

• WMSService-TS_20130218143945.log

$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 


 Test 7: try a matching with data requirements 


 Test 8: try a gang-matching 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 14:43:06
===> Ended  : 14:43:28
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218144306.log

• WMSService-TS_20130218144306.log

[bertocco@emitestbed16 WMS-service]$ myproxy-init -d
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
Creating proxy ....................................................................................... Done
Proxy Verify OK
Your proxy is valid until: Mon Feb 25 14:52:04 2013
Enter MyProxy pass phrase:
Verifying - Enter MyProxy pass phrase:
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco now exists on emitb2.ics.muni.cz.
[bertocco@emitestbed16 WMS-service]$ myproxy-logon -d --voms testers.eu-emi.eu
Enter MyProxy pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy/CN=proxy/CN=proxy
Contacting  emitestbed01.cnaf.infn.it:15002 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed01.cnaf.infn.it] "testers.eu-emi.eu" Done
Creating proxy ........................................................................................................ Done

Your proxy is valid until Tue Feb 19 02:50:28 2013
A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco in /tmp/x509up_u509.
[bertocco@emitestbed16 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u509
timeleft  : 11:57:50
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO testers.eu-emi.eu extension information ===
VO        : testers.eu-emi.eu
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
issuer    : /C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed01.cnaf.infn.it
attribute : /testers.eu-emi.eu/Role=NULL/Capability=NULL
timeleft  : 11:57:50
uri       : emitestbed01.cnaf.infn.it:15002

$ python WMS-listmatch-test.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job ListMatch Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: check if glite-wms-job-list-match command exists 


 Test 2: test a simple matching 


 Test 3: check --delegationid option 


 Test 4: exclude a CE from the match 


 Test 5: try a failure matching (Requirements == false) 


 Test 6: try a matching with EnableWMSFeedback attribute true 


 Test 7: try a matching with data requirements 


 Test 8: try a gang-matching 

===> 
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 14:52:44
===> Ended  : 14:53:03
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218145244.log

• WMSService-TS_20130218145244.log

Prologue and epilogue jobs - FAILED

$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test prologue attribute - CE_CREAM 

===> ERROR: TEST FAILS. Job finishes with status: Done(Success) cannot retrieve output

 Test 2: Test epilogue attribute - CE_CREAM 

===> ERROR: TEST FAILS. Job finishes with status: Done(Success) cannot retrieve output

 Test 3: Test prologue and epilogue attributes - CE_CREAM 

===> ERROR: TEST FAILS. Job finishes with status: Done(Success) cannot retrieve output
===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 14:23:06
===> Ended  : 14:28:48
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 3 test(s) fail(s): ['Test 1: Test prologue attribute', 'Test 2: Test epilogue attribute', 'Test 3: Test prologue and epilogue attributes'] <<< 
===> 
===> Test log file is WMSService-TS_20130219142306.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/c
===> 
===>  Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130219142306 has not been cleaned for debug purpose

• WMSService-Test_20130219142306_errors.log

Shallow and deep resubmission - PASSED

$ python WMS-job-resubmit.py -c wms-command.conf -V dteam -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try a shallow resubmission - CE_CREAM 


 Test 2: Try a deep resubmission - CE_CREAM 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 15:10:53
===> Ended  : 15:23:07
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218151053.log

• WMSService-TS_20130218151053.log

$ python WMS-job-resubmit.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try a shallow resubmission - CE_CREAM 


 Test 2: Try a deep resubmission - CE_CREAM 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 15:25:17
===> Ended  : 15:40:02
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218152517.log

• WMSService-TS_20130218152517.log

$ python WMS-job-resubmit.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Resubmission Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Try a shallow resubmission - CE_CREAM 


 Test 2: Try a deep resubmission - CE_CREAM 

===> 
===> Test: WMS-job-resubmit.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 15:28:53
===> Ended  : 15:42:37
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218152853.log

• WMSService-TS_20130218152853.log

Cancel - PASSED

Cancel operation sometimes fail. It is due to the testsuite implementation: the test waits that the job is in a final status for a fixed period of time, if it is not in a final state after X time it fails. The right implementation should be "wait until a final status is riched and then try to cancel".

$ python WMS-job-cancel.py -c wms-command.conf -V dteam -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Cancel Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try to cancel a normal job 


 Test 2: Try to cancel a DAG job 


 Test 3: Try to cancel one node of a DAG job 


 Test 4: Try to cancel a collection job 


 Test 5: Try to cancel one node of a collection job 

===> ERROR: TEST FAILS. Job's https://emitbrc-lamb4.civ.zcu.cz:9000/c43G-mrOKhsJ4oXqoX19KQ status is wrong: Running

 Test 6: Try to cancel a parametric job 


 Test 7: Try to cancel one node of a parametric job 


 Test 8: Try to cancel a MPI job 

===> 
===> Test: WMS-job-cancel.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 16:16:31
===> Ended  : 16:35:56
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 5: Try to cancel one node of a collection job'] <<< 
===> 
===> Test log file is WMSService-TS_20130218161631.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218161631/errors.log
===> 
===>  Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218161631 has not been cleaned for debug purpose

• WMSService-Test_20130218161631_errors.log

$ python WMS-job-cancel.py -c wms-command.conf -V dteam -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Job Cancel Testing 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Try to cancel a normal job 


 Test 2: Try to cancel a DAG job 


 Test 3: Try to cancel one node of a DAG job 


 Test 4: Try to cancel a collection job 


 Test 5: Try to cancel one node of a collection job 


 Test 6: Try to cancel a parametric job 


 Test 7: Try to cancel one node of a parametric job 

===> ERROR: TEST FAILS. Job's https://emitbrc-lamb4.civ.zcu.cz:9000/1a9gSpo8WUBuVPz0wXmpIw status is wrong: Running

 Test 8: Try to cancel a MPI job 

===> 
===> Test: WMS-job-cancel.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 17:10:03
===> Ended  : 17:37:11
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 1 test(s) fail(s): ['Test 7: Try to cancel one node of a parametric job'] <<< 
===> 
===> Test log file is WMSService-TS_20130218171003.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218171003/errors.log
===> 
===>  Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218171003 has not been cleaned for debug purpose

• WMSService-Test_20130218171003_errors.log

Proxy renewal - PASSED

On WMS:
[root@emitestbed44 siteinfo]# /etc/init.d/glite-wms-ice stop
stopping ICE... ok
[root@emitestbed44 siteinfo]#  rm -rf /var/ice/persist_dir/*
[root@emitestbed44 siteinfo]#  /etc/init.d/glite-wms-ice start
starting ICE... ok
[root@emitestbed44 siteinfo]# rm -f /var/glite/spool/glite-renewd/*

On UI:
[bertocco@emitestbed16 WMS-service]$ voms-proxy-init --voms testers.eu-emi.eu
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
Creating temporary proxy ......................... Done
Contacting  emitestbed07.cnaf.infn.it:15002 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed07.cnaf.infn.it] "testers.eu-emi.eu" Done
Creating proxy .............................................................. Done

Your proxy is valid until Wed Feb 20 03:08:48 2013
[bertocco@emitestbed16 WMS-service]$ myproxy-init -s emitb2.ics.muni.cz -d -n
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
Creating proxy ..................... Done
Proxy Verify OK
Your proxy is valid until: Tue Feb 26 15:08:58 2013
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco now exists on emitb2.ics.muni.cz.

$ python WMS-proxy-renewal.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test proxy renewal operation 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test proxy renewal - CE_CREAM 


 Test 2: Test proxy renewal without setting MYPROXYSERVER - CE_CREAM 

===> 
===> Test: WMS-proxy-renewal.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 15:09:08
===> Ended  : 15:40:09
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130219150908.log

• WMSService-TS_20130219150908.log

Limiter mechanism - Not working

Not able to make the testsuite running. It seems to be a problem in the parsing of the return value of submission command.

$  python WMS-limiter-mechanism.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1,2,3,4,6,7,8
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Limiter Mechanism 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Test option --load1 threshold for load average (1 min) 

===> ERROR: Faulure reason is not 'System load is too high:' as expected.

 Test 2: Test option --load5 threshold for load average (5 min) 

===> ERROR: Faulure reason is not 'System load is too high:' as expected.

 Test 3: Test option --load15 threshold for load average (15 min) 

===> ERROR: Faulure reason is not 'System load is too high:' as expected.

 Test 4: Test option --memusage threshold for memory usage (%) 

===> ERROR: Faulure reason is not 'System load is too high:' as expected.

 Test 6: Test option --ftpconn threshold for number of FTP connections 

===> ERROR: Faulure reason is not 'System load is too high:' as expected.

 Test 7: Test option --diskusage threshold for disk usage (%) 

===> ERROR: Faulure reason is not 'System load is too high:' as expected.

 Test 8: Test option --fdnum threshold for used file descriptor 

===> ERROR: Faulure reason is not 'System load is too high:' as expected.
===> 
===> Test: WMS-limiter-mechanism.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 13:46:10
===> Ended  : 13:46:52
===> 
===>     >>> TEST FAILED <<<
===> 
===>  >>> failure reason: 7 test(s) fail(s): ['Test 1: Test option --load1 threshold for load average (1 min)', 'Test 2: Test option --load5 threshold for load average (5 min)', 'Test 3: Test option --load15 threshold for load average (15 min)', 'Test 4: Test option --memusage threshold for memory usage (%)', 'Test 6: Test option --ftpconn threshold for number of FTP connections', 'Test 7: Test option --diskusage threshold for disk usage (%)', 'Test 8: Test option --fdnum threshold for used file descriptor'] <<< 
===> 
===> Test log file is WMSService-TS_20130220134610.log
===> Error messages have been written in /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130220134610/errors.log
===> 
===>  Test directory /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130220134610 has not been cleaned for debug purpose

• WMSService-Test_20130220134610_errors.log

Job purge - PASSED

$ python WMS-check-purger.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS Purge Mechanism 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 3: Test proxy cache purging 

===> 
===> Test: WMS-check-purger.py
===> WMS: emitestbed44.cnaf.infn.it
===> Started: 16:23:43
===> Ended  : 16:23:48
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20130218162343.log

• WMSService-TS_20130218162343.log

Configuration file - Skip

It does not exist a wms 3.5 configuration test

Feedback -

Performance test -

Stress test -

Results -

Regression tests

Bugs attached to this task

Bug #96136: WMS: stops accepting submissions when no swap is available - PASSED

[root@emitestbed44 ~]# /usr/sbin/glite_wms_wmproxy_load_monitor --oper jobSubmit |grep -i swap
Threshold for Swap Usage: 95 => Detected value for Swap Usage: 0.00%
[root@emitestbed44 ~]#  cat /proc/swaps
Filename            Type      Size   Used   Priority
/dev/dm-1                               partition   8388600   0   -1
[root@emitestbed44 ~]# swapoff /dev/dm-1
[root@emitestbed44 ~]# cat /proc/swaps
Filename            Type      Size   Used   Priority
[root@emitestbed44 ~]# /usr/sbin/glite_wms_wmproxy_load_monitor --oper jobSubmit|grep -i swap
Threshold for Swap Usage: 95 => Detected value for Swap Usage: 0.00%

On UI:
$ glite-wms-job-submit -a --config /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130220112411/wms.conf /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130220112411/example.jdl

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emitbrc-lamb4.civ.zcu.cz:9000/_xxDxiDioX1t1Ifr0XN48A

==========================================================================

Bug #97319 Set asyncjobstart=false to avoid lost jobs - PASSED

[root@emitestbed44 ~]#  grep -i asyncj /etc/glite-wms/glite_wms.conf
    AsyncJobStart  =  false;

Bug #100176 classad plugin functions are broken - PASSED

List-match for the following jdl:

[
Executable = "/bin/echo";
Arguments = "Hello";
StdOutput = "out.log";
StdError = "err.log";
InputSandbox = {};
OutputSandbox = {"out.log", "err.log"};
leftVOMS_FQAN="/gridit/ansys/Role=NULL/Capability=NULL";
rightGlueCEACBR= { "VOMS:/gridit/ansys", "VOMS:/gridit/ansys/Role=SoftwareManager"};
requirements = fqanMember(strcat("VOMS:", leftVOMS_FQAN), rightGlueCEACBR) is true;
myproxyserver="";
ShallowRetryCount = -1;
]

if the number of returned queues is more than 0 then the bug is fixed.

$ glite-wms-job-list-match -a --config /home/bertocco/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130220112411/wms.conf /home/bertocco/jdl/100176.jdl 

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server

==========================================================================

           COMPUTING ELEMENT IDs LIST 
 The following CE(s) matching your job requirements have been found:

   *CEId*
 - emi-demo08.cnaf.infn.it:8443/cream-lsf-cert
 - emi-demo08.cnaf.infn.it:8443/cream-lsf-demo
 - emi-demo08.cnaf.infn.it:8443/cream-lsf-testers
 - emi-demo13.cnaf.infn.it:8443/cream-pbs-demo
 - emitestbed29.cnaf.infn.it:8443/cream-pbs-demo
 - emitestbed32.cnaf.infn.it:8443/cream-lsf-cert
 - emitestbed32.cnaf.infn.it:8443/cream-lsf-demo
 - emitestbed32.cnaf.infn.it:8443/cream-lsf-testers
 - emitestbed02.cnaf.infn.it:8443/cream-sge-emitesters
 - emitestbed09.cnaf.infn.it:8443/cream-sge-emitesters

==========================================================================

Bug #98724 ICE removes its pid file at the start() instead of stop() - PASSED

[root@emitestbed44 ~]# ps -ef|grep ice
root      1741 31503  0 12:41 pts/1    00:00:00 grep ice
[root@emitestbed44 ~]# /etc/init.d/glite-wms-ice start
starting ICE... ok
[root@emitestbed44 ~]# ll /var/run/glite-wms-ice-safe.pid
-rw-r--r-- 1 root root 5 Feb 21 12:41 /var/run/glite-wms-ice-safe.pid
[root@emitestbed44 ~]# ps -ef|grep ice
glite     1768     1  0 12:41 ?        00:00:00 /usr/bin/glite-wms-ice-safe --conf glite_wms.conf --daemon /var/run/glite-wms-ice-safe.pid
glite     1773  1768  0 12:41 ?        00:00:00 sh -c /usr/bin/glite-wms-ice --conf glite_wms.conf /var/log/wms/ice_console.log 2>&1
glite     1774  1773  0 12:41 ?        00:00:00 /usr/bin/glite-wms-ice --conf glite_wms.conf /var/log/wms/ice_console.log
root      1988 31503  0 12:41 pts/1    00:00:00 grep ice
[root@emitestbed44 ~]# /etc/init.d/glite-wms-ice stop
stopping ICE... ok
[root@emitestbed44 ~]# ps -ef|grep ice
root      2026 31503  0 12:42 pts/1    00:00:00 grep ice
[root@emitestbed44 ~]# ll /var/run/glite-wms-ice-safe.pid
ls: cannot access /var/run/glite-wms-ice-safe.pid: No such file or directory

Bug #98282 various issues with EMI-1/2 proxy cleanup - PASSED

A bug should be filed because the script script /etc/cron.hourly/purge_proxycache is not installed.

[root@emitestbed44 ~]# ll /var/proxycache/cache/
total 4
drwx------ 4 glite glite 4096 Feb 21 12:39 %2FC%3DIT%2FO%3DINFN%2FOU%3DPersonal%20Certificate%2FL%3DPadova%2FCN%3DSara%20Bertocco
[root@emitestbed44 ~]# sh /usr/bin/glite-wms-wmproxy-purge-proxycache_keys
Thu Feb 21 12:47:59 CET 2013: proxy cache leftover private keys cleaner started
=== %2FC%3DIT%2FO%3DINFN%2FOU%3DPersonal%20Certificate%2FL%3DPadova%2FCN%3DSara%20Bertocco
403232    4 drwx------   2 glite    glite        4096 Feb 21 12:28 ./OGydCZ_VyBaS9JqmTQ3Jew
403220    4 drwx------   2 glite    glite        4096 Feb 21 12:39 ./MKcag-WAEfKL_mcekieBbQ
Thu Feb 21 12:47:59 CET 2013: finished cleaning keys
[root@emitestbed44 ~]# ll /var/proxycache/cache/
total 4
drwx------ 2 glite glite 4096 Feb 21 12:47 %2FC%3DIT%2FO%3DINFN%2FOU%3DPersonal%20Certificate%2FL%3DPadova%2FCN%3DSara%20Bertocco
[root@emitestbed44 ~]# ll /var/proxycache/cache/%2FC%3DIT%2FO%3DINFN%2FOU%3DPersonal%20Certificate%2FL%3DPadova%2FCN%3DSara%20Bertocco
total 0

Bug #99017 wmproxy init script 'status' does not return error when service is not running - PASSED

[root@emitestbed44 ~]# /etc/init.d/glite-wms-wmproxy stop
Stopping /usr/bin/glite_wms_wmproxy_server... ok
[root@emitestbed44 ~]# /etc/init.d/glite-wms-wmproxy status
/usr/bin/glite_wms_wmproxy_server is not running
[root@emitestbed44 ~]# echo $?
1

Bug #98524 glite-wms-job-output requires a valid delegated proxy on the WMS to enable output retrieval - PASSED

[bertocco@emitestbed16 WMS-service]$ glite-wms-job-submit -a -c wms_emitestbed44.conf /home/bertocco/jdl/file.jdl 

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emitbrc-lamb4.civ.zcu.cz:9000/jeTgqTkhcF2cn3XaPfxvJw

==========================================================================


[bertocco@emitestbed16 WMS-service]$ glite-wms-job-status https://emitbrc-lamb4.civ.zcu.cz:9000/jeTgqTkhcF2cn3XaPfxvJw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emitbrc-lamb4.civ.zcu.cz:9000/jeTgqTkhcF2cn3XaPfxvJw
Current Status:     Done(Success)
Logged Reason(s):
    - job completed
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        emi-demo08.cnaf.infn.it:8443/cream-lsf-testers
Submitted:          Thu Feb 21 12:59:59 2013 CET
==========================================================================

[root@emitestbed44 ~]# ls -trl /var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/
total 24
lrwxrwxrwx 1 glite glite   64 Feb 21 12:59 user.proxy -> /var/glite/spool/glite-renewd/b0070d5845b6e21cc5371cc35e95e37e.0
drwxrwx--- 2 tst10 glite 4096 Feb 21 12:59 peek
-rw-r--r-- 1 glite glite  668 Feb 21 12:59 JDLOriginal
-rw-r--r-- 1 glite glite 2976 Feb 21 13:00 JDLStarted
drwxrwxr-x 2 tst10 glite 4096 Feb 21 13:00 input
drwxrwx--- 2 tst10 glite 4096 Feb 21 13:00 output

[root@emitestbed44 ~]# find /var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/ -iname "*proxy*"
/var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/user.proxy
/var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/.user.proxy.bak

rm -f /var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/user.proxy
rm -f /var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/.user.proxy.bak

[root@emitestbed44 ~]# ls -trl /var/SandboxDir/je/https_3a_2f_2femitbrc-lamb4.civ.zcu.cz_3a9000_2fjeTgqTkhcF2cn3XaPfxvJw/
total 20
drwxrwx--- 2 tst10 glite 4096 Feb 21 12:59 peek
-rw-r--r-- 1 glite glite  668 Feb 21 12:59 JDLOriginal
-rw-r--r-- 1 glite glite 2976 Feb 21 13:00 JDLStarted
drwxrwxr-x 2 tst10 glite 4096 Feb 21 13:00 input
drwxrwx--- 2 tst10 glite 4096 Feb 21 13:00 output

[bertocco@emitestbed16 WMS-service]$ glite-wms-job-output https://emitbrc-lamb4.civ.zcu.cz:9000/jeTgqTkhcF2cn3XaPfxvJw

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emitbrc-lamb4.civ.zcu.cz:9000/jeTgqTkhcF2cn3XaPfxvJw
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/bertocco_jeTgqTkhcF2cn3XaPfxvJw

================================================================================

[bertocco@emitestbed16 WMS-service]$ ls -l /tmp/jobOutput/bertocco_jeTgqTkhcF2cn3XaPfxvJw
total 0
-rw-rw-r-- 1 bertocco bertocco 0 Feb 21 13:06 pippo
-rw-rw-r-- 1 bertocco bertocco 0 Feb 21 13:06 std.err
-rw-rw-r-- 1 bertocco bertocco 0 Feb 21 13:06 std.out

Bug #99092WMS: fix various bugs on Argus authZ - PASSED

21 Feb, 13:43:27 -I- PID: 11001 - "wmproxy::main": ------- Starting Server Instance -------
21 Feb, 13:43:27 -I- PID: 11001 - "wmproxy::main": WM proxy serving process started
21 Feb, 13:43:27 -I- PID: 11001 - "wmproxy::main": ---------------------------------------
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Called Operation: getVersion
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote Host Name: emitestbed16.cnaf.infn.it
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote CLIENT S DN: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote GRST CRED: VOMS 1361446109 108 0 /testers.eu-emi.eu/Role=NULL/Capability=NULL
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Service GRST PROXY LIMIT: 6
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": WMProxy instance serving core request N.: 1
21 Feb, 13:43:27 -I- PID: 11001 - "map_user_lcmaps": LCMAPS uid: 61010, gid: 6100
21 Feb, 13:43:27 -I- PID: 11001 - "wmpoperations::getVersion": Version retrieved: 3.3.1
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Called Operation: getProxyReq
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote Host Name: emitestbed16.cnaf.infn.it
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote CLIENT S DN: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote GRST CRED: VOMS 1361446109 108 0 /testers.eu-emi.eu/Role=NULL/Capability=NULL
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Service GRST PROXY LIMIT: 6
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": WMProxy instance serving core request N.: 2
21 Feb, 13:43:27 -I- PID: 11001 - "map_user_lcmaps": LCMAPS uid: 61010, gid: 6100
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Called Operation: putProxy
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote Host Name: emitestbed16.cnaf.infn.it
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote CLIENT S DN: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote GRST CRED: VOMS 1361446109 108 0 /testers.eu-emi.eu/Role=NULL/Capability=NULL
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Service GRST PROXY LIMIT: 6
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": WMProxy instance serving core request N.: 3
21 Feb, 13:43:27 -I- PID: 11001 - "map_user_lcmaps": LCMAPS uid: 61010, gid: 6100
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Called Operation: getTransferProtocols
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote Host Name: emitestbed16.cnaf.infn.it
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote CLIENT S DN: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote GRST CRED: VOMS 1361446109 108 0 /testers.eu-emi.eu/Role=NULL/Capability=NULL
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Service GRST PROXY LIMIT: 6
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": WMProxy instance serving core request N.: 4
21 Feb, 13:43:27 -I- PID: 11001 - "map_user_lcmaps": LCMAPS uid: 61010, gid: 6100
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Called Operation: getFreeQuota
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote Host Name: emitestbed16.cnaf.infn.it
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote CLIENT S DN: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote GRST CRED: VOMS 1361446109 108 0 /testers.eu-emi.eu/Role=NULL/Capability=NULL
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Service GRST PROXY LIMIT: 6
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": WMProxy instance serving core request N.: 5
21 Feb, 13:43:27 -I- PID: 11001 - "map_user_lcmaps": LCMAPS uid: 61010, gid: 6100
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Called Operation: getMaxInputSandboxSize
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote Host Name: emitestbed16.cnaf.infn.it
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote CLIENT S DN: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote GRST CRED: VOMS 1361446109 108 0 /testers.eu-emi.eu/Role=NULL/Capability=NULL
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Service GRST PROXY LIMIT: 6
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": WMProxy instance serving core request N.: 6
21 Feb, 13:43:27 -I- PID: 11001 - "map_user_lcmaps": LCMAPS uid: 61010, gid: 6100
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcoreoperations::jobRegister": Delegation ID: _ZBRodckrMzgMvx55IAQXw
21 Feb, 13:43:27 -I- PID: 11001 - "map_user_lcmaps": LCMAPS uid: 61010, gid: 6100
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Called Operation: jobRegister
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Called Operation: jobRegister
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote Host Name: emitestbed16.cnaf.infn.it
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote CLIENT S DN: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote GRST CRED: VOMS 1361446109 108 0 /testers.eu-emi.eu/Role=NULL/Capability=NULL
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Service GRST PROXY LIMIT: 6
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": WMProxy instance serving core request N.: 7
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::getType": JDL Type: job
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcoreoperations::regist JOB": Registered job id: https://emitbrc-lamb4.civ.zcu.cz:9000/B9zDc65qFIr-XudvQkX9Fw
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Called Operation: getSandboxDestURI
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote Host Name: emitestbed16.cnaf.infn.it
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote CLIENT S DN: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote GRST CRED: VOMS 1361446109 108 0 /testers.eu-emi.eu/Role=NULL/Capability=NULL
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Service GRST PROXY LIMIT: 6
21 Feb, 13:43:27 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": WMProxy instance serving core request N.: 8
21 Feb, 13:43:28 -I- PID: 11001 - "map_user_lcmaps": LCMAPS uid: 61010, gid: 6100
21 Feb, 13:43:28 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Called Operation: jobStart
21 Feb, 13:43:28 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote Host Name: emitestbed16.cnaf.infn.it
21 Feb, 13:43:28 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote CLIENT S DN: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=proxy
21 Feb, 13:43:28 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Remote GRST CRED: VOMS 1361446109 108 0 /testers.eu-emi.eu/Role=NULL/Capability=NULL
21 Feb, 13:43:28 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": Service GRST PROXY LIMIT: 6
21 Feb, 13:43:28 -I- PID: 11001 - "wmpcommon::initWMProxyOperation": WMProxy instance serving core request N.: 9
21 Feb, 13:43:28 -I- PID: 11001 - "map_user_lcmaps": LCMAPS uid: 61010, gid: 6100
21 Feb, 13:43:28 -I- PID: 11001 - "wmpcommon::getType": JDL Type: job

[bertocco@emitestbed16 WMS-service]$  glite-wms-job-submit -a -c wms_emitestbed44.conf /home/bertocco/jdl/file.jdl

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emitbrc-lamb4.civ.zcu.cz:9000/6Fqr8lN02sT841fr4oNVlQ

==========================================================================

[bertocco@emitestbed16 WMS-service]$ glite-wms-job-status https://emitbrc-lamb4.civ.zcu.cz:9000/6Fqr8lN02sT841fr4oNVlQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emitbrc-lamb4.civ.zcu.cz:9000/6Fqr8lN02sT841fr4oNVlQ
Current Status:     Done(Success)
Logged Reason(s):
    - job completed
    - Job Terminated Successfully
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        emi-demo08.cnaf.infn.it:8443/cream-lsf-cert
Submitted:          Thu Feb 21 13:48:27 2013 CET
==========================================================================

[bertocco@emitestbed16 WMS-service]$ glite-wms-job-output https://emitbrc-lamb4.civ.zcu.cz:9000/6Fqr8lN02sT841fr4oNVlQ

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server


================================================================================

         JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://emitbrc-lamb4.civ.zcu.cz:9000/6Fqr8lN02sT841fr4oNVlQ
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/bertocco_6Fqr8lN02sT841fr4oNVlQ

================================================================================


[bertocco@emitestbed16 WMS-service]$ ls -l /tmp/jobOutput/bertocco_6Fqr8lN02sT841fr4oNVlQ
total 0
-rw-rw-r-- 1 bertocco bertocco 0 Feb 21 14:13 pippo
-rw-rw-r-- 1 bertocco bertocco 0 Feb 21 14:13 std.err
-rw-rw-r-- 1 bertocco bertocco 0 Feb 21 14:13 std.out

Bug #98279 WMS: Job perusal is broken in EMI-2 WMS - PASSED

[bertocco@emitestbed16 WMS-service]$ cat ~/jdl/perusal.jdl 
Executable = "/home/bertocco/jdl/sleeper.sh";
requirements = true;
rank = 1;
EnableZippedIsb=true;
Arguments = "out.txt";
StdOutput = "std.out";
StdError = "std.err";
InputSandbox = {"/home/bertocco/jdl/sleeper.sh"};
OutputSandbox = {"std.out","std.err","out.txt"};
PerusalFileEnable = true;

[bertocco@emitestbed16 WMS-service]$ cat ~/jdl/sleeper.sh 
#!/bin/bash

while :
do
   sleep 1
   echo "slept for 1 sec" >>out.txt
done

[bertocco@emitestbed16 WMS-service]$  glite-wms-job-submit -a -c wms_emitestbed44.conf /home/bertocco/jdl/perusal.jdl 

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emitbrc-lamb4.civ.zcu.cz:9000/9_Z5FkHiUa4c15I1ycyJfQ

==========================================================================


[bertocco@emitestbed16 WMS-service]$ glite-wms-job-perusal --set -f out.txt https://emitbrc-lamb4.civ.zcu.cz:9000/9_Z5FkHiUa4c15I1ycyJfQ

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-perusal Success ======================

File perusal has been successfully enabled for the job:
https://emitbrc-lamb4.civ.zcu.cz:9000/9_Z5FkHiUa4c15I1ycyJfQ

==========================================================================

[bertocco@emitestbed16 ~]$ glite-wms-job-perusal --get -f out.txt  https://emitbrc-lamb4.civ.zcu.cz:9000/giGiU-4MOShKwdHSB-TKBQ

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-perusal Success ======================

No files to be retrieved for the job:
https://emitbrc-lamb4.civ.zcu.cz:9000/giGiU-4MOShKwdHSB-TKBQ

==========================================================================

(After not less than 10 minutes)

[bertocco@emitestbed16 ~]$ glite-wms-job-perusal --get -f out.txt  https://emitbrc-lamb4.civ.zcu.cz:9000/giGiU-4MOShKwdHSB-TKBQ

Connecting to the service https://emitestbed44.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-perusal Success ======================

The retrieved files have been successfully stored in:
/tmp/jobOutput/bertocco_giGiU-4MOShKwdHSB-TKBQ

==========================================================================


--------------------------------------------------------------------------
file 1/1: out.txt-20130221153043_1-20130221153043_1
--------------------------------------------------------------------------

[bertocco@emitestbed16 ~]$ tail /tmp/jobOutput/bertocco_giGiU-4MOShKwdHSB-TKBQ/out.txt-20130221153043_1-20130221153043_1 
slept for 1 sec
slept for 1 sec
slept for 1 sec
slept for 1 sec
slept for 1 sec
slept for 1 sec
slept for 1 sec
slept for 1 sec
slept for 1 sec
slept for 1 sec

Bug #97288 WM memory footprint bloats, especially on 64-bit architectures - HOPEFULLY FIXED

This bug cannot be checked in non production environments. A substantial change has been brought in the ldap purchasers, by removing legacy data structures and using a cleaner and unified approach. This needs to be tested in production

Standard Conformance Tests

Glue 1 Compliance - PASSED

[bertocco@cream-12 trunk]$ glue-validator -t glue1 -h emitestbed44.cnaf.infn.it -p 2170 -b o=grid
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok

----------------------------------------------------------------------
Ran 35 tests in 0.019s

OK

Glue 2 Compliance PASSED

[bertocco@cream-12 trunk]$ glue-validator -t glue2 -h emitestbed44.cnaf.infn.it -p 2170 -b o=glue
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok
Validating data types. ... ok
Verifying that attributes are not empty. ... ok
Verifying the existence of mandatory attributes. ... ok
Verifying the object class ... ok
Verifying single-valued attributes only have one value. ... ok

----------------------------------------------------------------------
Ran 35 tests in 0.019s

OK

-- SaraBertocco - 2013-02-15