WMS v. 3.5 (SL5) test report
Summary
- ETICS Subsystem Configuration Name: emi-wms_R_3_5_0
- Platform: SL5/x86_64 + EPEL
Deployment Tests
Clean installation - PASSED
Unit Tests - PASSED
Basic Functionality tests
Submission
Normal - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 17:49:12
===> Ended : 17:50:22
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130214174912.log
Proxy Mode - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 17:49:12
===> Ended : 17:50:22
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130214174912.log
Jdl attributes - PASSED
Test 4 fails because lxbra1910.cern.ch is not published in the top bdii.
Define the following variables in wms-command.conf:
# For Jdl attributes tests
SE=lxbra1910.cern.ch
LFC=emi2rc-sl5-lfc.cern.ch
ISB_DEST_HOSTNAME=emitestbed44.cnaf.infn.it
ISB_DEST_USERNAME=root
ISB_DEST_PASSWORD=***
OSB_DEST_HOSTNAME=emitestbed44.cnaf.infn.it
OSB_DEST_USERNAME=root
OSB_DEST_PASSWORD=***
[capannini@emitestbed08 WMS-service]$ python WMS-jdl-attributes-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i -t 1,2,4,5,6,7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle for normal job with non default jdl files
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Jdl with AllowZippedISB - CE_CREAM
Test 2: Jdl with ExpiryTime
Test 4: Jdl with DataRequirements
===> ERROR: Command lfc-mkdir /grid/testers.eu-emi.eu/20130215110949 failed. Failure message: cannot create /grid/testers.eu-emi.eu/20130215110949: Could not secure the connection
Test 5: Jdl with InputSandboxBaseURI
Test 5: Jdl with InputSandboxBaseURI - CE_CREAM
Test 6: Jdl with OutputSandboxBaseDestURI
Test 6: Jdl with OutputSandboxBaseDestURI - CE_CREAM
Test 7: Jdl with OutputSandboxDestURI
Test 7: Jdl with OutputSandboxDestURI - CE_CREAM
===>
===> Test: WMS-jdl-attributes-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:09:49
===> Ended : 11:20:55
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Test 4: Jdl with DataRequirements'] <<<
===>
===> Test log file is WMSService-TS_20130215110949.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130215110949/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130215110949 has not been cleaned for debug purpose
Collection
Bulk submission - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 2: Submit a bulk of jobs - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:58:06
===> Ended : 12:01:22
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130215115806.log
All in a jdl - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 7: Submit a bulk of jobs using a single jdl with al the jdls of nodes - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 12:23:46
===> Ended : 12:26:04
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130215122346.log
Parametric job - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 3: Submit a parametric job - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:13:54
===> Ended : 15:17:48
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130215151354.log
Dag - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 4: Submit a DAG job
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:32:46
===> Ended : 15:43:08
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130215153246.log
Parallel job - PASSED
### Submit parallel job 2 CPUs
### Job to be submitted:
Executable = "/usr/bin/mpi-start";
CPUNumber = 2;
Arguments = "-t dummy -- counter.sh cpus 2";
InputSandbox = {"counter.sh"};
OutputSandbox = {"std.out", "std.err"};
StdOutput = "std.out";
StdError = "std.err";
Requirements = member("MPI-START", other.GlueHostApplicationSoftwareRunTimeEnvironment)
&& other.GlueCEInfoJobManager == "pbs";
[capannini@emitestbed08 ~]$ glite-wms-job-submit -a -c wms_emitestbed41.conf mpijob.jdl
Connecting to the service https://emitestbed41.cnaf.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emitbrc-lamb4.civ.zcu.cz:9000/bE4XxarMfefsMCDlz4l2Gw
==========================================================================
[capannini@emitestbed08 ~]$ glite-wms-job-status https://emitbrc-lamb4.civ.zcu.cz:9000/bE4XxarMfefsMCDlz4l2Gw
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emitbrc-lamb4.civ.zcu.cz:9000/bE4XxarMfefsMCDlz4l2Gw
Current Status: Done (Success)
Logged Reason(s):
- job completed
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: emitestbed29.cnaf.infn.it:8443/cream-pbs-demo
Submitted: Fri Feb 15 16:08:55 2013 CET
==========================================================================
Forwarding parameters for parallel jobs - PASSED
Test 4 fails because there are no compatible resources.
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 8 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 8: Testing forwarding parameters for parallel jobs Case 1 - CE_CREAM
Set 8: Testing forwarding parameters for parallel jobs Case 2 - CE_CREAM
Set 8: Testing forwarding parameters for parallel jobs Case 3 - CE_CREAM
Set 8: Testing forwarding parameters for parallel jobs Case 4 - CE_CREAM
===> ERROR: Timeout reached while waiting the job https://emitbrc-lamb4.civ.zcu.cz:9000/zq5m0gmKRNL8DZaOE94dhw to transfered to CE
Traceback (most recent call last):
File "WMS-job-cycle.py", line 618, in ?
main()
File "WMS-job-cycle.py", line 606, in main
if forward_parameters_parallel_jobs(utils, tests[7]):
File "WMS-job-cycle.py", line 458, in forward_parameters_parallel_jobs
utils.wait_until_job_transfered(JOBID)
File "/home/capannini/WMS-Test-Suite-new/WMS-service/Test_utils.py", line 1237, in wait_until_job_transfered
raise TimeOutError("","Timeout reached while waiting the job %s to transfered to CE"%(jobid))
Exceptions.TimeOutError: 'Timeout reached while waiting the job https://emitbrc-lamb4.civ.zcu.cz:9000/zq5m0gmKRNL8DZaOE94dhw to transfered to CE'
Perusal - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 6 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 6: Submit a perusal job - CE_CREAM
===>
===> Test: WMS-job-cycle.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 10:41:20
===> Ended : 11:16:15
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218104120.log
Delegation - PASSED
Test 4 fails because the failure message has changed. Now it is 'Proxy exception: the proxy has expired'.
[capannini@emitestbed08 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test delegation operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Check --autm-delegation option
Test 2: Check --delegationid option
Test 3: Try to delegate with a short proxy and check the validity
Test 4: Works with expired proxy
===> ERROR: TEST FAILS. Job has been submitted with the expired delegation
To run this test you have to set the ROLE attribute for user proxy role at configuration file
===>
===> Test: WMS-delegation-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:32:34
===> Ended : 11:33:49
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Test 4: Works with expired proxy'] <<<
===>
===> Test log file is WMSService-TS_20130218113234.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218113234/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218113234 has not been cleaned for debug purpose
List-match - PASSED
Test 7 fails because there are no suitable CEs.
[capannini@emitestbed08 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job ListMatch Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: check if glite-wms-job-list-match command exists
Test 2: test a simple matching
Test 3: check --delegationid option
Test 4: exclude a CE from the match
Test 5: try a failure matching (Requirements == false)
Test 6: try a matching with EnableWMSFeedback attribute true
Test 7: try a matching with data requirements
===> ERROR: Unable to find any CEs mathing the job requirements
Test 8: try a gang-matching
===>
===> Test: WMS-listmatch-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:49:34
===> Ended : 11:49:58
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 1 test(s) fail(s): ['Test 7: try a matching with data requirements'] <<<
===>
===> Test log file is WMSService-TS_20130218114934.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218114934/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218114934 has not been cleaned for debug purpose
Prologue and epilogue jobs - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS test prologue and epilogue attributes
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Test prologue attribute - CE_CREAM
Test 2: Test epilogue attribute - CE_CREAM
Test 3: Test prologue and epilogue attributes - CE_CREAM
===>
===> Test: WMS-prologue-epilogue.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:53:01
===> Ended : 11:58:58
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218115301.log
Shallow and deep resubmission - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Resubmission Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Try a shallow resubmission - CE_CREAM
Test 2: Try a deep resubmission - CE_CREAM
===>
===> Test: WMS-job-resubmit.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 12:03:51
===> Ended : 12:15:39
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218120351.log
Cancel - FAILED
[capannini@emitestbed08 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Job Cancel Testing
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Try to cancel a normal job
Test 2: Try to cancel a DAG job
Test 3: Try to cancel one node of a DAG job
Test 4: Try to cancel a collection job
Test 5: Try to cancel one node of a collection job
Test 6: Try to cancel a parametric job
Test 7: Try to cancel one node of a parametric job
===> ERROR: TEST FAILS. Job's https://emitbrc-lamb4.civ.zcu.cz:9000/OpCSr3E9XGPQHYDxmSxLTA status is wrong: Running
Test 8: Try to cancel a MPI job
===> ERROR: Command glite-wms-job-cancel --config /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218122142/wms.conf --noint https://emitbrc-lamb4.civ.zcu.cz:9000/X_Fvj4sa0QW2LO4iVtbPvA failed. Failure message:
Error - Cancel not allowed
Current Job Status is Aborted
===>
===> Test: WMS-job-cancel.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 12:21:42
===> Ended : 12:41:05
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 2 test(s) fail(s): ['Test 7: Try to cancel one node of a parametric job', 'Test 8: Try to cancel a MPI job'] <<<
===>
===> Test log file is WMSService-TS_20130218122142.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218122142/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218122142 has not been cleaned for debug purpose
Limiter mechanism - MOSTLY PASSED (SAME FAILURES AS IN EMI1)
Some of the tests fail. They have been excluded from the certification as they need further checking.
[capannini@emitestbed08 WMS-service]$ python WMS-limiter-mechanism.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1,2,3,4,6,7,8
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Limiter Mechanism
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Test option --load1 threshold for load average (1 min)
Test 2: Test option --load5 threshold for load average (5 min)
Test 3: Test option --load15 threshold for load average (15 min)
Test 4: Test option --memusage threshold for memory usage (%)
Test 6: Test option --ftpconn threshold for number of FTP connections
Test 7: Test option --diskusage threshold for disk usage (%)
Test 8: Test option --fdnum threshold for used file descriptor
===>
===> Test: WMS-limiter-mechanism.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:01:35
===> Ended : 15:02:05
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218150135.log
Job purge - PASSED
[capannini@emitestbed08 WMS-service]$ python WMS-check-purger.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Purge Mechanism
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 3: Test proxy cache purging
===>
===> Test: WMS-check-purger.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:30:22
===> Ended : 15:30:30
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218153022.log
Configuration file - FAILED
[capannini@emitestbed08 WMS-service]$ python WMS-check-configuration-3.4.py -c wms-command.conf -d 3 -l -t 1-7
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Check glite_wms.conf file
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Check common section
Test 2: Check JobController section
Test 3: Check NetworkServer section
Test 4: Check LogMonitor section
Test 5: Check WorkloadManager section
Test 6: Check WorkloadManagerProxy section
Test 7: Check ICE section
===>
===> Test: WMS-check-configuration-3.4.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:43:57
===> Ended : 15:43:57
===>
===> >>> TEST FAILED <<<
===>
===> >>> failure reason: 3 test(s) fail(s): ['Test 5: Check WorkloadManager section', 'Test 6: Check WorkloadManagerProxy section', 'Test 7: Check ICE section'] <<<
===>
===> Test log file is WMSService-TS_20130218154357.log
===> Error messages have been written in /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218154357/errors.log
===>
===> Test directory /home/capannini/WMS-Test-Suite-new/WMS-service/WMSService-Test_20130218154357 has not been cleaned for debug purpose
Proxy renewal - PASSED
The myproxyserver (emitb2.ics.muni.cz) has to be configured in order to allow proxy renewal from the machine hosting the WMS.
If this has not been previously done contact
valtri@civ.zcu.cz.
It is necessary to clean the proxies from ice and proxyreneal:
[root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice stop
stopping ICE... ok
[root@emi-demo11 siteinfo]# rm -rf /var/ice/persist_dir/*
[root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice start
[root@emi-demo11 siteinfo]# rm -f /var/glite/spool/glite-renewd/*
then
Setting MYPROXYSERVER=emitb2.ics.muni.cz in wms-command.conf
[capannini@emitestbed08 ~]$ voms-proxy-init --voms testers.eu-emi.eu
Enter GRID pass phrase for this identity:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ................................................................... Done
Contacting emitestbed01.cnaf.infn.it:15002 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed01.cnaf.infn.it] "testers.eu-emi.eu" Done
Creating proxy ........................................................................ Done
Your proxy is valid until Tue Feb 19 23:07:16 2013
[capannini@emitestbed08 WMS-service]$ myproxy-init -s emitb2.ics.muni.cz -d -n
Enter GRID pass phrase for this identity:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating proxy ................................................................................. Done
Proxy Verify OK
Your proxy is valid until: Tue Feb 26 11:07:53 2013
A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on emitb2.ics.muni.cz.
[capannini@emitestbed08 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS test proxy renewal operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Test proxy renewal - CE_CREAM
Test 2: Test proxy renewal without setting MYPROXYSERVER - CE_CREAM
===>
===> Test: WMS-proxy-renewal.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 11:08:21
===> Ended : 11:39:26
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130219110821.log
Feedback - PASSED
The parameter
EnableReplanner has been introduced but is not configured by yaim so it must be manually defined in glite_wms.conf (
WorkloadManager section) before running the test. If it is not set, the test fails as expected as the default is false; it must be set to true for this test to be run successfully.
In the previous version of the WMS the parameter didn't exist and the feedback was always working by default, so the test ran consistently.
Moreover the test sometimes fails because the replanned job goes running instead of being replanned until reaching the maximum allowed number of replannings and then aborted.
[capannini@emitestbed08 WMS-service]$ python WMS-feedback-test.py -d3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: WMS Feedback
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Test WMS feedback feature
===>
===> Test: WMS-feedback-test.py
===> WMS: emitestbed41.cnaf.infn.it
===> Started: 15:51:46
===> Ended : 15:53:50
===>
===> === test PASSED ===
===>
===> Test log file is WMSService-TS_20130218155146.log
Published information - PASSED
bdb database information
[root@emitestbed41 ~]# ldapsearch -x -H ldap://cert-13.cnaf.infn.it:2170 -b 'o=grid'
# extended LDIF
#
# LDAPv3
# base <o=grid> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#
# grid
dn: o=grid
objectClass: organization
o: grid
# local, grid
dn: Mds-Vo-name=local,o=grid
Mds-Vo-name: local
objectClass: Mds
# resource, grid
dn: Mds-Vo-name=resource,o=grid
Mds-Vo-name: resource
objectClass: Mds
# cert-13.cnaf.infn.it_org.glite.lb.Server_2310828617, resource, grid
dn: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.lb.Server_2310828617,Md
s-Vo-name=resource,o=grid
objectClass: GlueTop
objectClass: GlueService
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueServiceUniqueID: cert-13.cnaf.infn.it_org.glite.lb.Server_2310828617
GlueServiceEndpoint: https://cert-13.cnaf.infn.it:9003/
GlueServiceVersion: 2.3.8
GlueSchemaVersionMinor: 3
GlueServiceName: emi-testbed-cnaf-Server
GlueServiceType: org.glite.lb.Server
GlueServiceWSDL: http://egee.cesnet.cz/cms/export/sites/egee/en/WSDL/3.1/LB.ws
dl
GlueServiceSemantics: https://edms.cern.ch/file/571273/2/LB-guide.pdf
GlueForeignKey: GlueSiteUniqueID=emi-testbed-cnaf
GlueSchemaVersionMajor: 1
GlueServiceStatus: Critical
GlueServiceStartTime: 2013-02-18T15:50:01+01:00
GlueServiceStatusInfo: glite-lb-notif-interlogd not running (stale pidfile) gl
ite-lb-interlogd for proxy running as 10314 glite-lb-bkserverd running as 102
50 glite-jp-importer not running (disabled)
# cert-13.cnaf.infn.it_org.glite.wms.WMProxy_753962038, resource, grid
dn: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.wms.WMProxy_753962038,M
ds-Vo-name=resource,o=grid
GlueServiceAccessControlBaseRule: VO:testers.eu-emi.eu
GlueServiceAccessControlBaseRule: VO:testers2.eu-emi.eu
GlueServiceAccessControlBaseRule: VO:cms
GlueServiceAccessControlBaseRule: VO:dteam
GlueServiceAccessControlBaseRule: VO:infngrid
GlueServiceStatus: OK
GlueServiceStatusInfo: /usr/bin/glite_wms_wmproxy_server is running...
objectClass: GlueTop
objectClass: GlueService
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueServiceUniqueID: cert-13.cnaf.infn.it_org.glite.wms.WMProxy_753962038
GlueServiceAccessControlRule: testers.eu-emi.eu
GlueServiceAccessControlRule: testers2.eu-emi.eu
GlueServiceAccessControlRule: cms
GlueServiceAccessControlRule: dteam
GlueServiceAccessControlRule: infngrid
GlueServiceEndpoint: https://cert-13.cnaf.infn.it:7443/glite_wms_wmproxy_serve
r
GlueServiceVersion: 3.4.0
GlueSchemaVersionMinor: 3
GlueServiceName: emi-testbed-cnaf-WMProxy
GlueServiceType: org.glite.wms.WMProxy
GlueServiceWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl
GlueServiceSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-guid
e.pdf
GlueForeignKey: GlueSiteUniqueID=emi-testbed-cnaf
GlueServiceOwner: testers.eu-emi.eu
GlueServiceOwner: testers2.eu-emi.eu
GlueServiceOwner: cms
GlueServiceOwner: dteam
GlueServiceOwner: infngrid
GlueSchemaVersionMajor: 1
GlueServiceStartTime: 2013-02-18T00:00:02+01:00
# DN, cert-13.cnaf.infn.it_org.glite.wms.WMProxy_753962038, resource, grid
dn: GlueServiceDataKey=DN,GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.w
ms.WMProxy_753962038,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: DN
GlueChunkKey: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.wms.WMProxy_7
53962038
GlueServiceDataValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=cert-13.cnaf.infn.it
# glite-info-service_version, cert-13.cnaf.infn.it_org.glite.lb.Server_231082
8617, resource, grid
dn: GlueServiceDataKey=glite-info-service_version,GlueServiceUniqueID=cert-13.
cnaf.infn.it_org.glite.lb.Server_2310828617,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_version
GlueChunkKey: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.lb.Server_231
0828617
GlueServiceDataValue: 1.6
# glite-info-service_version, cert-13.cnaf.infn.it_org.glite.wms.WMProxy_7539
62038, resource, grid
dn: GlueServiceDataKey=glite-info-service_version,GlueServiceUniqueID=cert-13.
cnaf.infn.it_org.glite.wms.WMProxy_753962038,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_version
GlueChunkKey: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.wms.WMProxy_7
53962038
GlueServiceDataValue: 1.6
# glite-info-service_hostname, cert-13.cnaf.infn.it_org.glite.lb.Server_23108
28617, resource, grid
dn: GlueServiceDataKey=glite-info-service_hostname,GlueServiceUniqueID=cert-13
.cnaf.infn.it_org.glite.lb.Server_2310828617,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_hostname
GlueChunkKey: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.lb.Server_231
0828617
GlueServiceDataValue: cert-13.cnaf.infn.it
# glite-info-service_hostname, cert-13.cnaf.infn.it_org.glite.wms.WMProxy_753
962038, resource, grid
dn: GlueServiceDataKey=glite-info-service_hostname,GlueServiceUniqueID=cert-13
.cnaf.infn.it_org.glite.wms.WMProxy_753962038,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_hostname
GlueChunkKey: GlueServiceUniqueID=cert-13.cnaf.infn.it_org.glite.wms.WMProxy_7
53962038
GlueServiceDataValue: cert-13.cnaf.infn.it
# search result
search: 2
result: 0 Success
# numResponses: 11
# numEntries: 10
Stats database definitions
[root@emitestbed41 ~]# ldapsearch -x -H ldap://emitestbed41.cnaf.infn.it:2170 -b 'o=infosys'
# extended LDIF
#
# LDAPv3
# base <o=infosys> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#
# infosys
dn: o=infosys
objectClass: organization
o: infosys
# zip, infosys
dn: CompressionType=zip,o=infosys
objectClass: CompressedContent
Hostname: localhost
CompressionType: zip
Data: file:///var/lib/bdii/archive/13-02-18-15-56-35-snapshot.gz
# localhost, infosys
dn: Hostname=localhost,o=infosys
objectClass: UpdateStats
Hostname: localhost
FailedDeletes: 0
ModifiedEntries: 5
DeletedEntries: 0
UpdateTime: 0
FailedAdds: 0
FailedModifies: 0
TotalEntries: 14
QueryTime: 0
NewEntries: 1
DBUpdateTime: 0
ReadTime: 0
PluginsTime: 0
ProvidersTime: 0
# search result
search: 2
result: 0 Success
# numResponses: 4
# numEntries: 3
[root@emitestbed41 ~]# ldapsearch -x -H ldap://emitestbed41.cnaf.infn.it:2170 -b 'o=glue'
# extended LDIF
#
# LDAPv3
# base <o=glue> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#
# glue
dn: o=glue
objectClass: organization
o: glue
# grid, glue
dn: GLUE2GroupID=grid,o=glue
objectClass: GLUE2Group
GLUE2GroupID: grid
# resource, glue
dn: GLUE2GroupID=resource,o=glue
objectClass: GLUE2Group
GLUE2GroupID: resource
# emitestbed41.cnaf.infn.it_wmproxy_4218551016, resource, glue
dn: GLUE2ServiceID=emitestbed41.cnaf.infn.it_wmproxy_4218551016,GLUE2GroupID=r
esource,o=glue
GLUE2EntityValidity: 3600
GLUE2ServiceType: org.glite.wms.WMProxy
GLUE2ServiceID: emitestbed41.cnaf.infn.it_wmproxy_4218551016
objectClass: GLUE2Service
GLUE2ServiceQualityLevel: production
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-service
GLUE2EntityOtherInfo: InfoProviderVersion=1.2
GLUE2EntityOtherInfo: InfoProviderHost=emitestbed41.cnaf.infn.it
GLUE2EntityOtherInfo: ProfileName=EGI
GLUE2EntityOtherInfo: ProfileVersion=1.0
GLUE2ServiceComplexity: endpointType=1, share=0, resource=0
GLUE2ServiceCapability: executionmanagement.candidatesetgenerator
GLUE2ServiceCapability: executionmanagement.jobdescription
GLUE2ServiceCapability: executionmanagement.jobmanager
GLUE2EntityName: emi-testbed-cnaf-WMProxy
GLUE2ServiceAdminDomainForeignKey: emi-testbed-cnaf
GLUE2EntityCreationTime: 2013-02-18T14:58:36Z
# emitestbed41.cnaf.infn.it_wmproxy_4218551016_org.glite.wms.WMProxy_42185510
16, emitestbed41.cnaf.infn.it_wmproxy_4218551016, resource, glue
dn: GLUE2EndpointID=emitestbed41.cnaf.infn.it_wmproxy_4218551016_org.glite.wms
.WMProxy_4218551016,GLUE2ServiceID=emitestbed41.cnaf.infn.it_wmproxy_42185510
16,GLUE2GroupID=resource,o=glue
GLUE2EntityValidity: 3600
GLUE2EndpointQualityLevel: production
GLUE2EndpointImplementor: gLite
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint
GLUE2EntityOtherInfo: InfoProviderVersion=1.4
GLUE2EntityOtherInfo: InfoProviderHost=emitestbed41.cnaf.infn.it
GLUE2EntityOtherInfo: ProfileName=EGI
GLUE2EntityOtherInfo: ProfileVersion=1.0
GLUE2EntityOtherInfo: OSName=Scientific
GLUE2EntityOtherInfo: OSVersion=5.9
GLUE2EntityOtherInfo: MiddlewareName=EMI
GLUE2EntityOtherInfo: MiddlewareVersion=3.0.0-0.rc
GLUE2EntityOtherInfo: HostDN=/C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed41.cnaf.
infn.it
GLUE2EndpointCapability: executionmanagement.candidatesetgenerator
GLUE2EndpointCapability: executionmanagement.jobdescription
GLUE2EndpointCapability: executionmanagement.jobmanager
GLUE2EndpointServiceForeignKey: emitestbed41.cnaf.infn.it_wmproxy_4218551016
GLUE2EntityName: WMProxy endpoint for Service emitestbed41.cnaf.infn.it_wmprox
y_4218551016
GLUE2EndpointTechnology: webservice
GLUE2EndpointWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl
GLUE2EndpointInterfaceName: org.glite.wms.WMProxy
GLUE2EndpointURL: https://emitestbed41.cnaf.infn.it:7443/glite_wms_wmproxy_ser
ver
GLUE2EndpointDowntimeInfo: See the GOC DB for downtimes: https://goc.egi.eu/
GLUE2EndpointImplementationVersion: package glite-wms-wmproxy is not installed
GLUE2EndpointSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-gu
ide.pdf
GLUE2EndpointIssuerCA: /C=IT/O=INFN/CN=INFN CA
GLUE2EndpointServingState: production
objectClass: GLUE2Endpoint
GLUE2EndpointInterfaceVersion: 1.0
GLUE2EndpointImplementationName: WMS
GLUE2EndpointTrustedCA: IGTF
GLUE2EndpointID: emitestbed41.cnaf.infn.it_wmproxy_4218551016_org.glite.wms.WM
Proxy_4218551016
GLUE2EndpointHealthStateInfo: /usr/bin/glite_wms_wmproxy_server is running...
GLUE2EndpointHealthState: ok
GLUE2EndpointStartTime: 2013-02-18T14:03:10Z
GLUE2EntityCreationTime: 2013-02-18T14:58:36Z
# DN_1, emitestbed41.cnaf.infn.it_wmproxy_4218551016_org.glite.wms.WMProxy_42
18551016, emitestbed41.cnaf.infn.it_wmproxy_4218551016, resource, glue
dn: GLUE2ExtensionLocalID=DN_1,GLUE2EndpointID=emitestbed41.cnaf.infn.it_wmpro
xy_4218551016_org.glite.wms.WMProxy_4218551016,GLUE2ServiceID=emitestbed41.cn
af.infn.it_wmproxy_4218551016,GLUE2GroupID=resource,o=glue
GLUE2ExtensionLocalID: DN_1
GLUE2ExtensionKey: DN
objectClass: GLUE2Extension
GLUE2ExtensionValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed41.cnaf.infn.it
GLUE2ExtensionEntityForeignKey: emitestbed41.cnaf.infn.it_wmproxy_4218551016_o
rg.glite.wms.WMProxy_4218551016
# emitestbed41.cnaf.infn.it_wmproxy_4218551016_org.glite.wms.WMProxy_42185510
16_Policy, emitestbed41.cnaf.infn.it_wmproxy_4218551016_org.glite.wms.WMProx
y_4218551016, emitestbed41.cnaf.infn.it_wmproxy_4218551016, resource, glue
dn: GLUE2PolicyID=emitestbed41.cnaf.infn.it_wmproxy_4218551016_org.glite.wms.W
MProxy_4218551016_Policy,GLUE2EndpointID=emitestbed41.cnaf.infn.it_wmproxy_42
18551016_org.glite.wms.WMProxy_4218551016,GLUE2ServiceID=emitestbed41.cnaf.in
fn.it_wmproxy_4218551016,GLUE2GroupID=resource,o=glue
GLUE2AccessPolicyEndpointForeignKey: emitestbed41.cnaf.infn.it_wmproxy_4218551
016_org.glite.wms.WMProxy_4218551016
GLUE2EntityValidity: 3600
objectClass: GLUE2Policy
objectClass: GLUE2AccessPolicy
GLUE2PolicyRule: VO:testers.eu-emi.eu
GLUE2PolicyRule: VO:testers2.eu-emi.eu
GLUE2PolicyRule: VO:testers3.eu-emi.eu
GLUE2PolicyScheme: org.glite.standard
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint
GLUE2EntityOtherInfo: InfoProviderVersion=1.4
GLUE2EntityOtherInfo: InfoProviderHost=emitestbed41.cnaf.infn.it
GLUE2EntityOtherInfo: ProfileName=EGI
GLUE2EntityOtherInfo: ProfileVersion=1.0
GLUE2PolicyUserDomainForeignKey: testers.eu-emi.eu
GLUE2PolicyUserDomainForeignKey: testers2.eu-emi.eu
GLUE2PolicyUserDomainForeignKey: testers3.eu-emi.eu
GLUE2PolicyID: emitestbed41.cnaf.infn.it_wmproxy_4218551016_org.glite.wms.WMPr
oxy_4218551016_Policy
GLUE2EntityName: Access control rules for Endpoint emitestbed41.cnaf.infn.it_w
mproxy_4218551016_org.glite.wms.WMProxy_4218551016
GLUE2EntityCreationTime: 2013-02-18T14:58:36Z
# search result
search: 2
result: 0 Success
# numResponses: 8
# numEntries: 7
Performance test
Stress test
Regression tests
Bugs attached to this task
WMS: stops accepting submissions when no swap is available (bug #96136) - PASSED
[root@emitestbed41 ~]# /usr/sbin/glite_wms_wmproxy_load_monitor --oper jobSubmit|grep -i swap
Threshold for Swap Usage: 95 => Detected value for Swap Usage: 0.00%
[root@emitestbed41 ~]# cat /proc/swaps
Filename Type Size Used Priority
/dev/mapper/vg_vol01-lv_swap partition 8388600 0 -1
[root@emitestbed41 ~]# swapoff /dev/mapper/vg_vol01-lv_swap
[root@emitestbed41 ~]# cat /proc/swaps
[root@emitestbed41 ~]# /usr/sbin/glite_wms_wmproxy_load_monitor --oper jobSubmit|grep -i swap
Threshold for Swap Usage: 95 => Detected value for Swap Usage: 0.00%
Set asyncjobstart=false to avoid lost jobs (bug #97319) - PASSED
[root@emitestbed41 ~]# grep -i asyncj /etc/glite-wms/glite_wms.conf
AsyncJobStart = false;
classad plugin functions are broken (bug #100176) - PASSED
List-match for the following jdl:
[
Executable = "/bin/echo";
Arguments = "Hello";
StdOutput = "out.log";
StdError = "err.log";
InputSandbox = {};
OutputSandbox = {"out.log", "err.log"};
leftVOMS_FQAN="/gridit/ansys/Role=NULL/Capability=NULL";
rightGlueCEACBR= { "VOMS:/gridit/ansys", "VOMS:/gridit/ansys/Role=SoftwareManager"};
requirements = fqanMember(strcat("VOMS:", leftVOMS_FQAN), rightGlueCEACBR) is true;
myproxyserver="";
ShallowRetryCount = -1;
]
if the number of returned queues is more than 0 then the bug is fixed.
[capannini@emitestbed08 ~]$ glite-wms-job-list-match -a -c wms_emitestbed41.conf fqanmember_emi2.jdl
Connecting to the service https://emitestbed41.cnaf.infn.it:7443/glite_wms_wmproxy_server
==========================================================================
COMPUTING ELEMENT IDs LIST
The following CE(s) matching your job requirements have been found:
*CEId*
- emi-demo08.cnaf.infn.it:8443/cream-lsf-cert
- emi-demo08.cnaf.infn.it:8443/cream-lsf-demo
- emi-demo08.cnaf.infn.it:8443/cream-lsf-testers
- emitestbed29.cnaf.infn.it:8443/cream-pbs-demo
- emitestbed32.cnaf.infn.it:8443/cream-lsf-cert
- emitestbed32.cnaf.infn.it:8443/cream-lsf-demo
- emitestbed32.cnaf.infn.it:8443/cream-lsf-testers
- emi-demo13.cnaf.infn.it:8443/cream-pbs-demo
- emitestbed02.cnaf.infn.it:8443/cream-sge-emitesters
- emitestbed09.cnaf.infn.it:8443/cream-sge-emitesters
==========================================================================
ICE removes its pid file at the start() instead of stop() (bug #98724) - PASSED
[root@emitestbed41 ~]# ps -ef|grep ice
root 14302 3187 0 12:11 pts/1 00:00:00 grep ice
[root@emitestbed41 ~]# /etc/init.d/glite-wms-ice start
starting ICE... ok
[root@emitestbed41 ~]# ll /var/run/glite-wms-ice-safe.pid
-rw-r--r-- 1 root root 6 19 feb 12:11 /var/run/glite-wms-ice-safe.pid
[root@emitestbed41 ~]# ps -ef|grep ice
glite 14329 1 0 12:11 ? 00:00:00 /usr/bin/glite-wms-ice-safe --conf glite_wms.conf --daemon /var/run/glite-wms-ice-safe.pid
glite 14334 14329 0 12:11 ? 00:00:00 sh -c /usr/bin/glite-wms-ice --conf glite_wms.conf /var/log/wms/ice_console.log 2>&1
glite 14335 14334 0 12:11 ? 00:00:00 /usr/bin/glite-wms-ice --conf glite_wms.conf /var/log/wms/ice_console.log
root 14372 3187 0 12:11 pts/1 00:00:00 grep ice
[root@emitestbed41 ~]# /etc/init.d/glite-wms-ice stop
stopping ICE... ok
[root@emitestbed41 ~]# ps -ef|grep ice
root 14408 3187 0 12:12 pts/1 00:00:00 grep ice
[root@emitestbed41 ~]# ll /var/run/glite-wms-ice-safe.pid
ls: /var/run/glite-wms-ice-safe.pid: No such file or directory
--
FabioCapannini - 2013-02-14