Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 55 to 55 | ||||||||
| ||||||||
Added: | ||||||||
> > |
# yum downgrade glite-jobid-api-c glite-jobid-api-cpp glite-jobid-api-java glite-lb-client glite-lb-client-java glite-lb-common glite-lb-doc glite-lb-harvester glite-lb-logger glite-lb-logger-msg glite-lb-server glite-lb-state-machine glite-lb-utils glite-lb-ws-interface glite-lb-ws-test glite-lb-yaim glite-lbjp-common-db glite-lbjp-common-gsoap-plugin glite-lbjp-common-gss glite-lbjp-common-jp-interface glite-lbjp-common-log glite-lbjp-common-maildir glite-lbjp-common-server-bones glite-lbjp-common-trio glite-px-proxyrenewal glite-wms-manager glite-wms-wmproxy glite-yaim-bdii glite-yaim-wms glue-schema gridsite-apache gridsite-shared voms # wget http://etics-repository.cern.ch/repository/download/registered/emi/emi.wms.wmproxy/3.3.5/sl5_x86_64_gcc412EPEL/glite-wms-wmproxy-3.3.5-1.sl5.x86_64.rpm # wget http://etics-repository.cern.ch/repository/download/registered/emi/emi.wms.yaim-wms/4.1.5/noarch/glite-yaim-wms-4.1.5-1.sl5.noarch.rpm # yum localinstall glite-wms-wmproxy-3.3.5-1.sl5.x86_64.rpm glite-yaim-wms-4.1.5-1.sl5.noarch.rpm # service gLite restart | |||||||
| ||||||||
Added: | ||||||||
> > |
| |||||||
| ||||||||
Line: 3041 to 3050 | ||||||||
=> test PASSED ==
| ||||||||
Added: | ||||||||
> > | Feedback[capannini@cert-17 WMS-service]$ pwd /home/capannini/wms_tests/WMS-service [capannini@cert-17 WMS-service]$ python WMS-feedback-test.py -d3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Feedback ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test WMS feedback feature ===> ===> Test: WMS-feedback-test.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 14:08:41 ===> Ended : 14:12:18 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120328140841.log
| |||||||
Published informationbdb database information | ||||||||
Line: 4112 to 4147 | ||||||||
VOMS FQANs: /dteam/Role=NULL/Capability=NULL, /dteam/NGI_IT/Role=NULL/Capability=NULL Active job - Running [2012-03-28T10:26:18Z] | ||||||||
Added: | ||||||||
> > | [capannini@cert-17 ~]$ /usr/libexec/grid-monitoring/probes/emi.wms/WMS-probe --vo dteam -x /tmp/x509up_u504 -H emi-demo11.cnaf.infn.it -m emi.wms.WMS-JobMonit --pass-check-dest active
metric results >>> <emi-demo11.cnaf.infn.it,emi.wms.WMS-JobSubmit-dteam>
OK: success.
glite-wms-job-output --noint --nosubdir --dir /var/lib/gridprobes/dteam/emi.wms/WMS/emi-demo11.cnaf.infn.it/jobOutput https://emi-demo11.cnaf.infn.it:9000/2b2lTYV75wO2Zx4z34gIWg![]() ![]() ============================================================================
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/2b2lTYV75wO2Zx4z34gIWg![]() ============================================================================
metric results >>> <emi-demo11.cnaf.infn.it,emi.wms.WMS-JobState-dteam>
OK: success.
glite-wms-job-output --noint --nosubdir --dir /var/lib/gridprobes/dteam/emi.wms/WMS/emi-demo11.cnaf.infn.it/jobOutput https://emi-demo11.cnaf.infn.it:9000/2b2lTYV75wO2Zx4z34gIWg![]() ![]() ============================================================================
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/2b2lTYV75wO2Zx4z34gIWg![]() ============================================================================
OK: Jobs processed - 1
OK: Jobs processed - 1
Done : 1|jobs_processed=1;; DONE=1;; RUNNING=0;; SCHEDULED=0;; SUBMITTED=0;; READY=0;; WAITING=0;; ABORTED=0;; CANCELLED=0;; CLEARED=0;; MISSED=0;; UNDETERMINED=0;; unknown=0;1;2 | |||||||
Added: | ||||||||
> > |
Summary: PASSED
[capannini@cert-17 ~]$ /usr/libexec/grid-monitoring/probes/emi.wms/WMS-probe --vo dteam -x /tmp/x509up_u504 -H emi-demo11.cnaf.infn.it -m emi.wms.WMS-JobState OK: OK: Testing from: cert-17.cnaf.infn.it DN: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy VOMS FQANs: /dteam/Role=NULL/Capability=NULL, /dteam/NGI_IT/Role=NULL/Capability=NULL Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/Cr-WRd9KppMM5OnrOlyxbg The job identifier has been saved in the following file: /var/lib/gridprobes/dteam/emi.wms/WMS/emi-demo11.cnaf.infn.it/jobID ========================================================================== [capannini@cert-17 ~]$ /usr/libexec/grid-monitoring/probes/emi.wms/WMS-probe --vo dteam -x /tmp/x509up_u504 -H emi-demo11.cnaf.infn.it -m emi.wms.WMS-JobMonit --pass-check-dest active metric results >>> <emi-demo11.cnaf.infn.it,emi.wms.WMS-JobState-dteam> OK: [Scheduled] https://emi-demo11.cnaf.infn.it:9000/Cr-WRd9KppMM5OnrOlyxbg OK: [Scheduled] https://emi-demo11.cnaf.infn.it:9000/Cr-WRd9KppMM5OnrOlyxbg glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/Cr-WRd9KppMM5OnrOlyxbg ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Cr-WRd9KppMM5OnrOlyxbg Current Status: Scheduled Status Reason: Job successfully submitted to Globus Destination: grid-ce.lns.infn.it:2119/jobmanager-lcgpbs-infinite Submitted: Wed Mar 28 13:56:07 2012 CEST ========================================================================== OK: Jobs processed - 1 OK: Jobs processed - 1 [Scheduled] : 1|jobs_processed=1;; DONE=0;; RUNNING=0;; SCHEDULED=1;; SUBMITTED=0;; READY=0;; WAITING=0;; ABORTED=0;; CANCELLED=0;; CLEARED=0;; MISSED=0;; UNDETERMINED=0;; unknown=0;1;2 [capannini@cert-17 ~]$ /usr/libexec/grid-monitoring/probes/emi.wms/WMS-probe --vo dteam -x /tmp/x509up_u504 -H emi-demo11.cnaf.infn.it -m emi.wms.WMS-JobCancel OK: job cancelled OK: job cancelled Testing from: cert-17.cnaf.infn.it DN: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy VOMS FQANs: /dteam/Role=NULL/Capability=NULL, /dteam/NGI_IT/Role=NULL/Capability=NULL Job cancellation request sent: glite-wms-job-cancel --noint -i /var/lib/gridprobes/dteam/emi.wms/WMS/emi-demo11.cnaf.infn.it/jobID Job bookkeeping files deleted. [capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/Cr-WRd9KppMM5OnrOlyxbg ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Cr-WRd9KppMM5OnrOlyxbg Current Status: Cancelled Logged Reason(s): - Aborted by user Destination: grid-ce.lns.infn.it:2119/jobmanager-lcgpbs-infinite Submitted: Wed Mar 28 13:56:07 2012 CEST ==========================================================================Summary: PASSED | |||||||
FabioCapannini - 2012-03-15 | ||||||||
Line: 4176 to 4347 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3930 to 3930 | ||||||||
All tests PASSED | ||||||||
Added: | ||||||||
> > | Nagios probes test | |||||||
Added: | ||||||||
> > | Clean installationEnvironmentClean SL5 installation plus an EMI-UI according to EMI guidelines.Repositories
Install[root@cert-17 ~]# yum install emi-wms-nagios Loaded plugins: downloadonly, kernel-module, priorities, protect-packages, protectbase, security, verify, versionlock Repository EGI-trustanchors is listed more than once in the configuration Repository EMI-1-base is listed more than once in the configuration Repository EMI-1-updates is listed more than once in the configuration Repository EMI-1-third-party is listed more than once in the configuration EMI-1-testing-base | 1.9 kB 00:00 EMI-1-testing-base/primary_db | 658 kB 00:00 EMI-1-testing-third-party | 1.9 kB 00:00 EMI-1-testing-third-party/primary_db | 26 kB 00:00 EMI-1-testing-updates | 1.9 kB 00:00 EMI-1-testing-updates/primary_db | 14 kB 00:00 Oracle | 1.9 kB 00:00 Oracle/primary_db | 2.1 kB 00:00 core | 1.1 kB 00:00 core/primary | 1.0 MB 00:00 core 3702/3702 egi-sam | 1.9 kB 00:00 egi-sam/primary_db | 108 kB 00:00 extras | 3.4 kB 00:00 extras/primary_db | 3.7 MB 00:00 4791 packages excluded due to repository priority protections 0 packages excluded due to repository protections Reading version lock configuration Setting up Install Process Resolving Dependencies --> Running transaction check ---> Package emi-wms-nagios.noarch 0:1.0.0-1.el5 set to be updated --> Processing Dependency: nagios-submit-conf >= 0.2 for package: emi-wms-nagios --> Processing Dependency: python-GridMon >= 1.1.10 for package: emi-wms-nagios --> Processing Dependency: python-ldap for package: emi-wms-nagios --> Running transaction check ---> Package nagios-submit-conf.noarch 0:0.2-2.el5 set to be updated ---> Package python-GridMon.noarch 0:1.1.12-1.el5 set to be updated ---> Package python-ldap.x86_64 0:2.2.0-2.1 set to be updated --> Finished Dependency Resolution Beginning Kernel Module Plugin Finished Kernel Module Plugin Dependencies Resolved ============================================================================================================================================= Package Arch Version Repository Size ============================================================================================================================================= Installing: emi-wms-nagios noarch 1.0.0-1.el5 EMI-1-testing-base 61 k Installing for dependencies: nagios-submit-conf noarch 0.2-2.el5 egi-sam 3.4 k python-GridMon noarch 1.1.12-1.el5 egi-sam 153 k python-ldap x86_64 2.2.0-2.1 sl-base 123 k Transaction Summary ============================================================================================================================================= Install 4 Package(s) Upgrade 0 Package(s) Total download size: 340 k Is this ok [y/N]: y Downloading Packages: (1/4): nagios-submit-conf-0.2-2.el5.noarch.rpm | 3.4 kB 00:00 (2/4): emi-wms-nagios-1.0.0-1.el5.noarch.rpm | 61 kB 00:00 (3/4): python-ldap-2.2.0-2.1.x86_64.rpm | 123 kB 00:00 (4/4): python-GridMon-1.1.12-1.el5.noarch.rpm | 153 kB 00:00 --------------------------------------------------------------------------------------------------------------------------------------------- Total 225 kB/s | 340 kB 00:01 Running rpm_check_debug Running Transaction Test Finished Transaction Test Transaction Test Succeeded Running Transaction Installing : python-ldap 1/4 Installing : nagios-submit-conf 2/4 Installing : python-GridMon 3/4 Installing : emi-wms-nagios 4/4 Installed: emi-wms-nagios.noarch 0:1.0.0-1.el5 Dependency Installed: nagios-submit-conf.noarch 0:0.2-2.el5 python-GridMon.noarch 0:1.1.12-1.el5 python-ldap.x86_64 0:2.2.0-2.1 Complete! Upgrade from productionN/A: This is the initial release. No previous version to upgrade from.Unit TestsN/A: The nagios probes are interpretted python scripts. Unit tests do not apply.Regression TestsN/A: This is the initial release. No associated bugs exist.Functional TestsPreparationLog as a user and create a valid voms proxyWMSProbe
[capannini@cert-17 ~]$ /usr/libexec/grid-monitoring/probes/emi.wms/WMS-probe --vo dteam -x /tmp/x509up_u504 -H emi-demo11.cnaf.infn.it -m emi.wms.WMS-JobState OK: OK: Testing from: cert-17.cnaf.infn.it DN: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy VOMS FQANs: /dteam/Role=NULL/Capability=NULL, /dteam/NGI_IT/Role=NULL/Capability=NULL Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/2b2lTYV75wO2Zx4z34gIWg The job identifier has been saved in the following file: /var/lib/gridprobes/dteam/emi.wms/WMS/emi-demo11.cnaf.infn.it/jobID ========================================================================== [capannini@cert-17 ~]$ /usr/libexec/grid-monitoring/probes/emi.wms/WMS-probe --vo dteam -x /tmp/x509up_u504 -H emi-demo11.cnaf.infn.it -m emi.wms.WMS-JobMonit --pass-check-dest active metric results >>> <emi-demo11.cnaf.infn.it,emi.wms.WMS-JobState-dteam> OK: [Scheduled] https://emi-demo11.cnaf.infn.it:9000/2b2lTYV75wO2Zx4z34gIWg OK: [Scheduled] https://emi-demo11.cnaf.infn.it:9000/2b2lTYV75wO2Zx4z34gIWg glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/2b2lTYV75wO2Zx4z34gIWg ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/2b2lTYV75wO2Zx4z34gIWg Current Status: Scheduled Status Reason: Job successfully submitted to Globus Destination: grid-ce.lns.infn.it:2119/jobmanager-lcgpbs-cert Submitted: Wed Mar 28 12:09:33 2012 CEST ========================================================================== OK: Jobs processed - 1 OK: Jobs processed - 1 [Scheduled] : 1|jobs_processed=1;; DONE=0;; RUNNING=0;; SCHEDULED=1;; SUBMITTED=0;; READY=0;; WAITING=0;; ABORTED=0;; CANCELLED=0;; CLEARED=0;; MISSED=0;; UNDETERMINED=0;; unknown=0;1;2 [capannini@cert-17 ~]$ /usr/libexec/grid-monitoring/probes/emi.wms/WMS-probe --vo dteam -x /tmp/x509up_u504 -H emi-demo11.cnaf.infn.it -m emi.wms.WMS-JobState OK: Active job - Scheduled [2012-03-28T10:10:04Z] OK: Active job - Scheduled [2012-03-28T10:10:04Z] Testing from: cert-17.cnaf.infn.it DN: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy VOMS FQANs: /dteam/Role=NULL/Capability=NULL, /dteam/NGI_IT/Role=NULL/Capability=NULL Active job - Scheduled [2012-03-28T10:10:04Z] [capannini@cert-17 ~]$ [capannini@cert-17 ~]$ [capannini@cert-17 ~]$ /usr/libexec/grid-monitoring/probes/emi.wms/WMS-probe --vo dteam -x /tmp/x509up_u504 -H emi-demo11.cnaf.infn.it -m emi.wms.WMS-JobState OK: Active job - Scheduled [2012-03-28T10:10:04Z] OK: Active job - Scheduled [2012-03-28T10:10:04Z] Testing from: cert-17.cnaf.infn.it DN: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy VOMS FQANs: /dteam/Role=NULL/Capability=NULL, /dteam/NGI_IT/Role=NULL/Capability=NULL Active job - Scheduled [2012-03-28T10:10:04Z] [capannini@cert-17 ~]$ /usr/libexec/grid-monitoring/probes/emi.wms/WMS-probe --vo dteam -x /tmp/x509up_u504 -H emi-demo11.cnaf.infn.it -m emi.wms.WMS-JobState OK: Active job - Running [2012-03-28T10:26:18Z] OK: Active job - Running [2012-03-28T10:26:18Z] Testing from: cert-17.cnaf.infn.it DN: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy VOMS FQANs: /dteam/Role=NULL/Capability=NULL, /dteam/NGI_IT/Role=NULL/Capability=NULL Active job - Running [2012-03-28T10:26:18Z] | |||||||
FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 260 to 260 | ||||||||
[cristofori@ui ~]$ cat /home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g/stderr.log [cristofori@ui ~]$ cat /home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g/stdout.log cmsuser07 | ||||||||
Added: | ||||||||
> > | ===> Test PASSED | |||||||
Added: | ||||||||
> > | The selected CE was not upgraded to version >1.x so we didn't hit the bug https://savannah.cern.ch/bugs/?92742![]() | |||||||
Jdl with DataRequirements |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3771 to 3771 | ||||||||
All tests PASSED | ||||||||
Changed: | ||||||||
< < | ||||||||
> > | bug #78406
| |||||||
FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 198 to 198 | ||||||||
* WMSService-TS_20120316105040.log: WMSService-TS_20120316105040.log | ||||||||
Added: | ||||||||
> > | ARC CEJob submitted on a production CE using the cms VO.[capannini@cert-17 regression_tests]$ lcg-infosites --is egee-bdii.cnaf.infn.it --vo cms ce |grep arc 80 0 95 5 95 arc.univ.kiev.ua:2811/nordugrid-torque-arc 768 707 196 61 196 jade-cms.hip.fi:2811/nordugrid-GE-arc 256 0 0 0 0 korundi.grid.helsinki.fi:2811/nordugrid-GE-arc [cristofori@ui ~]$ glite-wms-job-submit -e https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server -a -r jade-cms.hip.fi:2811/nordugrid-GE-arc firsttest.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g ========================================================================== [cristofori@ui ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: jade-cms.hip.fi:2811/nordugrid-GE-arc Submitted: Tue Mar 27 14:27:13 2012 CEST ========================================================================== [cristofori@ui ~]$ glite-wms-job-output --dir ./ https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the job: https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g have been successfully retrieved and stored in the directory: /home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g ================================================================================ [cristofori@ui ~]$ cat /home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g/stderr.log [cristofori@ui ~]$ cat /home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g/stdout.log cmsuser07 | |||||||
Jdl with DataRequirements[capannini@devel15 WMS-service]$ cat ~/certification/data-req.jdl | ||||||||
Line: 3694 to 3758 | ||||||||
All tests PASSED | ||||||||
Added: | ||||||||
> > | bug #77876
| |||||||
FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3642 to 3642 | ||||||||
All tests PASSED | ||||||||
Added: | ||||||||
> > | bug #75368
| |||||||
FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3617 to 3617 | ||||||||
All tests PASSED | ||||||||
Added: | ||||||||
> > | bug #73699
| |||||||
Added: | ||||||||
> > | Testing bug 73699 All tests PASSED | |||||||
bug #73711 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3376 to 3376 | ||||||||
Regression testsBugs attached to the task | ||||||||
Changed: | ||||||||
< < | WMproxy GACLs do not support wildcards (as they used to do) | |||||||
> > | bug #87261: WMproxy GACLs do not support wildcards (as they used to do) | |||||||
The WMproxy GACL file should accept now wildcards, on the FQAN tag only. VO: dteam, FQAN: /dteam/Role=NULL/Capability=NULL | ||||||||
Line: 3470 to 3470 | ||||||||
WMP log says: 26 Mar, 12:24:23 -D- PID: 32135 - "GaclManager::loadCredential": GACL FQAN fqan:/dteam/%2A was matched to /dteam/Role=NULL/Capability=NULL | ||||||||
Changed: | ||||||||
< < | EMI WMS doesn't use grid_monitor | |||||||
> > | bug #91875: EMI WMS doesn't use grid_monitor | |||||||
Submit a job to a GRAM CE and check that the scrpt /opt/lcg/sbin/grid_monitor.sh (linked by /usr/sbin/grid_monitor.sh) is accessed in read. | ||||||||
Line: 3502 to 3502 | ||||||||
Added: | ||||||||
> > | Old bugs bug #40982
| |||||||
FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3470 to 3470 | ||||||||
WMP log says: 26 Mar, 12:24:23 -D- PID: 32135 - "GaclManager::loadCredential": GACL FQAN fqan:/dteam/%2A was matched to /dteam/Role=NULL/Capability=NULL | ||||||||
Added: | ||||||||
> > | EMI WMS doesn't use grid_monitor
Submit a job to a GRAM CE and check that the scrpt /opt/lcg/sbin/grid_monitor.sh (linked by /usr/sbin/grid_monitor.sh) is accessed in read.
| |||||||
FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2976 to 2976 | ||||||||
Published informationbdb database information | ||||||||
Added: | ||||||||
> > | ldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=grid' # extended LDIF # # LDAPv3 # base <o=grid> with scope subtree # filter: (objectclass=*) # requesting: ALL # # grid dn: o=grid objectClass: organization o: grid # local, grid dn: Mds-Vo-name=local,o=grid Mds-Vo-name: local objectClass: Mds # resource, grid dn: Mds-Vo-name=resource,o=grid Mds-Vo-name: resource objectClass: Mds # emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637, resource, grid dn: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_84141563 7,Mds-Vo-name=resource,o=grid GlueServiceAccessControlBaseRule: VO:atlas GlueServiceAccessControlBaseRule: VO:alice GlueServiceAccessControlBaseRule: VO:lhcb GlueServiceAccessControlBaseRule: VO:cms GlueServiceAccessControlBaseRule: VO:dteam GlueServiceAccessControlBaseRule: VO:biomed GlueServiceAccessControlBaseRule: VO:ops GlueServiceAccessControlBaseRule: VO:infngrid GlueServiceAccessControlBaseRule: VO:testers.eu-emi.eu GlueServiceStatus: Other GlueServiceStatusInfo: ?? objectClass: GlueTop objectClass: GlueService objectClass: GlueKey objectClass: GlueSchemaVersion GlueServiceUniqueID: emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637 GlueServiceAccessControlRule: atlas GlueServiceAccessControlRule: alice GlueServiceAccessControlRule: lhcb GlueServiceAccessControlRule: cms GlueServiceAccessControlRule: dteam GlueServiceAccessControlRule: biomed GlueServiceAccessControlRule: ops GlueServiceAccessControlRule: infngrid GlueServiceAccessControlRule: testers.eu-emi.eu GlueServiceEndpoint: https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_se rver GlueServiceVersion: 3.3.5 GlueSchemaVersionMinor: 3 GlueServiceName: INFN-CREAMTEST-WMProxy GlueServiceType: org.glite.wms.WMProxy GlueServiceWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl GlueServiceSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-guid e.pdf GlueForeignKey: GlueSiteUniqueID=INFN-CREAMTEST GlueServiceOwner: atlas GlueServiceOwner: alice GlueServiceOwner: lhcb GlueServiceOwner: cms GlueServiceOwner: dteam GlueServiceOwner: biomed GlueServiceOwner: ops GlueServiceOwner: infngrid GlueServiceOwner: testers.eu-emi.eu GlueSchemaVersionMajor: 1 GlueServiceStartTime: 2012-03-26T00:00:01+02:00 # DN, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637, resource, grid dn: GlueServiceDataKey=DN,GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glit e.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid GlueSchemaVersionMajor: 1 objectClass: GlueTop objectClass: GlueServiceData objectClass: GlueKey objectClass: GlueSchemaVersion GlueSchemaVersionMinor: 3 GlueServiceDataKey: DN GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx y_841415637 GlueServiceDataValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=emi-demo11.cnaf.infn.it # glite-info-service_version, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_8 41415637, resource, grid dn: GlueServiceDataKey=glite-info-service_version,GlueServiceUniqueID=emi-demo 11.cnaf.infn.it_org.glite.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid GlueSchemaVersionMajor: 1 objectClass: GlueTop objectClass: GlueServiceData objectClass: GlueKey objectClass: GlueSchemaVersion GlueSchemaVersionMinor: 3 GlueServiceDataKey: glite-info-service_version GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx y_841415637 GlueServiceDataValue: 1.6 # glite-info-service_hostname, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_ 841415637, resource, grid dn: GlueServiceDataKey=glite-info-service_hostname,GlueServiceUniqueID=emi-dem o11.cnaf.infn.it_org.glite.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid GlueSchemaVersionMajor: 1 objectClass: GlueTop objectClass: GlueServiceData objectClass: GlueKey objectClass: GlueSchemaVersion GlueSchemaVersionMinor: 3 GlueServiceDataKey: glite-info-service_hostname GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx y_841415637 GlueServiceDataValue: emi-demo11.cnaf.infn.it # search result search: 2 result: 0 Success # numResponses: 8 # numEntries: 7 Stats database definitionsldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=infosys' # extended LDIF # # LDAPv3 # base <o=infosys> with scope subtree # filter: (objectclass=*) # requesting: ALL # # infosys dn: o=infosys objectClass: organization o: infosys # zip, infosys dn: CompressionType=zip,o=infosys objectClass: CompressedContent Hostname: localhost CompressionType: zip Data: file:///var/lib/bdii/archive/12-03-26-11-05-27-snapshot.gz # localhost, infosys dn: Hostname=localhost,o=infosys objectClass: UpdateStats Hostname: localhost FailedDeletes: 0 ModifiedEntries: 5 DeletedEntries: 0 UpdateTime: 0 FailedAdds: 0 FailedModifies: 0 TotalEntries: 14 QueryTime: 0 NewEntries: 1 DBUpdateTime: 0 ReadTime: 0 PluginsTime: 0 ProvidersTime: 0 # search result search: 2 result: 0 Success # numResponses: 4 # numEntries: 3 Stats database definitionsldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=glue' # extended LDIF # # LDAPv3 # base <o=glue> with scope subtree # filter: (objectclass=*) # requesting: ALL # # glue dn: o=glue objectClass: organization o: glue # grid, glue dn: GLUE2GroupID=grid,o=glue objectClass: GLUE2Group GLUE2GroupID: grid # resource, glue dn: GLUE2GroupID=resource,o=glue objectClass: GLUE2Group GLUE2GroupID: resource # emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue dn: GLUE2ServiceID=emi-demo11.cnaf.infn.it_wmproxy_2598325561,GLUE2GroupID=res ource,o=glue GLUE2EntityValidity: 3600 GLUE2ServiceType: org.glite.wms.WMProxy GLUE2ServiceID: emi-demo11.cnaf.infn.it_wmproxy_2598325561 objectClass: GLUE2Service GLUE2ServiceQualityLevel: production GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-service GLUE2EntityOtherInfo: InfoProviderVersion=1.1 GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it GLUE2ServiceComplexity: endpointType=1, share=0, resource=0 GLUE2ServiceCapability: executionmanagement.candidatesetgenerator GLUE2ServiceCapability: executionmanagement.jobdescription GLUE2ServiceCapability: executionmanagement.jobmanager GLUE2EntityName: INFN-CREAMTEST-WMProxy GLUE2ServiceAdminDomainForeignKey: INFN-CREAMTEST GLUE2EntityCreationTime: 2012-03-26T09:05:27Z # emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598325561 , emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue dn: GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.W MProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.infn.it_wmproxy_2598325561,G LUE2GroupID=resource,o=glue GLUE2EntityValidity: 3600 GLUE2EndpointQualityLevel: production GLUE2EndpointImplementor: gLite GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint GLUE2EntityOtherInfo: InfoProviderVersion=1.2 GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it GLUE2EntityOtherInfo: MiddlewareName=EMI GLUE2EntityOtherInfo: MiddlewareVersion=1.10.0-1 GLUE2EndpointCapability: executionmanagement.candidatesetgenerator GLUE2EndpointCapability: executionmanagement.jobdescription GLUE2EndpointCapability: executionmanagement.jobmanager GLUE2EndpointHealthState: ok GLUE2EndpointServiceForeignKey: emi-demo11.cnaf.infn.it_wmproxy_2598325561 GLUE2EntityName: WMProxy endpoint for Service emi-demo11.cnaf.infn.it_wmproxy_ 2598325561 GLUE2EndpointTechnology: webservice GLUE2EndpointWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl GLUE2EndpointInterfaceName: org.glite.wms.WMProxy GLUE2EndpointURL: https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_serve r GLUE2EndpointDowntimeInfo: See the GOC DB for downtimes: https://goc.egi.eu/ GLUE2EndpointImplementationVersion: 3.3.5 GLUE2EndpointSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-gu ide.pdf GLUE2EndpointIssuerCA: /C=IT/O=INFN/CN=INFN CA GLUE2EndpointServingState: production objectClass: GLUE2Endpoint GLUE2EndpointInterfaceVersion: 1.0 GLUE2EndpointImplementationName: WMS GLUE2EndpointTrustedCA: IGTF GLUE2EndpointID: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMPr oxy_2598325561 GLUE2EndpointStartTime: 2012-03-25T22:00:01Z GLUE2EndpointHealthStateInfo: WMProxy httpd listening on port 7443 httpd is ru nning .... === WMProxy Server running instances: UID PID PPID C STIME TTY TIM E CMD glite 11507 27310 0 09:28 ? 00:00:00 /usr/bin/glite_wms_wmproxy_server GLUE2EntityCreationTime: 2012-03-26T09:05:27Z # DN_1, emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598 325561, emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue dn: GLUE2ExtensionLocalID=DN_1,GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy _2598325561_org.glite.wms.WMProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.i nfn.it_wmproxy_2598325561,GLUE2GroupID=resource,o=glue GLUE2ExtensionLocalID: DN_1 GLUE2ExtensionKey: DN objectClass: GLUE2Extension GLUE2ExtensionValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=emi-demo11.cnaf.infn.it GLUE2ExtensionEntityForeignKey: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org .glite.wms.WMProxy_2598325561 # emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598325561 _Policy, emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_25 98325561, emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue dn: GLUE2PolicyID=emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMP roxy_2598325561_Policy,GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy_259832 5561_org.glite.wms.WMProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.infn.it_ wmproxy_2598325561,GLUE2GroupID=resource,o=glue GLUE2AccessPolicyEndpointForeignKey: emi-demo11.cnaf.infn.it_wmproxy_259832556 1_org.glite.wms.WMProxy_2598325561 GLUE2EntityValidity: 3600 objectClass: GLUE2Policy objectClass: GLUE2AccessPolicy GLUE2PolicyRule: VO:atlas GLUE2PolicyRule: VO:alice GLUE2PolicyRule: VO:lhcb GLUE2PolicyRule: VO:cms GLUE2PolicyRule: VO:dteam GLUE2PolicyRule: VO:biomed GLUE2PolicyRule: VO:ops GLUE2PolicyRule: VO:infngrid GLUE2PolicyRule: VO:testers.eu-emi.eu GLUE2PolicyScheme: org.glite.standard GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint GLUE2EntityOtherInfo: InfoProviderVersion=1.2 GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it GLUE2PolicyUserDomainForeignKey: atlas GLUE2PolicyUserDomainForeignKey: alice GLUE2PolicyUserDomainForeignKey: lhcb GLUE2PolicyUserDomainForeignKey: cms GLUE2PolicyUserDomainForeignKey: dteam GLUE2PolicyUserDomainForeignKey: biomed GLUE2PolicyUserDomainForeignKey: ops GLUE2PolicyUserDomainForeignKey: infngrid GLUE2PolicyUserDomainForeignKey: testers.eu-emi.eu GLUE2PolicyID: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProx y_2598325561_Policy GLUE2EntityName: Access control rules for Endpoint emi-demo11.cnaf.infn.it_wmp roxy_2598325561_org.glite.wms.WMProxy_2598325561 GLUE2EntityCreationTime: 2012-03-26T09:05:27Z # search result search: 2 result: 0 Success # numResponses: 8 # numEntries: 7 | |||||||
Performance testCollection of 1000 nodes | ||||||||
Line: 3032 to 3354 | ||||||||
2880 jobs submitted in 4721 seconds: 1/1/48 (min/avg/max) Test finishes at ven mar 23 16:09:44 CET 2012 | ||||||||
Added: | ||||||||
> > | Results:
DONE : 71777
NOTDone: 0
Aborted: 98
Total : 71875 done jobs on CREAM CEs: 71354 (99.4%) done jobs on LCG CEs: 423 (0.6%) The above statistics is obatined in the following way: [capannini@cert-17 output]$ cat *.done|wc -l 71777 [capannini@cert-17 output]$ cat *.done|grep '8443/cream' |wc -l 71354 [capannini@cert-17 output]$ cat *.done|grep '2119/jobmanager'|wc -l 423 ====> Test PASSED (Aborted/Total = 0.1%) Regression testsBugs attached to the task WMproxy GACLs do not support wildcards (as they used to do)
The WMproxy GACL file should accept now wildcards, on the FQAN tag only.
VO: dteam, FQAN: /dteam/Role=NULL/Capability=NULL
Test #1: GACL: [...] /dteam /dteam/R* [...]
access granted:
[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo11.conf ls.jdl
Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server | |||||||
FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3029 to 3029 | ||||||||
Results | ||||||||
Added: | ||||||||
> > | 2880 jobs submitted in 4721 seconds: 1/1/48 (min/avg/max) Test finishes at ven mar 23 16:09:44 CET 2012 | |||||||
FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2786 to 2786 | ||||||||
=> test PASSED == | ||||||||
Added: | ||||||||
> > | - Purge only jobs older than 12 hours:
[glite@emi-demo11 ~]$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin +720
/var/SandboxDir/2n/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f2n1K8mLSRn62CxdRL5V2mw
/var/SandboxDir/S9/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fS9jwBKA1y0ViIyQOozZ8gA
Try to purge:
[glite@emi-demo11 ~]$ date
Fri Mar 23 15:39:16 CET 2012
[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/2n
total 4
drwxrwx--- 5 dteam047 glite 4096 Mar 22 16:52 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f2n1K8mLSRn62CxdRL5V2mw
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/2n -t 43200
23 Mar, 15:39:48 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/2n1K8mLSRn62CxdRL5V2mw![]() ![]() ![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Zc2nqpKxjTTflY1DLirJEA![]() ![]() ======================================================================
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/Zc -s23 Mar, 15:56:25 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/Zc2nqpKxjTTflY1DLirJEA![]() ![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Zc2nqpKxjTTflY1DLirJEA![]() ![]() ======================================================================
=> test PASSED ==
- Purge a dag job
[capannini@cert-17 dag]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf dag.jdl
Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server![]() ================== glite-wms-job-submit Success ==================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g![]() ======================================================================
[capannini@cert-17 dag]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g![]() ======================================================================
- Nodes information for:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/0oWd90UfoGa_Hpekbxanjw![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/SPpi50irdHyOVsjnOlfJ2A![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/WZyAUZqFIPJijTyT9kb5iQ![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/iHlJijMoMfZeD05Ax3nJNA![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/oX3RwUu__q7fOPKX5l8OJA![]() ======================================================================
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/nS -s
23 Mar, 16:01:46 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:354): https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g![]() ![]() ![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/nSNsnE-tjh87JO6juecJ3g![]() ======================================================================
- Nodes information for:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/0oWd90UfoGa_Hpekbxanjw![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/SPpi50irdHyOVsjnOlfJ2A![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/WZyAUZqFIPJijTyT9kb5iQ![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/iHlJijMoMfZeD05Ax3nJNA![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/oX3RwUu__q7fOPKX5l8OJA![]() ======================================================================
=> test PASSED == | |||||||
Added: | ||||||||
> > | Published informationbdb database information | |||||||
Performance testCollection of 1000 nodes |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2376 to 2376 | ||||||||
The following bug https://savannah.cern.ch/bugs/?func=detailitem&item_id=90610![]() | ||||||||
Added: | ||||||||
> > | [capannini@cert-17 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test proxy renewal operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test proxy renewal with LCG CE Test 2: Test proxy renewal with CREAM CE Test 3: Test proxy renewal with LCG CE (without setting MYPROXYSERVER) Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER) ===> ERROR: Timeout reached while waiting the job https://emi-demo11.cnaf.infn.it:9000/7PGXtMm8gcJ5wIcnzYyGqQ to finish ===> ===> Test: WMS-proxy-renewal.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:08:16 ===> Ended : 14:31:07 ===> ===> >>> TEST FAILED <<< ===> ===> >>> failure reason: 1 test(s) fail(s): ['Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER)'] <<< ===> ===> Test log file is WMSService-TS_20120323100816.log ===> Error messages have been written in /home/capannini/wms_tests.old/WMS-service/WMSService-Test_20120323100816/errors.log ===> ===> Test directory /home/capannini/wms_tests.old/WMS-service/WMSService-Test_20120323100816 has not been cleaned for debug purpose You have new mail in /var/spool/mail/capannini [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l -t 4 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test proxy renewal operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER) ===> ===> Test: WMS-proxy-renewal.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 14:41:17 ===> Ended : 14:41:57 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120323144117.log
| |||||||
Configuration fileVerified that the following entries are present in/etc/glite-wms/glite_wms.conf : | ||||||||
Line: 2602 to 2665 | ||||||||
PurgeNormal job cycle | ||||||||
Added: | ||||||||
> > | [capannini@cert-17 WMS-service]$ python WMS-check-purger.py -c wms-command.conf -V dteam -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Purge Mechanism ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Test purge , normal job cycle ( Submit to LCG CE ) Test 2: Test purge, normal job cycle ( Submit to CREAM CE ) Test 3: Test proxy cache purging ===> ===> Test: WMS-check-purger.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:34:19 ===> Ended : 13:00:47 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120323123419.log
| |||||||
SandboxDir cron purgerThe purge of the SandBox dir is done by a cron job | ||||||||
Line: 2788 to 2877 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Line: 2807 to 2900 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2374 to 2374 | ||||||||
Added: | ||||||||
> > | The following bug https://savannah.cern.ch/bugs/?func=detailitem&item_id=90610![]() | |||||||
Configuration fileVerified that the following entries are present in/etc/glite-wms/glite_wms.conf : | ||||||||
Line: 2567 to 2569 | ||||||||
===> test PASSED | ||||||||
Added: | ||||||||
> > | Limiter mechanism[capannini@cert-17 WMS-service]$ python WMS-limiter-mechanism.py -c wms-command.conf -V dteam -d 3 -l -t 1,4,6-10 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Limiter Mechanism ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Test option --load1 threshold for load average (1 min) Test 4: Test option --memusage threshold for memory usage (%) Test 6: Test option --ftpconn threshold for number of FTP connections Test 7: Test option --diskusage threshold for disk usage (%) ===> ===> Test: WMS-limiter-mechanism.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 11:27:11 ===> Ended : 11:27:24 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120323112711.log
PurgeNormal job cycleSandboxDir cron purgerThe purge of the SandBox dir is done by a cron job - Submit a job and force its purge before it finishes: [capannini@cert-17 ~]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ls.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/VytISYunnM2UepnpRN9o3w ========================================================================== [capannini@cert-17 ~]$ [capannini@cert-17 ~]$ [capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/VytISYunnM2UepnpRN9o3w ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/VytISYunnM2UepnpRN9o3w Current Status: Scheduled Status Reason: unavailable Destination: cebo-t3-01.cr.cnaf.infn.it:8443/cream-lsf-T3_BO Submitted: Fri Mar 23 12:36:49 2012 CET ========================================================================== [root@emi-demo11 SandboxDir]# su - glite [glite@emi-demo11 ~]$ [glite@emi-demo11 ~]$ [glite@emi-demo11 ~]$ [glite@emi-demo11 ~]$ [glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/Vy/ -s 23 Mar, 12:38:06 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/VytISYunnM2UepnpRN9o3w: removed DONE job ===> === test PASSED === - Purge a done job: [capannini@cert-17 ~]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ls.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q ========================================================================== [capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q Current Status: Done (Success) Exit code: 0 Status Reason: Job Terminated Successfully Destination: cream-39.pd.infn.it:8443/cream-pbs-cert Submitted: Fri Mar 23 12:42:45 2012 CET ========================================================================== [glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/HX -s 23 Mar, 12:51:19 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q: removed DONE job [capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/HXAN0jlDqWuDPE_8SDU09Q Current Status: Cleared Status Reason: timed out, resource purge forced Destination: cream-39.pd.infn.it:8443/cream-pbs-cert Submitted: Fri Mar 23 12:42:45 2012 CET ========================================================================== ===> === test PASSED === | |||||||
Performance testCollection of 1000 nodesSubmission of a collection of 1000 nodes | ||||||||
Line: 2673 to 2806 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2343 to 2343 | ||||||||
* cancel.tgz: cancel.tgz | ||||||||
Added: | ||||||||
> > | Proxy renewalIt is necessary to clean the proxies from ice and proxyreneal:[root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice stop stopping ICE... ok [root@emi-demo11 siteinfo]# rm -rf /var/ice/persist_dir/* [root@emi-demo11 siteinfo]# /etc/init.d/glite-wms-ice start [root@emi-demo11 siteinfo]# rm -f /var/glite/spool/glite-renewd/* then Setting MYPROXYSERVER=emitb2.ics.muni.cz in wms-command.conf [capannini@cert-17 WMS-service]$ voms-proxy-init --voms dteam Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Creating temporary proxy ........................................... Done Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done Creating proxy ............................................. Done Your proxy is valid until Fri Mar 23 04:02:35 2012 [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ myproxy-init -s emitb2.ics.muni.cz -d -n Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Creating proxy ....................................................................... Done Proxy Verify OK Your proxy is valid until: Thu Mar 29 17:02:38 2012 A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on emitb2.ics.muni.cz. | |||||||
Configuration fileVerified that the following entries are present in/etc/glite-wms/glite_wms.conf : |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2343 to 2343 | ||||||||
* cancel.tgz: cancel.tgz | ||||||||
Added: | ||||||||
> > | Configuration fileVerified that the following entries are present in/etc/glite-wms/glite_wms.conf :
ICE section
ICE = [ job_cancellation_threshold_time = 300; max_logfile_size = 100*1024*1024; cream_url_prefix = "https://"; start_subscription_updater = true; max_ice_mem = 2096000; InputType = "jobdir"; subscription_update_threshold_time = 3600; ice_log_level = 700; listener_enable_authn = true; listener_enable_authz = true; poller_status_threshold_time = 30*60; lease_update_frequency = 20*60; lease_delta_time = 0; cream_url_postfix = "/ce-cream/services/CREAM2"; subscription_duration = 86400; start_lease_updater = false; notification_frequency = 3*60; creamdelegation_url_postfix = "/ce-cream/services/gridsite-delegation"; ice_host_cert = "/home/glite/.certs/hostcert.pem"; cemon_url_postfix = "/ce-monitor/services/CEMonitor"; ice_topic = "CREAM_JOBS"; start_proxy_renewer = true; Input = "/var/ice/jobdir"; max_logfile_rotations = 10; start_poller = true; listener_port = 7010; poller_delay = 2*60; creamdelegation_url_prefix = "https://"; purge_jobs = false; start_listener = false; proxy_renewal_frequency = 600; bulk_query_size = 100; soap_timeout = 60; persist_dir = "/var/ice/persist_dir"; log_on_file = true; logfile = "${WMS_LOCATION_LOG}/ice.log"; ice_host_key = "/home/glite/.certs/hostkey.pem"; max_ice_threads = 10; log_on_console = false; cemon_url_prefix = "https://"; ice_empty_threshold = 600; ];WorkloadManagerProxy: WorkloadManagerProxy = [ EnableServiceDiscovery = false; ListMatchRootPath = "/tmp"; OperationLoadScripts = [ jobSubmit = "${WMS_LOCATION_SBIN}/glite_wms_wmproxy_load_monitor --oper jobSubmit --load1 22 --load5 20 --load15 18 --memusage 99 --diskusage 95 --fdnum 1000 --jdnum 1500 --ftpconn 300"; jobRegister = "${WMS_LOCATION_SBIN}/glite_wms_wmproxy_load_monitor --oper jobRegister --load1 22 --load5 20 --load15 18 --memusag e 99 --diskusage 95 --fdnum 1000 --jdnum 1500 --ftpconn 300"; ]; MinPerusalTimeInterval = 1000; MaxServedRequests = 50; ServiceDiscoveryInfoValidity = 3600; LBServer = {"emi-demo11.cnaf.infn.it:9000"}; LBServiceDiscoveryType = "org.glite.lb.server"; LogLevel = 5; SandboxStagingPath = "${WMS_LOCATION_VAR}/SandboxDir"; LBLocalLogger = "localhost:9002"; WeightsCacheValidity = 86400; LogFile = "${WMS_LOCATION_LOG}/wmproxy.log"; AsyncJobStart = true; GridFTPPort = 2811; MaxInputSandboxSize = 100000000; ];NetworkServer: NetworkServer = [ II_Timeout = 100; EnableQuotaManagement = false; QuotaInsensibleDiskPortion = 2.0; SandboxStagingPath = "${WMS_LOCATION_VAR}/SandboxDir"; II_DN = "mds-vo-name=local, o=grid"; MasterThreads = 8; ConnectionTimeout = 300; LogFile = "${WMS_LOCATION_LOG}/networkserver_events.log"; LogLevel = 5; II_Contact = "cert-bdii-04.cnaf.infn.it"; //II_Contact = "egee-bdii.cnaf.infn.it"; II_Port = 2170; QuotaAdjustmentAmount = 10000; DispatcherThreads = 10; Gris_DN = "mds-vo-name=local, o=grid"; Gris_Port = 2170; DLI_SI_CatalogTimeout = 60; EnableDynamicQuotaAdjustment = false; ListMatchParadise = "${WMS_LOCATION_TMP}/MatchArea"; Gris_Timeout = 20; BacklogSize = 64; ListeningPort = 7772; MaxInputSandboxSize = 10000000; ];WorkloadManager: WorkloadManager = [ DisablePurchasingFromGris = true; IsmBlackList = {}; ExpiryPeriod = 7200; PipeDepth = 200; JobWrapperTemplateDir = "${WMS_JOBWRAPPER_TEMPLATE}"; IsmDump = "${WMS_LOCATION_VAR}/workload_manager/ismdump.fl"; IsmIiPurchasingRate = 480; MatchRetryPeriod = 600; MaxReplansCount = 5; EnableRecovery = true; DispatcherType = "jobdir"; LogLevel = 5; LogFile = "${WMS_LOCATION_LOG}/workload_manager_events.log"; DliServiceName = "data-location-interface"; RuntimeMalloc = "/usr/lib64/libjemalloc.so.1"; IsmUpdateRate = 600; WmsRequirements = ((ShortDeadlineJob =?= TRUE) ? RegExp(".*sdj$", other.GlueCEUniqueID) : !RegExp(".*sdj$", other.GlueCEUniqueID)) && (other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs) && (EnableWmsFeedback =?= TRUE ? RegExp("cream", other.GlueCEImplementationName, "i") : true); CeMonitorAsynchPort = 0; QueueSize = 1000; EnableBulkMM = true; MaxRetryCount = 10; SiServiceName = "org.glite.SEIndex"; IsmThreads = false; MaxOutputSandboxSize = -1; CeForwardParameters = {"GlueHostMainMemoryVirtualSize","GlueHostMainMemoryRAMSize","GlueCEPolicyMaxCPUTime"}; CeMonitorServices = {}; IsmIiLDAPCEFilterExt = "(|(GlueCEAccessControlBaseRule=VO:atlas)(GlueCEAccessControlBaseRule=VOMS:/atlas/*)(GlueCEAccessControlBaseRule=VO:alice)(GlueCEAccessControlBaseRule=VOMS:/alice/*)(GlueCEAccessControlBaseRule=VO:lhcb)(GlueCEAccessControlBaseRule=VOMS:/lhcb/*)(GlueCEAccessControlBaseRule=VO:cms)(GlueCEAccessControlBaseRule=VOMS:/cms/*)(GlueCEAccessControlBaseRule=VO:dteam)(GlueCEAccessControlBaseRule=VOMS:/dteam/*)(GlueCEAccessControlBaseRule=VO:biomed)(GlueCEAccessControlBaseRule=VOMS:/biomed/*)(GlueCEAccessControlBaseRule=VO:ops)(GlueCEAccessControlBaseRule=VOMS:/ops/*)(GlueCEAccessControlBaseRule=VO:infngrid)(GlueCEAccessControlBaseRule=VOMS:/infngrid/*)(GlueCEAccessControlBaseRule=VO:testers.eu-emi.eu)(GlueCEAccessControlBaseRule=VOMS:/testers.eu-emi.eu/*))"; ReplanGracePeriod = 3600; Input = "${WMS_LOCATION_VAR}/workload_manager/jobdir"; WorkerThreads = 5; ];Common section: Common = [ HostProxyFile = "${WMS_LOCATION_VAR}/glite/wms.proxy"; LBProxy = true; DGUser = "${GLITE_WMS_USER}"; ];Logmonitor section: LogMonitor = [ CondorLogRecycleDir = "${WMS_LOCATION_VAR}/logmonitor/CondorG.log/recycle"; LockFile = "${WMS_LOCATION_VAR}/logmonitor/lock"; AbortedJobsTimeout = 600; CondorLogDir = "${WMS_LOCATION_VAR}/logmonitor/CondorG.log"; MonitorInternalDir = "${WMS_LOCATION_VAR}/logmonitor/internal"; MainLoopDuration = 5; GlobusDownTimeout = 7200; LogLevel = 5; JobsPerCondorLog = 1000; LogFile = "${WMS_LOCATION_LOG}/logmonitor_events.log"; ExternalLogFile = "${WMS_LOCATION_LOG}/logmonitor_external.log"; RemoveJobFiles = true; IdRepositoryName = "irepository.dat"; ForceCancellationRetries = 2; ];JobController section: JobController = [ Input = "${WMS_LOCATION_VAR}/jobcontrol/jobdir/"; ContainerRefreshThreshold = 1000; CondorQuery = "${CONDORG_INSTALL_PATH}/bin/condor_q"; LogFile = "${WMS_LOCATION_LOG}/jobcontoller_events.log"; CondorDagman = "${CONDORG_INSTALL_PATH}/bin/condor_dagman"; MaximumTimeAllowedForCondorMatch = 1800; CondorRelease = "${CONDORG_INSTALL_PATH}/bin/condor_release"; OutputFileDir = "${WMS_LOCATION_VAR}/jobcontrol/condorio"; InputType = "jobdir"; CondorRemove = "${CONDORG_INSTALL_PATH}/bin/condor_rm"; DagmanMaxPre = 10; LockFile = "${WMS_LOCATION_VAR}/jobcontrol/lock"; SubmitFileDir = "${WMS_LOCATION_VAR}/jobcontrol/submit"; CondorSubmit = "${CONDORG_INSTALL_PATH}/bin/condor_submit"; LogLevel = 5; ];Verified that:
| |||||||
Performance testCollection of 1000 nodesSubmission of a collection of 1000 nodes |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2218 to 2218 | ||||||||
* resubmit.tgz: resubmit.tgz | ||||||||
Added: | ||||||||
> > | Job cancel[capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Cancel Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try to cancel a normal job Test 2: Try to cancel a DAG job Test 3: Try to cancel one node of a DAG job Test 4: Try to cancel a collection job Test 5: Try to cancel one node of a collection job Test 6: Try to cancel a parametric job Test 7: Try to cancel one node of a parametric job Test 8: Try to cancel a MPI job ===> ===> Test: WMS-job-cancel.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 17:32:35 ===> Ended : 17:39:44 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321173235.log [capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Cancel Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try to cancel a normal job Test 2: Try to cancel a DAG job Test 3: Try to cancel one node of a DAG job Test 4: Try to cancel a collection job Test 5: Try to cancel one node of a collection job Test 6: Try to cancel a parametric job Test 7: Try to cancel one node of a parametric job Test 8: Try to cancel a MPI job ===> ===> Test: WMS-job-cancel.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 17:32:58 ===> Ended : 17:39:39 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321173258.log [capannini@cert-17 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Cancel Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Try to cancel a normal job Test 2: Try to cancel a DAG job Test 3: Try to cancel one node of a DAG job Test 4: Try to cancel a collection job Test 5: Try to cancel one node of a collection job Test 6: Try to cancel a parametric job Test 7: Try to cancel one node of a parametric job Test 8: Try to cancel a MPI job ===> ===> Test: WMS-job-cancel.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 17:37:44 ===> Ended : 17:46:02 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321173744.log* cancel.tgz: cancel.tgz | |||||||
Performance testCollection of 1000 nodesSubmission of a collection of 1000 nodes | ||||||||
Line: 2304 to 2429 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Line: 2321 to 2448 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2147 to 2147 | ||||||||
* prologue.tgz: prologue.tgz | ||||||||
Added: | ||||||||
> > | Shallow and deep resubmission[capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Resubmission Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try a shallow resubmission Test 2: Try a deep resubmission ===> ===> Test: WMS-job-resubmit.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 15:43:25 ===> Ended : 16:07:40 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321154325.log [capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Resubmission Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try a shallow resubmission Test 2: Try a deep resubmission ===> ===> Test: WMS-job-resubmit.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 15:43:41 ===> Ended : 15:56:24 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321154341.log [capannini@cert-17 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Resubmission Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Try a shallow resubmission Test 2: Try a deep resubmission ===> ===> Test: WMS-job-resubmit.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 15:44:20 ===> Ended : 15:56:28 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321154420.log* resubmit.tgz: resubmit.tgz | |||||||
Performance testCollection of 1000 nodesSubmission of a collection of 1000 nodes | ||||||||
Line: 2231 to 2302 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Line: 2247 to 2320 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2177 to 2177 | ||||||||
1 jobs submitted in 5 seconds: 5/5/5 (min/avg/max) Test finishes at mer mar 21 12:13:30 CET 2012 | ||||||||
Added: | ||||||||
> > | All the nodes of the collection reached the status Done (Success), except a few of them which were submitted to the CE cremoso.cnaf.infn.it which had problems. ===> Test PASSED | |||||||
Stress test | ||||||||
Line: 2189 to 2192 | ||||||||
| ||||||||
Added: | ||||||||
> > | [capannini@cert-17 StressTest]$ ./StressTest.sh -t 2880 -n 25 -c ~/wms_devel20.conf -j ls.jdl Test starts on mer mar 21 16:10:09 CET 2012: submit 2880 collections (of 25 nodes) with a frequency of 60 seconds using 1 users. Results | |||||||
FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1971 to 1971 | ||||||||
===> Test PASSED
Gangmatching | ||||||||
Added: | ||||||||
> > | [capannini@cert-17 certification]$ cat gang.jdl [ executable="ls.sh"; myproxyserver=""; SErequirements = anyMatch(other.storage.CloseSEs, target.GlueSAStateAvailableSpace > 20); //SErequirements = true; CErequirements = other.GlueCEStateStatus == "Production" && other.GlueCEInfoTotalCPUs >= 2; requirements = CErequirements && SErequirements; inputsandbox={"ls.sh"}; stdoutput="out3.out"; stderror="err2.err"; outputsandbox={"out3.out", "err2.err", "ls.sh", "a"}; ] [capannini@cert-17 certification]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf gang.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ========================================================================== COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found: *CEId* - cccreamceli05.in2p3.fr:8443/cream-sge-long - cccreamceli05.in2p3.fr:8443/cream-sge-medium - cccreamceli05.in2p3.fr:8443/cream-sge-short - cccreamceli06.in2p3.fr:8443/cream-sge-long - cccreamceli06.in2p3.fr:8443/cream-sge-medium - cccreamceli06.in2p3.fr:8443/cream-sge-short - cccreamceli09.in2p3.fr:8443/cream-sge-long - cccreamceli09.in2p3.fr:8443/cream-sge-medium - cccreamceli09.in2p3.fr:8443/cream-sge-short - cccreamceli10.in2p3.fr:8443/cream-sge-long - cccreamceli10.in2p3.fr:8443/cream-sge-medium - cccreamceli10.in2p3.fr:8443/cream-sge-short - cmsrm-ce01.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert - cmsrm-ce02.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert - grid010.ct.infn.it:2119/jobmanager-lcgpbs-cert - unict-dmi-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-cert - virgo-ce.roma1.infn.it:2119/jobmanager-lcgpbs-cert - cmsrm-cream01.roma1.infn.it:8443/cream-lsf-cmsgcert - ce-01.grid.sissa.it:8443/cream-pbs-blade - cream-ce.pg.infn.it:8443/cream-pbs-cert - inaf-ce-01.ct.pi2s2.it:8443/cream-lsf-cert ========================================================================== In order to verify that the SErequirements are met: [capannini@cert-17 certification]$ lcg-infosites closeSE|grep -A 5 cccreamceli05 Name of the CE: cccreamceli05.in2p3.fr:8443/cream-sge-long ccsrm.in2p3.fr Name of the CE: cccreamceli05.in2p3.fr:8443/cream-sge-medium ccsrm.in2p3.fr Name of the CE: cccreamceli05.in2p3.fr:8443/cream-sge-short ccsrm.in2p3.fr Name of the CE: cccreamceli06.in2p3.fr:8443/cream-sge-long ccsrm.in2p3.fr [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ lcg-infosites se |egrep 'Avail|ccsrm.in2p3.fr' Avail Space(kB) Used Space(kB) Type SE 12601333761 2431051775 SRM ccsrm.in2p3.fr [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ lcg-infosites closeSE|grep -A 5 cmsrm-ce01 Name of the CE: cmsrm-ce01.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert cmsrm-se01.roma1.infn.it Name of the CE: cmsrm-ce02.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert cmsrm-se01.roma1.infn.it [capannini@cert-17 certification]$ lcg-infosites se |egrep 'Avail|cmsrm-se01.roma1.infn.it' Avail Space(kB) Used Space(kB) Type SE 1000 999999 SRM cmsrm-se01.roma1.infn.it [capannini@cert-17 certification]$ lcg-infosites closeSE|grep -A 5 unict-dmi-ce-01 Name of the CE: unict-dmi-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-cert unict-dmi-se-01.ct.pi2s2.it Name of the CE: unime-ce-01.me.pi2s2.it:2119/jobmanager-lcglsf-cert unime-se-01.me.pi2s2.it [capannini@cert-17 certification]$ lcg-infosites se |egrep 'Avail|unict-dmi-se-01.ct.pi2s2.it' Avail Space(kB) Used Space(kB) Type SE 58137369 8679392 SRM unict-dmi-se-01.ct.pi2s2.it Moreover, setting SErequirements = true in the jdl, the list of matching CEs is far longer.===> Test PASSED Prologue and Epilogue jobs[capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test prologue and epilogue attributes ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test prologue attribute Test 2: Test epilogue attribute Test 3: Test prologue and epilogue attributes ===> ===> Test: WMS-prologue-epilogue.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:42:41 ===> Ended : 12:48:00 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321124241.log [capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test prologue and epilogue attributes ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test prologue attribute Test 2: Test epilogue attribute Test 3: Test prologue and epilogue attributes ===> ===> Test: WMS-prologue-epilogue.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:42:55 ===> Ended : 12:47:44 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321124255.log [capannini@cert-17 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test prologue and epilogue attributes ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Test prologue attribute Test 2: Test epilogue attribute Test 3: Test prologue and epilogue attributes ===> ===> Test: WMS-prologue-epilogue.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:43:46 ===> Ended : 12:50:02 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321124346.log* prologue.tgz: prologue.tgz Performance testCollection of 1000 nodesSubmission of a collection of 1000 nodes[capannini@cert-17 StressTest]$ ./StressTest.sh -t 1 -n 1000 -c ~/wms_devel20.conf -j ls.jdl Test starts on mer mar 21 12:13:25 CET 2012: submit 1 collections (of 1000 nodes) with a frequency of 60 seconds using 1 users. Submission n. 1: mer mar 21 12:13:25 CET 2012: user 0 is submitting... Connecting to the service https://devel20.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://devel17.cnaf.infn.it:9000/_-FtjYEN09PrG31-TpMU1A The job identifier has been saved in the following file: /home/capannini/certification/StressTest/Test_1332328400/output/USER0_0.jobid ========================================================================== Submission takes 5 seconds. 1 jobs submitted in 5 seconds: 5/5/5 (min/avg/max) Test finishes at mer mar 21 12:13:30 CET 2012 Stress test
| |||||||
FabioCapannini - 2012-03-15 | ||||||||
Line: 2002 to 2219 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Line: 2017 to 2236 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1414 to 1414 | ||||||||
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20120320122015.log | ||||||||
Added: | ||||||||
> > |
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 5
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 5: Submit a MPI job (3 cases LCG-CE, CREAM, general)
Test 5A: Submit to an LCG-CE
Test 5B: Submit to a CREAM CE
Test 5C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 17:45:39
===> Ended : 18:20:06
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20120320174539.log | |||||||
Added: | ||||||||
> > |
| |||||||
Testing forwarding parameters for parallel jobsIn order to test the passing of mpi parameters (wholenodes,smpgranularity,cpunumber,hostnumber) to the ce, an mpi jdl is submitted with varying values for the parameters, specifying a cream CE as destination. Then the cream jobid is retrieved via a glite-wms-job-logging-info -v 2 ("Dest jobid" field of a Transfer event).Finally the cream jdl is found via glite-ce-job-status -L 2 <cream-jobid>. | ||||||||
Line: 1690 to 1719 | ||||||||
===> Test log file is WMSService-TS_20120320175026.log
| ||||||||
Added: | ||||||||
> > |
Job List-matchWithout data[capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job ListMatch Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: check if glite-wms-job-list-match command exists Test 2: test a simple matching Test 3: check --delegationid option Test 4: exclude a CE from the match Test 5: try a failure matching (Requirements == false) Test 6: try a matching with EnableWMSFeedback attribute true ===> ===> Test: WMS-listmatch-test.py ===> WMS: emi-demo12.cnaf.infn.it ===> Started: 10:52:17 ===> Ended : 10:52:41 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321105217.log [capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job ListMatch Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: check if glite-wms-job-list-match command exists Test 2: test a simple matching Test 3: check --delegationid option Test 4: exclude a CE from the match Test 5: try a failure matching (Requirements == false) Test 6: try a matching with EnableWMSFeedback attribute true ===> ===> Test: WMS-listmatch-test.py ===> WMS: emi-demo12.cnaf.infn.it ===> Started: 10:52:40 ===> Ended : 10:53:02 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321105240.log [capannini@cert-17 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Creating proxy ............................................................................................................................... Done Proxy Verify OK Your proxy is valid until: Wed Mar 28 11:53:08 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done Creating proxy ............................................................................................................................................................................... Done Your proxy is valid until Wed Mar 21 21:53:34 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@cert-17 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:53 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:52 uri : voms2.hellasgrid.gr:15004 [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job ListMatch Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: check if glite-wms-job-list-match command exists Test 2: test a simple matching Test 3: check --delegationid option Test 4: exclude a CE from the match Test 5: try a failure matching (Requirements == false) Test 6: try a matching with EnableWMSFeedback attribute true ===> ===> Test: WMS-listmatch-test.py ===> WMS: emi-demo12.cnaf.infn.it ===> Started: 10:53:48 ===> Ended : 10:54:07 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120321105348.log
With data[capannini@cert-17 WMS-service]$ export LFC_HOST=prod-lfc-shared-central.cern.ch [capannini@cert-17 WMS-service]$ lcg-lr --vo dteam lfn:/grid/dteam/fcapanni/PI_1M.txt srm://gridsrm.pi.infn.it/dteam/fcapanni/PI_1M.txt srm://srm-public.cern.ch/castor/cern.ch/grid/dteam/fcapanni/PI_1M.txt The two SEs where the file can be found are gridsrm.pi.infn.it and srm-public.cern.ch. [capannini@cert-17 WMS-service]$ cat JDLs/data-req.jdl ########################################### # JDL with Data Requirements # ########################################### Executable = "/bin/ls"; Arguments = "-la"; StdOutput = "std.out"; StdError = "std.err"; Prologue = "prologue.sh"; FuzzyRank = true; Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"}; InputSandbox = {"JDLs/prologue.sh"}; OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"}; DataRequirements = { [ DataCatalogType = "DLI"; DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" }; ] }; DataAccessProtocol = "gsiftp"; AllowZippedISB=true; RetryCount = 1; ShallowRetryCount = 2; [capannini@cert-17 WMS-service]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf JDLs/data-req.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ========================================================================== COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found: *CEId* - ce203.cern.ch:8443/cream-lsf-grid_2nh_dteam - ce203.cern.ch:8443/cream-lsf-grid_dteam - ce204.cern.ch:8443/cream-lsf-grid_2nh_dteam - ce204.cern.ch:8443/cream-lsf-grid_dteam - ce206.cern.ch:8443/cream-lsf-grid_2nh_dteam - ce206.cern.ch:8443/cream-lsf-grid_dteam - ce208.cern.ch:8443/cream-lsf-grid_2nh_dteam - ce208.cern.ch:8443/cream-lsf-grid_dteam - cream.sns.it:8443/cream-pbs-cert - gridce3.pi.infn.it:8443/cream-lsf-certmpi - gridce0.pi.infn.it:8443/cream-lsf-cert - gridce1.pi.infn.it:2119/jobmanager-lcglsf-cert - gridce2.pi.infn.it:2119/jobmanager-lcglsf-cert - gridce.sns.it:2119/jobmanager-lcgpbs-cert ========================================================================== In order to verify that these CEs are close to the above SEs: [capannini@cert-17 WMS-service]$ lcg-infosites --vo dteam closeSE|grep -A 5 ce203 Name of the CE: ce203.cern.ch:8443/cream-lsf-grid_2nh_dteam srm-atlas.cern.ch srm-cms.cern.ch srm-lhcb.cern.ch srm-public.cern.ch Name of the CE: ce203.cern.ch:8443/cream-lsf-grid_dteam srm-atlas.cern.ch srm-cms.cern.ch srm-lhcb.cern.ch srm-public.cern.ch [capannini@cert-17 WMS-service]$ lcg-infosites --vo dteam closeSE|grep -A 5 ce204 Name of the CE: ce204.cern.ch:8443/cream-lsf-grid_2nh_dteam srm-atlas.cern.ch srm-cms.cern.ch srm-lhcb.cern.ch srm-public.cern.ch Name of the CE: ce204.cern.ch:8443/cream-lsf-grid_dteam srm-atlas.cern.ch srm-cms.cern.ch srm-lhcb.cern.ch srm-public.cern.ch [capannini@cert-17 WMS-service]$ lcg-infosites --vo dteam closeSE|grep -A 5 gridce3.pi Name of the CE: gridce3.pi.infn.it:8443/cream-lsf-certmpi gridsrm.pi.infn.it Name of the CE: gridgate.cp.dias.ie:2119/jobmanager-lcgpbs-test gridstore.cp.dias.ie [capannini@cert-17 WMS-service]$ lcg-infosites --vo dteam closeSE|grep -A 5 gridce2 Name of the CE: gridce2.pi.infn.it:2119/jobmanager-lcglsf-cert gridsrm.pi.infn.it Name of the CE: gridce3.pi.infn.it:8443/cream-lsf-certmpi gridsrm.pi.infn.it===> Test PASSED Gangmatching | |||||||
FabioCapannini - 2012-03-15 | ||||||||
Line: 1730 to 2015 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1517 to 1517 | ||||||||
===> test PASSED
Perusal | ||||||||
Added: | ||||||||
> > | [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 6 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 6: Submit a perusal job BEWARE default min perusal interval is 1000 secs, so this phase could take many minutes ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 16:36:17 ===> Ended : 17:02:41 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120320163617.log [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 6 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 6: Submit a perusal job BEWARE default min perusal interval is 1000 secs, so this phase could take many minutes ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 16:36:46 ===> Ended : 17:05:11 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120320163646.log [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 6 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 6: Submit a perusal job BEWARE default min perusal interval is 1000 secs, so this phase could take many minutes ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 16:37:11 ===> Ended : 17:04:33 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120320163711.log* perusal.tgz: perusal.tgz Delegation[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test delegation operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Check --autm-delegation option Test 2: Check --delegationid option Test 3: Try to delegate with a short proxy and check the validity | |||||||
Added: | ||||||||
> > |
Test 4: Works with expired proxy
===>
===> Test: WMS-delegation-test.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 17:49:18
===> Ended : 17:50:36
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20120320174918.log
[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test delegation operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Test 1: Check --autm-delegation option
Test 2: Check --delegationid option
Test 3: Try to delegate with a short proxy and check the validity
Test 4: Works with expired proxy
===>
===> Test: WMS-delegation-test.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 17:49:50
===> Ended : 17:51:05
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20120320174950.log
[capannini@cert-17 WMS-service]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type : proxy
strength : 2048 bits
path : /tmp/x509up_u504
timeleft : 4:07:36
key usage : Digital Signature, Key Encipherment, Data Encipherment
= VO dteam extension information =
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft : 5:06:36
uri : voms.hellasgrid.gr:15004
[capannini@cert-17 WMS-service]$
[capannini@cert-17 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -d 3 -l
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test delegation operation
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Test 1: Check --autm-delegation option
Test 2: Check --delegationid option
There are other two tests which require the user proxy password. Use -i option to enable them
===>
===> Test: WMS-delegation-test.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 17:50:26
===> Ended : 17:50:30
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20120320175026.log
| |||||||
FabioCapannini - 2012-03-15 | ||||||||
Line: 1541 to 1713 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Line: 1552 to 1728 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1386 to 1386 | ||||||||
* dag.tgz: dag.tgz
Parallel job | ||||||||
Added: | ||||||||
> > | [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 5 -i===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 5: Submit a MPI job (3 cases LCG-CE, CREAM, general) Test 5A: Submit to an LCG-CE | |||||||
Added: | ||||||||
> > | Test 5B: Submit to a CREAM CE
Test 5C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo12.cnaf.infn.it
===> Started: 12:20:15
===> Ended : 12:32:42
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20120320122015.log
| |||||||
Testing forwarding parameters for parallel jobsIn order to test the passing of mpi parameters (wholenodes,smpgranularity,cpunumber,hostnumber) to the ce, an mpi jdl is submitted with varying values for the parameters, specifying a cream CE as destination. Then the cream jobid is retrieved via a glite-wms-job-logging-info -v 2 ("Dest jobid" field of a Transfer event).Finally the cream jdl is found via glite-ce-job-status -L 2 <cream-jobid>. |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1306 to 1306 | ||||||||
* param.tgz: param.tgz | ||||||||
Added: | ||||||||
> > | DAG job[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 4: Submit a DAG job ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 11:19:51 ===> Ended : 12:17:56 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120320111951.log [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 4: Submit a DAG job ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 11:19:41 ===> Ended : 12:17:57 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120320111941.log [capannini@cert-17 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:38:18 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:37:18 uri : voms.hellasgrid.gr:15004 [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 4: Submit a DAG job ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 11:19:35 ===> Ended : 12:17:32 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120320111935.log* dag.tgz: dag.tgz Parallel jobTesting forwarding parameters for parallel jobsIn order to test the passing of mpi parameters (wholenodes,smpgranularity,cpunumber,hostnumber) to the ce, an mpi jdl is submitted with varying values for the parameters, specifying a cream CE as destination. Then the cream jobid is retrieved via a glite-wms-job-logging-info -v 2 ("Dest jobid" field of a Transfer event).Finally the cream jdl is found via glite-ce-job-status -L 2 <cream-jobid>. The following jdls were submitted: 1)Executable = "openmpi-wrapper.sh"; Arguments="hello"; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"}; Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID); WholeNodes = true; SMPGranularity = 2; CpuNumber=2; Hostnumber = 1;Resulting cream JDL: JDL = [[ CEInfoHostName = "cex.grid.unipg.it"; OutputSandboxPath = "/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "cex.grid.unipg.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000011:BH=0000000000:JSS=000004:LM=000012:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; ce_id = "cex.grid.unipg.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_9Y6A4yCPUrI5GyKYt7p3yQ_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/k0SUJnW3rEOTwV5SeQgAWA"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 2; InputSandboxPath = "/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/input"; CeApplicationDir = "/opt/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/token.txt_0"; rank = -other.GlueCEStateEstimatedResponseTime; WholeNodes = true; CpuNumber = 2; edg_previous_matches = { "ce.scope.unina.it" }; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "torque"; MyProxyServer = "myproxy.cnaf.infn.it"; edg_previous_matches_ex = { [ timestamp = 1332241946; ce_id = "ce.scope.unina.it" ] }; X509UserProxy = "/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; Hostnumber = 1; requirements = ( ( ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && other.GlueCEInfoTotalCPUs >= 2 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueCEInfoTotalCPUs >= 2 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) : !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/k0/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fk0SUJnW3rEOTwV5SeQgAWA" ]]2) Executable = "openmpi-wrapper.sh"; Arguments="hello"; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"}; Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID); WholeNodes = true; SMPGranularity = 2;Resulting cream jdl: JDL = [[ CEInfoHostName = "cex.grid.unipg.it"; OutputSandboxPath = "/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "cex.grid.unipg.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000005:BH=0000000000:JSS=000002:LM=000002:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; ce_id = "cex.grid.unipg.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_J-4DceQ34C_J3-t-Z2F69Q_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/iiJ6s786Fq0Lm6kCuJaCWQ"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 2; InputSandboxPath = "/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/input"; CeApplicationDir = "/opt/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/token.txt_0"; rank = -other.GlueCEStateEstimatedResponseTime; WholeNodes = true; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "torque"; MyProxyServer = "myproxy.cnaf.infn.it"; X509UserProxy = "/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; requirements = ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) : !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/ii/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiiJ6s786Fq0Lm6kCuJaCWQ" ]]3) Executable = "openmpi-wrapper.sh"; Arguments="hello"; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"}; Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID); WholeNodes = false; SMPGranularity = 3; CpuNumber=3; Hostnumber = 1; Submission result: [capannini@cert-17 mpi]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf mpi.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server Error - SMPGranularity and HostNumber are mutually exclusive when WholeNodes allocation is not requested: wrong combination of values4) Executable = "openmpi-wrapper.sh"; Arguments="hello"; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"}; Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID); WholeNodes = false; SMPGranularity = 3; CpuNumber=3;Resulting cream jdl: JDL = [[ CEInfoHostName = "gridsrv2-4.dir.garr.it"; OutputSandboxPath = "/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "gridsrv2-4.dir.garr.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000005:BH=0000000000:JSS=000002:LM=000002:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; ce_id = "gridsrv2-4.dir.garr.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_gJoXBXkTpXAm9blO6-oh6w_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/jYRRmxWg0IzO4ayEujALIg"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 3; InputSandboxPath = "/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/input"; CeApplicationDir = "/opt/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/token.txt_0"; rank = -other.GlueCEStateEstimatedResponseTime; WholeNodes = false; CpuNumber = 3; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "pbs"; MyProxyServer = "myproxy.cnaf.infn.it"; X509UserProxy = "/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; requirements = ( ( ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && other.GlueCEInfoTotalCPUs >= 3 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueCEInfoTotalCPUs >= 3 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) : !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/jY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fjYRRmxWg0IzO4ayEujALIg" ]]5) Executable = "openmpi-wrapper.sh"; Arguments="hello"; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"}; Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID); WholeNodes = true; SMPGranularity = 8; CpuNumber=8; Hostnumber = 2;Resulting ce jdl: JDL = [[ CEInfoHostName = "ce-02.roma3.infn.it"; OutputSandboxPath = "/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "ce-02.roma3.infn.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000005:BH=0000000000:JSS=000002:LM=000002:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; ce_id = "ce-02.roma3.infn.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_wwQRc-_md4BHrKn3nazbOw_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/sDZrZug3OE9ZMgX2u45AhA"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 8; InputSandboxPath = "/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/input"; CeApplicationDir = "/storage/local/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/token.txt_0"; rank = -other.GlueCEStateEstimatedResponseTime; WholeNodes = true; CpuNumber = 8; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "pbs"; MyProxyServer = "myproxy.cnaf.infn.it"; X509UserProxy = "/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; Hostnumber = 2; requirements = ( ( ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && other.GlueCEInfoTotalCPUs >= 8 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueCEInfoTotalCPUs >= 8 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) : !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/sD/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fsDZrZug3OE9ZMgX2u45AhA" ]]===> test PASSED Perusal | |||||||
FabioCapannini - 2012-03-15 | ||||||||
Line: 1328 to 1511 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Line: 1338 to 1523 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1219 to 1219 | ||||||||
Parametric job | ||||||||
Added: | ||||||||
> > | [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general)
Test 3A: Submit to an LCG-CE
Test 3B: Submit to a CREAM CE
Test 3C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:16:16
===> Ended : 17:37:20
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20120319161616.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general)
Test 3A: Submit to an LCG-CE
Test 3B: Submit to a CREAM CE
Test 3C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:16:45
===> Ended : 17:27:39
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20120319161645.log
[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general)
Test 3A: Submit to an LCG-CE
Test 3B: Submit to a CREAM CE
Test 3C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:17:29
===> Ended : 16:57:30
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20120319161729.log
* param.tgz: param.tgz | |||||||
FabioCapannini - 2012-03-15 | ||||||||
Line: 1238 to 1326 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Line: 1247 to 1337 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 12 to 12 | ||||||||
| ||||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
| ||||||||
Line: 198 to 198 | ||||||||
* WMSService-TS_20120316105040.log: WMSService-TS_20120316105040.log | ||||||||
Changed: | ||||||||
< < | Jdl with DataRequirements | |||||||
> > | Jdl with DataRequirements | |||||||
[capannini@devel15 WMS-service]$ cat ~/certification/data-req.jdl ########################################### | ||||||||
Line: 260 to 260 | ||||||||
* WMSService-TS_20120316113322.log: WMSService-TS_20120316113322.log | ||||||||
Changed: | ||||||||
< < | Jdl with ISBBaseURI and OSBDestURI | |||||||
> > | Jdl with ISBBaseURI and OSBDestURI | |||||||
Test on CREAM ce: | ||||||||
Line: 408 to 408 | ||||||||
===> test PASSED | ||||||||
Changed: | ||||||||
< < | Jdl with ISBBaseURI and OSBBaseDestURI | |||||||
> > | Jdl with ISBBaseURI and OSBBaseDestURI | |||||||
Submit to CREAM CE | ||||||||
Line: 572 to 572 | ||||||||
===> Test PASSED | ||||||||
Changed: | ||||||||
< < | Jdl with AllowZippedISB | |||||||
> > | Jdl with AllowZippedISB | |||||||
[capannini@cert-17 certification]$ cat AllowZIP.jdl | ||||||||
Line: 836 to 836 | ||||||||
====> Test passed | ||||||||
Changed: | ||||||||
< < | Jdl with ExpiryTime | |||||||
> > | Jdl with ExpiryTime | |||||||
[capannini@cert-17 certification]$ cat ExpiryTime.jdl ########################################### | ||||||||
Line: 907 to 907 | ||||||||
===> Test PASSED | ||||||||
Changed: | ||||||||
< < | Jdl with ShortDeadlineJob | |||||||
> > | Jdl with ShortDeadlineJob | |||||||
To test SDJs the following bdii must be used: egee-bdii.cnaf.infn.it | ||||||||
Line: 984 to 984 | ||||||||
| ||||||||
Changed: | ||||||||
< < | -- FabioCapannini - 2012-03-15 | |||||||
> > | CollectionBulk submission[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 2 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) Test 2A: Submit to an LCG-CE Test 2B: Submit to a CREAM CE Test 2C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:22:14 ===> Ended : 12:56:24 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120319122214.log [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) Test 2A: Submit to an LCG-CE Test 2B: Submit to a CREAM CE Test 2C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 14:17:00 ===> Ended : 14:55:41 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120319141700.log [capannini@cert-17 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Creating proxy ........................................................................................................................................... Done Proxy Verify OK Your proxy is valid until: Mon Mar 26 15:59:39 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@cert-17 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done Creating proxy ................... Done Your proxy is valid until Tue Mar 20 02:00:12 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@cert-17 WMS-service]$ [capannini@cert-17 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:45 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:45 uri : voms.hellasgrid.gr:15004 [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 2 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) Test 2A: Submit to an LCG-CE Test 2B: Submit to a CREAM CE Test 2C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 15:00:43 ===> Ended : 15:42:21 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120319150043.log
All in a jdl[capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes Test 7A: Submit to an LCG-CE Test 7B: Submit to a CREAM CE Test 7C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 15:14:03 ===> Ended : 15:42:18 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120319151403.log [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes Test 7A: Submit to an LCG-CE Test 7B: Submit to a CREAM CE Test 7C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 15:18:26 ===> Ended : 15:56:37 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120319151826.log [capannini@cert-17 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:40:34 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:39:34 uri : voms.hellasgrid.gr:15004 [capannini@cert-17 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes Test 7A: Submit to an LCG-CE Test 7B: Submit to a CREAM CE Test 7C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 15:20:10 ===> Ended : 15:56:46 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120319152010.log
Parametric jobMain.FabioCapannini - 2012-03-15 | |||||||
Line: 1006 to 1245 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 502 to 502 | ||||||||
Submit to an LCG CE: | ||||||||
Added: | ||||||||
> > | [capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf BaseURI.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/urEE8OAYVl2r9jUsAysuQw ========================================================================== [capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/urEE8OAYVl2r9jUsAysuQw ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/urEE8OAYVl2r9jUsAysuQw Current Status: Done (Success) Logged Reason(s): - Job got an error while in the CondorG queue. - Job terminated successfully Exit code: 0 Status Reason: Job terminated successfully Destination: t2-ce-03.lnl.infn.it:2119/jobmanager-lcglsf-cert1 Submitted: Fri Mar 16 16:25:36 2012 CET ========================================================================== [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/urEE8OAYVl2r9jUsAysuQw Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME No output files to be retrieved for the job: https://emi-demo11.cnaf.infn.it:9000/urEE8OAYVl2r9jUsAysuQw ================================================================================ Log on devel20: [root@devel20 ~]# ls /tmp/std.* /tmp/std.err /tmp/std.out [root@devel20 ~]# cat /tmp/std.out 7A98_2qv4Qkqihilp2blrg total 36 -rwxr-xr-x 1 dteam022 dteam 80 Mar 16 16:56 exe.sh -rw-r--r-- 1 dteam022 dteam 118 Mar 16 16:56 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f7A98_5f2qv4Qkqihilp2blrg.output -rw-r--r-- 1 dteam022 dteam 0 Mar 16 16:56 std.err -rw-r--r-- 1 dteam022 dteam 23 Mar 16 16:56 std.out -rw-r--r-- 1 dteam022 dteam 6 Mar 16 16:56 test1 -rw-r--r-- 1 dteam022 dteam 6 Mar 16 16:56 test2 -rw------- 1 dteam022 dteam 103 Mar 16 16:56 tmp.boMqn22089 -rw------- 1 dteam022 dteam 2 Mar 16 16:56 tmp.lnMRO22073 -rw------- 1 dteam022 dteam 103 Mar 16 16:56 tmp.mxsln22074 -rw------- 1 dteam022 dteam 0 Mar 16 16:56 tmp.nBJFQ22087 -rw------- 1 dteam022 dteam 2 Mar 16 16:56 tmp.twwvt22088 ===> Test PASSED Jdl with AllowZippedISB[capannini@cert-17 certification]$ cat AllowZIP.jdl ########################################### # JDL with AllowZippedISB attribute # ########################################### Executable = "/bin/ls"; Arguments = "-la"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"}; OutputSandbox = {"std.out", "std.err"}; requirements = other.GlueCEStateStatus == "Testing" && regexp("/cream", other.GlueCEUniqueID); AllowZippedISB=true; RetryCount = 1; ShallowRetryCount = 2; [capannini@cert-17 certification]$ glite-wms-job-submit --debug -a -c ~/wms_emi-demo11.conf AllowZIP.jdl ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Vo read from proxy certificate extension ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - VirtualOrganisation value : dteam ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Configuration file: /home/capannini/wms_emi-demo11.conf - VirtualOrganisation, RetryCount, rank attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes" ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Loaded user configuration file: /home/capannini/wms_emi-demo11.conf ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Configuration file: //etc/glite-wms/dteam/glite_wmsui.conf - VirtualOrganisation, MyProxyServer attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes" ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Loaded Vo specific configuration file: //etc/glite-wms/dteam/glite_wmsui.conf ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Loaded Configuration values: [ JdlDefaultAttributes = [ PerusalFileEnable = false; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; AllowZippedISB = true; VirtualOrganisation = "dteam"; rank = -other.GlueCEStateEstimatedResponseTime; MyProxyServer = "myproxy.cnaf.infn.it" ]; OutputStorage = "/tmp"; ListenerStorage = "/tmp"; ErrorStorage = "/var/tmp"; WmProxyEndPoints = { "https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server" } ] ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Getting Endpoint URL from configuration file ----------------------------------------- Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy getVersion service ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - WMProxy Version: 3.3.5 ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Sending Proxy Request to https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy delegationns__getProxyReq service ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - delegationns__getProxyReq - The proxy has been successfully retrieved ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy delegationns__putProxyReq service ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - The proxy has been successfully delegated with the identifier: QEfCo4sVtkysnpwMV4Br5w ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy getTransferProtocols service ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - getTransferProtocols - Available protocols: gsiftp, https ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - FileTransferProtocol not specified; using the default protocol: gsiftp ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - The JDL file is: /home/capannini/certification/AllowZIP.jdl ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Retrieving the list of the local ISB files from the user JDL ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Total size of the ISB file(s) to be transferred to: 1126406 ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Max single job size of the ISB file(s) to be transferred to: 1024000 ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Checking the User-FreeQuota on the server ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy getFreeQuota service ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - getFreeQuota - User freequota not set on the server ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Getting the max ISB size from the server https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy getMaxInputSandboxSize service ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - getMaxInputSandboxSize - Max ISB size information successfully retrieved ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - The max job size (1024000 bytes) doesn't exceed the max size limit of 100000000 bytes: File transfer is allowed ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - File archiving and file compression allowed by user in the JDL ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Registering JDL [ StdOutput = "std.out"; ShallowRetryCount = 2; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 1; Executable = "/bin/ls"; Type = "job"; Arguments = "-la"; AllowZippedISB = true; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; ZippedISB = { "ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar.gz" }; OutputSandbox = { "std.out","std.err" }; InputSandbox = { "file:///home/capannini/certification/fileA","file:///home/capannini/certification/fileB","file:///home/capannini/certification/fileC","file:///home/capannini/certification/fileD","file:///home/capannini/certification/fileE" }; StdError = "std.err"; rank = -other.GlueCEStateEstimatedResponseTime; MyProxyServer = "myproxy.cnaf.infn.it"; requirements = other.GlueCEStateStatus == "Testing" && regexp("/cream",other.GlueCEUniqueID) ] ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Registering the job to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy jobRegister service ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - The JobId is: https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Archiving the ISB files: /tmp/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - This archive file has been successfully created: /tmp/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Compressing the file (.gz): /tmp/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - ISB ZIPPED file successfully created: /tmp/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar.gz ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Getting the SandboxDestinationURI from the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy getSandboxDestURI service with gsiftp protocol ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - getSandboxDestURI - Destination URIs sucessfully retrieved ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - DestinationURI: gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/KA/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fKAx2BtFz9BkraoEKeaHNAw/input ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - FileTransfer (gsiftp): using globus-url-copy to transfer the local InputSandBox file(s) to the submission endpoint ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - File Transfer (gsiftp) Command: /usr/bin/globus-url-copy Source: file:///tmp/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar.gz Destination: gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/KA/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fKAx2BtFz9BkraoEKeaHNAw/input/ISBfiles_901aKw3LrX55xFsD4_xnTw_0.tar.gz ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - File Transfer (gsiftp) Transfer successfully done ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Starting the job: https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - Calling the WMProxy jobStart service ----------------------------------------- ----------------------------------------- 16 March 2012, 17:00:28 -I- PID: 3015 (Debug) - jobStart - The job has been successfully started ----------------------------------------- ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw ========================================================================== *** Log file created *** Possible Errors and Debug messages have been printed in the following file: /var/tmp/glite-wms-job-submit_504_3015_20120316_17-00-28.log Check if AllowZippedISB has been included in the jdl: [capannini@cert-17 certification]$ glite-wms-job-info --jdl https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw|grep Allow AllowZippedISB = true; [capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw Current Status: Done (Success) Exit code: 0 Status Reason: Job Terminated Successfully Destination: cream-31.pd.infn.it:8443/cream-pbs-creamtest1 Submitted: Fri Mar 16 17:00:28 2012 CET ========================================================================== [capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the job: https://emi-demo11.cnaf.infn.it:9000/KAx2BtFz9BkraoEKeaHNAw have been successfully retrieved and stored in the directory: /tmp/jobOutput/capannini_KAx2BtFz9BkraoEKeaHNAw ================================================================================ [capannini@cert-17 certification]$ ls -l /tmp/jobOutput/capannini_KAx2BtFz9BkraoEKeaHNAw totale 4 -rw-r--r-- 1 capannini emitestbed 0 16 mar 17:06 std.err -rw-r--r-- 1 capannini emitestbed 623 16 mar 17:06 std.out [capannini@cert-17 certification]$ cat /tmp/jobOutput/capannini_KAx2BtFz9BkraoEKeaHNAw/std.out total 1132 drwxr-xr-x 2 dteam026 dteam 4096 Mar 16 17:00 . drwxr-xr-x 3 dteam026 dteam 4096 Mar 16 17:00 .. -rw-r--r-- 1 dteam026 dteam 4077 Mar 16 17:00 .BrokerInfo -rw-r--r-- 1 dteam026 dteam 2 Mar 16 17:00 fileA -rw-r--r-- 1 dteam026 dteam 2 Mar 16 17:00 fileB -rw-r--r-- 1 dteam026 dteam 1024000 Mar 16 17:00 fileC -rw-r--r-- 1 dteam026 dteam 102400 Mar 16 17:00 fileD -rw-r--r-- 1 dteam026 dteam 2 Mar 16 17:00 fileE -rw-r--r-- 1 dteam026 dteam 0 Mar 16 17:00 std.err -rw-r--r-- 1 dteam026 dteam 0 Mar 16 17:00 std.out -rw-r--r-- 1 dteam026 dteam 0 Mar 16 17:00 .tmp_file ====> Test passed Jdl with ExpiryTime[capannini@cert-17 certification]$ cat ExpiryTime.jdl ########################################### # JDL with ExpiryTime attribute # ########################################### Executable = "/bin/ls"; Arguments = "-la"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"}; OutputSandbox = {"std.out", "std.err"}; requirements = false; ExpiryTime = 1331914400; RetryCount = 1; ShallowRetryCount = 2; [capannini@cert-17 certification]$ date +%s 1331914321 [capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ExpiryTime.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/DLi-uEyoyTgKNYdsBfXMUQ ========================================================================== [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/DLi-uEyoyTgKNYdsBfXMUQ ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/DLi-uEyoyTgKNYdsBfXMUQ Current Status: Waiting Status Reason: BrokerHelper: no compatible resources Submitted: Fri Mar 16 17:13:15 2012 CET ========================================================================== [capannini@cert-17 certification]$ date +%s 1331915013 [capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/DLi-uEyoyTgKNYdsBfXMUQ ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/DLi-uEyoyTgKNYdsBfXMUQ Current Status: Aborted Status Reason: request expired Submitted: Fri Mar 16 17:13:15 2012 CET ========================================================================== ===> Test PASSED Jdl with ShortDeadlineJobTo test SDJs the following bdii must be used: egee-bdii.cnaf.infn.it[capannini@cert-17 certification]$ cat SDLJ.jdl ########################################### # JDL with ShortDeadlineJob attribute # ########################################### Executable = "/bin/ls"; Arguments = "-la"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"}; OutputSandbox = {"std.out", "std.err"}; requirements = true; ShortDeadlineJob = true; RetryCount = 1; ShallowRetryCount = 2; [capannini@cert-17 certification]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf SDLJ.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ========================================================================== COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found: *CEId* - ce01.ariagni.hellasgrid.gr:2119/jobmanager-pbs-dteam.sdj - ce01.marie.hellasgrid.gr:2119/jobmanager-pbs-sdj - ce02.marie.hellasgrid.gr:2119/jobmanager-pbs-sdj - cream-ce01.ariagni.hellasgrid.gr:8443/cream-pbs-dteam.sdj - cream-ce01.marie.hellasgrid.gr:8443/cream-pbs-sdj - grid4.mif.vu.lt:2119/jobmanager-lcgpbs-sdj - grive02.ibcp.fr:8443/cream-pbs-sdj - mario.univ-lille1.fr:8443/cream-pbs-sdj ========================================================================== [capannini@cert-17 certification]$ python ~/wms_tests.old/WMS-service/WMS-job-cycle.py -c ~/wms_tests.old/WMS-service/wms-command.conf -V dteam -d 3 -l -t 1 -i -j SDLJ.jdl ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) Test 1A: Submit to an LCG-CE Test 1B: Submit to a CREAM CE Test 1C: Submit without restrictions ===> ===> Test: /home/capannini/wms_tests.old/WMS-service/WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 17:32:05 ===> Ended : 17:43:26 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120316173205.log
| |||||||
-- FabioCapannini - 2012-03-15 | ||||||||
Line: 522 to 1005 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 336 to 336 | ||||||||
Same process with an LCG CE: | ||||||||
Added: | ||||||||
> > | [capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/nz4pKzrc453q3uSn-q8vsQ ========================================================================== [capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/nz4pKzrc453q3uSn-q8vsQ ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/nz4pKzrc453q3uSn-q8vsQ Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: gridce2.pi.infn.it:2119/jobmanager-lcglsf-cert Submitted: Fri Mar 16 14:51:57 2012 CET ========================================================================== [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/nz4pKzrc453q3uSn-q8vsQ Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the job: https://emi-demo11.cnaf.infn.it:9000/nz4pKzrc453q3uSn-q8vsQ have been successfully retrieved and stored in the directory: /tmp/jobOutput/capannini_nz4pKzrc453q3uSn-q8vsQ ================================================================================ [capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_nz4pKzrc453q3uSn-q8vsQ std.err Log on devel09: [root@devel09 ~]# cat /tmp/myjobOutput nz4pKzrc453q3uSn-q8vsQ total 96 -rwxr-xr-x 1 dteam016 dteam 80 Mar 16 14:53 exe.sh -rw-r--r-- 1 dteam016 dteam 118 Mar 16 14:53 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fnz4pKzrc453q3uSn-q8vsQ.output -rw-r--r-- 1 dteam016 dteam 0 Mar 16 14:53 std.err -rw-r--r-- 1 dteam016 dteam 23 Mar 16 14:53 std.out -rw-r--r-- 1 dteam016 dteam 6 Mar 16 14:53 test1 -rw-r--r-- 1 dteam016 dteam 6 Mar 16 14:53 test2 -rw------- 1 dteam016 dteam 103 Mar 16 14:53 tmp.dSuMI19622 -rw------- 1 dteam016 dteam 2 Mar 16 14:53 tmp.iYrdk19621 -rw------- 1 dteam016 dteam 2 Mar 16 14:53 tmp.kpcpo19636 -rw------- 1 dteam016 dteam 0 Mar 16 14:53 tmp.nAPiv19635 -rw------- 1 dteam016 dteam 103 Mar 16 14:53 tmp.rUfjz19637 ===> test PASSED Jdl with ISBBaseURI and OSBBaseDestURISubmit to CREAM CE[capannini@cert-17 certification]$ cat BaseURI.jdl ########################################### # JDL with ISBURI & OSBBaseDestURI # ########################################### Executable = "exe.sh"; StdOutput = "std.out"; StdError = "std.err"; InputSandboxBaseURI = "gsiftp://emi-demo12.cnaf.infn.it:2811/tmp"; FuzzyRank = true; InputSandbox = {"exe.sh", "test1", "test2"}; OutputSandbox = {"std.out", "std.err"}; OutputSandboxBaseDestURI="gsiftp://devel20.cnaf.infn.it:2811/tmp"; #requirements = other.GlueCEStateStatus == "Testing" && regexp("/cream", other.GlueCEUniqueID); requirements = regexp("/cream", other.GlueCEUniqueID); RetryCount = 1; ShallowRetryCount = 2; [capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf BaseURI.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g ========================================================================== [capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g Current Status: Done (Success) Logged Reason(s): - Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g: reason is User C=IT,O=INFN,OU=Personal Certificate,L=CNAF,CN=Fabio Capannini not authorized for operation {http://www.gridsite.org/namespaces/delegation-2}getProxyReq - Job Terminated Successfully Exit code: 0 Status Reason: Job Terminated Successfully Destination: gridce0.pi.infn.it:8443/cream-lsf-cert Submitted: Fri Mar 16 16:13:56 2012 CET ========================================================================== [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME No output files to be retrieved for the job: https://emi-demo11.cnaf.infn.it:9000/hlAzaQOlelzhpDmzgGL88g ================================================================================ Log on devel20: [root@devel20 ~]# ls /tmp/std* /tmp/std.err /tmp/std.out [root@devel20 ~]# [root@devel20 ~]# [root@devel20 ~]# cat /tmp/std.out hlAzaQOlelzhpDmzgGL88g total 76 -rwxr-xr-x 1 dteam015 dteam 80 Mar 16 16:14 exe.sh -rw-r--r-- 1 dteam015 dteam 0 Mar 16 16:14 std.err -rw-r--r-- 1 dteam015 dteam 23 Mar 16 16:14 std.out -rw-r--r-- 1 dteam015 dteam 6 Mar 16 16:14 test1 -rw-r--r-- 1 dteam015 dteam 6 Mar 16 16:14 test2 ===> === test PASSED === | |||||||
Added: | ||||||||
> > | Submit to an LCG CE: | |||||||
-- FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 258 to 258 | ||||||||
===> ===> Test log file is WMSService-TS_20120316113322.log | ||||||||
Added: | ||||||||
> > | * WMSService-TS_20120316113322.log: WMSService-TS_20120316113322.log
Jdl with ISBBaseURI and OSBDestURITest on CREAM ce:[capannini@cert-17 certification]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA ========================================================================== [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ [capannini@cert-17 certification]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA Current Status: Done (Success) Logged Reason(s): - Transfer to CREAM failed due to exception: Failed to create a delegation id for job https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA: reason is User C=IT,O=INFN,OU=Personal Certificate,L=CNAF,CN=Fabio Capannini not authorized for operation {http://www.gridsite.org/namespaces/delegation-2}getProxyReq - Job Terminated Successfully Exit code: 0 Status Reason: Job Terminated Successfully Destination: cccreamceli10.in2p3.fr:8443/cream-sge-short Submitted: Fri Mar 16 14:29:07 2012 CET ========================================================================== [capannini@cert-17 certification]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the job: https://emi-demo11.cnaf.infn.it:9000/FNmMujUg_2yIhS0iY8h9YA have been successfully retrieved and stored in the directory: /tmp/jobOutput/capannini_FNmMujUg_2yIhS0iY8h9YA ================================================================================ [capannini@cert-17 certification]$ ls /tmp/jobOutput/capannini_FNmMujUg_2yIhS0iY8h9YA std.err Log on devel09.cnaf.infn.it: [root@devel09 ~]# cat /tmp/myjobOutput FNmMujUg_2yIhS0iY8h9YA total 76 -rwxr-xr-x 1 dteam009 dteam 80 Mar 16 14:33 exe.sh -rw-r--r-- 1 dteam009 dteam 0 Mar 16 14:33 std.err -rw-r--r-- 1 dteam009 dteam 23 Mar 16 14:33 std.out -rw-r--r-- 1 dteam009 dteam 6 Mar 16 14:33 test1 -rw-r--r-- 1 dteam009 dteam 6 Mar 16 14:33 test2 ===> test PASSEDSame process with an LCG CE: | |||||||
-- FabioCapannini - 2012-03-15 | ||||||||
Line: 270 to 350 | ||||||||
Changed: | ||||||||
< < |
| |||||||
> > | ||||||||
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 60 to 60 | ||||||||
glite-wms-manager-3.3.1-4.sl5 | ||||||||
Changed: | ||||||||
< < | The wms was configured in proxy mode, pointing to the LB devel17.cnaf.infn.it | |||||||
> > | The wms emi-demo12 is configured in proxy mode, pointing to the LB devel17.cnaf.infn.it | |||||||
Unit Tests | ||||||||
Line: 77 to 77 | ||||||||
This is not possible, for example, for parallel jobs.
Normal | ||||||||
Added: | ||||||||
> > | [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) Test 1A: Submit to an LCG-CE Test 1B: Submit to a CREAM CE Test 1C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:28:22 ===> Ended : 10:32:49 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120316102822.log [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) Test 1A: Submit to an LCG-CE Test 1B: Submit to a CREAM CE Test 1C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:30:51 ===> Ended : 10:35:08 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120316103051.log [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V infngrid -d 3 -l -t 1 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) Test 1A: Submit to an LCG-CE Test 1B: Submit to a CREAM CE Test 1C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:31:52 ===> Ended : 10:37:14 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120316103152.log* submit.tgz: submit.tgz Proxy modePointing the testsuite at emi-demo12:[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) Test 1A: Submit to an LCG-CE Test 1B: Submit to a CREAM CE Test 1C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo12.cnaf.infn.it ===> Started: 10:50:40 ===> Ended : 10:56:37 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120316105040.log* WMSService-TS_20120316105040.log: WMSService-TS_20120316105040.log Jdl with DataRequirements[capannini@devel15 WMS-service]$ cat ~/certification/data-req.jdl ########################################### # JDL with Data Requirements # ########################################### Executable = "/bin/ls"; Arguments = "-la"; StdOutput = "std.out"; StdError = "std.err"; Prologue = "prologue.sh"; FuzzyRank = true; Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"}; InputSandbox = {"JDLs/prologue.sh"}; OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"}; DataRequirements = { [ DataCatalogType = "DLI"; DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" }; ] }; DataAccessProtocol = "gsiftp"; AllowZippedISB=true; RetryCount = 1; ShallowRetryCount = 2; [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i -j ~/certification/data-req.jdl ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) Test 1A: Submit to an LCG-CE Test 1B: Submit to a CREAM CE Test 1C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 11:33:22 ===> Ended : 11:54:21 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120316113322.log | |||||||
-- FabioCapannini - 2012-03-15 | ||||||||
Line: 85 to 266 | ||||||||
Added: | ||||||||
> > |
| |||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 56 to 56 | ||||||||
| ||||||||
Added: | ||||||||
> > |
Unit TestsN/A: Tests will be available with EMI-2.Basic Functionality testsSubmissionWhere possible the tests should use internal testbed CEs (located in Padova). This is accomplished by adding the following line to wms-command.conf:DEFAULTREQ= other.GlueCEStateStatus == "Testing"This is not possible, for example, for parallel jobs. Normal | |||||||
-- FabioCapannini - 2012-03-15 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 54 to 54 | ||||||||
| ||||||||
Deleted: | ||||||||
< < |
| |||||||
| ||||||||
Added: | ||||||||
> > |
| |||||||
-- FabioCapannini - 2012-03-15 |
Line: 1 to 1 | |||||||||
---|---|---|---|---|---|---|---|---|---|
Added: | |||||||||
> > |
WMS test reportSummary
Deployment TestsClean installation
[root@emi-demo11 ~]# cat /etc/redhat-release Scientific Linux SL release 5.7 (Boron) [root@emi-demo11 ~]# uname -a Linux emi-demo11.cnaf.infn.it 2.6.18-274.18.1.el5 #1 SMP Thu Feb 9 12:20:03 EST 2012 x86_64 x86_64 x86_64 GNU/Linux [root@emi-demo11 ~]# wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -O /tmp/emi-key_gd.asc [root@emi-demo11 ~]# rpm --import /tmp/emi-key_gd.asc
Update
[root@emi-demo12 yum.repos.d]# rpm -qa|grep wms-manager glite-wms-manager-3.3.1-3.sl5
|