Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 258 to 258 | ||||||||
See submit.log.tgz: Normal submission logs | ||||||||
Changed: | ||||||||
< < | Proxy mode | |||||||
> > | Proxy mode | |||||||
There is a problem with the configuration of emi-demo12 (wms in proxy mode) pointing to emi-demo11 (wms in both mode): the events Running,ReallyRunning and Done Ok are not logged by emi-demo11 (and don't appear in the logging-info), even if they are present in the lbserver20 db of emi-demo12. These events are instead correctly logged if emi-demo11 is configured as LB in server mode. Thus, in order to properly test a wms in proxy mode, then it should point to a LB server not in both mode. | ||||||||
Added: | ||||||||
> > | ARC CEJob submitted on a production CE using the cms VO.[capannini@cert-17 regression_tests]$ lcg-infosites --is egee-bdii.cnaf.infn.it --vo cms ce |grep arc 80 0 95 5 95 arc.univ.kiev.ua:2811/nordugrid-torque-arc 768 707 196 61 196 jade-cms.hip.fi:2811/nordugrid-GE-arc 256 0 0 0 0 korundi.grid.helsinki.fi:2811/nordugrid-GE-arc [cristofori@ui ~]$ glite-wms-job-submit -e https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server -a -r jade-cms.hip.fi:2811/nordugrid-GE-arc firsttest.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g ========================================================================== [cristofori@ui ~]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: jade-cms.hip.fi:2811/nordugrid-GE-arc Submitted: Tue Mar 27 14:27:13 2012 CEST ========================================================================== [cristofori@ui ~]$ glite-wms-job-output --dir ./ https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the job: https://emi-demo11.cnaf.infn.it:9000/e4f1VtGXy_I_2MS2dVUs4g have been successfully retrieved and stored in the directory: /home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g ================================================================================ [cristofori@ui ~]$ cat /home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g/stderr.log [cristofori@ui ~]$ cat /home/GUEST/cristofori/cristofori_e4f1VtGXy_I_2MS2dVUs4g/stdout.log cmsuser07 | |||||||
Jdl with DataRequirementsIn case of problems with lcg-ce, it i possible to create replicas of the file on other SEs close to different lcg-ces. |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3761 to 3761 | ||||||||
[capannini@cert-17 output]$ ../../loginfo.sh -e 54 | ||||||||
Added: | ||||||||
> > | Results:
DONE : 47192
NOTDone: 8
Aborted: 1775
Total : 48975 done jobs on CREAM CEs: 29819 (63%) done jobs on LCG CEs: 17373 (37%) The above statistics is obatined in the following way: [capannini@cert-17 output]$ cat *.done|wc -l 47192 [capannini@cert-17 output]$ cat *.done|grep cream|wc -l 29819 [capannini@cert-17 output]$ cat *.done|grep jobmanager|wc -l 17373 | |||||||
Added: | ||||||||
> > | ====> Test NOT PASSED (Aborted/Total = 3.6% probably too high percentage, but a general rule should be agreed upon) | |||||||
Regression tests |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3737 to 3737 | ||||||||
Test finishes at mer feb 1 11:58:34 CET 2012 | ||||||||
Added: | ||||||||
> > | The collection stays in status 'Waiting'. ======> Test NOT PASSED | |||||||
Stress test
| ||||||||
Line: 3753 to 3757 | ||||||||
Test starts on mer feb 1 14:19:49 CET 2012: submit 2880 collections (of 25 nodes) with a frequency of 60 seconds using 1 users. | ||||||||
Added: | ||||||||
> > | Results[capannini@cert-17 output]$ ../../loginfo.sh -e 54 | |||||||
Regression tests Bug #81376 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3705 to 3705 | ||||||||
# numEntries: 10
Performance test | ||||||||
Changed: | ||||||||
< < | TBD | |||||||
> > | The tests are carried out using emi-demo11, a virtual machine with wms installed, as this has never been tried before.
The real certification process should use devel20, a real machine with wms installed, instead.
Collection of 1000 nodesSubmission of a collection of 1000 nodes[capannini@cert-17 StressTest]$ ./StressTest.sh -t 1 -n 1000 -c ~/wms_emi-demo11.conf -j ls.jdl Test starts on mer feb 1 11:58:27 CET 2012: submit 1 collections (of 1000 nodes) with a frequency of 60 seconds using 1 users. Submission n. 1: mer feb 1 11:58:27 CET 2012: user 0 is submitting... Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/Cw4IByQC5DYhcHcEguYxuQ The job identifier has been saved in the following file: /home/capannini/certification/StressTest/Test_1328093897/output/USER0_0.jobid ========================================================================== Submission takes 7 seconds. 1 jobs submitted in 7 seconds: 7/7/7 (min/avg/max) Test finishes at mer feb 1 11:58:34 CET 2012 Stress test
[capannini@cert-17 StressTest]$ ./StressTest.sh -t 2880 -n 25 -c ~/wms_emi-demo11.conf -j ls.jdl Test starts on mer feb 1 14:19:49 CET 2012: submit 2880 collections (of 25 nodes) with a frequency of 60 seconds using 1 users. | |||||||
Regression tests Bug #81376 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 3959 to 3959 | ||||||||
Submitted a job: | ||||||||
Added: | ||||||||
> > | [capannini@devel15 WMS-service]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ~/ls.jdl
Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server![]() ================== glite-wms-job-submit Success ==================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emi-demo11.cnaf.infn.it:9000/-iL7RrvLDu1Z9jFultvSLA![]() ======================================================================
Copied the sandbox dir:
[root@emi-demo11 ~]# cd /var/SandboxDir/-i/
[root@emi-demo11 -i]# ls
https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f-iL7RrvLDu1Z9jFultvSLA
[root@emi-demo11 -i]# cp -r -p https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f-iL7RrvLDu1Z9jFultvSLA https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f-iL7RrvLDu1Z9jFultvSLA.old
[root@emi-demo11 -i]#
[root@emi-demo11 -i]#
[root@emi-demo11 -i]# ls -l
totale 8
drwxrwx--- 5 dteam045 glite 4096 26 gen 12:23 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f-iL7RrvLDu1Z9jFultvSLA
drwxrwx--- 5 dteam045 glite 4096 26 gen 12:23 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f-iL7RrvLDu1Z9jFultvSLA.old
Retrieved the OSB when the job is done:
[capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/-iL7RrvLDu1Z9jFultvSLA![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/-iL7RrvLDu1Z9jFultvSLA![]() ======================================================================
[capannini@devel15 WMS-service]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/-iL7RrvLDu1Z9jFultvSLA![]() ![]() ============================================================================
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
https://emi-demo11.cnaf.infn.it:9000/-iL7RrvLDu1Z9jFultvSLA![]() ============================================================================
[capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/-iL7RrvLDu1Z9jFultvSLA![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/-iL7RrvLDu1Z9jFultvSLA![]() ======================================================================
Restored the sandbox dir in the WMS:
[root@emi-demo11 -i]# mv https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f-iL7RrvLDu1Z9jFultvSLA.old https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2f-iL7RrvLDu1Z9jFultvSLA
Purged the job from LBProxy and from LBServer:
[root@emi-demo11 ~]# echo 'https://emi-demo11.cnaf.infn.it:9000/-iL7RrvLDu1Z9jFultvSLA' >jobid.txt
[root@emi-demo11 ~]#
[root@emi-demo11 ~]# /usr/bin/glite-lb-purge -m emi-demo11.cnaf.infn.it -x -j jobid.txt
The jobs were not dumped.
[root@emi-demo11 ~]# /usr/bin/glite-lb-purge -m emi-demo11.cnaf.infn.it -j jobid.txt
The jobs were not dumped.
Verified that job status returns Identifier removed (i.e. error EIDRM ):
[capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/-iL7RrvLDu1Z9jFultvSLA![]() ![]() glite-wms-purgeStorage.sh and verifying that Identifier removed (i.e. error 43) is returned:
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/-i
26 Jan, 15:05:17 -E: [Error] query_job_status(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:134): https://emi-demo11.cnaf.infn.it:9000/-iL7RrvLDu1Z9jFultvSLA![]() ![]() Bug #87994
Check the attributes get_acbr and get_owner in /etc/glite/info/service/glite-info-glue2-wmproxy.conf | |||||||
Added: | ||||||||
> > | [root@emi-demo11 ~]# grep get_acbr /etc/glite/info/service/glite-info-glue2-wmproxy.conf
get_acbr = echo -e "VO:atlas\nVO:alice\nVO:lhcb\nVO:cms\nVO:dteam\nVO:biomed\nVO:ops\nVO:infngrid\nVO:testers.eu-emi.eu"
[root@emi-demo11 ~]# grep get_owner /etc/glite/info/service/glite-info-glue2-wmproxy.conf
get_owner = echo -e "atlas\nalice\nlhcb\ncms\ndteam\nbiomed\nops\ninfngrid\ntesters.eu-emi.eu"
===> test PASSED
Bug #88072
| |||||||
-- FabioCapannini - 2011-12-28 |
Line: 1 to 1 | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| |||||||||||||||
Line: 2645 to 2645 | |||||||||||||||
See logs: cancel.tgz: Job cancel logs | |||||||||||||||
Added: | |||||||||||||||
> > | Proxy renewalSetting MYPROXYSERVER=emitb2.ics.muni.cz in wms-command.conf [capannini@devel15 ~]$ voms-proxy-init --voms dteam Enter GRID pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Creating temporary proxy .............................................. Done Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done Creating proxy ............................................... Done Your proxy is valid until Thu Jan 26 22:42:50 2012 [capannini@devel15 ~]$ myproxy-init -s emitb2.ics.muni.cz -d -n Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy .......................................................................................................................................................................................................................................................................... Done Proxy Verify OK Your proxy is valid until: Thu Feb 2 10:44:17 2012 A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on emitb2.ics.muni.cz. [capannini@devel15 WMS-service]$ python WMS-proxy-renewal.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test proxy renewal operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test proxy renewal with LCG CE Test 2: Test proxy renewal with CREAM CE Test 3: Test proxy renewal with LCG CE (without setting MYPROXYSERVER) Test 4: Test proxy renewal with CREAM CE (without setting MYPROXYSERVER) ===> ===> Test: WMS-proxy-renewal.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:47:52 ===> Ended : 11:29:27 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120126104752.logSee log: WMSService-TS_20120126104752.log: proxy renewal log | ||||||||||||||
Configuration fileVerified that the following entries are present in/etc/glite-wms/glite_wms.conf : | |||||||||||||||
Line: 2840 to 2892 | |||||||||||||||
===> test PASSED | |||||||||||||||
Added: | |||||||||||||||
> > | WMS feedbackTBD | ||||||||||||||
Limiter mechanism[capannini@devel15 WMS-service]$ python WMS-limiter-mechanism.py -c wms-command.conf -V dteam -d 3 -l -t 1,4,6-10 | |||||||||||||||
Line: 3190 to 3245 | |||||||||||||||
=> test PASSED ==
| |||||||||||||||
Added: | |||||||||||||||
> > | Published informationbdb database information[capannini@devel15 ~]$ ldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=grid' # extended LDIF # # LDAPv3 # base <o=grid> with scope subtree # filter: (objectclass=*) # requesting: ALL # # grid dn: o=grid objectClass: organization o: grid # local, grid dn: Mds-Vo-name=local,o=grid Mds-Vo-name: local objectClass: Mds # resource, grid dn: Mds-Vo-name=resource,o=grid Mds-Vo-name: resource objectClass: Mds # emi-demo11.cnaf.infn.it_org.glite.lb.Server_2310828617, resource, grid dn: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.lb.Server_2310828617 ,Mds-Vo-name=resource,o=grid objectClass: GlueTop objectClass: GlueService objectClass: GlueKey objectClass: GlueSchemaVersion GlueServiceUniqueID: emi-demo11.cnaf.infn.it_org.glite.lb.Server_2310828617 GlueServiceEndpoint: https://emi-demo11.cnaf.infn.it:9003/ GlueServiceVersion: 2.2.10 GlueSchemaVersionMinor: 3 GlueServiceName: INFN-CREAMTEST-Server GlueServiceType: org.glite.lb.Server GlueServiceWSDL: http://egee.cesnet.cz/cms/export/sites/egee/en/WSDL/3.1/LB.ws dl GlueServiceSemantics: https://edms.cern.ch/file/571273/2/LB-guide.pdf GlueForeignKey: GlueSiteUniqueID=INFN-CREAMTEST GlueSchemaVersionMajor: 1 GlueServiceStatus: OK GlueServiceStartTime: 2012-01-19T12:26:49+01:00 GlueServiceStatusInfo: glite-lb-notif-interlogd running as 9582 glite-lb-inter logd for proxy running as 9617 glite-lb-bkserverd running as 9536 glite-jp-im porter not running (disabled) # emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637, resource, grid dn: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_84141563 7,Mds-Vo-name=resource,o=grid GlueServiceAccessControlBaseRule: VO:atlas GlueServiceAccessControlBaseRule: VO:alice GlueServiceAccessControlBaseRule: VO:lhcb GlueServiceAccessControlBaseRule: VO:cms GlueServiceAccessControlBaseRule: VO:dteam GlueServiceAccessControlBaseRule: VO:biomed GlueServiceAccessControlBaseRule: VO:ops GlueServiceAccessControlBaseRule: VO:infngrid GlueServiceAccessControlBaseRule: VO:testers.eu-emi.eu GlueServiceStatus: Other GlueServiceStatusInfo: ?? objectClass: GlueTop objectClass: GlueService objectClass: GlueKey objectClass: GlueSchemaVersion GlueServiceUniqueID: emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637 GlueServiceAccessControlRule: atlas GlueServiceAccessControlRule: alice GlueServiceAccessControlRule: lhcb GlueServiceAccessControlRule: cms GlueServiceAccessControlRule: dteam GlueServiceAccessControlRule: biomed GlueServiceAccessControlRule: ops GlueServiceAccessControlRule: infngrid GlueServiceAccessControlRule: testers.eu-emi.eu GlueServiceEndpoint: https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_se rver GlueServiceVersion: 3.3.4 GlueSchemaVersionMinor: 3 GlueServiceName: INFN-CREAMTEST-WMProxy GlueServiceType: org.glite.wms.WMProxy GlueServiceWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl GlueServiceSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-guid e.pdf GlueForeignKey: GlueSiteUniqueID=INFN-CREAMTEST GlueServiceOwner: atlas GlueServiceOwner: alice GlueServiceOwner: lhcb GlueServiceOwner: cms GlueServiceOwner: dteam GlueServiceOwner: biomed GlueServiceOwner: ops GlueServiceOwner: infngrid GlueServiceOwner: testers.eu-emi.eu GlueSchemaVersionMajor: 1 GlueServiceStartTime: 2012-01-26T00:00:02+01:00 # DN, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637, resource, grid dn: GlueServiceDataKey=DN,GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glit e.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid GlueSchemaVersionMajor: 1 objectClass: GlueTop objectClass: GlueServiceData objectClass: GlueKey objectClass: GlueSchemaVersion GlueSchemaVersionMinor: 3 GlueServiceDataKey: DN GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx y_841415637 GlueServiceDataValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=emi-demo11.cnaf.infn.it # glite-info-service_version, emi-demo11.cnaf.infn.it_org.glite.lb.Server_231 0828617, resource, grid dn: GlueServiceDataKey=glite-info-service_version,GlueServiceUniqueID=emi-demo 11.cnaf.infn.it_org.glite.lb.Server_2310828617,Mds-Vo-name=resource,o=grid GlueSchemaVersionMajor: 1 objectClass: GlueTop objectClass: GlueServiceData objectClass: GlueKey objectClass: GlueSchemaVersion GlueSchemaVersionMinor: 3 GlueServiceDataKey: glite-info-service_version GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.lb.Server_ 2310828617 GlueServiceDataValue: 1.6 # glite-info-service_version, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_8 41415637, resource, grid dn: GlueServiceDataKey=glite-info-service_version,GlueServiceUniqueID=emi-demo 11.cnaf.infn.it_org.glite.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid GlueSchemaVersionMajor: 1 objectClass: GlueTop objectClass: GlueServiceData objectClass: GlueKey objectClass: GlueSchemaVersion GlueSchemaVersionMinor: 3 GlueServiceDataKey: glite-info-service_version GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx y_841415637 GlueServiceDataValue: 1.6 # glite-info-service_hostname, emi-demo11.cnaf.infn.it_org.glite.lb.Server_23 10828617, resource, grid dn: GlueServiceDataKey=glite-info-service_hostname,GlueServiceUniqueID=emi-dem o11.cnaf.infn.it_org.glite.lb.Server_2310828617,Mds-Vo-name=resource,o=grid GlueSchemaVersionMajor: 1 objectClass: GlueTop objectClass: GlueServiceData objectClass: GlueKey objectClass: GlueSchemaVersion GlueSchemaVersionMinor: 3 GlueServiceDataKey: glite-info-service_hostname GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.lb.Server_ 2310828617 GlueServiceDataValue: emi-demo11.cnaf.infn.it # glite-info-service_hostname, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_ 841415637, resource, grid dn: GlueServiceDataKey=glite-info-service_hostname,GlueServiceUniqueID=emi-dem o11.cnaf.infn.it_org.glite.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid GlueSchemaVersionMajor: 1 objectClass: GlueTop objectClass: GlueServiceData objectClass: GlueKey objectClass: GlueSchemaVersion GlueSchemaVersionMinor: 3 GlueServiceDataKey: glite-info-service_hostname GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx y_841415637 GlueServiceDataValue: emi-demo11.cnaf.infn.it # search result search: 2 result: 0 Success # numResponses: 11 # numEntries: 10 Stats database definitions[capannini@devel15 ~]$ ldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=infosys' # extended LDIF # # LDAPv3 # base <o=infosys> with scope subtree # filter: (objectclass=*) # requesting: ALL # # infosys dn: o=infosys objectClass: organization o: infosys # zip, infosys dn: CompressionType=zip,o=infosys objectClass: CompressedContent Hostname: localhost CompressionType: zip Data: file:///var/run/bdii/archive/12-01-26-11-02-24-snapshot.gz # localhost, infosys dn: Hostname=localhost,o=infosys objectClass: UpdateStats Hostname: localhost FailedDeletes: 0 ModifiedEntries: 8 DeletedEntries: 0 UpdateTime: 1 FailedAdds: 0 FailedModifies: 0 TotalEntries: 20 QueryTime: 0 NewEntries: 1 DBUpdateTime: 0 ReadTime: 0 PluginsTime: 0 ProvidersTime: 1 # search result search: 2 result: 0 Success # numResponses: 4 # numEntries: 3 Stats database definitions[capannini@devel15 ~]$ ldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=glue' # extended LDIF # # LDAPv3 # base <o=glue> with scope subtree # filter: (objectclass=*) # requesting: ALL # # glue dn: o=glue objectClass: organization o: glue # grid, glue dn: GLUE2GroupID=grid,o=glue objectClass: GLUE2Group GLUE2GroupID: grid # resource, glue dn: GLUE2GroupID=resource,o=glue objectClass: GLUE2Group GLUE2GroupID: resource # emi-demo11.cnaf.infn.it_lbserver_201164012, resource, glue dn: GLUE2ServiceID=emi-demo11.cnaf.infn.it_lbserver_201164012,GLUE2GroupID=res ource,o=glue GLUE2EntityValidity: 3600 GLUE2ServiceType: org.glite.lb.Server GLUE2ServiceID: emi-demo11.cnaf.infn.it_lbserver_201164012 objectClass: GLUE2Service GLUE2ServiceQualityLevel: production GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-service GLUE2EntityOtherInfo: InfoProviderVersion=1.1 GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it GLUE2ServiceComplexity: endpointType=1, share=0, resource=0 GLUE2ServiceCapability: information.logging GLUE2EntityName: INFN-CREAMTEST-Server GLUE2ServiceAdminDomainForeignKey: INFN-CREAMTEST GLUE2EntityCreationTime: 2012-01-26T10:04:25Z # emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue dn: GLUE2ServiceID=emi-demo11.cnaf.infn.it_wmproxy_2598325561,GLUE2GroupID=res ource,o=glue GLUE2EntityValidity: 3600 GLUE2ServiceType: org.glite.wms.WMProxy GLUE2ServiceID: emi-demo11.cnaf.infn.it_wmproxy_2598325561 objectClass: GLUE2Service GLUE2ServiceQualityLevel: production GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-service GLUE2EntityOtherInfo: InfoProviderVersion=1.1 GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it GLUE2ServiceComplexity: endpointType=1, share=0, resource=0 GLUE2ServiceCapability: executionmanagement.candidatesetgenerator GLUE2ServiceCapability: executionmanagement.jobdescription GLUE2ServiceCapability: executionmanagement.jobmanager GLUE2EntityName: INFN-CREAMTEST-WMProxy GLUE2ServiceAdminDomainForeignKey: INFN-CREAMTEST GLUE2EntityCreationTime: 2012-01-26T10:04:26Z # emi-demo11.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_201164012, e mi-demo11.cnaf.infn.it_lbserver_201164012, resource, glue dn: GLUE2EndpointID=emi-demo11.cnaf.infn.it_lbserver_201164012_org.glite.lb.Se rver_201164012,GLUE2ServiceID=emi-demo11.cnaf.infn.it_lbserver_201164012,GLUE 2GroupID=resource,o=glue GLUE2EntityValidity: 3600 GLUE2EndpointQualityLevel: production GLUE2EndpointImplementor: gLite GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint GLUE2EntityOtherInfo: InfoProviderVersion=1.2 GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it GLUE2EntityOtherInfo: MiddlewareName=EMI GLUE2EntityOtherInfo: MiddlewareVersion=1.7.0-1 GLUE2EndpointCapability: information.logging GLUE2EndpointServiceForeignKey: emi-demo11.cnaf.infn.it_lbserver_201164012 GLUE2EntityName: Server endpoint for Service emi-demo11.cnaf.infn.it_lbserver_ 201164012 GLUE2EndpointTechnology: webservice GLUE2EndpointWSDL: http://egee.cesnet.cz/cms/export/sites/egee/en/WSDL/3.1/LB. wsdl GLUE2EndpointInterfaceName: org.glite.lb.Server GLUE2EndpointURL: https://emi-demo11.cnaf.infn.it:9003/ GLUE2EndpointDowntimeInfo: See the GOC DB for downtimes: https://goc.egi.eu/ GLUE2EndpointImplementationVersion: 2.2.10 GLUE2EndpointSemantics: https://edms.cern.ch/file/571273/2/LB-guide.pdf GLUE2EndpointIssuerCA: /C=IT/O=INFN/CN=INFN CA GLUE2EndpointServingState: production objectClass: GLUE2Endpoint GLUE2EndpointInterfaceVersion: 3.2.4 GLUE2EndpointImplementationName: LB GLUE2EndpointTrustedCA: IGTF GLUE2EndpointID: emi-demo11.cnaf.infn.it_lbserver_201164012_org.glite.lb.Serve r_201164012 GLUE2EndpointStartTime: 2012-01-19T11:26:49Z GLUE2EndpointHealthStateInfo: glite-lb-notif-interlogd running as 9582 glite-l b-interlogd for proxy running as 9617 glite-lb-bkserverd running as 9536 glit e-jp-importer not running (disabled) GLUE2EndpointHealthState: ok GLUE2EntityCreationTime: 2012-01-26T10:04:25Z # emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598325561 , emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue dn: GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.W MProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.infn.it_wmproxy_2598325561,G LUE2GroupID=resource,o=glue GLUE2EntityValidity: 3600 GLUE2EndpointQualityLevel: production GLUE2EndpointImplementor: gLite GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint GLUE2EntityOtherInfo: InfoProviderVersion=1.2 GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it GLUE2EntityOtherInfo: MiddlewareName=EMI GLUE2EntityOtherInfo: MiddlewareVersion=1.7.0-1 GLUE2EndpointCapability: executionmanagement.candidatesetgenerator GLUE2EndpointCapability: executionmanagement.jobdescription GLUE2EndpointCapability: executionmanagement.jobmanager GLUE2EndpointHealthState: ok GLUE2EndpointServiceForeignKey: emi-demo11.cnaf.infn.it_wmproxy_2598325561 GLUE2EntityName: WMProxy endpoint for Service emi-demo11.cnaf.infn.it_wmproxy_ 2598325561 GLUE2EndpointTechnology: webservice GLUE2EndpointWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl GLUE2EndpointInterfaceName: org.glite.wms.WMProxy GLUE2EndpointURL: https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_serve r GLUE2EndpointDowntimeInfo: See the GOC DB for downtimes: https://goc.egi.eu/ GLUE2EndpointImplementationVersion: 3.3.4 GLUE2EndpointSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-gu ide.pdf GLUE2EndpointIssuerCA: /C=IT/O=INFN/CN=INFN CA GLUE2EndpointServingState: production objectClass: GLUE2Endpoint GLUE2EndpointInterfaceVersion: 1.0 GLUE2EndpointImplementationName: WMS GLUE2EndpointTrustedCA: IGTF GLUE2EndpointID: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMPr oxy_2598325561 GLUE2EndpointStartTime: 2012-01-25T23:00:02Z GLUE2EndpointHealthStateInfo: WMProxy httpd listening on port 7443 httpd is ru nning .... === WMProxy Server running instances: UID PID PPID C STIME TTY TIM E CMD glite 13421 30902 0 09:28 ? 00:00:00 /usr/bin/glite_wms_wmproxy_server GLUE2EntityCreationTime: 2012-01-26T10:04:26Z # DN_1, emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598 325561, emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue dn: GLUE2ExtensionLocalID=DN_1,GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy _2598325561_org.glite.wms.WMProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.i nfn.it_wmproxy_2598325561,GLUE2GroupID=resource,o=glue GLUE2ExtensionLocalID: DN_1 GLUE2ExtensionKey: DN objectClass: GLUE2Extension GLUE2ExtensionValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=emi-demo11.cnaf.infn.it GLUE2ExtensionEntityForeignKey: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org .glite.wms.WMProxy_2598325561 # emi-demo11.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_201164012_Po licy, emi-demo11.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_2011640 12, emi-demo11.cnaf.infn.it_lbserver_201164012, resource, glue dn: GLUE2PolicyID=emi-demo11.cnaf.infn.it_lbserver_201164012_org.glite.lb.Serv er_201164012_Policy,GLUE2EndpointID=emi-demo11.cnaf.infn.it_lbserver_20116401 2_org.glite.lb.Server_201164012,GLUE2ServiceID=emi-demo11.cnaf.infn.it_lbserv er_201164012,GLUE2GroupID=resource,o=glue GLUE2EntityValidity: 3600 objectClass: GLUE2Policy objectClass: GLUE2AccessPolicy GLUE2PolicyRule: ALL GLUE2PolicyScheme: org.glite.standard GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint GLUE2EntityOtherInfo: InfoProviderVersion=1.2 GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it GLUE2AccessPolicyEndpointForeignKey: emi-demo11.cnaf.infn.it_lbserver_20116401 2_org.glite.lb.Server_201164012 GLUE2PolicyID: emi-demo11.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_ 201164012_Policy GLUE2EntityName: Access control rules for Endpoint emi-demo11.cnaf.infn.it_lbs erver_201164012_org.glite.lb.Server_201164012 GLUE2EntityCreationTime: 2012-01-26T10:04:25Z # emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598325561 _Policy, emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_25 98325561, emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue dn: GLUE2PolicyID=emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMP roxy_2598325561_Policy,GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy_259832 5561_org.glite.wms.WMProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.infn.it_ wmproxy_2598325561,GLUE2GroupID=resource,o=glue GLUE2AccessPolicyEndpointForeignKey: emi-demo11.cnaf.infn.it_wmproxy_259832556 1_org.glite.wms.WMProxy_2598325561 GLUE2EntityValidity: 3600 objectClass: GLUE2Policy objectClass: GLUE2AccessPolicy GLUE2PolicyRule: VO:atlas GLUE2PolicyRule: VO:alice GLUE2PolicyRule: VO:lhcb GLUE2PolicyRule: VO:cms GLUE2PolicyRule: VO:dteam GLUE2PolicyRule: VO:biomed GLUE2PolicyRule: VO:ops GLUE2PolicyRule: VO:infngrid GLUE2PolicyRule: VO:testers.eu-emi.eu GLUE2PolicyScheme: org.glite.standard GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint GLUE2EntityOtherInfo: InfoProviderVersion=1.2 GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it GLUE2PolicyUserDomainForeignKey: atlas GLUE2PolicyUserDomainForeignKey: alice GLUE2PolicyUserDomainForeignKey: lhcb GLUE2PolicyUserDomainForeignKey: cms GLUE2PolicyUserDomainForeignKey: dteam GLUE2PolicyUserDomainForeignKey: biomed GLUE2PolicyUserDomainForeignKey: ops GLUE2PolicyUserDomainForeignKey: infngrid GLUE2PolicyUserDomainForeignKey: testers.eu-emi.eu GLUE2PolicyID: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProx y_2598325561_Policy GLUE2EntityName: Access control rules for Endpoint emi-demo11.cnaf.infn.it_wmp roxy_2598325561_org.glite.wms.WMProxy_2598325561 GLUE2EntityCreationTime: 2012-01-26T10:04:26Z # search result search: 2 result: 0 Success # numResponses: 11 # numEntries: 10 Performance testTBDRegression tests Bug #81376
| ||||||||||||||
-- FabioCapannini - 2011-12-28 | |||||||||||||||
Line: 3229 to 3999 | |||||||||||||||
Added: | |||||||||||||||
> > | |||||||||||||||
| |||||||||||||||
Line: 3251 to 4030 | |||||||||||||||
| |||||||||||||||
Added: | |||||||||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2908 to 2908 | ||||||||
===> Test log file is WMSService-TS_20120125120754.log See log: WMSService-TS_20120125120754.log: purge logs | ||||||||
Added: | ||||||||
> > | SandboxDir cron purgerThe purge of the SandBox dir is done by a cron job - Submit a job and force its purge before it finishes: [capannini@devel15 WMS-service]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ~/ls.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ ========================================================================== [capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ Current Status: Scheduled Status Reason: unavailable Destination: ce208.cern.ch:8443/cream-lsf-grid_dteam Submitted: Wed Jan 25 12:26:31 2012 CET ========================================================================== [root@emi-demo11 ~]# su - glite [glite@emi-demo11 ~]$ [glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/I- -s 25 Jan, 12:27:33 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ: removed SCHEDULED job [capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ Current Status: Cleared Status Reason: timed out, resource purge forced Destination: ce208.cern.ch:8443/cream-lsf-grid_dteam Submitted: Wed Jan 25 12:26:31 2012 CET ========================================================================== ===> === test PASSED === - Purge a done job: [capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/T7uROEeHs0MVTbeiMYDRJg ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/T7uROEeHs0MVTbeiMYDRJg Current Status: Done (Success) Exit code: 0 Status Reason: Job Terminated Successfully Destination: ce208.cern.ch:8443/cream-lsf-grid_dteam Submitted: Wed Jan 25 12:31:26 2012 CET ========================================================================== [glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/T7 -s 25 Jan, 14:09:45 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/T7uROEeHs0MVTbeiMYDRJg: removed DONE job [capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/T7uROEeHs0MVTbeiMYDRJg ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/T7uROEeHs0MVTbeiMYDRJg Current Status: Cleared Status Reason: timed out, resource purge forced Destination: ce208.cern.ch:8443/cream-lsf-grid_dteam Submitted: Wed Jan 25 12:31:26 2012 CET ========================================================================== - Purge only jobs older than 12 hours: Find some directories to be purged with the command: # find /var/SandboxDir/ -maxdepth 2 -type d -cmin +720 /var/SandboxDir/W6/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fW65OfHAN_5fLrcvyoohMGzWQ /var/SandboxDir/ez/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fezKOPmT5HcqCRjmO1ttSZA Try to purge: [glite@emi-demo11 ~]$ date Wed Jan 25 14:15:03 CET 2012 [glite@emi-demo11 ~]$ ls -l /var/SandboxDir/ez total 4 drwxrwx--- 5 dteam045 glite 4096 Jan 24 10:38 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fezKOPmT5HcqCRjmO1ttSZA [glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/ez -t 43200 25 Jan, 14:20:43 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/ezKOPmT5HcqCRjmO1ttSZA: removed ABORTED job [glite@emi-demo11 ~]$ ls -l /var/SandboxDir/ez total 0 [glite@emi-demo11 ~]$ ls -lr /var/SandboxDir/W6 total 4 drwxrwx--- 5 dteam045 glite 4096 Jan 24 14:24 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fW65OfHAN_5fLrcvyoohMGzWQ [glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/W6 -t 43200 25 Jan, 14:21:02 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/W65OfHAN_LrcvyoohMGzWQ: removed DONE job [glite@emi-demo11 ~]$ ls -lr /var/SandboxDir/W6 total 0 Find some directories that should not be purged: # find /var/SandboxDir/ -maxdepth 2 -type d -cmin -240 /var/SandboxDir/St/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fStNSoiVR3S47qnaFFHEOzw /var/SandboxDir/T5/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fT5gK96CZD8DbV8Oi1hSNcA Try to purge: [glite@emi-demo11 ~]$ date Wed Jan 25 14:15:03 CET 2012 [glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/T5 -t 43200 [glite@emi-demo11 ~]$ ls -l /var/SandboxDir/T5 total 4 drwxrwx--- 5 dteam045 glite 4096 Jan 25 10:29 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fT5gK96CZD8DbV8Oi1hSNcA [glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/St -t 43200 [glite@emi-demo11 ~]$ ls -l /var/SandboxDir/St total 4 drwxrwx--- 5 dteam045 glite 4096 Jan 25 12:59 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fStNSoiVR3S47qnaFFHEOzw ===> Test PASSED- Purge a job whose proxy is already expired [glite@emi-demo11 ~]$ openssl x509 -in /var/SandboxDir/z6/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fz6gxfYkbU1h8hZIyOXEOUg/user.proxy -noout -dates notBefore=Jan 17 15:52:12 2012 GMT notAfter=Jan 17 21:19:12 2012 GMT [glite@emi-demo11 ~]$ date Wed Jan 25 15:18:49 CET 2012 | |||||||
Added: | ||||||||
> > | [capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/z6gxfYkbU1h8hZIyOXEOUg![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/z6gxfYkbU1h8hZIyOXEOUg![]() ![]() ======================================================================
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/z6 -s
25 Jan, 15:21:10 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/z6gxfYkbU1h8hZIyOXEOUg![]() ![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/z6gxfYkbU1h8hZIyOXEOUg![]() ![]() ======================================================================
=> test PASSED ==
- Purge a dag job
[capannini@devel15 dag]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf dag.jdl
Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server![]() ================== glite-wms-job-submit Success ==================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw![]() ======================================================================
[capannini@devel15 dag]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw![]() ======================================================================
- Nodes information for:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/HnZfPHnH3xgxmhl_NrRr-g![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/X2-G_Tr9eyWgs88vjfnL2g![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Yc4eO097SXSBrXIvhsIqyw![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/b8bBqrceSFYU1mWEfpH-fQ![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/hGHl6d1B1D8xPAmNXdLdsw![]() ======================================================================
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/Ab -s25 Jan, 15:34:30 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:354): https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw![]() ![]() ![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw![]() ======================================================================
- Nodes information for:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/HnZfPHnH3xgxmhl_NrRr-g![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/X2-G_Tr9eyWgs88vjfnL2g![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Yc4eO097SXSBrXIvhsIqyw![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/b8bBqrceSFYU1mWEfpH-fQ![]() ======================================================================
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/hGHl6d1B1D8xPAmNXdLdsw![]() ======================================================================
=> test PASSED ==
| |||||||
-- FabioCapannini - 2011-12-28 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2880 to 2880 | ||||||||
See log: WMSService-TS_20120124151737.log: limiter log | ||||||||
Added: | ||||||||
> > | PurgeNormal job cycle[capannini@devel15 WMS-service]$ python WMS-check-purger.py -c wms-command.conf -V dteam -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Purge Mechanism ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Test purge , normal job cycle ( Submit to LCG CE ) Test 2: Test purge, normal job cycle ( Submit to CREAM CE ) Test 3: Test proxy cache purging ===> ===> Test: WMS-check-purger.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:07:54 ===> Ended : 12:11:47 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120125120754.logSee log: WMSService-TS_20120125120754.log: purge logs | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 2938 to 2969 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2839 to 2839 | ||||||||
| ||||||||
Added: | ||||||||
> > |
Limiter mechanism[capannini@devel15 WMS-service]$ python WMS-limiter-mechanism.py -c wms-command.conf -V dteam -d 3 -l -t 1,4,6-10 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Limiter Mechanism ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Test option --load1 threshold for load average (1 min) Test 4: Test option --memusage threshold for memory usage (%) Test 6: Test option --ftpconn threshold for number of FTP connections Test 7: Test option --diskusage threshold for disk usage (%) Test 8: Test option --fdnum threshold for used file descriptor Test 9: Test option --jdnum threshold for number of unprocessed jobs (for jobdir) Test 10: Test option --jdsize threshold for input jobdir size (KB) ===> ===> Test: WMS-limiter-mechanism.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 15:17:37 ===> Ended : 15:18:11 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120124151737.logSee log: WMSService-TS_20120124151737.log: limiter log | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 2874 to 2915 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Line: 2894 to 2937 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2645 to 2645 | ||||||||
See logs: cancel.tgz: Job cancel logs | ||||||||
Added: | ||||||||
> > | Configuration fileVerified that the following entries are present in/etc/glite-wms/glite_wms.conf :
ICE section
ICE = [ job_cancellation_threshold_time = 300; max_logfile_size = 100*1024*1024; cream_url_prefix = "https://"; start_subscription_updater = true; max_ice_mem = 2096000; InputType = "jobdir"; subscription_update_threshold_time = 3600; ice_log_level = 700; listener_enable_authn = true; listener_enable_authz = true; poller_status_threshold_time = 30*60; lease_update_frequency = 20*60; lease_delta_time = 0; cream_url_postfix = "/ce-cream/services/CREAM2"; subscription_duration = 86400; start_lease_updater = false; notification_frequency = 3*60; creamdelegation_url_postfix = "/ce-cream/services/gridsite-delegation"; ice_host_cert = "/home/glite/.certs/hostcert.pem"; cemon_url_postfix = "/ce-monitor/services/CEMonitor"; ice_topic = "CREAM_JOBS"; start_proxy_renewer = true; Input = "/var/ice/jobdir"; max_logfile_rotations = 10; start_poller = true; listener_port = 7010; poller_delay = 2*60; creamdelegation_url_prefix = "https://"; purge_jobs = false; start_listener = false; proxy_renewal_frequency = 600; bulk_query_size = 100; soap_timeout = 60; persist_dir = "/var/ice/persist_dir"; log_on_file = true; logfile = "${WMS_LOCATION_LOG}/ice.log"; ice_host_key = "/home/glite/.certs/hostkey.pem"; max_ice_threads = 10; log_on_console = false; cemon_url_prefix = "https://"; ice_empty_threshold = 600; ];WorkloadManagerProxy: WorkloadManagerProxy = [ EnableServiceDiscovery = false; ListMatchRootPath = "/tmp"; OperationLoadScripts = [ jobSubmit = "${WMS_LOCATION_SBIN}/glite_wms_wmproxy_load_monitor --oper jobSubmit --load1 22 --load5 20 --load15 18 --memusage 99 --diskusage 95 --fdnum 1000 --jdnum 1500 --ftpconn 300"; jobRegister = "${WMS_LOCATION_SBIN}/glite_wms_wmproxy_load_monitor --oper jobRegister --load1 22 --load5 20 --load15 18 --memusag e 99 --diskusage 95 --fdnum 1000 --jdnum 1500 --ftpconn 300"; ]; MinPerusalTimeInterval = 1000; MaxServedRequests = 50; ServiceDiscoveryInfoValidity = 3600; LBServer = {"emi-demo11.cnaf.infn.it:9000"}; LBServiceDiscoveryType = "org.glite.lb.server"; LogLevel = 5; SandboxStagingPath = "${WMS_LOCATION_VAR}/SandboxDir"; LBLocalLogger = "localhost:9002"; WeightsCacheValidity = 86400; LogFile = "${WMS_LOCATION_LOG}/wmproxy.log"; AsyncJobStart = true; GridFTPPort = 2811; MaxInputSandboxSize = 100000000; ];NetworkServer: NetworkServer = [ II_Timeout = 100; EnableQuotaManagement = false; QuotaInsensibleDiskPortion = 2.0; SandboxStagingPath = "${WMS_LOCATION_VAR}/SandboxDir"; II_DN = "mds-vo-name=local, o=grid"; MasterThreads = 8; ConnectionTimeout = 300; LogFile = "${WMS_LOCATION_LOG}/networkserver_events.log"; LogLevel = 5; II_Contact = "cert-bdii-04.cnaf.infn.it"; //II_Contact = "egee-bdii.cnaf.infn.it"; II_Port = 2170; QuotaAdjustmentAmount = 10000; DispatcherThreads = 10; Gris_DN = "mds-vo-name=local, o=grid"; Gris_Port = 2170; DLI_SI_CatalogTimeout = 60; EnableDynamicQuotaAdjustment = false; ListMatchParadise = "${WMS_LOCATION_TMP}/MatchArea"; Gris_Timeout = 20; BacklogSize = 64; ListeningPort = 7772; MaxInputSandboxSize = 10000000; ];WorkloadManager: WorkloadManager = [ DisablePurchasingFromGris = true; IsmBlackList = {}; ExpiryPeriod = 7200; PipeDepth = 200; JobWrapperTemplateDir = "${WMS_JOBWRAPPER_TEMPLATE}"; IsmDump = "${WMS_LOCATION_VAR}/workload_manager/ismdump.fl"; IsmIiPurchasingRate = 480; MatchRetryPeriod = 600; MaxReplansCount = 5; EnableRecovery = true; DispatcherType = "jobdir"; LogLevel = 5; LogFile = "${WMS_LOCATION_LOG}/workload_manager_events.log"; DliServiceName = "data-location-interface"; RuntimeMalloc = "/usr/lib64/libjemalloc.so.1"; IsmUpdateRate = 600; WmsRequirements = ((ShortDeadlineJob =?= TRUE) ? RegExp(".*sdj$", other.GlueCEUniqueID) : !RegExp(".*sdj$", other.GlueCEUniqueID)) && (other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs) && (EnableWmsFeedback =?= TRUE ? RegExp("cream", other.GlueCEImplementationName, "i") : true); CeMonitorAsynchPort = 0; QueueSize = 1000; EnableBulkMM = true; MaxRetryCount = 10; SiServiceName = "org.glite.SEIndex"; IsmThreads = false; MaxOutputSandboxSize = -1; CeForwardParameters = {"GlueHostMainMemoryVirtualSize","GlueHostMainMemoryRAMSize","GlueCEPolicyMaxCPUTime"}; CeMonitorServices = {}; IsmIiLDAPCEFilterExt = "(|(GlueCEAccessControlBaseRule=VO:atlas)(GlueCEAccessControlBaseRule=VOMS:/atlas/*)(GlueCEAccessControlBaseRule=VO:alice)(GlueCEAccessControlBaseRule=VOMS:/alice/*)(GlueCEAccessControlBaseRule=VO:lhcb)(GlueCEAccessControlBaseRule=VOMS:/lhcb/*)(GlueCEAccessControlBaseRule=VO:cms)(GlueCEAccessControlBaseRule=VOMS:/cms/*)(GlueCEAccessControlBaseRule=VO:dteam)(GlueCEAccessControlBaseRule=VOMS:/dteam/*)(GlueCEAccessControlBaseRule=VO:biomed)(GlueCEAccessControlBaseRule=VOMS:/biomed/*)(GlueCEAccessControlBaseRule=VO:ops)(GlueCEAccessControlBaseRule=VOMS:/ops/*)(GlueCEAccessControlBaseRule=VO:infngrid)(GlueCEAccessControlBaseRule=VOMS:/infngrid/*)(GlueCEAccessControlBaseRule=VO:testers.eu-emi.eu)(GlueCEAccessControlBaseRule=VOMS:/testers.eu-emi.eu/*))"; ReplanGracePeriod = 3600; Input = "${WMS_LOCATION_VAR}/workload_manager/jobdir"; WorkerThreads = 5; ];Common section: Common = [ HostProxyFile = "${WMS_LOCATION_VAR}/glite/wms.proxy"; LBProxy = true; DGUser = "${GLITE_WMS_USER}"; ];Logmonitor section: LogMonitor = [ CondorLogRecycleDir = "${WMS_LOCATION_VAR}/logmonitor/CondorG.log/recycle"; LockFile = "${WMS_LOCATION_VAR}/logmonitor/lock"; AbortedJobsTimeout = 600; CondorLogDir = "${WMS_LOCATION_VAR}/logmonitor/CondorG.log"; MonitorInternalDir = "${WMS_LOCATION_VAR}/logmonitor/internal"; MainLoopDuration = 5; GlobusDownTimeout = 7200; LogLevel = 5; JobsPerCondorLog = 1000; LogFile = "${WMS_LOCATION_LOG}/logmonitor_events.log"; ExternalLogFile = "${WMS_LOCATION_LOG}/logmonitor_external.log"; RemoveJobFiles = true; IdRepositoryName = "irepository.dat"; ForceCancellationRetries = 2; ];JobController section: JobController = [ Input = "${WMS_LOCATION_VAR}/jobcontrol/jobdir/"; ContainerRefreshThreshold = 1000; CondorQuery = "${CONDORG_INSTALL_PATH}/bin/condor_q"; LogFile = "${WMS_LOCATION_LOG}/jobcontoller_events.log"; CondorDagman = "${CONDORG_INSTALL_PATH}/bin/condor_dagman"; MaximumTimeAllowedForCondorMatch = 1800; CondorRelease = "${CONDORG_INSTALL_PATH}/bin/condor_release"; OutputFileDir = "${WMS_LOCATION_VAR}/jobcontrol/condorio"; InputType = "jobdir"; CondorRemove = "${CONDORG_INSTALL_PATH}/bin/condor_rm"; DagmanMaxPre = 10; LockFile = "${WMS_LOCATION_VAR}/jobcontrol/lock"; SubmitFileDir = "${WMS_LOCATION_VAR}/jobcontrol/submit"; CondorSubmit = "${CONDORG_INSTALL_PATH}/bin/condor_submit"; LogLevel = 5; ];Verified that:
| |||||||
-- FabioCapannini - 2011-12-28 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2414 to 2414 | ||||||||
See logs: prolepilog.tgz: prologue epilog logs | ||||||||
Added: | ||||||||
> > | Shallow and deep resubmission[capannini@devel15 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Resubmission Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try a shallow resubmission Test 2: Try a deep resubmission ===> ===> Test: WMS-job-resubmit.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:16:38 ===> Ended : 10:28:49 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120124101638.log [capannini@devel15 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Resubmission Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try a shallow resubmission Test 2: Try a deep resubmission ===> ===> Test: WMS-job-resubmit.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:32:35 ===> Ended : 10:45:18 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120124103235.log [capannini@devel15 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy ............................................................................................................................................. Done Proxy Verify OK Your proxy is valid until: Tue Jan 31 10:39:47 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done Creating proxy ................................................................................................................................................. Done Your proxy is valid until Tue Jan 24 21:40:11 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:51 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:50 uri : voms.hellasgrid.gr:15004 [capannini@devel15 WMS-service]$ python WMS-job-resubmit.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Resubmission Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Try a shallow resubmission Test 2: Try a deep resubmission ===> ===> Test: WMS-job-resubmit.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:40:39 ===> Ended : 10:53:15 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120124104039.logSee logs: resub.tgz: resubmission logs Job cancel[capannini@devel15 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Cancel Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try to cancel a normal job Test 2: Try to cancel a DAG job Test 3: Try to cancel one node of a DAG job Test 4: Try to cancel a collection job Test 5: Try to cancel one node of a collection job Test 6: Try to cancel a parametric job Test 7: Try to cancel one node of a parametric job Test 8: Try to cancel a MPI job ===> ===> Test: WMS-job-cancel.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:53:04 ===> Ended : 11:02:03 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120124105304.log [capannini@devel15 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Cancel Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Try to cancel a normal job Test 2: Try to cancel a DAG job Test 3: Try to cancel one node of a DAG job Test 4: Try to cancel a collection job Test 5: Try to cancel one node of a collection job Test 6: Try to cancel a parametric job Test 7: Try to cancel one node of a parametric job Test 8: Try to cancel a MPI job ===> ===> Test: WMS-job-cancel.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:43:32 ===> Ended : 10:52:08 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120124104332.log [capannini@devel15 WMS-service]$ python WMS-job-cancel.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job Cancel Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Try to cancel a normal job Test 2: Try to cancel a DAG job Test 3: Try to cancel one node of a DAG job Test 4: Try to cancel a collection job Test 5: Try to cancel one node of a collection job Test 6: Try to cancel a parametric job Test 7: Try to cancel one node of a parametric job Test 8: Try to cancel a MPI job ===> ===> Test: WMS-job-cancel.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:52:46 ===> Ended : 10:57:43 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120124105246.logSee logs: cancel.tgz: Job cancel logs | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 2446 to 2676 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Line: 2464 to 2698 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2112 to 2112 | ||||||||
See logs: WMSService-TS_20120123121509.log: list-match log | ||||||||
Added: | ||||||||
> > | With data[fabiok@ui ~]$ export LFC_HOST=prod-lfc-shared-central.cern.ch [fabiok@ui ~]$ lcg-lr --vo dteam lfn:/grid/dteam/fcapanni/e-2M.txt srm://gridsrm.pi.infn.it/dteam/fcapanni/e-2M.txt srm://srm-public.cern.ch/castor/cern.ch/grid/dteam/fcapanni/e-2M.txt The two SEs where the file can be found are gridsrm.pi.infn.it and srm-public.cern.ch. [capannini@devel15 WMS-service]$ cat JDLs/data-req.jdl ########################################### # JDL with Data Requirements # ########################################### Executable = "/bin/ls"; Arguments = "-la"; StdOutput = "std.out"; StdError = "std.err"; Prologue = "prologue.sh"; FuzzyRank = true; Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"}; InputSandbox = {"JDLs/prologue.sh"}; OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"}; DataRequirements = { [ DataCatalogType = "DLI"; DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" }; ] }; DataAccessProtocol = "gsiftp"; AllowZippedISB=true; RetryCount = 1; ShallowRetryCount = 2; [capannini@devel15 WMS-service]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf JDLs/data-req.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ========================================================================== COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found: *CEId* - ce130.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam - ce130.cern.ch:2119/jobmanager-lcglsf-grid_dteam - ce131.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam - ce131.cern.ch:2119/jobmanager-lcglsf-grid_dteam - ce132.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam - ce132.cern.ch:2119/jobmanager-lcglsf-grid_dteam - ce133.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam - ce133.cern.ch:2119/jobmanager-lcglsf-grid_dteam - ce203.cern.ch:8443/cream-lsf-grid_2nh_dteam - ce203.cern.ch:8443/cream-lsf-grid_dteam - ce204.cern.ch:8443/cream-lsf-grid_2nh_dteam - ce204.cern.ch:8443/cream-lsf-grid_dteam - ce205.cern.ch:8443/cream-lsf-grid_2nh_dteam - ce205.cern.ch:8443/cream-lsf-grid_dteam - ce206.cern.ch:8443/cream-lsf-grid_2nh_dteam - ce206.cern.ch:8443/cream-lsf-grid_dteam - ce207.cern.ch:8443/cream-lsf-grid_2nh_dteam - ce207.cern.ch:8443/cream-lsf-grid_dteam - ce208.cern.ch:8443/cream-lsf-grid_2nh_dteam - ce208.cern.ch:8443/cream-lsf-grid_dteam - cream.sns.it:8443/cream-pbs-cert - gridce0.pi.infn.it:8443/cream-lsf-cert - gridce1.pi.infn.it:2119/jobmanager-lcglsf-cert - gridce2.pi.infn.it:2119/jobmanager-lcglsf-cert - gridce3.pi.infn.it:8443/cream-lsf-certmpi - gridce.sns.it:2119/jobmanager-lcgpbs-cert ========================================================================== In order to verify that these CEs are close to the above SEs: [fabiok@ui ~]$ lcg-infosites --vo dteam closeSE|grep -A 5 ce130 Name of the CE: ce130.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam srm-alice.cern.ch srm-atlas.cern.ch srm-cms.cern.ch srm-lhcb.cern.ch srm-public.cern.ch -- Name of the CE: ce130.cern.ch:2119/jobmanager-lcglsf-grid_dteam srm-alice.cern.ch srm-atlas.cern.ch srm-cms.cern.ch srm-lhcb.cern.ch srm-public.cern.ch [fabiok@ui ~]$ lcg-infosites --vo dteam closeSE|grep -A 5 ce208.cern.ch Name of the CE: ce208.cern.ch:8443/cream-lsf-grid_2nh_dteam srm-alice.cern.ch srm-atlas.cern.ch srm-cms.cern.ch srm-lhcb.cern.ch srm-public.cern.ch -- Name of the CE: ce208.cern.ch:8443/cream-lsf-grid_dteam srm-alice.cern.ch srm-atlas.cern.ch srm-cms.cern.ch srm-lhcb.cern.ch srm-public.cern.ch [fabiok@ui ~]$ lcg-infosites --vo dteam closeSE|grep -A 5 cream.sns.it Name of the CE: cream.sns.it:8443/cream-pbs-cert gridsrm.pi.infn.it [fabiok@ui ~]$ lcg-infosites --vo dteam closeSE|grep -A 5 gridce.sns.it Name of the CE: gridce.sns.it:2119/jobmanager-lcgpbs-cert gridsrm.pi.infn.it===> Test PASSED Gangmatching[capannini@devel15 certification]$ cat gang.jdl [ executable="ls.sh"; myproxyserver=""; SErequirements = anyMatch(other.storage.CloseSEs, target.GlueSAStateAvailableSpace > 20); CErequirements = other.GlueCEStateStatus == "Production" && other.GlueCEInfoTotalCPUs >= 2; requirements = CErequirements && SErequirements; inputsandbox={"ls.sh"}; stdoutput="out3.out"; stderror="err2.err"; outputsandbox={"out3.out", "err2.err", "ls.sh", "a"}; ] [capannini@devel15 certification]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf gang.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ========================================================================== COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found: *CEId* - cccreamceli05.in2p3.fr:8443/cream-sge-long - cccreamceli05.in2p3.fr:8443/cream-sge-medium - cccreamceli05.in2p3.fr:8443/cream-sge-short - cccreamceli09.in2p3.fr:8443/cream-sge-long - cccreamceli09.in2p3.fr:8443/cream-sge-medium - cccreamceli09.in2p3.fr:8443/cream-sge-short - cmsce01.na.infn.it:2119/jobmanager-lcgpbs-cert - cmsrm-ce01.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert - cmsrm-cream01.roma1.infn.it:8443/cream-lsf-cmsgcert - grid010.ct.infn.it:2119/jobmanager-lcgpbs-cert - inaf-ce-01.ct.pi2s2.it:8443/cream-lsf-cert - unict-dmi-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-cert - virgo-ce.roma1.infn.it:2119/jobmanager-lcgpbs-cert - ce-01.grid.sissa.it:8443/cream-pbs-blade - cccreamceli10.in2p3.fr:8443/cream-sge-long - cccreamceli10.in2p3.fr:8443/cream-sge-medium - cccreamceli10.in2p3.fr:8443/cream-sge-short - cmsrm-ce02.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert - cccreamceli06.in2p3.fr:8443/cream-sge-long - cccreamceli06.in2p3.fr:8443/cream-sge-medium - cccreamceli06.in2p3.fr:8443/cream-sge-short - cream-ce.pg.infn.it:8443/cream-pbs-cert ========================================================================== In order to verify that the SErequirements are met: [capannini@devel15 certification]$ lcg-infosites closeSE|grep -A 5 cccreamceli05.in2p3.fr Name of the CE: cccreamceli05.in2p3.fr:8443/cream-sge-long ccsrm.in2p3.fr [capannini@devel15 certification]$ lcg-infosites se |egrep 'Avail|ccsrm.in2p3.fr' Avail Space(kB) Used Space(kB) Type SE 11385302023 3647083513 SRM ccsrm.in2p3.fr [capannini@devel15 certification]$ lcg-infosites closeSE|grep -A 5 cmsce01.na.infn.it Name of the CE: cmsce01.na.infn.it:2119/jobmanager-lcgpbs-cert cmsse02.na.infn.it Name of the CE: cmsrm-ce01.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert cmsrm-se01.roma1.infn.it [capannini@devel15 certification]$ lcg-infosites se |egrep 'Avail|cmsse02.na.infn.it' Avail Space(kB) Used Space(kB) Type SE 25271855845 690913963 SRM cmsse02.na.infn.it [capannini@devel15 certification]$ lcg-infosites closeSE|grep -A 5 cmsrm-ce02.roma1.infn.it Name of the CE: cmsrm-ce02.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert cmsrm-se01.roma1.infn.it Name of the CE: cmsrm-cream01.roma1.infn.it:8443/cream-lsf-cmsgcert cmsrm-se01.roma1.infn.it [capannini@devel15 certification]$ lcg-infosites se |egrep 'Avail|cmsrm-se01.roma1.infn.it' Avail Space(kB) Used Space(kB) Type SE 1000 999999 SRM cmsrm-se01.roma1.infn.it Moreover, setting SErequirements = true in the jdl, the list of matching CEs is far longer.===> Test PASSED Prologue and Epilogue jobs[capannini@devel15 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test prologue and epilogue attributes ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test prologue attribute Test 2: Test epilogue attribute Test 3: Test prologue and epilogue attributes ===> ===> Test: WMS-prologue-epilogue.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 16:05:57 ===> Ended : 16:11:17 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120123160557.log [capannini@devel15 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test prologue and epilogue attributes ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Test prologue attribute Test 2: Test epilogue attribute Test 3: Test prologue and epilogue attributes ===> ===> Test: WMS-prologue-epilogue.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 16:18:49 ===> Ended : 16:25:09 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120123161849.log [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 6:43:33 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 7:42:33 uri : voms.hellasgrid.gr:15004 [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS test prologue and epilogue attributes ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Test prologue attribute Test 2: Test epilogue attribute Test 3: Test prologue and epilogue attributes ===> ===> Test: WMS-prologue-epilogue.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 16:30:56 ===> Ended : 16:37:13 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120123163056.logSee logs: prolepilog.tgz: prologue epilog logs | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 2159 to 2463 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 2002 to 2002 | ||||||||
See log: WMSService-TS_20120123104906.log: list-match log | ||||||||
Added: | ||||||||
> > | [capannini@devel15 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job ListMatch Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: check if glite-wms-job-list-match command exists Test 2: test a simple matching Test 3: check --delegationid option Test 4: exclude a CE from the match Test 5: try a failure matching (Requirements == false) Test 6: try a matching with EnableWMSFeedback attribute true ===> ===> Test: WMS-listmatch-test.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:10:55 ===> Ended : 12:11:07 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120123121055.logSee logs: WMSService-TS_20120123121055.log: list-match log [capannini@devel15 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy .................................................................. Done Proxy Verify OK Your proxy is valid until: Mon Jan 30 12:13:56 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@devel15 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done Creating proxy ....................... Done Your proxy is valid until Mon Jan 23 23:14:19 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:52 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:52 uri : voms.hellasgrid.gr:15004 [capannini@devel15 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job ListMatch Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: check if glite-wms-job-list-match command exists Test 2: test a simple matching Test 3: check --delegationid option Test 4: exclude a CE from the match Test 5: try a failure matching (Requirements == false) Test 6: try a matching with EnableWMSFeedback attribute true ===> ===> Test: WMS-listmatch-test.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:15:09 ===> Ended : 12:15:15 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120123121509.logSee logs: WMSService-TS_20120123121509.log: list-match log | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 2044 to 2157 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1962 to 1962 | ||||||||
See logs: delegation.tgz: delegation logs | ||||||||
Added: | ||||||||
> > | Job List-matchWithout data[capannini@devel15 WMS-service]$ python WMS-listmatch-test.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Job ListMatch Testing ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: check if glite-wms-job-list-match command exists Test 2: test a simple matching Test 3: check --delegationid option Test 4: exclude a CE from the match Test 5: try a failure matching (Requirements == false) Test 6: try a matching with EnableWMSFeedback attribute true ===> ===> Test: WMS-listmatch-test.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:49:06 ===> Ended : 10:49:18 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120123104906.logSee log: WMSService-TS_20120123104906.log: list-match log | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 2002 to 2043 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1750 to 1750 | ||||||||
--> Test PASSED | ||||||||
Added: | ||||||||
> > | Perusal[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 6 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 6: Submit a perusal job BEWARE default min perusal interval is 1000 secs, so this phase could take many minutes ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:12:07 ===> Ended : 10:46:35 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120120101207.log [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 6 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 6: Submit a perusal job BEWARE default min perusal interval is 1000 secs, so this phase could take many minutes ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 14:28:05 ===> Ended : 14:55:34 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120120142805.log [capannini@devel15 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 6:31:39 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 7:30:39 uri : voms2.hellasgrid.gr:15004 [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 6 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 6: Submit a perusal job BEWARE default min perusal interval is 1000 secs, so this phase could take many minutes ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 14:58:43 ===> Ended : 15:26:03 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120120145843.logSee logs: perusal.tgz: perusal logs | |||||||
Delegation[capannini@devel15 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V dteam -d 3 -l -i | ||||||||
Line: 1913 to 2001 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1750 to 1750 | ||||||||
--> Test PASSED | ||||||||
Added: | ||||||||
> > | Delegation[capannini@devel15 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V dteam -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test delegation operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Check --autm-delegation option Test 2: Check --delegationid option Test 3: Try to delegate with a short proxy and check the validity Test 4: Works with expired proxy ===> ===> Test: WMS-delegation-test.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:22:35 ===> Ended : 10:23:49 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120120102235.log [capannini@devel15 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test delegation operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Test 1: Check --autm-delegation option Test 2: Check --delegationid option Test 3: Try to delegate with a short proxy and check the validity Test 4: Works with expired proxy ===> ===> Test: WMS-delegation-test.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:25:00 ===> Ended : 10:26:14 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120120102500.log [capannini@devel15 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy ............................... Done Proxy Verify OK Your proxy is valid until: Fri Jan 27 10:27:27 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done Creating proxy .................... Done Your proxy is valid until Fri Jan 20 21:27:59 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:47 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:47 uri : voms2.hellasgrid.gr:15004 [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ python WMS-delegation-test.py -c wms-command.conf -d 3 -l ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test delegation operation ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Test 1: Check --autm-delegation option Test 2: Check --delegationid option There are other two tests which require the user proxy password. Use -i option to enable them ===> ===> Test: WMS-delegation-test.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:28:43 ===> Ended : 10:28:46 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120120102843.logSee logs: delegation.tgz: delegation logs | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 1785 to 1912 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1649 to 1649 | ||||||||
===> Test log file is WMSService-TS_20120118162322.log See logs: parallel.tgz: parallel job logs | ||||||||
Added: | ||||||||
> > | Testing forwarding parameters for parallel jobsIn order to test the passing of mpi parameters (wholenodes,smpgranularity,cpunumber,hostnumber) to the ce, an mpi jdl is submitted with varying values for the parameters, specifying a cream CE as destination. Then the cream jobid is retrieved via a glite-wms-job-logging-info -v 2 ("Dest jobid" field of a Transfer event).Finally the cream jdl is found via glite-ce-job-status -L 2 <cream-jobid>. The following jdls were submitted: 1)Executable = "openmpi-wrapper.sh"; Arguments="hello"; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"}; Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID); WholeNodes = true; SMPGranularity = 2; CpuNumber=2; Hostnumber = 1;Resulting cream JDL: JDL = [[ CEInfoHostName = "ce-qamar.utmgrid.utm.my"; OutputSandboxPath = "/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "ce-qamar.utmgrid.utm.my:8443/cream-pbs"; QueueName = "dteam"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000011:BH=0000000000:JSS=000004:LM=000012:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; ce_id = "ce-qamar.utmgrid.utm.my:8443/cream-pbs-dteam"; ZippedISB = { "ISBfiles_Gmr4VWTb4-nGOH4-Bd092w_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && ( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/iYM9Zl0NcKDqT1HqZiYN_g"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 2; InputSandboxPath = "/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg/input"; CeApplicationDir = "/opt/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg/token.txt_0"; rank = -other.GlueCEStateEstimatedResponseTime; WholeNodes = true; CpuNumber = 2; edg_previous_matches = { "gb-ce-emc.erasmusmc.nl" }; ReplansCount = 0; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "torque"; MyProxyServer = "myproxy.cnaf.infn.it"; edg_previous_matches_ex = { [ timestamp = 1326965618; ce_id = "gb-ce-emc.erasmusmc.nl" ] }; X509UserProxy = "/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; Hostnumber = 1; requirements = ( ( ( ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && ( other.GlueCEStateStatus == "Production" ) ) && other.GlueCEInfoTotalCPUs >= 2 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueCEInfoTotalCPUs >= 2 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) : !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/iY/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fiYM9Zl0NcKDqT1HqZiYN_5fg" ]]2) Executable = "openmpi-wrapper.sh"; Arguments="hello"; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"}; Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID); WholeNodes = true; SMPGranularity = 2;Resulting cream jdl: JDL = [[ CEInfoHostName = "ce-02.roma3.infn.it"; OutputSandboxPath = "/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "ce-02.roma3.infn.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000017:BH=0000000000:JSS=000006:LM=000022:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; ce_id = "ce-02.roma3.infn.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_zpOEExFPS0a9q8TGstx7hQ_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/mRQj0IPxfJ5ZjuBWrcDn1g"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 2; InputSandboxPath = "/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g/input"; CeApplicationDir = "/storage/local/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g/token.txt_0"; rank = -other.GlueCEStateEstimatedResponseTime; WholeNodes = true; edg_previous_matches = { "ce.scope.unina.it","grisuce.scope.unina.it" }; ReplansCount = 0; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "pbs"; MyProxyServer = "myproxy.cnaf.infn.it"; edg_previous_matches_ex = { [ timestamp = 1326967114; ce_id = "ce.scope.unina.it" ],[ timestamp = 1326967117; ce_id = "grisuce.scope.unina.it" ] }; X509UserProxy = "/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; requirements = ( ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && ( other.GlueCEStateStatus == "Production" ) ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) : !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/mR/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fmRQj0IPxfJ5ZjuBWrcDn1g" ]]3) Executable = "openmpi-wrapper.sh"; Arguments="hello"; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"}; Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID); WholeNodes = false; SMPGranularity = 3; CpuNumber=3; Hostnumber = 1; Submission result: [capannini@devel15 mpi]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf mpi.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server Error - SMPGranularity and HostNumber are mutually exclusive when WholeNodes allocation is not requested: wrong combination of values4) Executable = "openmpi-wrapper.sh"; Arguments="hello"; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"}; Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID); WholeNodes = false; SMPGranularity = 3; CpuNumber=3;Resulting cream jdl: JDL = [[ CEInfoHostName = "ce-02.roma3.infn.it"; OutputSandboxPath = "/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "ce-02.roma3.infn.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000017:BH=0000000000:JSS=000006:LM=000022:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; ce_id = "ce-02.roma3.infn.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_gQrxvLonwNUGPUr_WRZxrg_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && ( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/l-na1nvxx06q_y6klpEnQQ"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 3; InputSandboxPath = "/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ/input"; CeApplicationDir = "/storage/local/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ/token.txt_0"; rank = -other.GlueCEStateEstimatedResponseTime; WholeNodes = false; CpuNumber = 3; edg_previous_matches = { "grisuce.scope.unina.it","ce.scope.unina.it" }; ReplansCount = 0; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "pbs"; MyProxyServer = "myproxy.cnaf.infn.it"; edg_previous_matches_ex = { [ timestamp = 1326968771; ce_id = "grisuce.scope.unina.it" ],[ timestamp = 1326968773; ce_id = "ce.scope.unina.it" ] }; X509UserProxy = "/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; requirements = ( ( ( ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && ( other.GlueCEStateStatus == "Production" ) ) && other.GlueCEInfoTotalCPUs >= 3 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueCEInfoTotalCPUs >= 3 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) : !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/l-/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fl-na1nvxx06q_5fy6klpEnQQ" ]]5) Executable = "openmpi-wrapper.sh"; Arguments="hello"; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; InputSandbox = {"/home/capannini/certification/mpi/openmpi-wrapper.sh","/home/capannini/certification/mpi/hello.c","/home/capannini/certification/mpi/Makefile"}; Requirements = Member ("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*", other.GlueCEUniqueID); WholeNodes = true; SMPGranularity = 8; CpuNumber=8; Hostnumber = 2;Resulting ce jdl: JDL = [[ CEInfoHostName = "ce-02.roma3.infn.it"; OutputSandboxPath = "/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ/output"; StdOutput = "hello.out"; BatchSystem = "pbs"; GlobusResourceContactString = "ce-02.roma3.infn.it:8443/cream-pbs"; QueueName = "cert"; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; Executable = "openmpi-wrapper.sh"; Type = "job"; LB_sequence_code = "UI=000000:NS=0000000004:WM=000005:BH=0000000000:JSS=000002:LM=000002:LRMS=000000:APP=000000:LBS=000000"; Arguments = "hello"; AllowZippedISB = true; maxOutputSandboxSize = -1.000000000000000E+00; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; ce_id = "ce-02.roma3.infn.it:8443/cream-pbs-cert"; ZippedISB = { "ISBfiles_dz-M5EA3o9uj857y8CkqMg_0.tar.gz" }; OutputSandboxDestURI = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ/output/hello.out","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ/output/hello.err" }; OutputSandbox = { "hello.out","hello.err" }; CeRequirements = "( true && ( true && ( true && ( true && ( true && ( true && Member(\"OPENMPI\",other.GlueHostApplicationSoftwareRunTimeEnvironment) ) ) ) ) ) ) && ( true && ( ( ShortDeadlineJob is true ) ? false : true ) && ( EnableWmsFeedback is true ? true : true ) )"; InputSandbox = { "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ/input/openmpi-wrapper.sh","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ/input/hello.c","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ/input/Makefile","gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ/input/.BrokerInfo" }; edg_jobid = "https://emi-demo11.cnaf.infn.it:9000/Oc3Gbgez4On6im_B63zOkQ"; VOMS_FQAN = "/dteam/Role=NULL/Capability=NULL"; CertificateSubject = "/C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini"; StdError = "hello.err"; SMPGranularity = 8; InputSandboxPath = "/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ/input"; CeApplicationDir = "/storage/local/exp_soft/dteam"; ReallyRunningToken = "gsiftp://emi-demo11.cnaf.infn.it/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ/token.txt_0"; rank = -other.GlueCEStateEstimatedResponseTime; WholeNodes = true; CpuNumber = 8; WMSHostname = "emi-demo11.cnaf.infn.it"; lrms_type = "pbs"; MyProxyServer = "myproxy.cnaf.infn.it"; X509UserProxy = "/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ/user.proxy"; InputSandboxDestFileName = { "openmpi-wrapper.sh","hello.c","Makefile" }; Hostnumber = 2; requirements = ( ( ( ( ( ( Member("OPENMPI",other.GlueHostApplicationSoftwareRunTimeEnvironment) && RegExp(".*cream.*",other.GlueCEUniqueID) ) && ( other.GlueCEStateStatus == "Production" ) ) && other.GlueCEInfoTotalCPUs >= 8 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && other.GlueCEInfoTotalCPUs >= 8 ) && other.GlueHostArchitectureSMPSize >= SMPGranularity ) && ( ( ( ShortDeadlineJob is true ) ? RegExp(".*sdj$",other.GlueCEUniqueID) : !RegExp(".*sdj$",other.GlueCEUniqueID) ) && ( other.GlueCEPolicyMaxTotalJobs == 0 || other.GlueCEStateTotalJobs < other.GlueCEPolicyMaxTotalJobs ) && ( EnableWmsFeedback is true ? RegExp("cream",other.GlueCEImplementationName,"i") : true ) ); WMPInputSandboxBaseURI = "gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/Oc/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fOc3Gbgez4On6im_5fB63zOkQ" ]]--> Test PASSED | |||||||
-- FabioCapannini - 2011-12-28 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1571 to 1571 | ||||||||
===> Test log file is WMSService-TS_20120118120630.log See logs: dag.tgz: dag logs | ||||||||
Added: | ||||||||
> > | Parallel jobSetting II_Contact = "egee-bdii.cnaf.infn.it"; in glite_wms.conf and commenting #DEFAULTREQ= other.GlueCEStateStatus == "Testing"[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 5 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 5: Submit a MPI job (3 cases LCG-CE, CREAM, general) Test 5A: Submit to an LCG-CE Test 5B: Submit to a CREAM CE Test 5C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 16:23:09 ===> Ended : 16:27:29 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120118162309.log [capannini@devel15 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 5:59:20 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 6:58:19 uri : voms.hellasgrid.gr:15004 [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 5 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 5: Submit a MPI job (3 cases LCG-CE, CREAM, general) Test 5A: Submit to an LCG-CE Test 5B: Submit to a CREAM CE Test 5C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 16:23:22 ===> Ended : 16:29:12 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120118162322.logSee logs: parallel.tgz: parallel job logs | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 1603 to 1684 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 92 to 92 | ||||||||
Basic Functionality testsSubmission | ||||||||
Added: | ||||||||
> > | Where possible the tests should use internal testbed CEs (located in Padova).
This is accomplished by adding the following line to wms-command.conf:
DEFAULTREQ= other.GlueCEStateStatus == "Testing"This is not possible, for example, for parallel jobs. | |||||||
Normal[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i | ||||||||
Line: 1375 to 1381 | ||||||||
See logs: coll.tgz: all in a jdl collection logs | ||||||||
Added: | ||||||||
> > | Parametric job[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) Test 3A: Submit to an LCG-CE Test 3B: Submit to a CREAM CE Test 3C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:46:35 ===> Ended : 10:53:22 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120118104635.log [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 3 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) Test 3A: Submit to an LCG-CE Test 3B: Submit to a CREAM CE Test 3C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:47:30 ===> Ended : 10:53:46 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120118104730.log [capannini@devel15 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy ............... Done Proxy Verify OK Your proxy is valid until: Wed Jan 25 10:48:21 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done Creating proxy ................................................................................................................................................ Done Your proxy is valid until Wed Jan 18 21:48:49 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ [capannini@devel15 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:51 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:50 uri : voms.hellasgrid.gr:15004 [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 3 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 3: Submit a parametric job (3 cases LCG-CE, CREAM, general) Test 3A: Submit to an LCG-CE Test 3B: Submit to a CREAM CE Test 3C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:49:51 ===> Ended : 10:55:10 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120118104951.logSee logs: parametric.tgz: parametric logs DAG job[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 4: Submit a DAG job ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:05:40 ===> Ended : 12:10:56 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120118120540.log [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 4 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 4: Submit a DAG job ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:06:00 ===> Ended : 12:11:15 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120118120600.log [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 4 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 4: Submit a DAG job ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 12:06:30 ===> Ended : 12:12:39 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120118120630.logSee logs: dag.tgz: dag logs | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 1401 to 1601 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1250 to 1250 | ||||||||
See log: WMSService-TS_20120116163257.log: bulk collection log | ||||||||
Added: | ||||||||
> > | All in a jdl[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes Test 7A: Submit to an LCG-CE Test 7B: Submit to a CREAM CE Test 7C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:04:17 ===> Ended : 10:36:27 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120117100417.log [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 7 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes Test 7A: Submit to an LCG-CE Test 7B: Submit to a CREAM CE Test 7C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 10:24:08 ===> Ended : 10:38:44 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120117102408.log [capannini@devel15 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy ..................................................................................................................................................................................................... Done Proxy Verify OK Your proxy is valid until: Tue Jan 24 11:18:37 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@devel15 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done Creating proxy ............................................................................................................................................................................................................................................. Done Your proxy is valid until Tue Jan 17 22:19:16 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@devel15 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:59:33 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:58:32 uri : voms2.hellasgrid.gr:15004 [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 7 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 7: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) using a single jdl with al the jdls of nodes Test 7A: Submit to an LCG-CE Test 7B: Submit to a CREAM CE Test 7C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 11:19:59 ===> Ended : 11:29:26 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120117111959.logSee logs: coll.tgz: all in a jdl collection logs | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 1265 to 1390 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Line: 1273 to 1400 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1114 to 1114 | ||||||||
Log is here: WMSService-TS_20120116115816.log: sdj log | ||||||||
Added: | ||||||||
> > | CollectionBulk submission[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 2 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) Test 2A: Submit to an LCG-CE Test 2B: Submit to a CREAM CE Test 2C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 15:15:00 ===> Ended : 15:24:31 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120116151500.logSee log: WMSService-TS_20120116151500.log: bulk collection log [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 2 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) Test 2A: Submit to an LCG-CE Test 2B: Submit to a CREAM CE Test 2C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 15:46:24 ===> Ended : 15:56:56 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120116154624.logSee log: WMSService-TS_20120116154624.log: bulk collection log [capannini@devel15 WMS-service]$ myproxy-init -d Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Enter GRID pass phrase for this identity: Creating proxy .................................................................. Done Proxy Verify OK Your proxy is valid until: Mon Jan 23 16:04:28 2012 Enter MyProxy pass phrase: Verifying - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on myproxy.cnaf.infn.it. [capannini@devel15 WMS-service]$ myproxy-logon -d --voms dteam Enter MyProxy pass phrase: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam" Done Creating proxy ......................................................................................................................... Done Your proxy is valid until Tue Jan 17 03:32:47 2012 A credential has been received for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini in /tmp/x509up_u504. [capannini@devel15 WMS-service]$ voms-proxy-info -all subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy type : proxy strength : 2048 bits path : /tmp/x509up_u504 timeleft : 10:54:56 key usage : Digital Signature, Key Encipherment, Data Encipherment === VO dteam extension information === VO : dteam subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr attribute : /dteam/Role=NULL/Capability=NULL attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL timeleft : 11:53:55 uri : voms.hellasgrid.gr:15004 [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -d 3 -l -t 2 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Set 2: Submit a bulk of jobs (3 cases LCG-CE, CREAM, general) Test 2A: Submit to an LCG-CE Test 2B: Submit to a CREAM CE Test 2C: Submit without restrictions ===> ===> Test: WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 16:32:57 ===> Ended : 16:41:22 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120116163257.logSee log: WMSService-TS_20120116163257.log: bulk collection log | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 1129 to 1270 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 1039 to 1039 | ||||||||
Jdl with ShortDeadlineJob | ||||||||
Added: | ||||||||
> > | To test SDJs the following bdii must be used: egee-bdii.cnaf.infn.it
[capannini@devel15 certificazione]$ cat SDLJ.jdl ########################################### # JDL with ShortDeadlineJob attribute # ########################################### Executable = "/bin/ls"; Arguments = "-la"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"}; OutputSandbox = {"std.out", "std.err"}; requirements = true; ShortDeadlineJob = true; RetryCount = 1; ShallowRetryCount = 2; [capannini@devel15 certificazione]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf SDLJ.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ========================================================================== COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found: *CEId* - ce01.marie.hellasgrid.gr:2119/jobmanager-pbs-sdj - cream-ce01.marie.hellasgrid.gr:8443/cream-pbs-sdj - grid4.mif.vu.lt:2119/jobmanager-lcgpbs-sdj - grive02.ibcp.fr:8443/cream-pbs-sdj - mario.univ-lille1.fr:8443/cream-pbs-sdj - ce01.ariagni.hellasgrid.gr:2119/jobmanager-pbs-dteam.sdj - cream-ce01.ariagni.hellasgrid.gr:8443/cream-pbs-dteam.sdj ========================================================================== [capannini@devel15 certificazione]$ python ~/wms_tests/WMS-service/WMS-job-cycle.py -c ~/wms_tests/WMS-service/wms-command.conf -V dteam -d 3 -l -t 1 -i -j SDLJ.jdl ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ Enter the user proxy password: Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general) Test 1A: Submit to an LCG-CE Test 1B: Submit to a CREAM CE Test 1C: Submit without restrictions ===> ===> Test: /home/capannini/wms_tests/WMS-service/WMS-job-cycle.py ===> WMS: emi-demo11.cnaf.infn.it ===> Started: 11:58:16 ===> Ended : 12:04:06 ===> ===> === test PASSED === ===> ===> Test log file is WMSService-TS_20120116115816.logLog is here: WMSService-TS_20120116115816.log: sdj log | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 1053 to 1128 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 252 to 252 | ||||||||
See submit.log.tgz: Normal submission logs | ||||||||
Added: | ||||||||
> > | Proxy modeThere is a problem with the configuration of emi-demo12 (wms in proxy mode) pointing to emi-demo11 (wms in both mode): the events Running,ReallyRunning and Done Ok are not logged by emi-demo11 (and don't appear in the logging-info), even if they are present in the lbserver20 db of emi-demo12. These events are instead correctly logged if emi-demo11 is configured as LB in server mode. Thus, in order to properly test a wms in proxy mode, then it should point to a LB server not in both mode. | |||||||
Jdl with DataRequirementsIn case of problems with lcg-ce, it i possible to create replicas of the file on other SEs close to different lcg-ces. |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 63 to 63 | ||||||||
glite-wms-manager-3.3.1-4.sl5 | ||||||||
Added: | ||||||||
> > | Proxy modeThe same update procedure has been applied on a wms configured in proxy mode. emi-demo12 being the wms and emi-demo11 the LB server. In order to configure emi-demo12 in proxy mode the following lines have been defined in the site-info.def file:# Hostname of the WMS WMS_HOST=emi-demo12.$MY_DOMAIN LB_HOST=emi-demo11.$MY_DOMAINand the following lines in siteinfo/services/glite-wms : LB_HOST="emi-demo11.cnaf.infn.it:9000" #GLITE_LB_TYPE=both GLITE_LB_TYPE=proxyOn emi-demo11 the following lines have been defined in the site-info.def file: GLITE_LB_WMS_DN="/C=IT/O=INFN/OU=Host/L=CNAF/CN=emi-demo12.cnaf.infn.it" GLITE_LB_AUTHZ_REGISTER_JOBS=".*" | |||||||
Unit TestsN/A: Tests will be available with EMI-2. |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 244 to 244 | ||||||||
The ce/se couple can be found looking for "/jobmanager" in the output of the following command: [capannini@devel15 WMS-service]$ lcg-infosites --vo dteam closeSE | ||||||||
Added: | ||||||||
> > |
The GlueVOInfoPath of the storage area to be used in the srm surl after the endpoint can be found with the following search:
ldapsearch -x -LLL -H ldap://egee-bdii.cnaf.infn.it:2170 -b mds-vo-name=local,o=grid '(&(objectClass=GlueVOInfo)(GlueChunkKey=GlueSEUniqueID=gridsrm.pi.infn.it))' GlueVOInfoPath
(/dteam was picked up in this test)
the lcg-ce to be excluded can be specified in the testsuite configuration file (wms-command.conf) with the following attribute:
DEFAULTREQ=!regexp(".*ce130.*", other.GlueCEUniqueID) && regexp(".*ce131.*", other.GlueCEUniqueID) && regexp(".*ce133.*", other.GlueCEUniqueID)
In the following test the lcg-ce was the following (by inspecting the log):
Destination CE is ce132.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam
[capannini@devel15 WMS-service]$ cat JDLs/data-req.jdl
###########################################
# JDL with Data Requirements #
###########################################
Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";
FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};
DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/";
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};
DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i -j JDLs/data-req.jdl
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 12:24:32
===> Ended : 12:36:28
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20120110122432.log | |||||||
Jdl with ISBBaseURI and OSBDestURI |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 231 to 231 | ||||||||
See submit.log.tgz: Normal submission logs
Jdl with DataRequirements | ||||||||
Added: | ||||||||
> > | In case of problems with lcg-ce, it i possible to create replicas of the file on other SEs close to different lcg-ces.
[capannini@devel15 WMS-service]$ lcg-rep --vo dteam -d srm://gridsrm.pi.infn.it:8444/dteam/fcapanni/e-2M.txt lfn:/grid/dteam/fcapanni/e-2M.txt GSIFTP: source: set up FTP mode. DCAU disabled. Streams = 1, Tcp BS = 0 GSIFTP: dest: set up FTP mode. DCAU disabled. Streams = 1, Tcp BS = 0 Transfer completed succesfully [capannini@devel15 WMS-service]$ lcg-rep --vo dteam -d srm://gridsrm.pi.infn.it:8444/dteam/fcapanni/PI_1M.txt lfn:/grid/dteam/fcapanni/PI_1M.txt GSIFTP: source: set up FTP mode. DCAU disabled. Streams = 1, Tcp BS = 0 GSIFTP: dest: set up FTP mode. DCAU disabled. Streams = 1, Tcp BS = 0 Transfer completed succesfully | |||||||
Added: | ||||||||
> > | The ce/se couple can be found looking for "/jobmanager" in the output of the following command: [capannini@devel15 WMS-service]$ lcg-infosites --vo dteam closeSE | |||||||
Jdl with ISBBaseURI and OSBDestURI |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 592 to 592 | ||||||||
-rw------- 1 dteam050 dteam 103 Dec 30 13:19 tmp.hSlSL18138 | ||||||||
Added: | ||||||||
> > | Jdl with AllowZippedISB[capannini@devel15 certificazione]$ cat AllowZIP.jdl ########################################### # JDL with AllowZippedISB attribute # ########################################### Executable = "/bin/ls"; Arguments = "-la"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"}; OutputSandbox = {"std.out", "std.err"}; #requirements = other.GlueCEStateStatus == "Testing" && regexp("/cream", other.GlueCEUniqueID); requirements = regexp("/cream", other.GlueCEUniqueID); AllowZippedISB=true; RetryCount = 1; ShallowRetryCount = 2; [capannini@devel15 certificazione]$ glite-wms-job-submit --debug -a -c ~/wms_emi-demo11.conf AllowZIP.jdl ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Vo read from proxy certificate extension ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - VirtualOrganisation value : dteam ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Configuration file: /home/capannini/wms_emi-demo11.conf - VirtualOrganisation, RetryCount, rank, requirements attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes" ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Loaded user configuration file: /home/capannini/wms_emi-demo11.conf ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Configuration file: //etc/glite-wms/dteam/glite_wmsui.conf - VirtualOrganisation, MyProxyServer attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes" ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Loaded Vo specific configuration file: //etc/glite-wms/dteam/glite_wmsui.conf ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Loaded Configuration values: [ JdlDefaultAttributes = [ PerusalFileEnable = false; ShallowRetryCount = 10; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 3; AllowZippedISB = true; VirtualOrganisation = "dteam"; rank = -other.GlueCEStateEstimatedResponseTime; MyProxyServer = "myproxy.cnaf.infn.it"; requirements = other.GlueCEStateStatus == "Production" ]; OutputStorage = "/tmp"; ListenerStorage = "/tmp"; ErrorStorage = "/var/tmp"; WmProxyEndPoints = { "https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server" } ] ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Getting Endpoint URL from configuration file ----------------------------------------- Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Calling the WMProxy getVersion service ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - WMProxy Version: 3.3.4 ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Sending Proxy Request to https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Calling the WMProxy delegationns__getProxyReq service ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - delegationns__getProxyReq - The proxy has been successfully retrieved ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Calling the WMProxy delegationns__putProxyReq service ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - The proxy has been successfully delegated with the identifier: oHGkZ5pxjZH7-LDxL2NIMw ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Calling the WMProxy getTransferProtocols service ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - getTransferProtocols - Available protocols: gsiftp, https ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - FileTransferProtocol not specified; using the default protocol: gsiftp ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - The JDL file is: /home/capannini/certificazione/AllowZIP.jdl ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Retrieving the list of the local ISB files from the user JDL ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Total size of the ISB file(s) to be transferred to: 1126406 ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Max single job size of the ISB file(s) to be transferred to: 1024000 ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Checking the User-FreeQuota on the server ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:29 -I- PID: 23649 (Debug) - Calling the WMProxy getFreeQuota service ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - getFreeQuota - User freequota not set on the server ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Getting the max ISB size from the server https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Calling the WMProxy getMaxInputSandboxSize service ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - getMaxInputSandboxSize - Max ISB size information successfully retrieved ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - The max job size (1024000 bytes) doesn't exceed the max size limit of 100000000 bytes: File transfer is allowed ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - File archiving and file compression allowed by user in the JDL ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Registering JDL [ StdOutput = "std.out"; ShallowRetryCount = 2; SignificantAttributes = { "Requirements","Rank","FuzzyRank" }; RetryCount = 1; Executable = "/bin/ls"; Type = "job"; Arguments = "-la"; AllowZippedISB = true; VirtualOrganisation = "dteam"; JobType = "normal"; DefaultRank = -other.GlueCEStateEstimatedResponseTime; ZippedISB = { "ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar.gz" }; OutputSandbox = { "std.out","std.err" }; InputSandbox = { "file:///home/capannini/certificazione/fileA","file:///home/capannini/certificazione/fileB","file:///home/capannini/certificazione/fileC","file:///home/capannini/certificazione/fileD","file:///home/capannini/certificazione/fileE" }; StdError = "std.err"; rank = -other.GlueCEStateEstimatedResponseTime; MyProxyServer = "myproxy.cnaf.infn.it"; requirements = ( regexp("/cream",other.GlueCEUniqueID) ) && ( other.GlueCEStateStatus == "Production" ) ] ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Registering the job to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Calling the WMProxy jobRegister service ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - The JobId is: https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Archiving the ISB files: /tmp/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - This archive file has been successfully created: /tmp/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Compressing the file (.gz): /tmp/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - ISB ZIPPED file successfully created: /tmp/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar.gz ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Getting the SandboxDestinationURI from the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Calling the WMProxy getSandboxDestURI service with gsiftp protocol ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - getSandboxDestURI - Destination URIs sucessfully retrieved ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - DestinationURI: gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/nG/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fnGo2GsPtKD3urj66sBnHLA/input ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - FileTransfer (gsiftp): using globus-url-copy to transfer the local InputSandBox file(s) to the submission endpoint ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - File Transfer (gsiftp) Command: /usr/bin/globus-url-copy Source: file:///tmp/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar.gz Destination: gsiftp://emi-demo11.cnaf.infn.it:2811/var/SandboxDir/nG/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fnGo2GsPtKD3urj66sBnHLA/input/ISBfiles_y8ovpm9W5-W_kUqpeNiCKA_0.tar.gz ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - File Transfer (gsiftp) Transfer successfully done ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Starting the job: https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - Calling the WMProxy jobStart service ----------------------------------------- ----------------------------------------- 30 Dec 2011, 16:54:30 -I- PID: 23649 (Debug) - jobStart - The job has been successfully started ----------------------------------------- ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA ========================================================================== *** Log file created *** Possible Errors and Debug messages have been printed in the following file: /var/tmp/glite-wms-job-submit_504_23649_20111230_16-54-29.log Check if AllowZippedISB has been included in the jdl: [capannini@devel15 certificazione]$ glite-wms-job-info --jdl https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA|grep Allow AllowZippedISB = true; [capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA Current Status: Done (Success) Exit code: 0 Status Reason: Job Terminated Successfully Destination: cremino.cnaf.infn.it:8443/cream-pbs-cert Submitted: Fri Dec 30 16:54:30 2011 CET ========================================================================== [capannini@devel15 certificazione]$ [capannini@devel15 certificazione]$ [capannini@devel15 certificazione]$ [capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the job: https://emi-demo11.cnaf.infn.it:9000/nGo2GsPtKD3urj66sBnHLA have been successfully retrieved and stored in the directory: /tmp/jobOutput/capannini_nGo2GsPtKD3urj66sBnHLA ================================================================================ [capannini@devel15 certificazione]$ ls -l /tmp/jobOutput/capannini_nGo2GsPtKD3urj66sBnHLA total 4 -rw-r--r-- 1 capannini emitestbed 0 Dec 30 17:00 std.err -rw-r--r-- 1 capannini emitestbed 623 Dec 30 17:00 std.out [capannini@devel15 certificazione]$ cat /tmp/jobOutput/capannini_nGo2GsPtKD3urj66sBnHLA/std.out total 1132 drwxr-xr-x 2 dteam011 dteam 4096 Dec 30 16:54 . drwxr-xr-x 3 dteam011 dteam 4096 Dec 30 16:54 .. -rw-r--r-- 1 dteam011 dteam 4037 Dec 30 16:54 .BrokerInfo -rw-r--r-- 1 dteam011 dteam 2 Dec 30 16:54 fileA -rw-r--r-- 1 dteam011 dteam 2 Dec 30 16:54 fileB -rw-r--r-- 1 dteam011 dteam 1024000 Dec 30 16:54 fileC -rw-r--r-- 1 dteam011 dteam 102400 Dec 30 16:54 fileD -rw-r--r-- 1 dteam011 dteam 2 Dec 30 16:54 fileE -rw-r--r-- 1 dteam011 dteam 0 Dec 30 16:54 std.err -rw-r--r-- 1 dteam011 dteam 0 Dec 30 16:54 std.out -rw-r--r-- 1 dteam011 dteam 0 Dec 30 16:54 .tmp_file ===> === test PASSED === Jdl with ExpiryTime[capannini@devel15 certificazione]$ cat ExpiryTime.jdl ########################################### # JDL with ExpiryTime attribute # ########################################### Executable = "/bin/ls"; Arguments = "-la"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"fileA", "fileB", "fileC", "fileD", "fileE"}; OutputSandbox = {"std.out", "std.err"}; requirements = false; ExpiryTime = 1325261887; RetryCount = 1; ShallowRetryCount = 2; [capannini@devel15 certificazione]$ date +%s 1325261324 [capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ExpiryTime.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/O6MWj0UPsVQblxDjgmo-gQ ========================================================================== [capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/O6MWj0UPsVQblxDjgmo-gQ ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/O6MWj0UPsVQblxDjgmo-gQ Current Status: Waiting Status Reason: BrokerHelper: no compatible resources Submitted: Fri Dec 30 17:08:58 2011 CET ========================================================================== [capannini@devel15 certificazione]$ date +%s 1325261928 [capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/O6MWj0UPsVQblxDjgmo-gQ ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/O6MWj0UPsVQblxDjgmo-gQ Current Status: Aborted Status Reason: request expired Submitted: Fri Dec 30 17:08:58 2011 CET ========================================================================== ===> === test PASSED === Jdl with ShortDeadlineJob | |||||||
-- FabioCapannini - 2011-12-28 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 513 to 513 | ||||||||
Submit to an LCG CE: | ||||||||
Added: | ||||||||
> > | [capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf BaseURI.jdl
Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server![]() ================== glite-wms-job-submit Success ==================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg![]() ======================================================================
[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg![]() ======================================================================
[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg![]() ![]() ============================================================================
JOB GET OUTPUT OUTCOME
No output files to be retrieved for the job:
https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg![]() ============================================================================
[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/pX2yRjupthmRSr8bqf5_Bg![]() ======================================================================
Log on devel09.cnaf.infn.it:
[root@devel09 tmp]# ls -l std*
-rw-r--r-- 1 dteam042 dteam 0 30 dic 13:19 std.err
-rw-r--r-- 1 dteam042 dteam 727 30 dic 13:19 std.out
[root@devel09 tmp]# cat std.out
pX2yRjupthmRSr8bqf5_Bg
total 36
-rwxr-xr-x 1 dteam050 dteam 80 Dec 30 13:19 exe.sh
-rw-r--r-- 1 dteam050 dteam 118 Dec 30 13:19 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fpX2yRjupthmRSr8bqf5_5fBg.output
-rw-r--r-- 1 dteam050 dteam 0 Dec 30 13:19 std.err
-rw-r--r-- 1 dteam050 dteam 23 Dec 30 13:19 std.out
-rw-r--r-- 1 dteam050 dteam 6 Dec 30 13:19 test1
-rw-r--r-- 1 dteam050 dteam 6 Dec 30 13:19 test2
-rw------- 1 dteam050 dteam 103 Dec 30 13:19 tmp.csGdY18153
-rw------- 1 dteam050 dteam 0 Dec 30 13:19 tmp.FBSue18151
-rw------- 1 dteam050 dteam 2 Dec 30 13:19 tmp.FZDLk18152
-rw------- 1 dteam050 dteam 2 Dec 30 13:19 tmp.HdslV18137
-rw------- 1 dteam050 dteam 103 Dec 30 13:19 tmp.hSlSL18138
| |||||||
-- FabioCapannini - 2011-12-28 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 336 to 336 | ||||||||
Same process with an LCG CE: | ||||||||
Added: | ||||||||
> > | [capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA ========================================================================== [capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA Current Status: Done (Success) Logged Reason(s): - Job got an error while in the CondorG queue. - Job terminated successfully Exit code: 0 Status Reason: Job terminated successfully Destination: gridce.sns.it:2119/jobmanager-lcgpbs-cert Submitted: Fri Dec 30 11:43:28 2011 CET ========================================================================== [capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the job: https://emi-demo11.cnaf.infn.it:9000/d4akLe8H2jynZpCPe5jGxA have been successfully retrieved and stored in the directory: /tmp/jobOutput/capannini_d4akLe8H2jynZpCPe5jGxA ================================================================================ [capannini@devel15 certificazione]$ ls -l /tmp/jobOutput/capannini_d4akLe8H2jynZpCPe5jGxA total 0 -rw-r--r-- 1 capannini emitestbed 0 Dec 30 13:08 std.err Log on devel09.cnaf.infn.it: [root@devel09 tmp]# ls -l myjobOutput -rw-r--r-- 1 dteam042 dteam 714 30 dic 13:01 myjobOutput [root@devel09 tmp]# cat myjobOutput d4akLe8H2jynZpCPe5jGxA total 36 -rwxr-xr-x 1 dteam003 dteam 80 Dec 30 13:00 exe.sh -rw-r--r-- 1 dteam003 dteam 154 Dec 30 13:01 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fd4akLe8H2jynZpCPe5jGxA.output -rw-r--r-- 1 dteam003 dteam 0 Dec 30 13:01 std.err -rw-r--r-- 1 dteam003 dteam 23 Dec 30 13:01 std.out -rw-r--r-- 1 dteam003 dteam 6 Dec 30 13:00 test1 -rw-r--r-- 1 dteam003 dteam 6 Dec 30 13:00 test2 -rw------- 1 dteam003 dteam 2 Dec 30 13:01 tmp.GPdus14280 -rw------- 1 dteam003 dteam 2 Dec 30 13:01 tmp.OAref14000 -rw------- 1 dteam003 dteam 103 Dec 30 13:01 tmp.QtSZI14001 -rw------- 1 dteam003 dteam 0 Dec 30 13:01 tmp.vFipq14279 -rw------- 1 dteam003 dteam 103 Dec 30 13:01 tmp.YUTON14281 ===> test PASSED Jdl with ISBBaseURI and OSBBaseDestURISubmit to CREAM CE[capannini@devel15 certificazione]$ cat BaseURI.jdl ########################################### # JDL with ISBURI & OSBBaseDestURI # ########################################### Executable = "exe.sh"; StdOutput = "std.out"; StdError = "std.err"; InputSandboxBaseURI = "gsiftp://devel11.cnaf.infn.it:2811/tmp"; FuzzyRank = true; InputSandbox = {"exe.sh", "test1", "test2"}; OutputSandbox = {"std.out", "std.err"}; OutputSandboxBaseDestURI="gsiftp://devel09.cnaf.infn.it:2811/tmp"; | |||||||
Added: | ||||||||
> > | #requirements = other.GlueCEStateStatus == "Testing" && regexp("/cream", other.GlueCEUniqueID);
requirements = regexp("/cream", other.GlueCEUniqueID);
RetryCount = 1;
ShallowRetryCount = 2;
[capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf BaseURI.jdl
Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server![]() ================== glite-wms-job-submit Success ==================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ![]() ======================================================================
[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ![]() ======================================================================
[capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ![]() ![]() ============================================================================
JOB GET OUTPUT OUTCOME
No output files to be retrieved for the job:
https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ![]() ============================================================================
[capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ![]() =================== glite-wms-job-status Success =================
BOOKKEEPING INFORMATION:
Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/bRxuYfMUA79tvRXdrpgJdQ![]() ======================================================================
Log on devel09.cnaf.infn.it:
[root@devel09 tmp]# ls std*
std.err std.out
[root@devel09 tmp]# cat std.out
bRxuYfMUA79tvRXdrpgJdQ
total 16
-rwxr-xr-x 1 dteam029 dteam 80 Dec 30 12:48 exe.sh
-rw-r--r-- 1 dteam029 dteam 0 Dec 30 12:48 std.err
-rw-r--r-- 1 dteam029 dteam 23 Dec 30 12:48 std.out
-rw-r--r-- 1 dteam029 dteam 6 Dec 30 12:48 test1
-rw-r--r-- 1 dteam029 dteam 6 Dec 30 12:48 test2
=> test PASSED ==
Submit to an LCG CE: | |||||||
-- FabioCapannini - 2011-12-28 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 232 to 232 | ||||||||
Jdl with DataRequirements | ||||||||
Added: | ||||||||
> > |
Jdl with ISBBaseURI and OSBDestURITest on CREAM ce:[capannini@devel15 certificazione]$ cat URI.jdl ########################################### # JDL with ISBURI & OSBDestURI # ########################################### Executable = "exe.sh"; StdOutput = "std.out"; StdError = "std.err"; InputSandboxBaseURI = "gsiftp://devel11.cnaf.infn.it:2811/tmp"; FuzzyRank = true; InputSandbox = {"exe.sh", "test1", "test2"}; OutputSandbox = {"std.out", "std.err"}; OutputSandboxDestURI = {"gsiftp://devel09.cnaf.infn.it:2811/tmp/myjobOutput", "std.err"}; #requirements = other.GlueCEStateStatus == "Testing" && regexp("/cream", other.GlueCEUniqueID); requirements = regexp("/cream", other.GlueCEUniqueID); DataAccessProtocol = "gsiftp"; RetryCount = 1; ShallowRetryCount = 2; [capannini@devel15 certificazione]$ cat tmp/exe.sh #!/bin/sh NAME=`echo $GLITE_WMS_JOBID | sed -e 's/.*\///'` echo $NAME ls -l [capannini@devel15 certificazione]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf URI.jdl Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ====================== glite-wms-job-submit Success ====================== The job has been successfully submitted to the WMProxy Your job identifier is: https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg ========================================================================== [capannini@devel15 certificazione]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg ======================= glite-wms-job-status Success ===================== BOOKKEEPING INFORMATION: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg Current Status: Done (Success) Exit code: 0 Status Reason: Job Terminated Successfully Destination: inaf-ce-01.ct.pi2s2.it:8443/cream-lsf-cert Submitted: Thu Dec 29 16:20:11 2011 CET ========================================================================== [capannini@devel15 certificazione]$ glite-wms-job-output https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server ================================================================================ JOB GET OUTPUT OUTCOME Output sandbox files for the job: https://emi-demo11.cnaf.infn.it:9000/NAwVzPxlPqGYz-Kf2xWLNg have been successfully retrieved and stored in the directory: /tmp/jobOutput/capannini_NAwVzPxlPqGYz-Kf2xWLNg ================================================================================ [capannini@devel15 certificazione]$ ls /tmp/jobOutput/capannini_NAwVzPxlPqGYz-Kf2xWLNg std.err Log on devel09.cnaf.infn.it: [root@devel09 ~]# cat /tmp/myjobOutput NAwVzPxlPqGYz-Kf2xWLNg total 16 -rwxr-xr-x 1 dteam002 dteam 80 Dec 29 16:20 exe.sh -rw-r--r-- 1 dteam002 dteam 0 Dec 29 16:20 std.err -rw-r--r-- 1 dteam002 dteam 23 Dec 29 16:20 std.out -rw-r--r-- 1 dteam002 dteam 6 Dec 29 16:20 test1 -rw-r--r-- 1 dteam002 dteam 6 Dec 29 16:20 test2 ===> test PASSEDSame process with an LCG CE: | |||||||
-- FabioCapannini - 2011-12-28 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 72 to 72 | ||||||||
SubmissionNormal | ||||||||
Added: | ||||||||
> > | [capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: Test a complete job cycle: from submission to get output ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ | |||||||
Added: | ||||||||
> > | Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 17:09:32
===> Ended : 17:21:55
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20111228170932.log
[capannini@devel15 WMS-service]$ voms-proxy-init --voms dteam:/dteam/NGI_IT:operator
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy .................................................................. Done
Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam" Done
Creating proxy ........................................................................... Done
Your proxy is valid until Thu Dec 29 23:31:47 2011
[capannini@devel15 WMS-service]$ voms-proxy-info --all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
identity : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
type : proxy
strength : 1024 bits
path : /tmp/x509up_u504
timeleft : 11:59:51
key usage : Digital Signature, Key Encipherment, Data Encipherment
= VO dteam extension information =
VO : dteam
subject : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr
attribute : /dteam/NGI_IT/Role=operator/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
attribute : /dteam/Role=NULL/Capability=NULL
timeleft : 11:59:51
uri : voms2.hellasgrid.gr:15004
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V dteam -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:32:22
===> Ended : 11:40:10
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20111229113222.log
[capannini@devel15 WMS-service]$ voms-proxy-init --voms testers.eu-emi.eu
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ................................... Done
Contacting emitestbed07.cnaf.infn.it:15002 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed07.cnaf.infn.it] "testers.eu-emi.eu" Done
Creating proxy ...................................................... Done
[capannini@devel15 WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:45:01
===> Ended : 11:52:20
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20111229114501.log
[fabiok@ui WMS-service]$ voms-proxy-init --voms infngrid
Enter GRID pass phrase:
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
Creating temporary proxy ..................................................... Done
Contacting voms.cnaf.infn.it:15000 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=voms.cnaf.infn.it] "infngrid" Done
Creating proxy .................................................... Done
Your proxy is valid until Thu Dec 29 23:45:58 2011
[fabiok@ui WMS-service]$ python WMS-job-cycle.py -c wms-command.conf -V infngrid -d 3 -l -t 1 -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service
===> + Description: Test a complete job cycle: from submission to get output
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
Enter the user proxy password:
Set 1: Submit a normal job (3 cases LCG-CE, CREAM, general)
Test 1A: Submit to an LCG-CE
Test 1B: Submit to a CREAM CE
Test 1C: Submit without restrictions
===>
===> Test: WMS-job-cycle.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 11:46:25
===> Ended : 11:52:40
===>
=> test PASSED ==
===>
===> Test log file is WMSService-TS_20111229114625.log
See submit.log.tgz: Normal submission logs
Jdl with DataRequirements | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 84 to 244 | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Line: 53 to 53 | ||||||||
glite-wms-manager-3.3.1-3.sl5 | ||||||||
Added: | ||||||||
> > |
Unit TestsN/A: Tests will be available with EMI-2.Basic Functionality testsSubmissionNormal | |||||||
-- FabioCapannini - 2011-12-28 | ||||||||
Line: 59 to 79 | ||||||||
Added: | ||||||||
> > | ||||||||
| ||||||||
Added: | ||||||||
> > |
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Added: | ||||||||
> > |
WMS test reportSummary
Deployment TestsClean installation
[root@emi-demo11 ~]# cat /etc/redhat-release Scientific Linux SL release 5.7 (Boron) [root@emi-demo11 ~]# uname -a Linux emi-demo11.cnaf.infn.it 2.6.18-274.12.1.el5 #1 SMP Tue Nov 29 11:14:39 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
[root@emi-demo11 ~]# wget http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RPM-GPG-KEY-emi -O /tmp/emi-key_gd.asc [root@emi-demo11 ~]# rpm --import /tmp/emi-key_gd.asc
Update
[root@emi-demo12 yum.repos.d]# rpm -qa|grep wms-manager glite-wms-manager-3.3.1-3.sl5-- FabioCapannini - 2011-12-28
|