Difference: WMSCertificationExercise (21 vs. 22)

Revision 222012-01-23 - FabioCapannini

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Line: 2112 to 2112
  See logs: WMSService-TS_20120123121509.log: list-match log
Added:
>
>
With data
[fabiok@ui ~]$ export LFC_HOST=prod-lfc-shared-central.cern.ch
[fabiok@ui ~]$ lcg-lr --vo dteam lfn:/grid/dteam/fcapanni/e-2M.txt
srm://gridsrm.pi.infn.it/dteam/fcapanni/e-2M.txt
srm://srm-public.cern.ch/castor/cern.ch/grid/dteam/fcapanni/e-2M.txt
The two SEs where the file can be found are gridsrm.pi.infn.it and srm-public.cern.ch.

[capannini@devel15 WMS-service]$ cat JDLs/data-req.jdl 
###########################################
#      JDL with Data Requirements         #
###########################################

Executable = "/bin/ls";
Arguments = "-la";
StdOutput = "std.out";
StdError = "std.err";
Prologue = "prologue.sh";

FuzzyRank = true;
Environment={"LFC_HOST=prod-lfc-shared-central.cern.ch", "LFC_HOME=prod-lfc-shared-central.cern.ch:/grid/dteam/aleph"};
InputSandbox = {"JDLs/prologue.sh"};
OutputSandbox = {"std.out", "std.err","prologue.out", "PI_1M.txt"};

DataRequirements = {
[
DataCatalogType = "DLI";
DataCatalog ="http://prod-lfc-shared-central.cern.ch:8085/"; 
InputData = { "lfn:/grid/dteam/fcapanni/PI_1M.txt" };
]
};

DataAccessProtocol = "gsiftp";
AllowZippedISB=true;
RetryCount = 1;
ShallowRetryCount = 2;

[capannini@devel15 WMS-service]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf JDLs/data-req.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

==========================================================================

           COMPUTING ELEMENT IDs LIST 
 The following CE(s) matching your job requirements have been found:

   *CEId*
 - ce130.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam
 - ce130.cern.ch:2119/jobmanager-lcglsf-grid_dteam
 - ce131.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam
 - ce131.cern.ch:2119/jobmanager-lcglsf-grid_dteam
 - ce132.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam
 - ce132.cern.ch:2119/jobmanager-lcglsf-grid_dteam
 - ce133.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam
 - ce133.cern.ch:2119/jobmanager-lcglsf-grid_dteam
 - ce203.cern.ch:8443/cream-lsf-grid_2nh_dteam
 - ce203.cern.ch:8443/cream-lsf-grid_dteam
 - ce204.cern.ch:8443/cream-lsf-grid_2nh_dteam
 - ce204.cern.ch:8443/cream-lsf-grid_dteam
 - ce205.cern.ch:8443/cream-lsf-grid_2nh_dteam
 - ce205.cern.ch:8443/cream-lsf-grid_dteam
 - ce206.cern.ch:8443/cream-lsf-grid_2nh_dteam
 - ce206.cern.ch:8443/cream-lsf-grid_dteam
 - ce207.cern.ch:8443/cream-lsf-grid_2nh_dteam
 - ce207.cern.ch:8443/cream-lsf-grid_dteam
 - ce208.cern.ch:8443/cream-lsf-grid_2nh_dteam
 - ce208.cern.ch:8443/cream-lsf-grid_dteam
 - cream.sns.it:8443/cream-pbs-cert
 - gridce0.pi.infn.it:8443/cream-lsf-cert
 - gridce1.pi.infn.it:2119/jobmanager-lcglsf-cert
 - gridce2.pi.infn.it:2119/jobmanager-lcglsf-cert
 - gridce3.pi.infn.it:8443/cream-lsf-certmpi
 - gridce.sns.it:2119/jobmanager-lcgpbs-cert

==========================================================================

In order to verify that these CEs are close to the above SEs:

[fabiok@ui ~]$ lcg-infosites --vo dteam closeSE|grep -A 5 ce130
Name of the CE: ce130.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam
   srm-alice.cern.ch
   srm-atlas.cern.ch
   srm-cms.cern.ch
   srm-lhcb.cern.ch
   srm-public.cern.ch
--
Name of the CE: ce130.cern.ch:2119/jobmanager-lcglsf-grid_dteam
   srm-alice.cern.ch
   srm-atlas.cern.ch
   srm-cms.cern.ch
   srm-lhcb.cern.ch
   srm-public.cern.ch

[fabiok@ui ~]$ lcg-infosites --vo dteam closeSE|grep -A 5 ce208.cern.ch
Name of the CE: ce208.cern.ch:8443/cream-lsf-grid_2nh_dteam
   srm-alice.cern.ch
   srm-atlas.cern.ch
   srm-cms.cern.ch
   srm-lhcb.cern.ch
   srm-public.cern.ch
--
Name of the CE: ce208.cern.ch:8443/cream-lsf-grid_dteam
   srm-alice.cern.ch
   srm-atlas.cern.ch
   srm-cms.cern.ch
   srm-lhcb.cern.ch
   srm-public.cern.ch

[fabiok@ui ~]$ lcg-infosites --vo dteam closeSE|grep -A 5 cream.sns.it
Name of the CE: cream.sns.it:8443/cream-pbs-cert
   gridsrm.pi.infn.it

[fabiok@ui ~]$ lcg-infosites --vo dteam closeSE|grep -A 5 gridce.sns.it
Name of the CE: gridce.sns.it:2119/jobmanager-lcgpbs-cert
   gridsrm.pi.infn.it

===> Test PASSED

Gangmatching
[capannini@devel15 certification]$ cat gang.jdl
[
executable="ls.sh";
myproxyserver="";
SErequirements = anyMatch(other.storage.CloseSEs, target.GlueSAStateAvailableSpace > 20);
CErequirements = other.GlueCEStateStatus == "Production" && other.GlueCEInfoTotalCPUs >= 2;
requirements = CErequirements && SErequirements;
inputsandbox={"ls.sh"};
stdoutput="out3.out";
stderror="err2.err";
outputsandbox={"out3.out", "err2.err", "ls.sh", "a"};
]

[capannini@devel15 certification]$ glite-wms-job-list-match -a -c ~/wms_emi-demo11.conf gang.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

==========================================================================

           COMPUTING ELEMENT IDs LIST 
 The following CE(s) matching your job requirements have been found:

   *CEId*
 - cccreamceli05.in2p3.fr:8443/cream-sge-long
 - cccreamceli05.in2p3.fr:8443/cream-sge-medium
 - cccreamceli05.in2p3.fr:8443/cream-sge-short
 - cccreamceli09.in2p3.fr:8443/cream-sge-long
 - cccreamceli09.in2p3.fr:8443/cream-sge-medium
 - cccreamceli09.in2p3.fr:8443/cream-sge-short
 - cmsce01.na.infn.it:2119/jobmanager-lcgpbs-cert
 - cmsrm-ce01.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert
 - cmsrm-cream01.roma1.infn.it:8443/cream-lsf-cmsgcert
 - grid010.ct.infn.it:2119/jobmanager-lcgpbs-cert
 - inaf-ce-01.ct.pi2s2.it:8443/cream-lsf-cert
 - unict-dmi-ce-01.ct.pi2s2.it:2119/jobmanager-lcglsf-cert
 - virgo-ce.roma1.infn.it:2119/jobmanager-lcgpbs-cert
 - ce-01.grid.sissa.it:8443/cream-pbs-blade
 - cccreamceli10.in2p3.fr:8443/cream-sge-long
 - cccreamceli10.in2p3.fr:8443/cream-sge-medium
 - cccreamceli10.in2p3.fr:8443/cream-sge-short
 - cmsrm-ce02.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert
 - cccreamceli06.in2p3.fr:8443/cream-sge-long
 - cccreamceli06.in2p3.fr:8443/cream-sge-medium
 - cccreamceli06.in2p3.fr:8443/cream-sge-short
 - cream-ce.pg.infn.it:8443/cream-pbs-cert

==========================================================================

In order to verify that the SErequirements are met:

[capannini@devel15 certification]$ lcg-infosites closeSE|grep -A 5 cccreamceli05.in2p3.fr
Name of the CE: cccreamceli05.in2p3.fr:8443/cream-sge-long
   ccsrm.in2p3.fr

[capannini@devel15 certification]$ lcg-infosites se |egrep 'Avail|ccsrm.in2p3.fr'
 Avail Space(kB)  Used Space(kB)  Type    SE
     11385302023      3647083513  SRM     ccsrm.in2p3.fr

[capannini@devel15 certification]$ lcg-infosites closeSE|grep -A 5 cmsce01.na.infn.it
Name of the CE: cmsce01.na.infn.it:2119/jobmanager-lcgpbs-cert
   cmsse02.na.infn.it

Name of the CE: cmsrm-ce01.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert
   cmsrm-se01.roma1.infn.it

[capannini@devel15 certification]$ lcg-infosites se |egrep 'Avail|cmsse02.na.infn.it'
 Avail Space(kB)  Used Space(kB)  Type    SE
     25271855845       690913963  SRM     cmsse02.na.infn.it
[capannini@devel15 certification]$ lcg-infosites closeSE|grep -A 5 cmsrm-ce02.roma1.infn.it
Name of the CE: cmsrm-ce02.roma1.infn.it:2119/jobmanager-lcglsf-cmsgcert
   cmsrm-se01.roma1.infn.it

Name of the CE: cmsrm-cream01.roma1.infn.it:8443/cream-lsf-cmsgcert
   cmsrm-se01.roma1.infn.it

[capannini@devel15 certification]$ lcg-infosites se |egrep 'Avail|cmsrm-se01.roma1.infn.it'
 Avail Space(kB)  Used Space(kB)  Type    SE
            1000          999999  SRM     cmsrm-se01.roma1.infn.it

Moreover, setting SErequirements = true in the jdl, the list of matching CEs is far longer.
===> Test PASSED

Prologue and Epilogue jobs

 [capannini@devel15 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V dteam -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:05:57
===> Ended  : 16:11:17
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120123160557.log
[capannini@devel15 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -V testers.eu-emi.eu -d 3 -l  -i
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Enter the user proxy password:

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:18:49
===> Ended  : 16:25:09
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120123161849.log
[capannini@devel15 WMS-service]$ 
[capannini@devel15 WMS-service]$ 
[capannini@devel15 WMS-service]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini/CN=proxy/CN=proxy/CN=proxy
type      : proxy
strength  : 2048 bits
path      : /tmp/x509up_u504
timeleft  : 6:43:33
key usage : Digital Signature, Key Encipherment, Data Encipherment
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini
issuer    : /C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr
attribute : /dteam/Role=NULL/Capability=NULL
attribute : /dteam/NGI_IT/Role=NULL/Capability=NULL
timeleft  : 7:42:33
uri       : voms.hellasgrid.gr:15004
[capannini@devel15 WMS-service]$ 
[capannini@devel15 WMS-service]$ python WMS-prologue-epilogue.py -c wms-command.conf -d 3 -l 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++
===> + TestSuite of the WMS Service                       
===> + Description: WMS test prologue and epilogue attributes 
===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

 Test 1: Test prologue attribute 


 Test 2: Test epilogue attribute 


 Test 3: Test prologue and epilogue attributes 

===> 
===> Test: WMS-prologue-epilogue.py
===> WMS: emi-demo11.cnaf.infn.it
===> Started: 16:30:56
===> Ended  : 16:37:13
===> 
===>     === test PASSED === 
===> 
===> Test log file is WMSService-TS_20120123163056.log

See logs: prolepilog.tgz: prologue epilog logs

 -- FabioCapannini - 2011-12-28
Line: 2159 to 2463
 
META FILEATTACHMENT attachment="WMSService-TS_20120123104906.log" attr="" comment="list-match log" date="1327312704" name="WMSService-TS_20120123104906.log" path="WMSService-TS_20120123104906.log" size="4208" user="FabioCapannini" version="1"
META FILEATTACHMENT attachment="WMSService-TS_20120123121055.log" attr="" comment="list-match log" date="1327317166" name="WMSService-TS_20120123121055.log" path="WMSService-TS_20120123121055.log" size="4208" user="FabioCapannini" version="1"
META FILEATTACHMENT attachment="WMSService-TS_20120123121509.log" attr="" comment="list-match log" date="1327317406" name="WMSService-TS_20120123121509.log" path="WMSService-TS_20120123121509.log" size="3969" user="FabioCapannini" version="1"
Added:
>
>
META FILEATTACHMENT attachment="prolepilog.tgz" attr="" comment="prologue epilog logs" date="1327333501" name="prolepilog.tgz" path="prolepilog.tgz" size="3241" user="FabioCapannini" version="1"
 
This site is powered by the TWiki collaboration platformCopyright © 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback