Difference: WMS35PrecertificationReport (2 vs. 3)

Revision 32013-01-30 - MarcoCecchi

Line: 1 to 1
 
META TOPICPARENT name="WmsTestSuite"

WMS 3.5 pre-certification report

Line: 6 to 6
  Testing instance at devel09.cnaf.infn.it (SL5.8)
Changed:
<
<
- job submission

-listmatch

-cancel

- perusal

-emir

Follow the instructions here: https://wiki.italiangrid.it/twiki/bin/view/CREAM/EmirConfigurationForCream

just replace CREAM with WMS. In the log, you should see:

2013-01-30 13:22:42,541 DEBUG Registering service entries
2013-01-30 13:22:42,542 DEBUG Retrieving data from ldap://localhost:2170/GLUE2GroupID=resource,o=glue
2013-01-30 13:22:42,577 DEBUG REGISTRATION: Endpoint ID: devel09.cnaf.infn.it_lbserver_201164012_org.glite.lb.Server_201164012; URL: https://devel09.cnaf.infn.it:9003/
2013-01-30 13:22:42,577 DEBUG REGISTRATION: Endpoint ID: devel09.cnaf.infn.it_wmproxy_2272271975_org.glite.wms.WMProxy_2272271975; URL: https://devel09.cnaf.infn.it:7443/glite_wms_wmproxy_server

-argus

mcecchi Jan, 16th, 2013

[root@devel09 ~]# rpm -qa | grep glite-wms
glite-wms-utils-classad-3.4.1-1.sl5
glite-wms-purger-3.5.0-3.sl5
glite-wms-jobsubmission-3.5.0-3.sl5
glite-wms-core-devel-3.5.0-4.sl5
glite-wms-common-3.5.0-3.sl5
glite-wms-configuration-3.5.0-3.sl5
glite-wms-interface-3.5.0-3.sl5
glite-wms-ice-3.5.0-3.sl5
glite-wms-core-3.5.0-5.sl5
glite-wms-jobsubmission-lib-3.5.0-3.sl5
glite-wms-utils-exception-3.4.1-1.sl5

1) Without Argus:

>
>
job submission
 
[mcecchi@devel15 ~]$ glite-wms-job-submit -a --endpoint https://devel09.cnaf.infn.it:7443/glite_wms_wmproxy_server ls.jdl 
Line: 101 to 59
 
Added:
>
>
-listmatch

-cancel

- perusal

Check publication in EMIR

Put in your siteinfo.def something like:

BDII_EMIR_ENABLE=yes
BDII_EMIR_SERP_PERIOD=1
BDII_EMIR_SERP_VALIDITY=2
BDII_EMIR_HOST=http://emitbdsr1.cern.ch:9126

Then run:

[root@devel09 ~]# export PATH=$PATH:/sbin
[root@devel09 ~]# /opt/glite/yaim/bin/yaim -r -f config_emir_serp -s siteinfo_/site-info.def
   WARNING: 
   WARNING: *****************************************************************************
   WARNING: Your siteinfo directory is world readable. This is generally a bad idea      
   WARNING: as configuration files may contain passwords and other sensitive information.
   WARNING: *****************************************************************************
   WARNING: 
   INFO: Configuring HOST: devel09.cnaf.infn.it
   INFO: Using site configuration file: siteinfo_/site-info.def
   INFO: 
         ###################################################################
         
         .             /'.-. ')
         .     yA,-"-,( ,m,:/ )   .oo.     oo    o      ooo  o.     .oo
         .    /      .-Y a  a Y-.     8. .8'    8'8.     8    8b   d'8
         .   /           ~ ~ /         8'    .8oo88.     8    8  8'  8
         . (_/         '===='          8    .8'     8.   8    8  Y   8
         .   Y,-''-,Yy,-.,/           o8o  o8o    o88o  o8o  o8o    o8o
         .    I_))_) I_))_)
         
         
         current working directory: /root
         site-info.def date: Jan 30 15:39 siteinfo_/site-info.def
         yaim command: -r -f config_emir_serp -s siteinfo_/site-info.def
         log file: /opt/glite/yaim/bin/../log/yaimlog
         Wed Jan 30 15:50:43 CET 2013 : /opt/glite/yaim/bin/yaim
         
         Installed YAIM versions:
         glite-lb-yaim 4.5.8-1
         glite-yaim-bdii 4.3.13-1
         glite-yaim-core 5.1.0-1
         
         ####################################################################
   INFO: The default location of the grid-env.(c)sh files will be: /usr/libexec
   INFO: Sourcing the utilities in /opt/glite/yaim/functions/utils
   INFO: Detecting environment
   INFO: Assuming the node types:  WMSLB
   INFO: Using hostname: devel09.cnaf.infn.it
   WARNING: config_emir_serp function is not supported by  WMSLB!
   WARNING: Anyway you can force this operation.
   WARNING: Would you really run config_emir_serp on  WMSLB? [y/]: 
   INFO: Executing function: config_emir_serp_check 
   INFO: Executing function: config_emir_serp 
EMIR-SERP startup                                          [  OK  ]
   INFO: YAIM terminated succesfully.

Check that the record has reached its destination

mcecchi@pccecchi ~ $ curl -v -H "Accept:application/xml" -X GET http://emitbdsr1.cern.ch:9126/services?Service_Endpoint_ID=devel09.cnaf.infn.it_wmproxy_2272271975_org.glite.wms.WMProxy_2272271975
* About to connect() to emitbdsr1.cern.ch port 9126 (#0)
*   Trying 128.142.136.66... connected
* Connected to emitbdsr1.cern.ch (128.142.136.66) port 9126 (#0)
> GET /services?Service_Endpoint_ID=devel09.cnaf.infn.it_wmproxy_2272271975_org.glite.wms.WMProxy_2272271975 HTTP/1.1
> User-Agent: curl/7.21.0 (i386-redhat-linux-gnu) libcurl/7.21.0 NSS/3.12.10.0 zlib/1.2.5 libidn/1.18 libssh2/1.2.4
> Host: emitbdsr1.cern.ch:9126
> Accept:application/xml
> 
< HTTP/1.1 200 OK
< Content-Type: application/xml
< Vary: Accept-Encoding
< Content-Length: 981
< Server: Jetty(8.1.4.v20120524)
< 
* Connection #0 to host emitbdsr1.cern.ch left intact
* Closing connection #0
<?xml version="1.0" encoding="UTF-8" standalone="yes"?><ns2:QueryResult xmlns="http://schemas.ogf.org/glue/2009/03/spec_2.0_r1" xmlns:ns2="http://www.eu-emi.eu/emiregistry" count="1"><Service BaseType="Entity" CreationTime="2013-01-30T15:22:41.000+01:00"><ID>devel09.cnaf.infn.it_wmproxy_2272271975</ID><Name>INFN-CNAF-WMProxy</Name><Extensions/><Type>org.glite.wms.WMProxy</Type><Location/><Endpoint CreationTime="2013-01-30T15:22:41.000+01:00"><ID>devel09.cnaf.infn.it_wmproxy_2272271975_org.glite.wms.WMProxy_2272271975</ID><URL>https://devel09.cnaf.infn.it:7443/glite_wms_wmproxy_server</URL><Capability>executionmanagement.candidatesetgenerator</Capability><Capability>executionmanagement.jobdescription</Capability><Capability>executionmanagement.jobmanager</Capability><Technology>webservice</Technology><InterfaceName>org.glite.wms.WMProxy</InterfaceName><InterfaceVersion>1.0</InterfaceVersion><QualityLevel>production</QualityLevel></Endpoint></Service></ns2:QueryResult>mcecchi@pccecchi ~ $ 

Argus based authZ

mcecchi Jan, 16th, 2013

[root@devel09 ~]# rpm -qa | grep glite-wms
glite-wms-utils-classad-3.4.1-1.sl5
glite-wms-purger-3.5.0-3.sl5
glite-wms-jobsubmission-3.5.0-3.sl5
glite-wms-core-devel-3.5.0-4.sl5
glite-wms-common-3.5.0-3.sl5
glite-wms-configuration-3.5.0-3.sl5
glite-wms-interface-3.5.0-3.sl5
glite-wms-ice-3.5.0-3.sl5
glite-wms-core-3.5.0-5.sl5
glite-wms-jobsubmission-lib-3.5.0-3.sl5
glite-wms-utils-exception-3.4.1-1.sl5
 

LIST OF BUGS

Server

Changed:
<
<
Vulnerability bug in ICE's proxy renewal (Advisory-SVG-2012-4073) Yes / Done
Vulnerability bug in ICE's proxy renewal (Advisory-SVG-2012-4039) Yes / Done
>
>
WMS stops accepting submissions when no swap is available (bug #96136) No
Set asyncjobstart=false to avoid lost jobs (bug #97319) Yes / Done
Job perusal is broken in EMI-2 WMS (bug #98279) No
WMS to limit ISB size as a whole, not only per file (bug #98280) No
EMI-2 WMS UI glite-wms-job-output creates files without checking VO membership first, also changing status (bug #98281) No
various issues with EMI-1/2 proxy cleanup (bug #98282) No
classad plugin functions are broken (bug #100176) Yes / Done
glite-wms-job-output requires a valid delegated proxy on the WMS to enable output retrieval (bug #98524) No
ICE removes its pid file at the start() instead of stop() (bug #98724) No
wmproxy init script 'status' does not return error when service is not running (bug #99017) No
WMS: fix various bugs on Argus authZ (bug #99092) No
  UI
Changed:
<
<
glite-wms-job-status needs a better handing of purged-related error code. (https://savannah.cern.ch/bugs/?85063) Yes / Done
>
>
Better output message from glite-wms-job-status for missing jobs (bug #94683) No
EMI-2 WMS UI cannot handle jobids starting with a - (bug #98113) No

BUGS

 
Added:
>
>
MC 30/12/2013: Set asyncjobstart=false to avoid lost jobs (bug #97319)
[root@devel09 ~]# grep -i asyncj /etc/glite-wms/glite_wms.conf
    AsyncJobStart  =  false;

MC 30/12/2013: classad plugin functions are broken (bug #100176)

[root@devel09 ~]# rpm -qa | grep wms-core
glite-wms-core-3.5.0-5.sl5
On a UI, list-match for this JDL:
[mcecchi@devel15 ~]$ cat fqanmember_emi2.jdl 
[
Executable = "/bin/echo";
Arguments = "Hello";
StdOutput = "out.log";
StdError = "err.log";
InputSandbox = {};
OutputSandbox = {"out.log", "err.log"};
leftVOMS_FQAN="/gridit/ansys/Role=NULL/Capability=NULL";
rightGlueCEACBR= { "VOMS:/gridit/ansys", "VOMS:/gridit/ansys/Role=SoftwareManager"};
requirements = fqanMember(strcat("VOMS:", leftVOMS_FQAN), rightGlueCEACBR) is true;
myproxyserver="";
ShallowRetryCount = -1;
]

if the number of returned queues if more than 0 then the bug is fixed (actually it should be high, because if the classad plugin function works requirements evaluates to true)

[mcecchi@devel15 ~]$ glite-wms-job-list-match --rank -a --endpoint https://devel09.cnaf.infn.it:7443/glite_wms_wmproxy_server fqanmember_emi2.jdl |wc -l
635
  -- MarcoCecchi - 2013-01-16
 
This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback