Difference: WMSTask26837 (23 vs. 24)

Revision 242012-03-26 - FabioCapannini

Line: 1 to 1
 
META TOPICPARENT name="TestingWms"
Line: 2976 to 2976
 

Published information

bdb database information

Added:
>
>
ldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=grid'
# extended LDIF
#
# LDAPv3
# base <o=grid> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#

# grid
dn: o=grid
objectClass: organization
o: grid

# local, grid
dn: Mds-Vo-name=local,o=grid
Mds-Vo-name: local
objectClass: Mds

# resource, grid
dn: Mds-Vo-name=resource,o=grid
Mds-Vo-name: resource
objectClass: Mds

# emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637, resource, grid
dn: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_84141563
 7,Mds-Vo-name=resource,o=grid
GlueServiceAccessControlBaseRule: VO:atlas
GlueServiceAccessControlBaseRule: VO:alice
GlueServiceAccessControlBaseRule: VO:lhcb
GlueServiceAccessControlBaseRule: VO:cms
GlueServiceAccessControlBaseRule: VO:dteam
GlueServiceAccessControlBaseRule: VO:biomed
GlueServiceAccessControlBaseRule: VO:ops
GlueServiceAccessControlBaseRule: VO:infngrid
GlueServiceAccessControlBaseRule: VO:testers.eu-emi.eu
GlueServiceStatus: Other
GlueServiceStatusInfo: ??
objectClass: GlueTop
objectClass: GlueService
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueServiceUniqueID: emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637
GlueServiceAccessControlRule: atlas
GlueServiceAccessControlRule: alice
GlueServiceAccessControlRule: lhcb
GlueServiceAccessControlRule: cms
GlueServiceAccessControlRule: dteam
GlueServiceAccessControlRule: biomed
GlueServiceAccessControlRule: ops
GlueServiceAccessControlRule: infngrid
GlueServiceAccessControlRule: testers.eu-emi.eu
GlueServiceEndpoint: https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_se
 rver
GlueServiceVersion: 3.3.5
GlueSchemaVersionMinor: 3
GlueServiceName: INFN-CREAMTEST-WMProxy
GlueServiceType: org.glite.wms.WMProxy
GlueServiceWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl
GlueServiceSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-guid
 e.pdf
GlueForeignKey: GlueSiteUniqueID=INFN-CREAMTEST
GlueServiceOwner: atlas
GlueServiceOwner: alice
GlueServiceOwner: lhcb
GlueServiceOwner: cms
GlueServiceOwner: dteam
GlueServiceOwner: biomed
GlueServiceOwner: ops
GlueServiceOwner: infngrid
GlueServiceOwner: testers.eu-emi.eu
GlueSchemaVersionMajor: 1
GlueServiceStartTime: 2012-03-26T00:00:01+02:00

# DN, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_841415637, resource, grid
dn: GlueServiceDataKey=DN,GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glit
 e.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: DN
GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx
 y_841415637
GlueServiceDataValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=emi-demo11.cnaf.infn.it

# glite-info-service_version, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_8
 41415637, resource, grid
dn: GlueServiceDataKey=glite-info-service_version,GlueServiceUniqueID=emi-demo
 11.cnaf.infn.it_org.glite.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_version
GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx
 y_841415637
GlueServiceDataValue: 1.6

# glite-info-service_hostname, emi-demo11.cnaf.infn.it_org.glite.wms.WMProxy_
 841415637, resource, grid
dn: GlueServiceDataKey=glite-info-service_hostname,GlueServiceUniqueID=emi-dem
 o11.cnaf.infn.it_org.glite.wms.WMProxy_841415637,Mds-Vo-name=resource,o=grid
GlueSchemaVersionMajor: 1
objectClass: GlueTop
objectClass: GlueServiceData
objectClass: GlueKey
objectClass: GlueSchemaVersion
GlueSchemaVersionMinor: 3
GlueServiceDataKey: glite-info-service_hostname
GlueChunkKey: GlueServiceUniqueID=emi-demo11.cnaf.infn.it_org.glite.wms.WMProx
 y_841415637
GlueServiceDataValue: emi-demo11.cnaf.infn.it

# search result
search: 2
result: 0 Success

# numResponses: 8
# numEntries: 7

Stats database definitions

ldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=infosys'
# extended LDIF
#
# LDAPv3
# base <o=infosys> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#

# infosys
dn: o=infosys
objectClass: organization
o: infosys

# zip, infosys
dn: CompressionType=zip,o=infosys
objectClass: CompressedContent
Hostname: localhost
CompressionType: zip
Data: file:///var/lib/bdii/archive/12-03-26-11-05-27-snapshot.gz

# localhost, infosys
dn: Hostname=localhost,o=infosys
objectClass: UpdateStats
Hostname: localhost
FailedDeletes: 0
ModifiedEntries: 5
DeletedEntries: 0
UpdateTime: 0
FailedAdds: 0
FailedModifies: 0
TotalEntries: 14
QueryTime: 0
NewEntries: 1
DBUpdateTime: 0
ReadTime: 0
PluginsTime: 0
ProvidersTime: 0

# search result
search: 2
result: 0 Success

# numResponses: 4
# numEntries: 3

Stats database definitions

ldapsearch -x -H ldap://emi-demo11.cnaf.infn.it:2170 -b 'o=glue'
# extended LDIF
#
# LDAPv3
# base <o=glue> with scope subtree
# filter: (objectclass=*)
# requesting: ALL
#

# glue
dn: o=glue
objectClass: organization
o: glue

# grid, glue
dn: GLUE2GroupID=grid,o=glue
objectClass: GLUE2Group
GLUE2GroupID: grid

# resource, glue
dn: GLUE2GroupID=resource,o=glue
objectClass: GLUE2Group
GLUE2GroupID: resource

# emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue
dn: GLUE2ServiceID=emi-demo11.cnaf.infn.it_wmproxy_2598325561,GLUE2GroupID=res
 ource,o=glue
GLUE2EntityValidity: 3600
GLUE2ServiceType: org.glite.wms.WMProxy
GLUE2ServiceID: emi-demo11.cnaf.infn.it_wmproxy_2598325561
objectClass: GLUE2Service
GLUE2ServiceQualityLevel: production
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-service
GLUE2EntityOtherInfo: InfoProviderVersion=1.1
GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it
GLUE2ServiceComplexity: endpointType=1, share=0, resource=0
GLUE2ServiceCapability: executionmanagement.candidatesetgenerator
GLUE2ServiceCapability: executionmanagement.jobdescription
GLUE2ServiceCapability: executionmanagement.jobmanager
GLUE2EntityName: INFN-CREAMTEST-WMProxy
GLUE2ServiceAdminDomainForeignKey: INFN-CREAMTEST
GLUE2EntityCreationTime: 2012-03-26T09:05:27Z

# emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598325561
 , emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue
dn: GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.W
 MProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.infn.it_wmproxy_2598325561,G
 LUE2GroupID=resource,o=glue
GLUE2EntityValidity: 3600
GLUE2EndpointQualityLevel: production
GLUE2EndpointImplementor: gLite
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint
GLUE2EntityOtherInfo: InfoProviderVersion=1.2
GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it
GLUE2EntityOtherInfo: MiddlewareName=EMI
GLUE2EntityOtherInfo: MiddlewareVersion=1.10.0-1
GLUE2EndpointCapability: executionmanagement.candidatesetgenerator
GLUE2EndpointCapability: executionmanagement.jobdescription
GLUE2EndpointCapability: executionmanagement.jobmanager
GLUE2EndpointHealthState: ok
GLUE2EndpointServiceForeignKey: emi-demo11.cnaf.infn.it_wmproxy_2598325561
GLUE2EntityName: WMProxy endpoint for Service emi-demo11.cnaf.infn.it_wmproxy_
 2598325561
GLUE2EndpointTechnology: webservice
GLUE2EndpointWSDL: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy.wsdl
GLUE2EndpointInterfaceName: org.glite.wms.WMProxy
GLUE2EndpointURL: https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_serve
 r
GLUE2EndpointDowntimeInfo: See the GOC DB for downtimes: https://goc.egi.eu/
GLUE2EndpointImplementationVersion: 3.3.5
GLUE2EndpointSemantics: http://web.infn.it/gLiteWMS/images/WMS/Docs/wmproxy-gu
 ide.pdf
GLUE2EndpointIssuerCA: /C=IT/O=INFN/CN=INFN CA
GLUE2EndpointServingState: production
objectClass: GLUE2Endpoint
GLUE2EndpointInterfaceVersion: 1.0
GLUE2EndpointImplementationName: WMS
GLUE2EndpointTrustedCA: IGTF
GLUE2EndpointID: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMPr
 oxy_2598325561
GLUE2EndpointStartTime: 2012-03-25T22:00:01Z
GLUE2EndpointHealthStateInfo: WMProxy httpd listening on port 7443 httpd is ru
 nning .... === WMProxy Server running instances: UID PID PPID C STIME TTY TIM
 E CMD glite 11507 27310 0 09:28 ? 00:00:00 /usr/bin/glite_wms_wmproxy_server
GLUE2EntityCreationTime: 2012-03-26T09:05:27Z

# DN_1, emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598
 325561, emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue
dn: GLUE2ExtensionLocalID=DN_1,GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy
 _2598325561_org.glite.wms.WMProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.i
 nfn.it_wmproxy_2598325561,GLUE2GroupID=resource,o=glue
GLUE2ExtensionLocalID: DN_1
GLUE2ExtensionKey: DN
objectClass: GLUE2Extension
GLUE2ExtensionValue: /C=IT/O=INFN/OU=Host/L=CNAF/CN=emi-demo11.cnaf.infn.it
GLUE2ExtensionEntityForeignKey: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org
 .glite.wms.WMProxy_2598325561

# emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_2598325561
 _Policy, emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProxy_25
 98325561, emi-demo11.cnaf.infn.it_wmproxy_2598325561, resource, glue
dn: GLUE2PolicyID=emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMP
 roxy_2598325561_Policy,GLUE2EndpointID=emi-demo11.cnaf.infn.it_wmproxy_259832
 5561_org.glite.wms.WMProxy_2598325561,GLUE2ServiceID=emi-demo11.cnaf.infn.it_
 wmproxy_2598325561,GLUE2GroupID=resource,o=glue
GLUE2AccessPolicyEndpointForeignKey: emi-demo11.cnaf.infn.it_wmproxy_259832556
 1_org.glite.wms.WMProxy_2598325561
GLUE2EntityValidity: 3600
objectClass: GLUE2Policy
objectClass: GLUE2AccessPolicy
GLUE2PolicyRule: VO:atlas
GLUE2PolicyRule: VO:alice
GLUE2PolicyRule: VO:lhcb
GLUE2PolicyRule: VO:cms
GLUE2PolicyRule: VO:dteam
GLUE2PolicyRule: VO:biomed
GLUE2PolicyRule: VO:ops
GLUE2PolicyRule: VO:infngrid
GLUE2PolicyRule: VO:testers.eu-emi.eu
GLUE2PolicyScheme: org.glite.standard
GLUE2EntityOtherInfo: InfoProviderName=glite-info-glue2-endpoint
GLUE2EntityOtherInfo: InfoProviderVersion=1.2
GLUE2EntityOtherInfo: InfoProviderHost=emi-demo11.cnaf.infn.it
GLUE2PolicyUserDomainForeignKey: atlas
GLUE2PolicyUserDomainForeignKey: alice
GLUE2PolicyUserDomainForeignKey: lhcb
GLUE2PolicyUserDomainForeignKey: cms
GLUE2PolicyUserDomainForeignKey: dteam
GLUE2PolicyUserDomainForeignKey: biomed
GLUE2PolicyUserDomainForeignKey: ops
GLUE2PolicyUserDomainForeignKey: infngrid
GLUE2PolicyUserDomainForeignKey: testers.eu-emi.eu
GLUE2PolicyID: emi-demo11.cnaf.infn.it_wmproxy_2598325561_org.glite.wms.WMProx
 y_2598325561_Policy
GLUE2EntityName: Access control rules for Endpoint emi-demo11.cnaf.infn.it_wmp
 roxy_2598325561_org.glite.wms.WMProxy_2598325561
GLUE2EntityCreationTime: 2012-03-26T09:05:27Z

# search result
search: 2
result: 0 Success

# numResponses: 8
# numEntries: 7
 

Performance test

Collection of 1000 nodes

Line: 3032 to 3354
 2880 jobs submitted in 4721 seconds: 1/1/48 (min/avg/max) Test finishes at ven mar 23 16:09:44 CET 2012
Added:
>
>
Results: DONE : 71777 NOTDone: 0 Aborted: 98
Total : 71875

done jobs on CREAM CEs: 71354 (99.4%) done jobs on LCG CEs: 423 (0.6%)

The above statistics is obatined in the following way: [capannini@cert-17 output]$ cat *.done|wc -l 71777 [capannini@cert-17 output]$ cat *.done|grep '8443/cream' |wc -l 71354 [capannini@cert-17 output]$ cat *.done|grep '2119/jobmanager'|wc -l 423

====> Test PASSED (Aborted/Total = 0.1%)

Regression tests

Bugs attached to the task

WMproxy GACLs do not support wildcards (as they used to do) Fix Certified

The WMproxy GACL file should accept now wildcards, on the FQAN tag only.

VO: dteam, FQAN: /dteam/Role=NULL/Capability=NULL

Test #1: GACL: [...] /dteam /dteam/R* [...]

access granted: [capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo11.conf ls.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/laC85FTZblaB409x38-mMQ

======================================================================

WMP log says: 26 Mar, 12:20:58 -D- PID: 32135 - "GaclManager::loadCredential": GACL FQAN fqan:/dteam/R%2A was matched to /dteam/Role=NULL/Capability=NULL

Test #2: [...] /dteam /dteam/r* [...]

access denied :

[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo11.conf ls.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

Warning - Unable to delegate the credential to the endpoint: https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server AuthorizationException: Authorization error: user not authorized at checkGaclUserAuthZ()[/home/condor/execute/dir_2494/userdir/emi.wms.wmproxy/build/../src/authorizer/wmpauthorizer.cpp:416] at checkGaclUserAuthZ()[/home/condor/execute/dir_2494/userdir/emi.wms.wmproxy/build/../src/authorizer/wmpauthorizer.cpp:281] at authorize()[/home/condor/execute/dir_2494/userdir/emi.wms.wmproxy/build/../src/authorizer/wmpauthorizer.cpp:149] at getProxyReq()[/home/condor/execute/dir_2494/userdir/emi.wms.wmproxy/build/../src/server/wmpoperations.cpp:627]

Switching to next WMProxy Server...

Error - Operation failed Unable to find any endpoint where to perform service request

Test #3:

[...] /dtea* [...]

access granted

[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo11.conf ls.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/EPcAIfYJL6YkFKhlgJkNRw

======================================================================

WMP log says: 26 Mar, 12:22:36 -D- PID: 32135 - "GaclManager::loadCredential": GACL FQAN fqan:/dtea%2A was matched to /dteam/Role=NULL/Capability=NULL

Test #4: [...] /dteam /dteam/* [...]

access granted

[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo11.conf ls.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/2M1Csn3LSER-jq5nfgNblw

======================================================================

WMP log says: 26 Mar, 12:24:23 -D- PID: 32135 - "GaclManager::loadCredential": GACL FQAN fqan:/dteam/%2A was matched to /dteam/Role=NULL/Capability=NULL

  FabioCapannini - 2012-03-15

 
This site is powered by the TWiki collaboration platformCopyright © 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback