Difference: EMI2CREAMTaskIGIRTC157SL5 (3 vs. 4)

Revision 42013-07-30 - SergioTraldi

Line: 1 to 1
 
META TOPICPARENT name="EMI2CREAMTaskJiraIGIRTC-157"

CREAM v. 1.14.5 - Testing report SL5: IGIRTC-157

Line: 419 to 419
 
Bug #CREAM-84 The DelegationPurger may cause a java.lang.OutOfMemoryError exception FIXED
Added:
>
>
From CE:
[root@cert-34 ~]# mysql -u root -p -v delegationcreamdb < duplicateDelegation.sql
Enter password: 
--------------
DROP PROCEDURE IF EXISTS duplicateDelegation
--------------

--------------
CREATE PROCEDURE duplicateDelegation(delegationId VARCHAR(255), i INT)
       BEGIN              
               DECLARE x INT;
               DECLARE delegId VARCHAR(255);
               DECLARE delegDN VARCHAR(255);
               DECLARE delegFQAN VARCHAR(255);
               DECLARE delegVO VARCHAR(50);
               DECLARE delegLocalUser VARCHAR(100);
               DECLARE delegLocalUserGroup VARCHAR(100);
               DECLARE delegVomsAttribute text;
               DECLARE delegCertificate text;
               DECLARE delegInfo text;
               DECLARE delegStartTime datetime;
               DECLARE delegExpirationTime datetime;
               DECLARE delegLastUpdateTime datetime;

               SET x = 1;
               select id, dn, fqan, vo, localUser, localUserGroup, vomsAttribute, certificate, info, startTime, expirationTime, lastUpdateTime INTO delegId, delegDN, delegFQAN, delegVO, delegLocalUser, delegLocalUserGroup, delegVomsAttribute, delegCertificate, delegInfo, delegStartTime, delegExpirationTime, delegLastUpdateTime FROM delegation where id=delegationId;

               WHILE x <= i DO
                  insert into delegation (id, dn, fqan, vo, localUser, localUserGroup, vomsAttribute, certificate, info, startTime, expirationTime, lastUpdateTime) VALUES (CONCAT(delegId,'_',x), delegDN, delegFQAN, delegVO, delegLocalUser, delegLocalUserGroup, delegVomsAttribute, delegCertificate, delegInfo, delegStartTime, delegExpirationTime, delegLastUpdateTime);
                  commit;
                  SET  x = x + 1; 
               END WHILE;
       END
--------------

From UI:

[traldi@cert-16 ~]$ glite-ce-delegate-proxy -e cert-34.pd.infn.it:8443 myproxyid
Proxy with delegation id [myproxyid] succesfully delegated to endpoint [cert-34.pd.infn.it:8443]

From CE:

[root@cert-34 ~]# grep MaxFileSize /etc/glite-ce-cream-es/log4j.properties
log4j.appender.fileout.MaxFileSize=15000KB


[root@cert-34 ~]# /etc/init.d/tomcat5 stop
Stopping tomcat5:                                          [  OK  ]


[root@cert-34 ~]# mysql -u root -p
Enter password: 

mysql> use delegationcreamdb;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Database changed
mysql> update delegation set expirationTime=now() where id="myproxyid";
Query OK, 1 row affected (0.09 sec)
Rows matched: 1  Changed: 1  Warnings: 0

mysql> call duplicateDelegation("myproxyid", 10000);
Query OK, 0 rows affected (2 min 3.46 sec)

mysql> quit
Bye


[root@cert-34 ~]# /etc/init.d/tomcat5 start
Starting tomcat5:                                          [  OK  ]

During the store procedure processing, and afeter 15 minutes: From CE:

[root@cert-34 ~]# tail -f /var/log/cream/glite-ce-cream.log | grep -i OutOfMemoryError

[root@cert-34 ~]# mysql -u root -p
Enter password: 

mysql> use delegationcreamdb;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

mysql> select id from delegation where id like "myproxyid%";
Empty set (0.00 sec)
 
Bug #CREAM-83 CREAM should be able to immediately kill also queued jobs, when the proxy is expiring FIXED

From CE:

Line: 503 to 597
 

Bug #CREAM-78 Check for /etc/lrms in config_cream_gip_scheduler_plugin FIXED
Added:
>
>
This is for SGE batch system (not tested)
 
Bug #CREAM-77 List index error from persistent estimator FIXED
Added:
>
>
From CE:
[root@cream-22 ~]# grep BDII_BREATHE_TIME /etc/bdii/bdii.conf
BDII_BREATHE_TIME=120

From UI:

[traldi@cert-16 ~]$ cat sleepCream.jdl 
[
Type = "Job";
JobType = "Normal";
Executable = "/bin/sleep";
Arguments = " 200"
]


[traldi@cert-16 ~]$ for i in `seq 1 20`; do echo $i; glite-ce-job-submit -r cream-22.pd.infn.it:8443/cream-lsf-cert -a sleepCream.jdl; done
1
https://cream-22.pd.infn.it:8443/CREAM569174996
2
https://cream-22.pd.infn.it:8443/CREAM415358478
3
https://cream-22.pd.infn.it:8443/CREAM464172774
4
https://cream-22.pd.infn.it:8443/CREAM614592479
5
https://cream-22.pd.infn.it:8443/CREAM887749317
6
https://cream-22.pd.infn.it:8443/CREAM379894752
7
https://cream-22.pd.infn.it:8443/CREAM291315683
8
https://cream-22.pd.infn.it:8443/CREAM292136709
9
https://cream-22.pd.infn.it:8443/CREAM356298704
10
https://cream-22.pd.infn.it:8443/CREAM172191910
11
https://cream-22.pd.infn.it:8443/CREAM142468616
12
https://cream-22.pd.infn.it:8443/CREAM492937374
13
https://cream-22.pd.infn.it:8443/CREAM189243448
14
https://cream-22.pd.infn.it:8443/CREAM291411042
15
https://cream-22.pd.infn.it:8443/CREAM682469473
16
https://cream-22.pd.infn.it:8443/CREAM507192499
17
https://cream-22.pd.infn.it:8443/CREAM168869617
18
https://cream-22.pd.infn.it:8443/CREAM800306211
19
https://cream-22.pd.infn.it:8443/CREAM553847847
20
https://cream-22.pd.infn.it:8443/CREAM123559982


[traldi@cert-16 ~]$ ldapsearch -x -H ldap://cream-22.pd.infn.it:2170 -b o=glue | grep GLUE2ComputingShareEstimatedAverageWaitingTime
GLUE2ComputingShareEstimatedAverageWaitingTime: 0
GLUE2ComputingShareEstimatedAverageWaitingTime: 90
GLUE2ComputingShareEstimatedAverageWaitingTime: 0
GLUE2ComputingShareEstimatedAverageWaitingTime: 0
GLUE2ComputingShareEstimatedAverageWaitingTime: 90
GLUE2ComputingShareEstimatedAverageWaitingTime: 0
GLUE2ComputingShareEstimatedAverageWaitingTime: 90
GLUE2ComputingShareEstimatedAverageWaitingTime: 0
GLUE2ComputingShareEstimatedAverageWaitingTime: 0
GLUE2ComputingShareEstimatedAverageWaitingTime: 90

During submission and after 10 minutes: From CE:

[root@cream-22 ~]# tail -f /var/log/bdii/bdii-update.log
 
Bug #CREAM-75 CREAM should avoid to log the error messages by including even the full stack trace (i.e printStackTrace()) FIXED
Added:
>
>
From UI:
[traldi@cert-16 ~]$ glite-ce-job-submit -a -r cream-22.pd.infn.it/cream-lsf-cert --leaseId mylease sleepCream.jdl 
2013-07-30 11:33:48,702 WARN - ERROR submitting JDL [sleepCream.jdl]: MethodName=[jobRegister] Timestamp=[Tue 30 Jul 2013 11:33:48] ErrorCode=[0] Description=[lease id not found!] FaultCause=[lease id "mylease" not found!].

From CE:

[root@cream-22 ~]# tail -f /var/log/cream/glite-ce-cream.log

30 Jul 2013 11:33:46,762 INFO org.glite.ce.commonj.authz.gjaf.VomsServicePDP - VOMS attribute authorized: /dteam/Role=NULL/Capability=NULL
30 Jul 2013 11:33:46,762 INFO org.glite.ce.commonj.authz.axis2.AuthorizationHandler - request for OPERATION={http://www.gridsite.org/namespaces/delegation-2}getProxyReq; REMOTE_REQUEST_ADDRESS=193.206.210.233; USER_DN=CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT; USER_FQAN={ /dteam/Role=NULL/Capability=NULL; /dteam/NGI_IT/Role=NULL/Capability=NULL; };  AUTHORIZED
30 Jul 2013 11:33:47,965 INFO org.glite.ce.commonj.authz.gjaf.VomsServicePDP - VOMS attribute authorized: /dteam/Role=NULL/Capability=NULL
30 Jul 2013 11:33:47,965 INFO org.glite.ce.commonj.authz.axis2.AuthorizationHandler - request for OPERATION={http://www.gridsite.org/namespaces/delegation-2}putProxy; REMOTE_REQUEST_ADDRESS=193.206.210.233; USER_DN=CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT; USER_FQAN={ /dteam/Role=NULL/Capability=NULL; /dteam/NGI_IT/Role=NULL/Capability=NULL; };  AUTHORIZED
30 Jul 2013 11:33:47,968 INFO org.glite.ce.cream.ws.delegation.CREAMDelegationService - BEGIN putProxy
30 Jul 2013 11:33:48,102 INFO org.glite.ce.cream.delegationmanagement.cmdexecutor.DelegationExecutor - New delegation created [id='964f1f49362e3012f731c80a3c00e25438a55fa4'; rfc=false; dn='CN_Sergio_Traldi_L_Padova_OU_Personal_Certificate_O_INFN_C_IT'; localUser='dteam037'; vo='dteam'; startTime='7/30/13 9:28 AM (GMT)'; expirationTime='7/30/13 9:24 PM (GMT)'];
30 Jul 2013 11:33:48,391 INFO org.glite.ce.cream.ws.delegation.CREAMDelegationService - END putProxy
30 Jul 2013 11:33:48,661 INFO org.glite.ce.commonj.authz.gjaf.VomsServicePDP - VOMS attribute authorized: /dteam/Role=NULL/Capability=NULL
30 Jul 2013 11:33:48,663 INFO org.glite.ce.commonj.authz.axis2.AuthorizationHandler - request for OPERATION={http://glite.org/2007/11/ce/cream/types}JobRegister; REMOTE_REQUEST_ADDRESS=193.206.210.233; USER_DN=CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT; USER_FQAN={ /dteam/Role=NULL/Capability=NULL; /dteam/NGI_IT/Role=NULL/Capability=NULL; };  AUTHORIZED
30 Jul 2013 11:33:48,680 INFO org.glite.ce.cream.cmdmanagement.CommandManager - new command [NAME="JOB_REGISTER"; PRIORITY_LEVEL=1; IS_ASYNCHRONOUS=false; STATUS=ACCEPTED; CATEGORY="JOB_MANAGEMENT"; EXECUTOR_NAME="BLAHExecutor"; USER_ID="CN_Sergio_Traldi_L_Padova_OU_Personal_Certificate_O_INFN_C_IT_dteam_Role_NULL_Capability_NULL"; CREATION_TIME="Tue Jul 30 11:33:48 CEST 2013"; REMOTE_REQUEST_ADDRESS="193.206.210.233"; USER_DN_X500="/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sergio Traldi"; AUTOSTART="false"; LEASE_ID="mylease"; GSI_FTP_CREAM_URL="gsiftp://cream-22.pd.infn.it"; LOCAL_USER_GROUP="dteam"; LOCAL_USER="dteam037"; USER_VO="dteam"; USER_DN="CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT"; DELEGATION_PROXY_ID="964f1f49362e3012f731c80a3c00e25438a55fa4"; CREAM_URL="https://cream-22.pd.infn.it:8443/ce-cream/services/CREAM2"; USER_FQAN={ /dteam/Role=NULL/Capability=NULL; /dteam/NGI_IT/Role=NULL/Capability=NULL }]
30 Jul 2013 11:33:48,689 ERROR org.glite.ce.creamapi.jobmanagement.cmdexecutor.AbstractJobExecutor - lease id "mylease" not found!
30 Jul 2013 11:33:48,689 ERROR org.glite.ce.cream.cmdmanagement.CommandManager - CommandManager execute: JOB_REGISTER error lease id "mylease" not found!
30 Jul 2013 11:33:48,690 INFO org.glite.ce.cream.cmdmanagement.CommandManager - status change for command [ID=1375176828680; NAME="JOB_REGISTER"; PRIORITY_LEVEL=1; IS_ASYNCHRONOUS=false; STATUS=EXECUTED-ERROR; FAILURE_REASON="lease id "mylease" not found!"; CATEGORY="JOB_MANAGEMENT"; EXECUTOR_NAME="BLAHExecutor"; USER_ID="CN_Sergio_Traldi_L_Padova_OU_Personal_Certificate_O_INFN_C_IT_dteam_Role_NULL_Capability_NULL"; CREATION_TIME="Tue Jul 30 11:33:48 CEST 2013"; START_PROCESSING_TIME="Tue Jul 30 11:33:48 CEST 2013"; EXECUTION_COMPLETED_TIME="Tue Jul 30 11:33:48 CEST 2013"; REMOTE_REQUEST_ADDRESS="193.206.210.233"; USER_DN_X500="/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sergio Traldi"; AUTOSTART="false"; LEASE_ID="mylease"; GSI_FTP_CREAM_URL="gsiftp://cream-22.pd.infn.it"; LOCAL_USER_GROUP="dteam"; LOCAL_USER="dteam037"; USER_VO="dteam"; USER_DN="CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT"; DELEGATION_PROXY_ID="964f1f49362e3012f731c80a3c00e25438a55fa4"; CREAM_URL="https://cream-22.pd.infn.it:8443/ce-cream/services/CREAM2"; USER_FQAN={ /dteam/Role=NULL/Capability=NULL; /dteam/NGI_IT/Role=NULL/Capability=NULL }]
30 Jul 2013 11:33:48,690 ERROR org.glite.ce.cream.ws.CREAM2Service - lease id "mylease" not found!
 

Standard conformance tests

Glue 1 Compliance - PASSED

 
This site is powered by the TWiki collaboration platformCopyright © 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback