Bug #83238 Sometimes CREAM does not update the state of a failed job. SL5 FIXED

Bug #83338 endpointType (in GLUE2ServiceComplexity) hardwired to 1 in CREAM CE is not always correct SL5 FIXED

Bug #83592 CREAM client doesn't allow the delegation of RFC proxies SL5 FIXED

$ /usr/bin/voms-proxy-init -pwstdin --voms testers.eu-emi.eu -rfc
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
Creating temporary proxy ....................... Done
Contacting  emitestbed01.cnaf.infn.it:15002 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=emitestbed01.cnaf.infn.it] "testers.eu-emi.eu" Done
Creating proxy ......................... Done

Your proxy is valid until Wed Sep  5 03:55:44 2012

$  glite-ce-job-submit  -r cream-20.pd.infn.it:8443/cream-lsf-cert  -a /home/bertocco/jdl/test.jdl
https://cream-20.pd.infn.it:8443/CREAM612979110

$ glite-ce-job-status https://cream-20.pd.infn.it:8443/CREAM612979110

******  JobID=[https://cream-20.pd.infn.it:8443/CREAM612979110]
   Status        = [DONE-OK]
   ExitCode      = [0]

Bug #83593 Problems limiting RFC proxies in CREAM SL5 FIXED

Bug#84374 yaim-cream-ce: GlueForeignKey: GlueCEUniqueID: published using : instead of=. SL5 FIXED

==============================================================================
Bug 84374 :: Regression test of Bug #84374 yaim-cream-ce: GlueForeignKey: G...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_84374                                                             | PASS |
------------------------------------------------------------------------------
Bug 84374 :: Regression test of Bug #84374 yaim-cream-ce: GlueFore... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

Bug#86191 No info published by the lcg-info-dynamic-scheduler for one VOView SL5 FIXED

==============================================================================
Bug 86191 :: Regression test of Bug #86191 No info published by the lcg-inf...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_86191                                                             | PASS |
------------------------------------------------------------------------------
Bug 86191 :: Regression test of Bug #86191 No info published by th... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

Bug#87492 CREAM doesn't handle correctly the jdl attribute "environment". SL5 FIXED

==============================================================================
Bug 87492 :: Regression test of bug #87492 CREAM doesn't handle correctly t...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_87492                                                             | PASS |
------------------------------------------------------------------------------
Bug 87492 :: Regression test of bug #87492 CREAM doesn't handle co... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

Bug#95356 Better parsing for static definition files in lcg-info-dynamic-scheduler. SL5 FIXED

==============================================================================
Bug 95356 :: Regression test of bug #95356 Better parsing for static defini...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_95356                                                             | PASS |
------------------------------------------------------------------------------
Suite Teardown :: Restore original file on CREAM CE                   | PASS |
------------------------------------------------------------------------------
Bug 95356 :: Regression test of bug #95356 Better parsing for stat... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================

Verification attached bugs for CREAM LSF

Verification of old bugs for CREAM LSF

Bug #69857 Job submission to CreamCE is enabled by restart of service even if it was previously disabled FIXED

==============================================================================
Bug 69857 :: Regression test of bug #69857: Job submission to CreamCE is en...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_69857                                                             | PASS |
------------------------------------------------------------------------------
Bug 69857 :: Regression test of bug #69857: Job submission to Crea... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================

• Reports here

Bug #83238 Sometimes CREAM does not update the state of a failed job.

==============================================================================
Bug 83238 :: Regression test of bug #83238 Sometimes CREAM does not update ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83238                                                             | PASS |
------------------------------------------------------------------------------
Bug 83238 :: Regression test of bug #83238 Sometimes CREAM does no... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================

Bug #83338 endpointType (in GLUE2ServiceComplexity) hardwired to 1 in CREAM CE is not always correct

==============================================================================
Bug 83338 :: Regression test of bug #83338 endpointType (in GLUE2ServiceCom...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83338                                                             | PASS |
------------------------------------------------------------------------------
Bug 83338 :: Regression test of bug #83338 endpointType (in GLUE2S... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================

CREAM LSF

• SL5:
  • SL5_LSF_emi-cream-ce_update.log: SL5_LSF_emi-cream-ce_update.log
  • SL5_LSF_emi-cream-ce_update_config.log: SL5_LSF_emi-cream-ce_update_config.log

Bug #89153 JobDBAdminPurger cannot purge jobs if CREAM DB is on another host FIXED

On CE node: only the cream_db is set in remote host.

[root@cream-30 ~]# grep jdbc /etc/glite-ce-cream/cream-config.xml
              url="jdbc:mysql://cream-20.pd.infn.it:3306/creamdb?autoReconnect=true"
              url="jdbc:mysql://localhost:3306/delegationcreamdb?autoReconnect=true"


[root@cream-30 ~]# /usr/sbin/JobDBAdminPurger.sh -s registered:pending:idle:running
log4j:WARN No appenders could be found for logger (org.glite.ce.commonj.configuration.xppm.ConfigurationManager).
log4j:WARN Please initialize the log4j system properly.
AbandonedObjectPool is used (org.apache.commons.dbcp.AbandonedObjectPool@b23b25c)
   LogAbandoned: false
   RemoveAbandoned: true
   RemoveAbandonedTimeout: 30
START jobAdminPurger
No jobs to purge!
STOP jobAdminPurger

On DB node:

mysql> GRANT ALL PRIVILEGES ON creamdb.* to 'glite'@'%' identified by 'omit';
Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

• • Configuration log file

Bug #96055 Wrong DN format in logfiles for accounting FIXED

From UI:

[traldi@cert-25 ~]$ glite-ce-job-submit -r cream-20.pd.infn.it:8443/cream-lsf-cert -a simple.jdl 
https://cream-20.pd.infn.it:8443/CREAM005725930


[traldi@cert-25 ~]$ glite-ce-job-status https://cream-20.pd.infn.it:8443/CREAM005725930

******  JobID=[https://cream-20.pd.infn.it:8443/CREAM005725930]
        Status        = [IDLE]


[traldi@cert-25 ~]$ glite-ce-job-status https://cream-20.pd.infn.it:8443/CREAM005725930

******  JobID=[https://cream-20.pd.infn.it:8443/CREAM005725930]
        Status        = [DONE-OK]
        ExitCode      = [0]

From CE:

[root@cream-20 ~]# tail -10 /var/log/cream/accounting/blahp.log-20120830 
"timestamp=2012-08-30 14:32:19" "userDN=/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sergio Traldi" "userFQAN=/dteam/Role=NULL/Capability=NULL" "userFQAN=/dteam/NGI_IT/Role=NULL/Capability=NULL" "ceID=cream-20.pd.infn.it:8443/cream-lsf-cert" "jobID=CREAM005725930" "lrmsID=701106" "localUser=18264" "clientID=cre20_005725930"

Bug #93091 Add some resubmission machinery to CREAM FIXED

From UI:

[traldi@cert-25 ~]$ glite-ce-job-submit -r cream-20.pd.infn.it:8443/cream-lsf-cert -a simple.jdl 
https://cream-20.pd.infn.it:8443/CREAM122613009


[traldi@cert-25 ~]$ glite-ce-job-status https://cream-20.pd.infn.it:8443/CREAM122613009

******  JobID=[https://cream-20.pd.infn.it:8443/CREAM122613009]
        Status        = [PENDING]

From CE:

[root@cream-20]# grep sleep /usr/libexec/lsf_submit.sh
sleep 10m


[root@cream-20 ~]#  tail -f /var/log/cream/glite-ce-cream.log
30 Aug 2012 16:38:42,248 org.glite.ce.commonj.authz.axis2.AuthorizationHandler - request for OPERATION={http://glite.org/2007/11/ce/cream/types}JobStatus; REMOTE_REQUEST_ADDRESS=193.206.210.252; USER_DN=CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT; USER_FQAN={ /dteam/Role=NULL/Capability=NULL; /dteam/NGI_IT/Role=NULL/Capability=NULL; };  AUTHORIZED
30 Aug 2012 16:38:42,249 org.glite.ce.cream.cmdmanagement.CommandManager - new command [NAME="JOB_STATUS"; PRIORITY_LEVEL=1; IS_ASYNCHRONOUS=false; STATUS=ACCEPTED; CATEGORY="JOB_MANAGEMENT"; EXECUTOR_NAME="BLAHExecutor"; USER_ID="CN_Sergio_Traldi_L_Padova_OU_Personal_Certificate_O_INFN_C_IT_dteam_Role_NULL_Capability_NULL"; CREATION_TIME="Thu Aug 30 16:38:42 CEST 2012"; JOB_ID_LIST={ CREAM122613009 }; IS_ADMIN="false"; REMOTE_REQUEST_ADDRESS="193.206.210.252"; LOCAL_USER="dteam020"; USER_DN="CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT"; USER_FQAN={ /dteam/Role=NULL/Capability=NULL; /dteam/NGI_IT/Role=NULL/Capability=NULL }; LOCAL_USER_GROUP="dteam"]
30 Aug 2012 16:39:28,778 org.glite.ce.creamapi.jobmanagement.db.DBInfoManager - set submissionEnabled to 0 in the database
30 Aug 2012 16:39:28,778 org.glite.ce.creamapi.jobmanagement.cmdexecutor.JobSubmissionManager - AcceptNewJobs by script = true
30 Aug 2012 16:42:08,528 org.glite.ce.creamapi.jobmanagement.cmdexecutor.AbstractJobExecutor - submission to BLAH failed [jobId=CREAM122613009; reason=BLAH error: submission command failed (exit code = 143) (stdout:) (stderr: <blah> execute_cmd: 200 seconds timeout expired, killing child process.-) N/A (jobId = CREAM122613009); retry count=1/3]

Remeber to delete the user dteam* from /etc/passwd and if you submit job before this test my hint is to delete the contents of /etc/grid-security/gridmapdir

[root@cream-30 siteinfo]# grep dteam users.conf
18118:dteamlonguser001:2688:dteam:dteam::
18119:dteamlonguser002:2688:dteam:dteam::
50501:prddtmlonguser01:2689,2688:dteamprd,dteam:dteam:prd
50502:prddtmlonguser02:2689,2688:dteamprd,dteam:dteam:prd
60501:sgmdtmlonguser01:2690,2688:dteamsgm,dteam:dteam:sgm
60502:sgmdtmlonguser02:2690,2688:dteamsgm,dteam:dteam:sgm

[root@cream-30 ~]# /opt/glite/yaim/bin/yaim -c -d 6 -s /root/siteinfo/site-info.def -n creamCE -n TORQUE_server -n TORQUE_utils  2>&1 | tee /root/conf_EMI2-CE_Torque.`hostname -s`.`date +%Y%m%d-%H%M%S`.log


[root@cream-30 siteinfo]# grep dteam /etc/passwd
dteamlonguser001:x:18118:2688:mapped user for group dteam:/home/dteamlonguser001:/bin/bash
dteamlonguser002:x:18119:2688:mapped user for group dteam:/home/dteamlonguser002:/bin/bash
prddtmlonguser01:x:50501:2689:mapped user for group dteamprd:/home/prddtmlonguser01:/bin/bash
prddtmlonguser02:x:50502:2689:mapped user for group dteamprd:/home/prddtmlonguser02:/bin/bash
sgmdtmlonguser01:x:60501:2690:mapped user for group dteamsgm:/home/sgmdtmlonguser01:/bin/bash
sgmdtmlonguser02:x:60502:2690:mapped user for group dteamsgm:/home/sgmdtmlonguser02:/bin/bash

Note you have also to reconfigure with that users.conf the WNs in your cluster.

From UI:

https://cream-30.pd.infn.it:8443/CREAM678472851

**** JobID=[https://cream-30.pd.infn.it:8443/CREAM678472851] Current Status = [REALLY-RUNNING] Working Dir = reserved Grid JobID = [N/A] LRMS Abs JobID = reserved LRMS JobID = reserved Deleg Proxy ID = [60007c291353a7124c2b712fdca6fd3977226120] DelegProxyInfo = isRFC="false"; valid from="8/30/12 9:37 AM (GMT)"; valid to="8/30/12 8:36 PM (GMT)"; holder DN="CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT"; holder AC issuer="CN=proxy,CN=proxy,CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT"; VO="dteam"; AC issuer="CN=voms2.hellasgrid.gr,OU=hellasgrid.gr,O=HellasGrid,C=GR"; VOMS attributes={ /dteam/Role=NULL/Capability=NULL, /dteam/NGI_IT/Role=NULL/Capability=NULL } Worker Node = [N/A] Local User = [dteamlonguser002] CREAM ISB URI = [gsiftp://cream-30.pd.infn.it/var/cream_sandbox/dteam/CN_Sergio_Traldi_L_Padova_OU_Personal_Certificate_O_INFN_C_IT_dteam_Role_NULL_Capability_NULL_dteamlonguser002/67/CREAM678472851/ISB] CREAM OSB URI = [gsiftp://cream-30.pd.infn.it/var/cream_sandbox/dteam/CN_Sergio_Traldi_L_Padova_OU_Personal_Certificate_O_INFN_C_IT_dteam_Role_NULL_Capability_NULL_dteamlonguser002/67/CREAM678472851/OSB] JDL = BatchSystem = "pbs"; QueueName = "cert"; Executable = "/bin/sleep"; Arguments = "10"; VirtualOrganisation = "dteam" Type = [normal]

Job status changes: ------------------- Status = [REGISTERED] - [Thu 30 Aug 2012 11:42:11] (1346319731) Status = [PENDING] - [Thu 30 Aug 2012 11:42:12] (1346319732) Status = [RUNNING] - [Thu 30 Aug 2012 11:42:15] (1346319735) Status = [REALLY-RUNNING] - [Thu 30 Aug 2012 11:42:15] (1346319735)

Issued Commands: -------------------

* Command Name = [JOB_REGISTER] Command Category = [JOB_MANAGEMENT] Command Status = [SUCCESSFULL] Creation Time = [Thu 30 Aug 2012 11:42:11] (1346319731) Start Scheduling Time = [Thu 30 Aug 2012 11:42:11] (1346319731) Start Processing Time = [Thu 30 Aug 2012 11:42:11] (1346319731) Execution Completed Time = [Thu 30 Aug 2012 11:42:11] (1346319731)

* Command Name = [JOB_START] Command Category = [JOB_MANAGEMENT] Command Status = [CREATED] Creation Time = [Thu 30 Aug 2012 11:42:11] (1346319731) Start Scheduling Time = [Thu 30 Aug 2012 11:42:12] (1346319732) Start Processing Time = [Thu 30 Aug 2012 11:42:12] (1346319732)

[traldi@cert-25 ~]$ glite-ce-job-status https://cream-30.pd.infn.it:8443/CREAM678472851

**** JobID=[https://cream-30.pd.infn.it:8443/CREAM678472851] Status = [DONE-OK] ExitCode = [0]

[traldi@cert-25 ~]$ glite-ce-job-submit -r cream-30.pd.infn.it:8443/cream-pbs-cert -a simple2.jdl 
https://cream-30.pd.infn.it:8443/CREAM406480779


[traldi@cert-25 ~]$ glite-ce-job-status https://cream-30.pd.infn.it:8443/CREAM406480779

******  JobID=[https://cream-30.pd.infn.it:8443/CREAM406480779]
        Status        = [PENDING]

From CE:

[root@cream-30 siteinfo]# grep sleep /usr/libexec/pbs_submit.sh
sleep 10m


[root@cream-30 siteinfo]# tail -f /var/log/cream/glite-ce-cream.log
30 Aug 2012 11:59:55,508 org.glite.ce.commonj.authz.gjaf.VomsServicePDP - VOMS attribute authorized: /dteam/Role=NULL/Capability=NULL
30 Aug 2012 11:59:55,516 org.glite.ce.commonj.authz.axis2.AuthorizationHandler - request for OPERATION={http://glite.org/2007/11/ce/cream/types}JobStatus; REMOTE_REQUEST_ADDRESS=193.206.210.252; USER_DN=CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT; USER_FQAN={ /dteam/Role=NULL/Capability=NULL; /dteam/NGI_IT/Role=NULL/Capability=NULL; };  AUTHORIZED
30 Aug 2012 11:59:55,517 org.glite.ce.cream.cmdmanagement.CommandManager - new command [NAME="JOB_STATUS"; PRIORITY_LEVEL=1; IS_ASYNCHRONOUS=false; STATUS=ACCEPTED; CATEGORY="JOB_MANAGEMENT"; EXECUTOR_NAME="BLAHExecutor"; USER_ID="CN_Sergio_Traldi_L_Padova_OU_Personal_Certificate_O_INFN_C_IT_dteam_Role_NULL_Capability_NULL"; CREATION_TIME="Thu Aug 30 11:59:55 CEST 2012"; REMOTE_REQUEST_ADDRESS="193.206.210.252"; JOB_ID_LIST={ CREAM406480779 }; IS_ADMIN="false"; USER_FQAN={ /dteam/Role=NULL/Capability=NULL; /dteam/NGI_IT/Role=NULL/Capability=NULL }; USER_DN="CN=Sergio Traldi,L=Padova,OU=Personal Certificate,O=INFN,C=IT"]
30 Aug 2012 12:02:25,785 org.glite.ce.creamapi.jobmanagement.db.DBInfoManager - set submissionEnabled to 0 in the database
30 Aug 2012 12:02:25,785 org.glite.ce.creamapi.jobmanagement.cmdexecutor.JobSubmissionManager - AcceptNewJobs by script = true
30 Aug 2012 12:02:55,290 org.glite.ce.creamapi.jobmanagement.cmdexecutor.AbstractJobExecutor - submission to BLAH failed [jobId=CREAM406480779; reason=BLAH error: submission command failed (exit code = 143) (stdout:) (stderr: <blah> execute_cmd: 200 seconds timeout expired, killing child process.-) N/A (jobId = CREAM406480779); retry count=1/3]

OK

================================================================== FAIL: Validating data types.

FAILED (failures=1)

Bug #95593 CREAM cannot insert in the command queue if the lenght of the localUser field is > 14 chars FIXED

Bug #96055 Wrong DN format in logfiles for accounting FIXED

From UI:

[traldi@cert-25 ~]$ glite-ce-job-submit -r cream-30.pd.infn.it:8443/cream-pbs-cert -a simple.jdl 
https://cream-30.pd.infn.it:8443/CREAM382717553


[traldi@cert-25 ~]$ glite-ce-job-status https://cream-30.pd.infn.it:8443/CREAM382717553

******  JobID=[https://cream-30.pd.infn.it:8443/CREAM382717553]
        Status        = [DONE-OK]
        ExitCode      = [0]

From CE:

[root@cream-30 ~]# tail -10 /var/log/cream/accounting/blahp.log-20120829 
"timestamp=2012-08-29 07:57:14" "userDN=/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sergio Traldi" "userFQAN=/dteam/Role=NULL/Capability=NULL" "userFQAN=/dteam/NGI_IT/Role=NULL/Capability=NULL" "ceID=cream-30.pd.infn.it:8443/cream-pbs-cert" "jobID=CREAM382717553" "lrmsID=112.cream-30.pd.infn.it" "localUser=18757" "clientID=cre30_382717553"

Bug #93091 Add some resubmission machinery to CREAM FIXED

Bug # 95356 Better parsing for static definition files in lcg-info-dynamic-scheduler FIXED

[root@cream-30 ~]# grep GLUE2PolicyRule /var/lib/bdii/gip/ldif/ComputingShare.ldif
GLUE2PolicyRule: VO:dteam
GLUE2PolicyRule: VO:testers.eu-emi.eu
GLUE2PolicyRule: VO:dteam
GLUE2PolicyRule: VO:testers.eu-emi.eu
GLUE2PolicyRule: wrong value 


[root@cream-30 ~]# grep outputformat /etc/lrms/scheduler.conf
outputformat: both


[root@cream-30 ~]# /var/lib/bdii/gip/plugin/glite-info-dynamic-scheduler-wrapper
[root@cream-30 ~]# 

[root@cream-30 ~]# grep LRMS /etc/glite-ce-cream/cream-config.xml
      <!-- The following parameter sets the sandbox transfer method (GSIFTP/LRMS)-->
    <parameter name="SANDBOX_TRANSFER_METHOD" value="LRMS" />
      <parameter name="LRMS_EVENT_LISTENER_PORT" value="49152"/>

[root@cream-30 ~]# service tomcat5 restart
Stopping tomcat5:                                          [  OK  ]
Starting tomcat5:                                          [  OK  ]

From UI:

[traldi@cert-25 ~]$ glite-wms-job-submit -e https://wms-multi.grid.cnaf.infn.it:7443/glite_wms_wmproxy_server -r cream-30.pd.infn.it:8443/cream-pbs-cert -a outputTest.jdl

Connecting to the service https://prod-wms-02.ct.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://prod-wms-02.ct.infn.it:9000/03ZQrwN31II_d4p_Gsje3Q

==========================================================================



[traldi@cert-25 ~]$ glite-wms-job-status https://prod-wms-02.ct.infn.it:9000/03ZQrwN31II_d4p_Gsje3Q
/usr/lib64/python


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://prod-wms-02.ct.infn.it:9000/03ZQrwN31II_d4p_Gsje3Q
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-30.pd.infn.it:8443/cream-pbs-cert
Submitted:          Tue Aug 28 15:12:29 2012 CEST
==========================================================================

[traldi@cert-25 ~]$ glite-wms-job-output https://prod-wms-02.ct.infn.it:9000/03ZQrwN31II_d4p_Gsje3Q

Connecting to the service https://prod-wms-02.ct.infn.it:7443/glite_wms_wmproxy_server


================================================================================

                        JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://prod-wms-02.ct.infn.it:9000/03ZQrwN31II_d4p_Gsje3Q
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/traldi_03ZQrwN31II_d4p_Gsje3Q

================================================================================



[traldi@cert-25 ~]$ cat /tmp/jobOutput/traldi_03ZQrwN31II_d4p_Gsje3Q/stdout 
Test bug 95480

Bug #95552 Malformed URL from glite-ce-glue2-endpoint-static FIXED

[root@cream-30 ~]# /usr/libexec/glite-ce-glue2-endpoint-static /etc/glite-ce-glue2/glite-ce-glue2.conf | grep GLUE2EndpointURL
GLUE2EndpointURL: https://cream-30.pd.infn.it:8443/ce-cream/services

• • Configuration log file

Bug # 95356 Better parsing for static definition files in lcg-info-dynamic-scheduler SL5 FIXED

• Test report logs here.

$ glite-wms-job-submit -a -c bug95480.conf -r cream-20.pd.infn.it:8443/cream-lsf-cert bug95480.jdl

Connecting to the service https://wms01.grid.hep.ph.ic.ac.uk:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://wmslb01.grid.hep.ph.ic.ac.uk:9000/obrIyblaAuDh0yCbY7LgTQ

======================================================================

https://wmslb01.grid.hep.ph.ic.ac.uk:9000/obrIyblaAuDh0yCbY7LgTQ

$ glite-wms-job-output https://wmslb01.grid.hep.ph.ic.ac.uk:9000/obrIyblaAuDh0yCbY7LgTQ

Connecting to the service https://wms01.grid.hep.ph.ic.ac.uk:7443/glite_wms_wmproxy_server

============================================================================

JOB GET OUTPUT OUTCOME

Output sandbox files for the job: https://wmslb01.grid.hep.ph.ic.ac.uk:9000/obrIyblaAuDh0yCbY7LgTQ have been successfully retrieved and stored in the directory: /tmp/jobOutput/bertocco_obrIyblaAuDh0yCbY7LgTQ

============================================================================

$ cat /tmp/jobOutput/bertocco_obrIyblaAuDh0yCbY7LgTQ/stdout hello world!!!

Bug # 95552 Malformed URL from glite-ce-glue2-endpoint-static SL5 FIXED

The files of this testsuite will be stored under: /tmp/tmpb2aXuu.cream_testing/
==============================================================================
Bug 95552 :: Regression test of bug #83338 endpointType (in GLUE2ServiceCom...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_95552                                                             | PASS |
------------------------------------------------------------------------------
Bug 95552 :: Regression test of bug #83338 endpointType (in GLUE2S... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Output:  /home/bertocco/mie_certificazioni/task31337/italiangrid-cream_blah_testsuites-c80a30e/cream_regression_testsuite/tests/output.xml
Log:     /home/bertocco/mie_certificazioni/task31337/italiangrid-cream_blah_testsuites-c80a30e/cream_regression_testsuite/tests/log.html
Report:  /home/bertocco/mie_certificazioni/task31337/italiangrid-cream_blah_testsuites-c80a30e/cream_regression_testsuite/tests/report.html

• Test report logs here.

• bug_95552.reports.tar: bug_95552.reports.tar

• Test SL5. Results of Functionality tests for LSF PASSED

• • Installation log file
  • Configuration log file

• • Installation log file
  • [[][Configuration log file]]

• • [[][Update log file]]
  • [[][Configuration log file]]

• • [[][Update log file]]
  • [[][Configuration log file]]

• SL5_LSF_install_config_log1.txt: SL5_LSF_install_config_log1.txt

Bug # 95480 CREAM doesn't transfert the output files remotely under well known conditions SL5 FIXED

On CE:
# grep SANDBOX_TRANSFER_METHOD /etc/glite-ce-cream/cream-config.xml
    <parameter name="SANDBOX_TRANSFER_METHOD" value="LRMS" /># service tomcat5 restart

# service tomcat5 restart
Stopping tomcat5:                                          [  OK  ]
Starting tomcat5:                                          [  OK  ]

On UI:
$ cat bug95480.jdl


$ cat bug95480.conf

• Test SL5. Results of Functionality tests for LSF PASSED

• • Installation log file
  • Configuration log file

• • Configuration log file

• • SL5_LSF_install_log.txt
  • [[][Configuration log file]]

• • [[][Installation log file]]
  • [[][Configuration log file]]

Testing report: IGIRTC-91

Summary

• Product: CREAM v. 1.14.1
• Release Task: Task #31337
• ETICS Subsystem Configuration Name:
• VCS Tag: emi-cream-ce_R_1_14_2_3
• EMI Major Release: EMI 2 (Matterhorn)
• Platform: SL5 epel, SL6 epel
• Author: Sergio Traldi
• Testing report: Testing Report file
• Certification report: Certification Report file
• Outcome: "Certified*

Deployment tests

Clean Installation

CREAM PBS

• SL5:
  • Installation log file
  • Configuration log file

• SL6:
  • Installation log file
  • Configuration log file

CREAM LSF

• SL5:
  • Installation log file
  • Configuration log file

• SL6:
  • Installation log file
  • Configuration log file

Upgrade Installation

CREAM PBS

• SL5:
  • Update log file
  • Configuration log file

• SL6:
  • Update log file
  • Configuration log file

CREAM LSF

• SL5:
  • Update log file
  • Configuration log file

• SL6:
  • Update log file
  • Configuration log file

Unit Tests

http://etics-repository.cern.ch/repository/download/registered/emi/emi.cream-ce.cream-common/1.14.0/noarch/glite-ce-common-java-1.14.0-4-reports.tar.gz

System tests

Functionality tests

CREAM PBS

• Test SL5 results of Functionality tests for Torque PASSED

[traldi@cert-25 ~]$ pybot -e glue -e Job_man cream_test_suite.htmlINFO: The files of this testsuite will be stored under: /tmp/tmp6D7SPS.cream_testing/
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
34 critical tests, 34 passed, 0 failed
34 tests total, 34 passed, 0 failed
==============================================================================
Output:  /home/traldi/output.xml
Log:     /home/traldi/log.html
Report:  /home/traldi/report.html

• Test SL6 results of Functionality tests for Torque PASSED

CREAM LSF

• Test SL5 results of Functionality tests for LSF PASSED

• Test SL6 results of Functionality tests for LSF PASSED

Regression tests

Verification attached bugs for CREAM Torque

Bug # 95480 CREAM doesn't transfert the output files remotely under well known conditions FIXED

Verification old bugs for CREAM LSF

Bug # 95480 CREAM doesn't transfert the output files remotely under well known conditions FIXED

Standard Conformance Tests

Glue 1 Compliance

Result: PASSED

Glue 2 Compliance

Result: PASSED

Integration testing

Tests described:

• https://twiki.cern.ch/twiki/bin/view/EMI/EmiJra1TaskForceIntegrationTesting
  • test 2: "CEMon to use Argus for authorization "
    • NA
  • test 3: "CREAM jobs executed under different backends is properly treated by APEL client "
    • PASSED - proven by functionality tests of different CREAM + LSF, TORQUE, SGE modules
  • test 16: "Do authorization filtering based on VOMS attributes and ARGUS authorization" * NA

-- SergioTraldi - 2012-08-03