(r6) EMI2CREAMTask21059 < IGIRelease

Tags: , view all tags
---++Testing and Certification report savannah task #21059 CREAM v. 1.14.0  (EMI2)

%TOC%


---++ Summary

   * Product: *CREAM v. 1.14.0*
   * Release Task: [[https://savannah.cern.ch/task/?21059][Task #21059]]
   * ETICS Subsystem Configuration Name: *emi-cream-ce_R_1_14_0_3*
   * VCS Tag: emi-cream-mp_R_1_1_0_3
   * EMI Major Release: EMI 2 (Matterhorn)
   * Platform: SL5 epel 
   * Author: Sara Bertocco
   * Testing report:  TBD
   * Certification report:  TBD
   * Date: 12st April 2012
   * Outcome: %ORANGE% In certification %ENDCOLOR%

---++ SL5

---+++ Deployment tests 

---++++ Clean Installation 

   * EMI2 CREAM SL5 installation  from scratch and configuration log  [[%ATTACHURL%/EMI2RC_CREAM_SL5_install.log][here]].

   * EMI2 CREAM SL6 installation  from scratch and configuration log [[%ATTACHURL%/EMI2RC_CREAM_SL6_install.log][here]].

---++++ Upgrade Installation

   * EMI2 CREAM SL5 update from EMI1 production version and configuration log [[%ATTACHURL%/EMI1_CREAMprod_to_EMI2RC_update.log][here]].


---+++ Unit Tests

TODO: ask mbuto

---+++ System tests

---++++ Functionality tests after the update

---+++++ Check of  `service gLite restart` commad

   * In SL5 installed from scratch:
<verbatim>

[root@cream-48 ~]# service gLite restart
STOPPING SERVICES
*** glite-lb-locallogger:
Stopping glite-lb-logd ... not running
Stopping glite-lb-interlogd ... not running

*** tomcat5:
Stopping tomcat5:                                          [  OK  ]

*** glite-ce-blah-parser:
Shutting down BNotifier:                                   [  OK  ]
Shutting down BUpdaterLSF:                                 [  OK  ]

STARTING SERVICES
*** glite-ce-blah-parser:
Starting BNotifier:                                        [  OK  ]
Starting BUpdaterLSF:                                      [  OK  ]

*** tomcat5:
Starting tomcat5:                                          [  OK  ]

*** glite-lb-locallogger:
Error: GLITE_USER is not set
FAILED
</verbatim>

   * In SL5 update from EMI1 production to EMI2:

<verbatim>
service gLite restart
STOPPING SERVICES
*** tomcat5:
Stopping tomcat5:                                          [  OK  ]

*** glite-ce-blah-parser:
Shutting down BNotifier:                                   [  OK  ]
Shutting down BUpdaterLSF:                                 [  OK  ]

*** glite-ce-blahparser:
/etc/init.d/gLite: line 48: /etc/init.d/glite-ce-blahparser: No such file or directory

*** glite-lb-locallogger:
Stopping glite-lb-logd ... done
Stopping glite-lb-interlogd ... done

*** tomcat5:
Stopping tomcat5:
STARTING SERVICES
*** tomcat5:
Starting tomcat5:                                          [  OK  ]

*** glite-lb-locallogger:
Starting glite-lb-logd ...This is LocalLogger, part of Workload Management System in EU DataGrid & EGEE.
 done
Starting glite-lb-interlogd ... done

*** glite-ce-blahparser:
/etc/init.d/gLite: line 40: /etc/init.d/glite-ce-blahparser: No such file or directory

*** glite-ce-blah-parser:
Starting BNotifier: /usr/libexec/BNotifier: Error creating and binding socket: Address already in use
                                                           [FAILED]
Starting BUpdaterLSF:                                      [  OK  ]

*** tomcat5:
Starting tomcat5: tomcat5 process already running
</verbatim>

---+++++ Testsuite results:

   * Testsuite run vs. SL5
<verbatim>
pybot  -e cpu_alloc -e glue /opt/cream_test/testsuite/cream_test_suite.html 
INFO: The files of this testsuite will be stored under: /tmp/tmpg4Iz9k.cream_testing/
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Admin Manage Job :: This test case checks whether a user can manag... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
29 critical tests, 29 passed, 0 failed
29 tests total, 29 passed, 0 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html
</verbatim>

Testsuite output and reports [[%ATTACHURL%/EMI2_CREAM_SL5_functionality_testsuite_reports.tar][here]].


---++++ Regression tests 

---+++++ Tests of attached bugs fixed in CREAM 1.14
---++++++ Bug #59871 - SL5 %GREEN% FIXED %ENDCOLOR%
<verbatim>
ldapsearch -h emi-demo08.cnaf.infn.it -x -p 2170 -b "o=grid" |grep tag
GlueHostApplicationSoftwareRunTimeEnvironment: tag1
GlueHostApplicationSoftwareRunTimeEnvironment: tag2
GlueHostApplicationSoftwareRunTimeEnvironment: tag3
</verbatim>
---++++++ Bug #59871 - SL6 %GREEN% FIXED %ENDCOLOR%
<verbatim>
ldapsearch -h emitestbed32.cnaf.infn.it -x -p 2170 -b "o=grid" | grep tag
GlueHostApplicationSoftwareRunTimeEnvironment: tag1
GlueHostApplicationSoftwareRunTimeEnvironment: tag2
GlueHostApplicationSoftwareRunTimeEnvironment: tag3
</verbatim>
---++++++ Bug #68968 - SL5 %GREEN% FIXED %ENDCOLOR%
<verbatim>
ldapsearch -h emi-demo08.cnaf.infn.it -x -p 2170 -b "o=grid" |grep -i tag
GlueHostApplicationSoftwareRunTimeEnvironment: tag1
GlueHostApplicationSoftwareRunTimeEnvironment: tag2
</verbatim>
---++++++ Bug #68968 - SL6 %GREEN% FIXED %ENDCOLOR%
<verbatim>
ldapsearch -h emitestbed32.cnaf.infn.it -x -p 2170 -b "o=grid" | grep -i tag
GlueHostApplicationSoftwareRunTimeEnvironment: tag1
GlueHostApplicationSoftwareRunTimeEnvironment: tag2
</verbatim>
---++++++ Bug #69854 - SL5 %GREEN% FIXED %ENDCOLOR%
In each case:
<verbatim>
ldapsearch -h emi-demo08.cnaf.infn.it -x -p 2170 -b "o=grid" |grep GlueCEStateStatus
GlueCEStateStatus: Draining
GlueCEStateStatus: Draining
GlueCEStateStatus: Draining
</verbatim>
---++++++ Bug #69854 - SL6 %RED% NOT FIXED %ENDCOLOR%
---++++++ Bug #77791 - SL5 %GREEN% FIXED %ENDCOLOR%
<verbatim>
   ERROR: sudo probably not installed !
   ERROR: One of the functions returned with error without specifying its nature !
</verbatim>
---++++++ Bug #77791 - SL6 %GREEN% FIXED %ENDCOLOR%
<verbatim>
   ERROR: sudo probably not installed !
   ERROR: One of the functions returned with error without specifying its nature !
</verbatim>
---++++++ Bug #79362 - SL5 %GREEN% FIXED %ENDCOLOR%
<verbatim>
[root@emi-demo08 ~]# rpm -ql dynsched-generic
/usr/lib/python2.4/site-packages/EstTT.py
/usr/lib/python2.4/site-packages/EstTT.pyc
/usr/lib/python2.4/site-packages/EstTT.pyo
</verbatim>
---++++++ Bug #79362 - SL6 %GREEN% FIXED %ENDCOLOR%
<verbatim>
[root@emitestbed32 ~]# rpm -ql dynsched-generic
/usr/lib/python2.6/site-packages/EstTT.py
/usr/lib/python2.6/site-packages/EstTT.pyc
/usr/lib/python2.6/site-packages/EstTT.pyo
/usr/lib/python2.6/site-packages/dynsched_generic-2.4.0-py2.6.egg-info
</verbatim>
---++++++ Bug #80410 - SL5 
---+++++ Regression tests of bugs fixed in CREAM 1.13.3

---++++++ Bug #81561  %GREEN% FIXED %ENDCOLOR%
<verbatim>
$ JobDBAdminPurger.sh -c /etc/glite-ce-cream/cream-config.xml  -s DONE-FAILED,0
log4j:WARN No appenders could be found for logger (org.glite.ce.commonj.configuration.xppm.ConfigurationManager).
log4j:WARN Please initialize the log4j system properly.
AbandonedObjectPool is used (org.apache.commons.dbcp.AbandonedObjectPool@5c73a7ab)
   LogAbandoned: false
   RemoveAbandoned: true
   RemoveAbandonedTimeout: 30
START jobAdminPurger
-----------------------------------------------------------
Job CREAM615605246 is going to be purged ...
CREAM615605246 has been purged!
-----------------------------------------------------------

-----------------------------------------------------------
Job CREAM208116849 is going to be purged ...
CREAM208116849 has been purged!
-----------------------------------------------------------

-----------------------------------------------------------
Job CREAM415420889 is going to be purged ...
CREAM415420889 has been purged!
-----------------------------------------------------------

-----------------------------------------------------------
Job CREAM244215198 is going to be purged ...
CREAM244215198 has been purged!
-----------------------------------------------------------

-----------------------------------------------------------
Job CREAM677106743 is going to be purged ...
CREAM677106743 has been purged!
-----------------------------------------------------------

-----------------------------------------------------------
Job CREAM999977070 is going to be purged ...
CREAM999977070 has been purged!
-----------------------------------------------------------

-----------------------------------------------------------
Job CREAM029821674 is going to be purged ...
CREAM029821674 has been purged!
-----------------------------------------------------------

-----------------------------------------------------------
Job CREAM209002030 is going to be purged ...
CREAM209002030 has been purged!
-----------------------------------------------------------

-----------------------------------------------------------
Job CREAM301874724 is going to be purged ...
CREAM301874724 has been purged!
-----------------------------------------------------------

STOP jobAdminPurger
</verbatim>

---++++++ Bug #83238 %GREEN% FIXED %ENDCOLOR%
<verbatim>
==============================================================================
Bug 83238 :: Regression test of bug #83238 Sometimes CREAM does not update ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83238                                                             | PASS |
------------------------------------------------------------------------------
Bug 83238 :: Regression test of bug #83238 Sometimes CREAM does no... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
</verbatim>

---++++++ Bug #83749 %GREEN% FIXED %ENDCOLOR%
<verbatim>
[bertocco@cream-12 tests]$ glite-ce-job-submit  -r cream-48.pd.infn.it:8443/cream-lsf-cert  -a /home/bertocco/jdl/bug87492.jdl
https://cream-48.pd.infn.it:8443/CREAM403470689
[bertocco@cream-12 tests]$ glite-ce-job-submit  -r cream-48.pd.infn.it:8443/cream-lsf-cert  -a /home/bertocco/jdl/bug87492.jdl
https://cream-48.pd.infn.it:8443/CREAM069317193
[bertocco@cream-12 tests]$ glite-ce-job-submit  -r cream-48.pd.infn.it:8443/cream-lsf-cert  -a /home/bertocco/jdl/simple_greci.jdl 
2012-04-30 19:56:56,352 WARN - VirtualOrganisation specified in the JDL but overrided with [dteam]
https://cream-48.pd.infn.it:8443/CREAM564301640

[bertocco@cream-12 tests]$ glite-ce-job-status https://cream-48.pd.infn.it:8443/CREAM403470689 https://cream-48.pd.infn.it:8443/CREAM069317193 https://cream-48.pd.infn.it:8443/CREAM564301640

******  JobID=[https://cream-48.pd.infn.it:8443/CREAM069317193]
	Status        = [DONE-OK]
	ExitCode      = [0]



******  JobID=[https://cream-48.pd.infn.it:8443/CREAM403470689]
	Status        = [DONE-OK]
	ExitCode      = [0]



******  JobID=[https://cream-48.pd.infn.it:8443/CREAM564301640]
	Status        = [DONE-OK]
	ExitCode      = [0]

Changed CREAM_SANDBOX_PATH and re-configured the cream ce, launched:

Job correctly purged:

[root@cream-48 ~]# JobDBAdminPurger.sh -c /etc/glite-ce-cream/cream-config.xml  -j CREAM069317193:CREAM403470689:CREAM564301640log4j:WARN No appenders could be found for logger (org.glite.ce.commonj.configuration.xppm.ConfigurationManager).
log4j:WARN Please initialize the log4j system properly.
AbandonedObjectPool is used (org.apache.commons.dbcp.AbandonedObjectPool@2d04faf8)
   LogAbandoned: false
   RemoveAbandoned: true
   RemoveAbandonedTimeout: 30
START jobAdminPurger
-----------------------------------------------------------
Job CREAM069317193 is going to be purged ...
CREAM069317193 has been purged!
-----------------------------------------------------------

-----------------------------------------------------------
Job CREAM403470689 is going to be purged ...
CREAM403470689 has been purged!
-----------------------------------------------------------

-----------------------------------------------------------
Job CREAM564301640 is going to be purged ...
CREAM564301640 has been purged!
-----------------------------------------------------------

STOP jobAdminPurger

[bertocco@cream-12 tests]$ glite-ce-job-status https://cream-48.pd.infn.it:8443/CREAM403470689 https://cream-48.pd.infn.it:8443/CREAM069317193 https://cream-48.pd.infn.it:8443/CREAM564301640

******  JobID=[https://cream-48.pd.infn.it:8443/CREAM069317193]
	For this job CREAM has returned a fault: MethodName=[jobStatus] Timestamp=[Mon 30 Apr 2012 20:04:53] ErrorCode=[2] Description=[job not found] FaultCause=[N/A]



******  JobID=[https://cream-48.pd.infn.it:8443/CREAM403470689]
	For this job CREAM has returned a fault: MethodName=[jobStatus] Timestamp=[Mon 30 Apr 2012 20:04:53] ErrorCode=[2] Description=[job not found] FaultCause=[N/A]



******  JobID=[https://cream-48.pd.infn.it:8443/CREAM564301640]
	For this job CREAM has returned a fault: MethodName=[jobStatus] Timestamp=[Mon 30 Apr 2012 20:04:53] ErrorCode=[2] Description=[job not found] FaultCause=[N/A]

Cleaned correctly also sandbox:

[root@cream-48 ~]# grep -r CREAM564301640 /var/cream_sandbox/dteam/
[root@cream-48 ~]# grep -r CREAM403470689 /var/cream_sandbox/dteam/
[root@cream-48 ~]# grep -r CREAM564301640 /var/cream_sandbox/dteam/

</verbatim>


---++++++ Bug #84374 %GREEN% FIXED %ENDCOLOR%
<verbatim>
==============================================================================
Bug 84374 :: Regression test of Bug #84374 yaim-cream-ce: GlueForeignKey: G...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_84374                                                             | PASS |
------------------------------------------------------------------------------
Bug 84374 :: Regression test of Bug #84374 yaim-cream-ce: GlueFore... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
</verbatim>

---++++++ Bug #86191 %GREEN% FIXED %ENDCOLOR%
<verbatim>
==============================================================================
Bug 86191 :: Regression test of Bug #86191 No info published by the lcg-inf...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_86191                                                             | PASS |
------------------------------------------------------------------------------
Bug 86191 :: Regression test of Bug #86191 No info published by th... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
</verbatim>

---++++++ Bug #87492 %GREEN% FIXED %ENDCOLOR%
<verbatim>
==============================================================================
Bug 87492 :: Regression test of bug #87492 CREAM doesn't handle correctly t...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_87492                                                             | PASS |
------------------------------------------------------------------------------
Bug 87492 :: Regression test of bug #87492 CREAM doesn't handle co... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
</verbatim>

Robot framework logs for bugs fixed in CREAM 1.13.3 and tested through the testsuite are available [[%ATTACHURL%/regression_logs_1.13.tar][here]].

-- Main.SaraBertocco - 2012-04-27
Attachments
Topic attachments
I	Attachment	Action	Size	Date	Who
log	EMI1_CREAMprod_to_EMI2RC_update.log	manage	59.2 K	2012-04-27 - 11:31	SaraBertocco
log	EMI2RC_CREAM_SL5_install.log	manage	122.4 K	2012-04-27 - 12:22	SaraBertocco
log	EMI2RC_CREAM_SL6_install.log	manage	203.9 K	2012-04-27 - 11:59	SaraBertocco
tar	regression_logs_1.13.tar	manage	660.0 K	2012-05-02 - 14:49	SaraBertocco
tar	EMI2_CREAM_SL5_functionality_testsuite_reports.tar	manage	1530.0 K	2012-05-02 - 14:44	SaraBertocco
Topic revision: r6 - 2012-05-03 - FabioCapannini
Account
- Log In
~~Edit~~
~~Attach~~