Testing and Certification report savannah task #23312: BLAH v. 1.18.0 (EMI2)
Summary
- Product: BLAH v. 1.18.0
- Release Task: Task #23312
- ETICS Subsystem Configuration Name: **
- VCS Tag:
- EMI Major Release: EMI 2 (Matterhorn)
- Platform: SL5 epel, SL6 epel
- Author: Sara Bertocco
- Testing report:
- Certification report:
- Date: 3 May 2012
- Outcome: In certification
Deployment tests
Clean Installation
- EMI2 BLAH SL5 installation from scratch and configuration log (in CREAM environment) here
- EMI2 BLAH SL6 installation from scratch and configuration log (in CREAM environment) here.
Upgrade Installation
- EMI2 BLAH SL5 update from EMI1 production version and configuration log (in CREAM environment) here.
Unit Tests
- SL5 Unit test report available here.
- SL5 Unit test report available here.
System tests
Functionality tests
- Check Notifications (SL5 -LSF New parser):
Trying with default blah configuration file /etc/blah.config the test on cancelled jobs notifications fails:
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_cancelled_jobs | FAIL |
NOTIFICATIONS FAILURE != NOTIFICATIONS OK
------------------------------------------------------------------------------
Tests.Check Notifications For Cancelled Jobs :: Test that notifica... | FAIL |
2 critical tests, 1 passed, 1 failed
2 tests total, 1 passed, 1 failed
==============================================================================
Tests.Check Notifications For Normally Finished Jobs :: Test that notificat...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_normally_finished_jobs | PASS |
------------------------------------------------------------------------------
Tests.Check Notifications For Normally Finished Jobs :: Test that ... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Tests.Check Notifications For Suspended Resumed Jobs :: Test that notificat...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_suspended_resumed_jobs | PASS |
------------------------------------------------------------------------------
Tests.Check Notifications For Suspended Resumed Jobs :: Test that ... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Tests | FAIL |
6 critical tests, 5 passed, 1 failed
6 tests total, 5 passed, 1 failed
==============================================================================
Changing the configuration file /etc/blah.config adding the row
bupdater_use_bhist_for_killed="yes"
all notification tests have success.
The files of this testsuite will be stored under: /tmp/tmp5KGJmM.cream_testing/
Tests.Check Notifications For Cancelled Jobs :: Test that notifications are...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_cancelled_jobs | PASS |
------------------------------------------------------------------------------
Tests.Check Notifications For Cancelled Jobs :: Test that notifica... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Tests.Check Notifications For Normally Finished Jobs :: Test that notificat...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_normally_finished_jobs | PASS |
------------------------------------------------------------------------------
Tests.Check Notifications For Normally Finished Jobs :: Test that ... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Tests.Check Notifications For Suspended Resumed Jobs :: Test that notificat...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_suspended_resumed_jobs | PASS |
------------------------------------------------------------------------------
Tests.Check Notifications For Suspended Resumed Jobs :: Test that ... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Tests | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
- Check Notifications (SL5 -LSF Old parser using bupdater_use_bhist_for_killed="yes"):
- Check Notifications (SL6 -LSF New parser using bupdater_use_bhist_for_killed="yes"):
- Check Notifications (SL5 -LSF Old parser using bupdater_use_bhist_for_killed="yes"):
- Check Notifications (SL5 -PBS New parser using bupdater_use_bhist_for_killed="yes"):
- Check Notifications (SL5 -PBS Old parser using bupdater_use_bhist_for_killed="yes"):
- Check Notifications (SL6 -PBS New parser using bupdater_use_bhist_for_killed="yes"):
- Check Notifications (SL5 -PBS Old parser using bupdater_use_bhist_for_killed="yes"):
Regression tests
Verification attached bugs
==============================================================================
Bug 84261 :: Regression test of bug #84261 BNotifier on CREAM CE seems to n...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_84261 | PASS |
------------------------------------------------------------------------------
Bug 84261 :: Regression test of bug #84261 BNotifier on CREAM CE s... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Verification old bugs
==============================================================================
Bug 81824 :: Regression test of bug #81824 yaim-cream-ce should manage the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_81824 | PASS |
------------------------------------------------------------------------------
Bug 81824 :: Regression test of bug #81824 yaim-cream-ce should ma... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
--
SaraBertocco - 2012-05-03