Tags:
create new tag
, view all tags

Testing and Certification report savannah task #30328: BLAH v. 1.18.1 (EMI2)

Summary

  • Product: BLAH v. 1.18.1
  • Release Task: Task #30328
  • ETICS Subsystem Configuration Name: emi-blahp_R_1_18_1_2
  • VCS Tag: glite-ce-blahp_R_1_18_1_2
  • EMI Major Release: EMI 2 (Matterhorn)
  • Platform: SL5 epel, SL6 epel
  • Author: Sara Bertocco
  • Testing report: here
  • Certification report: here
  • Date: 19 Jun 2012
  • Outcome: In certification

Deployment tests

Clean Installation

  • EMI2 BLAH SL5 installation from scratch and configuration log (in CREAM environment) here

  • EMI2 BLAH SL6 installation from scratch and configuration log (in CREAM environment) here.

Upgrade Installation

  • EMI2 BLAH SL5 update and configuration log (in CREAM environment) here.

  • EMI2 BLAH SL6 update and configuration log (in CREAM environment) here. Configuration using USE_EMIES=true

Unit Tests

  • SL5 Unit test report available here.
  • SL6 Unit test report available here.

System tests

Functionality tests

Submission tests SL5 PASSED
  • Submission tests on SL5 old parser log.
  • Submission tests on SL5 new parser log.

Submission tests SL6 PASSED
  • Submission tests on SL6 new parser log
  • Submission tests onold parser log

Check Notifications SL5 - LSF New parser. PASSED

  • For normally finished jobs 

$ pybot check_notifications_for_normally_finished_jobs.html
The files of this testsuite will be stored under: /tmp/tmpYO0NkC.cream_testing/
==============================================================================
Check Notifications For Normally Finished Jobs :: Test that notifications a...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_normally_finished_jobs                        | PASS |
------------------------------------------------------------------------------
Check Notifications For Normally Finished Jobs :: Test that notifi... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

  • For cancelled jobs 

$ pybot check_notifications_for_cancelled_jobs.html
The files of this testsuite will be stored under: /tmp/tmpZX4Pgl.cream_testing/
==============================================================================
Check Notifications For Cancelled Jobs :: Test that notifications are sent ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_cancelled_jobs                                | PASS |
------------------------------------------------------------------------------
Check Notifications For Cancelled Jobs :: Test that notifications ... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

  • For suspended and resumed jobs: 

$ pybot check_notifications_for_suspended_resumed_jobs.html
The files of this testsuite will be stored under: /tmp/tmpi7uk2S.cream_testing/
==============================================================================
Check Notifications For Suspended Resumed Jobs :: Test that notifications a...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_suspended_resumed_jobs                        | PASS |
------------------------------------------------------------------------------
Check Notifications For Suspended Resumed Jobs :: Test that notifi... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

Check Notifications SL5 - LSF Old parser PASSED

  • For normally finished jobs 
$ pybot check_notifications_for_normally_finished_jobs.html
The files of this testsuite will be stored under: /tmp/tmpQxvJj7.cream_testing/
==============================================================================
Check Notifications For Normally Finished Jobs :: Test that notifications a...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_normally_finished_jobs                        | PASS |
------------------------------------------------------------------------------
Check Notifications For Normally Finished Jobs :: Test that notifi... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

  • For cancelled jobs: 
$ pybot check_notifications_for_cancelled_jobs.html
The files of this testsuite will be stored under: /tmp/tmpk38P_I.cream_testing/
==============================================================================
Check Notifications For Cancelled Jobs :: Test that notifications are sent ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_cancelled_jobs                                | PASS |
------------------------------------------------------------------------------
Check Notifications For Cancelled Jobs :: Test that notifications ... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

  • For suspended and resumed jobs: 

$ pybot check_notifications_for_suspended_resumed_jobs.html
The files of this testsuite will be stored under: /tmp/tmp73m_TY.cream_testing/
==============================================================================
Check Notifications For Suspended Resumed Jobs :: Test that notifications a...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_suspended_resumed_jobs                        | PASS |
------------------------------------------------------------------------------
Check Notifications For Suspended Resumed Jobs :: Test that notifi... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

Check Notifications SL6 - LSF New parser PASSED

  • For normally finished jobs 
$ pybot check_notifications_for_normally_finished_jobs.html
The files of this testsuite will be stored under: /tmp/tmpqYVxOk.cream_testing/
==============================================================================
Check Notifications For Normally Finished Jobs :: Test that notifications a...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_normally_finished_jobs                        | PASS |
------------------------------------------------------------------------------
Check Notifications For Normally Finished Jobs :: Test that notifi... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

  • For cancelled jobs: 
$ pybot check_notifications_for_cancelled_jobs.html
The files of this testsuite will be stored under: /tmp/tmpnbulen.cream_testing/
==============================================================================
Check Notifications For Cancelled Jobs :: Test that notifications are sent ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_cancelled_jobs                                | PASS |
------------------------------------------------------------------------------
Check Notifications For Cancelled Jobs :: Test that notifications ... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

  • For suspended and resumed jobs: 

$ pybot check_notifications_for_suspended_resumed_jobs.html
The files of this testsuite will be stored under: /tmp/tmp4rq3de.cream_testing/
==============================================================================
Check Notifications For Suspended Resumed Jobs :: Test that notifications a...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_suspended_resumed_jobs                        | PASS |
------------------------------------------------------------------------------
Check Notifications For Suspended Resumed Jobs :: Test that notifi... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

Check Notifications SL6 - LSF Old parser PASSED

  • For normally finished jobs 
$ pybot check_notifications_for_normally_finished_jobs.html
The files of this testsuite will be stored under: /tmp/tmpchCOOe.cream_testing/
==============================================================================
Check Notifications For Normally Finished Jobs :: Test that notifications a...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_normally_finished_jobs                        | PASS |
------------------------------------------------------------------------------
Check Notifications For Normally Finished Jobs :: Test that notifi... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

  • For cancelled jobs: 
$ pybot check_notifications_for_cancelled_jobs.html
The files of this testsuite will be stored under: /tmp/tmp8LnYJT.cream_testing/
==============================================================================
Check Notifications For Cancelled Jobs :: Test that notifications are sent ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_cancelled_jobs                                | PASS |
------------------------------------------------------------------------------
Check Notifications For Cancelled Jobs :: Test that notifications ... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

  • For suspended and resumed jobs: 

$ pybot check_notifications_for_suspended_resumed_jobs.html
The files of this testsuite will be stored under: /tmp/tmpsb_cPd.cream_testing/
==============================================================================
Check Notifications For Suspended Resumed Jobs :: Test that notifications a...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
check_notifications_for_suspended_resumed_jobs                        | PASS |
------------------------------------------------------------------------------
Check Notifications For Suspended Resumed Jobs :: Test that notifi... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

Regression tests

Verification attached bugs

bug #94712: FIXED, NOT CERTIFIED
In the BLAH Testplan it is: "Not easy to reproduce (unpredictable behaviour)"

bug #94414: On SL5 FIXED
The bug is already tested in check_notifications_for_suspended_resumed_jobs.html because the testsuite is designed to suspend the job when the job status is IDLE.

bug #94414: On SL6 FIXED
The bug is already tested in check_notifications_for_suspended_resumed_jobs.html because the testsuite is designed to suspend the job when the job status is IDLE.

bug #94519: On SL5 FIXED
Try to cancel jobs in different state. 
$ glite-ce-job-status https://cream-48.pd.infn.it:8443/CREAM540188800

******  JobID=[https://cream-48.pd.infn.it:8443/CREAM540188800]
   Status        = [IDLE]
$ glite-ce-job-cancel https://cream-48.pd.infn.it:8443/CREAM540188800
Are you sure you want to cancel specified job(s) [y/n]: y
$ glite-ce-job-status https://cream-48.pd.infn.it:8443/CREAM540188800

******  JobID=[https://cream-48.pd.infn.it:8443/CREAM540188800]
   Status        = [CANCELLED]
   ExitCode      = []
   Description   = [Cancelled by user]


$ glite-ce-job-submit  -r cream-48:8443/cream-lsf-cert  -a /home/bertocco/jdl/sleep_30.jdl
https://cream-48.pd.infn.it:8443/CREAM243409722
$ date; glite-ce-job-status
Wed Jun 27 14:33:16 CEST 2012
2012-06-27 14:33:16,739 FATAL - You didn't provide one or more JobID(s) to get status of. Must specify at least on option between --all or --input or specify a JobID as argument. Stop
[bertocco@cream-12 ~]$ date; glite-ce-job-status https://cream-48.pd.infn.it:8443/CREAM243409722
Wed Jun 27 14:33:21 CEST 2012

******  JobID=[https://cream-48.pd.infn.it:8443/CREAM243409722]
   Status        = [RUNNING]
$ date;glite-ce-job-cancel https://cream-48.pd.infn.it:8443/CREAM243409722
Wed Jun 27 14:33:31 CEST 2012

Are you sure you want to cancel specified job(s) [y/n]: y
$ glite-ce-job-status https://cream-48.pd.infn.it:8443/CREAM243409722

******  JobID=[https://cream-48.pd.infn.it:8443/CREAM243409722]
   Status        = [CANCELLED]
   ExitCode      = []
   Description   = [Cancelled by user]

$ glite-ce-job-submit  -r cream-48:8443/cream-lsf-cert  -a /home/bertocco/jdl/sleep_30.jdl
https://cream-48.pd.infn.it:8443/CREAM042964325
$  date; glite-ce-job-status https://cream-48.pd.infn.it:8443/CREAM042964325
Wed Jun 27 14:33:59 CEST 2012

******  JobID=[https://cream-48.pd.infn.it:8443/CREAM042964325]
   Status        = [REALLY-RUNNING]
$ date;glite-ce-job-cancel https://cream-48.pd.infn.it:8443/CREAM042964325
Wed Jun 27 14:34:12 CEST 2012

Are you sure you want to cancel specified job(s) [y/n]: y
$ glite-ce-job-status https://cream-48.pd.infn.it:8443/CREAM042964325

******  JobID=[https://cream-48.pd.infn.it:8443/CREAM042964325]
   Status        = [CANCELLED]
   ExitCode      = []
   Description   = [Cancelled by user]

bug #94519: On SL6 FIXED 
$ glite-ce-job-submit   -r emitestbed32.cnaf.infn.it:8443/cream-lsf-demo -a /home/bertocco/sleep_100.jdl
glite-ce-job-statushttps://emitestbed32.cnaf.infn.it:8443/CREAM756815286
$ glite-ce-job-status https://emitestbed32.cnaf.infn.it:8443/CREAM756815286

******  JobID=[https://emitestbed32.cnaf.infn.it:8443/CREAM756815286]
   Status        = [RUNNING]


[bertocco@emitestbed16 only_new_parser]$ glite-ce-job-cancel https://emitestbed32.cnaf.infn.it:8443/CREAM756815286

Are you sure you want to cancel specified job(s) [y/n]: y
$ glite-ce-job-status https://emitestbed32.cnaf.infn.it:8443/CREAM756815286

******  JobID=[https://emitestbed32.cnaf.infn.it:8443/CREAM756815286]
   Status        = [CANCELLED]
   ExitCode      = []
   Description   = [Cancelled by user]

$ glite-ce-job-submit   -r emitestbed32.cnaf.infn.it:8443/cream-lsf-demo -a /home/bertocco/sleep_100.jdl
https://emitestbed32.cnaf.infn.it:8443/CREAM605598164
$ glite-ce-job-status https://emitestbed32.cnaf.infn.it:8443/CREAM605598164

******  JobID=[https://emitestbed32.cnaf.infn.it:8443/CREAM605598164]
   Status        = [PENDING]
[bertocco@emitestbed16 only_new_parser]$ glite-ce-job-cancel https://emitestbed32.cnaf.infn.it:8443/CREAM605598164

Are you sure you want to cancel specified job(s) [y/n]: y
$ glite-ce-job-status https://emitestbed32.cnaf.infn.it:8443/CREAM605598164

******  JobID=[https://emitestbed32.cnaf.infn.it:8443/CREAM605598164]
   Status        = [IDLE]
$ glite-ce-job-status https://emitestbed32.cnaf.infn.it:8443/CREAM605598164

******  JobID=[https://emitestbed32.cnaf.infn.it:8443/CREAM605598164]
   Status        = [IDLE]
[bertocco@emitestbed16 only_new_parser]$ glite-ce-job-cancel https://emitestbed32.cnaf.infn.it:8443/CREAM605598164

Are you sure you want to cancel specified job(s) [y/n]: y
[bertocco@emitestbed16 only_new_parser]$ glite-ce-job-status https://emitestbed32.cnaf.infn.it:8443/CREAM605598164

******  JobID=[https://emitestbed32.cnaf.infn.it:8443/CREAM605598164]
   Status        = [IDLE]

bug #95392: FIXED, NOT CERTIFIED
In the BLAH Testplan there is no verification receipt.

Verification old bugs

bug #90085: On SL5 FIXED 
The files of this testsuite will be stored under: /tmp/tmpQnSk16.cream_testing/
==============================================================================
Bug 90085 :: Regression test of bug #90985 Suspend command doesn't work wit...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_90085                                                             | PASS |
------------------------------------------------------------------------------
Teardown                                                              | PASS |
------------------------------------------------------------------------------
Bug 90085 :: Regression test of bug #90985 Suspend command doesn't... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================

bug #90085: On SL6 FIXED 
The files of this testsuite will be stored under: /tmp/tmpHg2_PS.cream_testing/
==============================================================================
Bug 90085 :: Regression test of bug #90985 Suspend command doesn't work wit...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_90085                                                             | PASS |
------------------------------------------------------------------------------
Teardown                                                              | PASS |
------------------------------------------------------------------------------
Bug 90085 :: Regression test of bug #90985 Suspend command doesn't... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================

bug #81824: On SL5 FIXED 
The files of this testsuite will be stored under: /tmp/tmpBvbHGW.cream_testing/
==============================================================================
Bug 81824 :: Regression test of bug #81824 yaim-cream-ce should manage the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_81824                                                             | PASS |
------------------------------------------------------------------------------
Bug 81824 :: Regression test of bug #81824 yaim-cream-ce should ma... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

bug #81824: On SL6 FIXED 
The files of this testsuite will be stored under: /tmp/tmpJd5MNk.cream_testing/
==============================================================================
Bug 81824 :: Regression test of bug #81824 yaim-cream-ce should manage the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_81824                                                             | PASS |
------------------------------------------------------------------------------
Bug 81824 :: Regression test of bug #81824 yaim-cream-ce should ma... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

bug #84261: On SL5 FIXED 
The files of this testsuite will be stored under: /tmp/tmppP10m_.cream_testing/
==============================================================================
Bug 84261 :: Regression test of bug #84261 BNotifier on CREAM CE seems to n...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_84261                                                             | PASS |
------------------------------------------------------------------------------
Bug 84261 :: Regression test of bug #84261 BNotifier on CREAM CE s... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

bug #84261: On SL6 FIXED 
The files of this testsuite will be stored under: /tmp/tmpmgY7is.cream_testing/
==============================================================================
Bug 84261 :: Regression test of bug #84261 BNotifier on CREAM CE seems to n...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_84261                                                             | PASS |
------------------------------------------------------------------------------
Bug 84261 :: Regression test of bug #84261 BNotifier on CREAM CE s... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

bug #86238: On SL5 FIXED 
The files of this testsuite will be stored under: /tmp/tmpRyx4_u.cream_testing/
==============================================================================
Bug 86238 :: Regression test of bug #86238 blahpd doesn't check the status ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_86238                                                             | PASS |
------------------------------------------------------------------------------
Bug 86238 :: Regression test of bug #86238 blahpd doesn't check th... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

bug #86238: On SL6 FIXED 
The files of this testsuite will be stored under: /tmp/tmpnQITow.cream_testing/
==============================================================================
Bug 86238 :: Regression test of bug #86238 blahpd doesn't check the status ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_86238                                                             | PASS |
------------------------------------------------------------------------------
Bug 86238 :: Regression test of bug #86238 blahpd doesn't check th... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================

-- SaraBertocco - 2012-06-19

Attachments Attachments
Topic attachments
I Attachment Action SizeSorted ascending Date Who Comment
Texttxt EMI2_Certification_Report_Task30328.txt manage 2.9 K 2012-07-02 - 14:54 SaraBertocco  
Texttxt EMI2_Test_Report_Task30328.txt manage 11.2 K 2012-07-02 - 14:45 SaraBertocco  
Texttxt update_on_SL5.txt manage 20.0 K 2012-06-21 - 13:02 SaraBertocco  
Texttxt update_on_SL6.txt manage 45.0 K 2012-06-21 - 13:43 SaraBertocco  
Texttxt SL5_install_yaim_conf.log.txt manage 81.7 K 2012-06-29 - 15:20 SaraBertocco  
Texttxt SL6_install_and_yaim_conf.log.txt manage 92.7 K 2012-07-02 - 14:07 SaraBertocco  
Texttxt submission_test_SL5_log.txt manage 127.5 K 2012-06-25 - 14:20 SaraBertocco  
Texttxt submission_test_SL6_log.txt manage 1106.1 K 2012-06-25 - 15:15 SaraBertocco  
Texttxt blah_exerciser.sh.SL5newparser_log.txt manage 1131.1 K 2012-06-28 - 14:27 SaraBertocco  
Texttxt submission_test_SL6_old-parser_log.txt manage 1138.2 K 2012-06-27 - 14:26 SaraBertocco  
Edit | Attach | PDF | History: r19 < r18 < r17 < r16 < r15 | Backlinks | Raw View | More topic actions
Topic revision: r19 - 2012-07-06 - CristinaAiftimiei
 
This site is powered by the TWiki collaboration platformCopyright © 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback