Tags:
, view all tags

Testing report: IGIRTC-120

Summary

  • Product: CREAM v. 1.14.2
  • Release Task: Task #34089
  • ETICS Subsystem Configuration Name:
  • VCS Tag:
  • EMI Major Release: EMI 2 (Matterhorn)
  • Platform: SL6 epel
  • Author: Sara Bertocco
  • Testing report: [[][Testing Report file]]
  • Certification report: [[][Certification Report file]]
  • Outcome: "In Certification*

Deployment tests

Clean Installation

CREAM PBS

    • [[][Installation log file]]
    • [[][Configuration log file]]

CREAM LSF

    • [[][Installation log file]]
    • [[][Configuration log file]]

Upgrade Installation

CREAM PBS

    • [[][Update log file]]
    • [[][Configuration log file]]

CREAM LSF

Unit Tests

System tests

Functionality tests

CREAM PBS

CREAM LSF

 pybot -e job_man -e cpu_alloc -e glue -e ban -e bdii -e lb -e old_blah -e status /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpryBt_X.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
26 critical tests, 26 passed, 0 failed
26 tests total, 26 passed, 0 failed
==============================================================================
Output:  /home/bertocco/.ssh/output.xml
Log:     /home/bertocco/.ssh/log.html
Report:  /home/bertocco/.ssh/report.html

$ pybot -i ban /opt/cream_test/testsuite/cream_test_suite.html  
INFO: The files of this testsuite will be stored under: /tmp/tmpwdRNS1.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  /home/bertocco/.ssh/output.xml
Log:     /home/bertocco/.ssh/log.html
Report:  /home/bertocco/.ssh/report.html

$ pybot -i cpu_alloc /opt/cream_test/testsuite/cream_test_suite.html  
INFO: The files of this testsuite will be stored under: /tmp/tmpAMdB1O.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  /home/bertocco/.ssh/output.xml
Log:     /home/bertocco/.ssh/log.html
Report:  /home/bertocco/.ssh/report.html

$ pybot -i lb /opt/cream_test/testsuite/cream_test_suite.html  
INFO: The files of this testsuite will be stored under: /tmp/tmpBFbw5R.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Logging and Bookkeeping :: Check if the logging and bookkeeping se... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html

$ pybot -i old_blah /opt/cream_test/testsuite/cream_test_suite.html  
INFO: The files of this testsuite will be stored under: /tmp/tmpoyqIJS.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Old BLParser Restart :: Configure a CREAM CE using the old blah bl... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html

Excluded tests:

  • job_man (Admin Manage Job) is excluded because it requires 2 user proxies and the certifier has one only.
  • bdii is excluded because some problem in the testsuite
  • glue is excluded because some not relevant error

Regression tests

Verification attached bugs for CREAM Torque

Bug #97441: CREAM: Unwanted auto-updating of the field "creationTime" on the creamdb database FIXED

Verification attached bugs for CREAM LSF

Bug # FIXED

Verification old bugs for CREAM LSF and bugs 96306 and 96512 attached to the patch

$ pwd
/home/bertocco/cream_blah_testsuites-master/cream_regression_testsuite/tests
$ pybot bug_*.html
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
 batch_system = lsf
 ce_admin_user = root
 ce_admin_pass = cmsgrid
 ce_host = cert-41.pd.infn.it
 ce_endpoint = cert-41.pd.infn.it:8443
 cream_queue = cream-lsf-cert
 vo = dteam
 proxy_pass = sarabINFN
 log_level = TRACE
 tmp_dir = /tmp
 delete_files = False
 tomcat_service = tomcat6
 catalina_home = /usr/share/tomcat6
middleware_version = emi2
 ce_cream_xml = /etc/glite-ce-cream/cream-config.xml
 cream_config_xml = /etc/glite-ce-cream/cream-config.xml
 blah_config = /etc/blah.config
 site_info = /root/siteinfo/site-info.def
 services_glite_creamce = /root/siteinfo/services/glite-creamce
 blah_bupdater_loop_interval = bupdater_loop_interval
 blah_check_children_interval = blah_check_children_interval
 blah_bupdater_use_bhist_for_killed = bupdater_use_bhist_for_killed
 cream_sandbox_path = CREAM_SANDBOX_PATH
 cream_concurrency_level_yaim_name = CREAM_CONCURRENCY_LEVEL
 middleware_version = emi2
 cream_concurrency_level = commandworkerpoolsize
 ce = cert-41.pd.infn.it:8443/cream-lsf-cert
Command "/usr/bin/voms-proxy-info" output follows:
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=1192746910
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
type      : RFC compliant proxy
strength  : 1024 bits
path      : /tmp/x509up_u33337
timeleft  : 11:47:38

Command's output printed.
 dn = /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=1192746910
The files of this testsuite will be stored under: /tmp/tmpNmu7wa.cream_testing/
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_59871                                                             | PASS |
------------------------------------------------------------------------------
Teardown                                                              | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_69857                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_81561                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83238                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83338                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83592                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83593                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
bug_83749                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_84374                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_86191                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_87361                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_87492                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_89489                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_95356                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_95552                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_96306                                                             | PASS |
------------------------------------------------------------------------------
Teardown                                                              | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_96512                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
41 critical tests, 41 passed, 0 failed
41 tests total, 41 passed, 0 failed
==============================================================================
Output:  /home/bertocco/cream_blah_testsuites-master/cream_regression_testsuite/tests/output.xml
Log:     /home/bertocco/cream_blah_testsuites-master/cream_regression_testsuite/tests/log.html
Report:  /home/bertocco/cream_blah_testsuites-master/cream_regression_testsuite/tests/report.html

Integration testing

-- SaraBertocco - 2012-11-26

Topic attachments
I Attachment Action Size Date Who Comment
Unknown file formatlog CREAM_SL6_LSF_update_yum.log manage 8.8 K 2012-12-04 - 13:15 SaraBertocco  
Unknown file formatlog SL6_yaim_update.log manage 208.9 K 2012-12-04 - 13:15 SaraBertocco  
Texttxt log1.html.txt manage 441.1 K 2012-12-03 - 17:10 SaraBertocco  
Texttxt log_ban.html.txt manage 171.3 K 2012-12-03 - 17:10 SaraBertocco  
Texttxt log_cpu_alloc.html.txt manage 191.8 K 2012-12-03 - 17:10 SaraBertocco  
Texttxt log_lb.html.txt manage 172.6 K 2012-12-03 - 17:10 SaraBertocco  
Texttxt log_old_blah.html.txt manage 167.7 K 2012-12-03 - 17:10 SaraBertocco  
Texttxt log_regression.html.txt manage 376.3 K 2012-12-05 - 11:45 SaraBertocco  
Edit | Attach | PDF | History: r18 | r7 < r6 < r5 < r4 | Backlinks | Raw View | More topic actions...
Topic revision: r5 - 2012-12-05 - SaraBertocco
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback