Difference: EMI2CREAMTask38531SL6 (3 vs. 4)

Revision 42013-01-29 - SaraBertocco

Line: 1 to 1
 
META TOPICPARENT name="EMI2CREAMTask38531"

Testing report: IGIRTC-125

Line: 48 to 48
 

Functionality tests

Added:
>
>
  • Test "bdii" and "glue" are covered in compliance tests
  • Test "job_man" is excluded because it requires two proxy certificates and the certifier has one only
  • Test "outputdata" is excluded in the first test suite run because a problem in testbed bdii setup, solved later.
 

CREAM PBS

Added:
>
>
$ pybot -e outputdata -e bdii -e glue -e job_man /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpMSXELI.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | FAIL |
'['https://cert-42.pd.infn.it:8443/CREAM008747298', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM092671703', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM124860354', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM190619285', 'IDLE', 'https://cert-42.pd.infn.it:8443/CREAM209313410', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM216599452', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM247509604', 'CANCELLED', 'https://cert-42.pd.infn.it:8443/CREAM298811348', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM338616186', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM397680813', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM409140727', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM418737077', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM438966721', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM478916637', 'IDLE', 'https://cert-42.pd.infn.it:8443/CREAM483549371', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM504522990', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM588399968', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM621620940', 'CANCELLED', 'https://cert-42.pd.infn.it:8443/CREAM658041789', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM722241788', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM803417493', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM805989025', 'CANCELLED', 'https://cert-42.pd.infn.it:8443/CREAM829770983', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM856980366', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM906476021', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM932057863', 'DONE-OK', 'https://cert-42.pd.infn.it:8443/CREAM973629738', 'DONE-OK']' does not contain 'https://cert-42.pd.infn.it:8443/CREAM061880031'
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Logging and Bookkeeping :: Check if the logging and bookkeeping se... | PASS |
------------------------------------------------------------------------------
Old BLParser Restart :: Configure a CREAM CE using the old blah bl... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | FAIL |
35 critical tests, 34 passed, 1 failed
35 tests total, 34 passed, 1 failed
==============================================================================

$ pybot -i outputdata  /opt/cream_test/testsuite/cream_test_suite.html
.......
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================

  • Functionality test suite log
  • Test "outputdata" log
 

CREAM LSF

Line: 137 to 242
 35 critical tests, 34 passed, 1 failed 35 tests total, 34 passed, 1 failed ==========================================================================
Changed:
<
<
Output: /home/bertocco/output.xml Log: /home/bertocco/log.html Report: /home/bertocco/report.html
>
>
$ pybot -i outputdata /opt/cream_test/testsuite/cream_test_suite.html ........ ========================================================================== Cream Test Suite :: This is the main testing module,needed for testing the ... ========================================================================== OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
Cream Test Suite :: This is the main testing module,needed for tes... | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ==========================================================================
  $ pybot -i sb_stage /opt/cream_test/testsuite/cream_test_suite.html
Changed:
<
<
INFO: The files of this testsuite will be stored under: /tmp/tmpaeZMfI.cream_testing/ INFO: Non-mandatory variable "sec_cert" has not been set. INFO: Non-mandatory variable "sec_key" has not been set. INFO: Non-mandatory variable "argus_host" has not been set. INFO: Non-mandatory variable "sec_proxy_pass" has not been set. INFO: Non-mandatory variable "argus_root_pass" has not been set.
>
>
.....
 ========================================================================== Cream Test Suite :: This is the main testing module,needed for testing the ... ==========================================================================
Line: 157 to 266
 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ==========================================================================
Changed:
<
<
Output: /home/bertocco/output.xml Log: /home/bertocco/log.html Report: /home/bertocco/report.html
>
>
 

  • Functionality test suite log
Added:
>
>
  • Test "outputdata" log
 
  • Sandbox staging log. This run stand alone is successful. The failure in the previous run is due to some syncronization problem in the testsuite.
Changed:
<
<
  • Test "outputdata" is excluded because a problem in testbed bdii setup
  • Test "bdii" and "glue" are covered in compliance tests
  • Test "job_man" is excluded because it requires two proxy certificates and the certifier has one only
>
>
 

Regression tests

Line: 205 to 313
 
META FILEATTACHMENT attachment="task38531_install_cream_lsf_sl6.log" attr="h" comment="" date="1359128969" name="task38531_install_cream_lsf_sl6.log" path="task38531_install_cream_lsf_sl6.log" size="194513" user="SaraBertocco" version="1"
META FILEATTACHMENT attachment="functionality_CREAM_SL6_LSF.html.log" attr="" comment="" date="1359453777" name="functionality_CREAM_SL6_LSF.html.log" path="functionality_CREAM_SL6_LSF.html.log" size="518569" user="SaraBertocco" version="1"
META FILEATTACHMENT attachment="sandbox_staging_CREAM_SL6_LSF.html.log" attr="" comment="" date="1359453777" name="sandbox_staging_CREAM_SL6_LSF.html.log" path="sandbox_staging_CREAM_SL6_LSF.html.log" size="174528" user="SaraBertocco" version="1"
Added:
>
>
META FILEATTACHMENT attachment="functionality_CREAM_SL6_PBS.html.log" attr="" comment="" date="1359464659" name="functionality_CREAM_SL6_PBS.html.log" path="functionality_CREAM_SL6_PBS.html.log" size="515216" user="SaraBertocco" version="1"
META FILEATTACHMENT attachment="outputdata_PBS_SL6.html.log" attr="" comment="" date="1359465211" name="outputdata_PBS_SL6.html.log" path="outputdata_PBS_SL6.html.log" size="181831" user="SaraBertocco" version="1"
META FILEATTACHMENT attachment="outputdata_LSF_SL6.html.log" attr="" comment="" date="1359465966" name="outputdata_LSF_SL6.html.log" path="outputdata_LSF_SL6.html.log" size="178076" user="SaraBertocco" version="1"
 
This site is powered by the TWiki collaboration platformCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback