EMI2CREAMTask34043SL5 < IGIRelease

Tags: , view all tags
---+ Testing report: [[http://issues.cnaf.infn.it/browse/IGIRTC-133][IGIRTC-133]]

%TOC%

---++ Summary

   * Product: *CREAM v. 1.15.1*
   * Release Task: [[https://savannah.cern.ch/task/?34043][Task #34043]]
   * ETICS Subsystem Configuration Name: emi-cream-ce_R_1_15_1_1, emi-cream-ui_R_1_15_1_1
   * VCS Tag: emi-cream-ce-1.2.1-2, dynsched-generic-2.5.1-3, glite-ce-common-java-1.15.1-2, glite-ce-cream-api-java-1.15.1-2, glite-ce-cream-core-1.15.1-2, glite-ce-cream-es-1.15.1-2, glite-ce-cream-utils-1.3.1-4, glite-ce-wsdl-1.15.1-1, glite-ce-yaim-cream-ce-4.4.1-4, glite-jdl-api-java-3.3.1-2,
   * EMI Major Release: *EMI 3 (Monte Bianco)*
   * Platform: *SL5 epel*
   * Author: Sara Bertocco
   * Testing report: [[%ATTACHURL%/task34043_Test_Report.txt][Testing Report file]]
   * Certification report: [[%ATTACHURL%/task34043_Certification_Report.txt][Certification Report file]]
   * Outcome: %RED% "In Certification* %ENDCOLOR%


---++ Deployment tests

---+++ Clean Installation

---++++CREAM  LSF %GREEN% PASSED %ENDCOLOR%
   * [[%ATTACHURL%/task34043_install_cream_lsf_sl5.log][Installation log file]]
   * [[%ATTACHURL%/task34043_install_config_cream_lsf_sl5.log][Configuration log file]]
---++++CREAM  PBS %GREEN% PASSED %ENDCOLOR%
   * [[%ATTACHURL%/task34043_install_cream_pbs_sl5.log][Installation log file]]
   * [[%ATTACHURL%/task34043_config_install_cream_pbs_sl5.log][Configuration log file]]

---+++ Upgrade Installation

---++++ CREAM LSF %GREEN% PASSED %ENDCOLOR%
   * [[%ATTACHURL%/task34043_update_cream_lsf_sl5.log][Update log file]]
   * [[%ATTACHURL%/task34043_config_update_cream_lsf_sl5.log][Configuration log file]]
---++++ CREAM PBS %GREEN% PASSED %ENDCOLOR%
   * [[%ATTACHURL%/task34043_update_cream_pbs_sl5.log][Update log file]]
   * [[%ATTACHURL%/task34043_conf_update_cream_pbs_sl5.log][Configuration log file]]


---++ Unit Tests

---++ System tests

---+++ Functionality tests

---++++ CREAM LSF %GREEN% PASSED %ENDCOLOR%
<verbatim>
$ /usr/bin/pybot  -e bdii -e glue -e job_man -e old_blah  -e outputdata -e lb /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmp821WvU.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
INFO: Non-mandatory variable "argus_root_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
33 critical tests, 33 passed, 0 failed
33 tests total, 33 passed, 0 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html
</verbatim>
   * Functionality tests [[%ATTACHURL%/task34043_functionality_cream_lsf_sl5.log][log file]]


---++++ CREAM PBS %GREEN% PASSED %ENDCOLOR%
<verbatim>
$ /usr/bin/pybot  -e bdii -e glue -e job_man -e old_blah -e en_dis_sub -e outputdata -e lb /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpXPN31E.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
32 critical tests, 32 passed, 0 failed
32 tests total, 32 passed, 0 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html
</verbatim>
   * Functionality tests [[%ATTACHURL%/functionality_cream_sl5_pbs.html.log][log file]]

<verbatim>
$ /usr/bin/pybot  -i en_dis_sub /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpFS3SlD.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html
</verbatim>
   * Enable-Disable submission test [[%ATTACHURL%enable-disable.html.log][log file]]

<verbatim>
$ /usr/bin/pybot  -i outputdata /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmp4BrkOb.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html
</verbatim>
   * Use of OutputData attribute test [[%ATTACHURL%outputdata.html.log][log file]]


---+++ Standard conformance tests

---++++ Glue 1 Compliance 
---+++++ LSF %GREEN% PASSED %ENDCOLOR%
   * <verbatim>glue-validator -t glue1 -h cream-20.pd.infn.it -p 2170 -b o=grid </verbatim> [[%ATTACHURL%/glue1_compliance_sl5_lsf.log][log]]

---+++++ PBS %GREEN% PASSED %ENDCOLOR%
   * <verbatim>glue-validator -t glue1 -h cream-06.pd.infn.it -p 2170 -b o=grid</verbatim> [[%ATTACHURL%/glue1_compliance_sl5_pbs.log][log]]

---++++ Glue 2 Compliance

---+++++ LSF %GREEN% PASSED %ENDCOLOR%
   * <verbatim>glue-validator -t glue2 -h cream-20.pd.infn.it -p 2170 -b o=glue </verbatim> [[%ATTACHURL%/glue2_compliance_sl5_lsf.log][log]]

---+++++ PBS %GREEN% PASSED %ENDCOLOR%
   * <verbatim>glue-validator -t glue2 -h cream-06.pd.infn.it -p 2170 -b o=glue </verbatim> [[%ATTACHURL%/glue2_compliance_sl5_pbs.log][log]]



---+++ Performance and scalability tests

   * <verbatim>./bin/cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -l log4py.conf -j jdl/testsandbox.jdl -R cream-20.pd.infn.it:8443/cream-lsf-cert</verbatim>
     [[%ATTACHURL%/cream-test-monitored-submit_cream-20.log][log file]]

---+++ Integration testing

Tests described:
   * [[https://twiki.cern.ch/twiki/bin/view/EMI/EmiJra1TaskForceIntegrationTesting][https://twiki.cern.ch/twiki/bin/view/EMI/EmiJra1TaskForceIntegrationTesting]]
      * test 2: [[https://wiki.italiangrid.it/twiki/bin/view/CEMon/CemonTestPlan#gJAF_and_ARGUS_authorization_tes]["CEMon to use Argus for authorization "]]
         * NA
      * test 3: "CREAM jobs executed under different backends is properly treated by APEL client "
         * PASSED - proven by functionality tests of different CREAM + LSF, TORQUE, SGE modules
      * test 16: [[https://wiki.italiangrid.it/twiki/bin/view/CREAM/CreamTestWorkPlan#Authz_test]["Do authorization filtering based on VOMS attributes and ARGUS authorization"]]
        * NA


-- Main.SaraBertocco - 2013-03-04
Attachments
Topic attachments
I	Attachment	Action	Size	Date	Who
log	cream-test-monitored-submit_cream-20.log	manage	843.5 K	2013-03-08 - 16:20	SaraBertocco
log	functionality_cream_sl5_pbs.html.log	manage	461.4 K	2013-03-06 - 11:21	SaraBertocco
log	glue1_compliance_sl5_lsf.log	manage	9.0 K	2013-03-11 - 17:15	SaraBertocco
log	glue1_compliance_sl5_pbs.log	manage	6.7 K	2013-03-11 - 17:15	SaraBertocco
log	glue2_compliance_sl5_lsf.log	manage	15.1 K	2013-03-11 - 17:15	SaraBertocco
log	glue2_compliance_sl5_pbs.log	manage	11.0 K	2013-03-11 - 17:15	SaraBertocco
txt	task34043_Certification_Report.txt	manage	3.0 K	2013-03-12 - 17:59	SaraBertocco
txt	task34043_Test_Report.txt	manage	8.2 K	2013-03-12 - 17:59	SaraBertocco
log	task34043_conf_update_cream_pbs_sl5.log	manage	14.7 K	2013-03-05 - 13:07	SaraBertocco
log	task34043_config_install_cream_lsf_sl5.log	manage	12.4 K	2013-03-07 - 16:40	SaraBertocco
log	task34043_config_install_cream_pbs_sl5.log	manage	15.7 K	2013-03-06 - 16:06	SaraBertocco
log	task34043_config_update_cream_lsf_sl5.log	manage	45.4 K	2013-03-08 - 15:38	SaraBertocco
log	task34043_config_update_cream_pbs_sl5.log	manage	17.5 K	2013-03-08 - 11:29	SaraBertocco
log	task34043_functionality_cream_lsf_sl5.log	manage	493.1 K	2013-03-05 - 15:45	SaraBertocco
log	task34043_install_config_cream_lsf_sl5.log	manage	12.5 K	2013-03-05 - 10:29	SaraBertocco
log	task34043_install_cream_lsf_sl5.log	manage	121.8 K	2013-03-07 - 16:41	SaraBertocco
log	task34043_install_cream_pbs_sl5.log	manage	139.4 K	2013-03-06 - 16:06	SaraBertocco
log	task34043_update_cream_lsf_sl5.log	manage	98.0 K	2013-03-08 - 15:38	SaraBertocco
log	task34043_update_cream_pbs_sl5.log	manage	32.0 K	2013-03-08 - 11:29	SaraBertocco
Topic revision: r12 - 2013-03-12 - SaraBertocco
Account
- Log In
Edit
Attach