Tags:
, view all tags

Testing report: IGIRTC-125

Summary

  • Product: CREAM v. 1.14.3
  • Release Task: Task #38531
  • ETICS Subsystem Configuration Name:
  • VCS Tag:
  • EMI Major Release: EMI 2 (Matterhorn)
  • Platform: SL5 epel
  • Author: Sara Bertocco
  • Testing report: [[][Testing Report file]]
  • Certification report: [[][Certification Report file]]
  • Outcome: "In Certification*

Deployment tests

Clean Installation

CREAM PBS

CREAM LSF

Upgrade Installation

CREAM PBS

CREAM LSF

Unit Tests

System tests

The tests are performed with two different user interfaces:

  • tests of CREAM PBS use UI EMI version 1.11.0-1
  • tests of CREAM LSF use UI EMI version 2.5.1-1

this is the reason why the test "Verify Job Status Output" fails in the lsf version: it is a UI problem.

Authentication using ARGUS in PBS.

  • Test "bdii" and "glue" are covered in compliance tests
  • Test "job_man" is excluded because it requires two proxy certificates and the certifier has one only
  • Test "ban user" is failing in pbs because it is not correctly running in argus. The test does in the argus server:
          #  pap-admin un-ban subject "/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco"
          # /etc/init.d/argus-pepd clearcache
          # /etc/init.d/argus-pdp reloadpolicy
         
    then it tryes a job-submission and it shoul fail, instead it is successful.
  • Test 'old_blah' is excluded because a ssh communication error between ce and ui.

Functionality tests

CREAM PBS

$  pybot  -e bdii -e glue -e job_man -e old_blah /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmp1mUltH.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
INFO: Non-mandatory variable "argus_root_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | FAIL |
Expected error '*' did not occur
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Logging and Bookkeeping :: Check if the logging and bookkeeping se... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | FAIL |
35 critical tests, 34 passed, 1 failed
35 tests total, 34 passed, 1 failed
==============================================================================

  • Functionality testsuite log

CREAM LSF

$ pybot  -e bdii -e glue -e job_man -e old_blah  /opt/cream_test/testsuite/cream_test_suite.html 
INFO: The files of this testsuite will be stored under: /tmp/tmppeeI65.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | FAIL |
'['https://cream-48.pd.infn.it:8443/CREAM028512789', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM053966155', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM070498673', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM073852060', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM075843685', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM076595960', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM176232679', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM185807557', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM196640844', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM220465714', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM223251516', 'DONE-FAILED', 'https://cream-48.pd.infn.it:8443/CREAM262719768', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM388041650', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM389904579', 'DONE-FAILED', 'https://cream-48.pd.infn.it:8443/CREAM391059930', 'DONE-FAILED', 'https://cream-48.pd.infn.it:8443/CREAM419080879', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM487916505', 'DONE-FAILED', 'https://cream-48.pd.infn.it:8443/CREAM499449716', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM509540273', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM521766039', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM541142479', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM542406292', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM571261194', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM665174716', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM667593577', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM691800694', 'ABORTED', 'https://cream-48.pd.infn.it:8443/CREAM733263594', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM745902414', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM763317264', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM775305199', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM798608571', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM801128435', 'CANCELLED', 'https://cream-48.pd.infn.it:8443/CREAM815325178', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM850827111', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM860601078', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM864851068', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM878965713', 'DONE-OK', 'https://cream-48.pd.infn.it:8443/CREAM899266586', 'DONE-OK']' does not contain 'https://cream-48.pd.infn.it:8443/CREAM272488513'
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Logging and Bookkeeping :: Check if the logging and bookkeeping se... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | FAIL |
35 critical tests, 34 passed, 1 failed
35 tests total, 34 passed, 1 failed
==============================================================================

  • Functionality testsuite log

Regression tests

Verification attached bugs for CREAM Torque

Bug #99747: glite-info-dynamic-ce does not update GLUE2ComputingShareServingState FIXED
* From UI
$ glite-ce-enable-submission cream-06.pd.infn.it:8443
Operation for enabling new submissions succeeded
  • On CE
# /sbin/runuser -s /bin/sh ldap -c "/var/lib/bdii/gip/plugin/glite-info-cream-glue2" |grep ServingState
GLUE2EndpointServingState: production
* From UI
$ glite-ce-disable-submission cream-06.pd.infn.it:8443
Operation for disabling new submissions succeeded
  • On CE
# /sbin/runuser -s /bin/sh ldap -c "/var/lib/bdii/gip/plugin/glite-info-cream-glue2" |grep ServingState
GLUE2EndpointServingState: draining

Verification attached bugs for CREAM LSF

Bug #99747: glite-info-dynamic-ce does not update GLUE2ComputingShareServingState FIXED
  • From UI
$ glite-ce-disable-submission cream-48.pd.infn.it:8443
Operation for disabling new submissions succeeded
  • On CE
# /sbin/runuser -s /bin/sh ldap -c "/var/lib/bdii/gip/plugin/glite-info-cream-glue2" |grep ServingState
GLUE2EndpointServingState: draining
* From UI
$ glite-ce-enable-submission cream-48.pd.infn.it:8443
Operation for enabling new submissions succeeded
  • On CE
# /sbin/runuser -s /bin/sh ldap -c "/var/lib/bdii/gip/plugin/glite-info-cream-glue2" |grep ServingState
GLUE2EndpointServingState: production

Standard conformance tests

Glue 1 Compliance

  • glue-validator -t glue1 -h cert-41.pd.infn.it -p 2170 -b o=grid 
    log

Glue 2 Compliance

Performance and scalability tests

Integration testing

Tests described:

-- SaraBertocco - 2013-02-01

Edit | Attach | PDF | History: r12 | r10 < r9 < r8 < r7 | Backlinks | Raw View | More topic actions...
Topic revision: r8 - 2013-02-08 - SergioTraldi
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback