Tags:
, view all tags

Testing report: IGIRTC-159

Summary

  • Product: CREAM v. 1.16.2
  • Release Task: CREAM 1.16.2
  • EMI Major Release: EMI 3 (Monte Bianco)
  • Platform: SL5 epel
  • Outcome: "In Certification*

Deployment tests

Upgrade Installation

CREAM PBS

upgrade from EM2 to EM3
upgrade from EM3 production to EM3 in testing

CREAM LSF

upgrade from EM3 production to EM3 in testing
    • Update and configuration log file

Unit Tests

System tests

Functionality tests

CREAM PBS GJAF

[traldi@cert-16 ~]$ pybot -e glue -e lb /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpbaW5T2.cream_testing/
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Admin Manage Job :: This test case checks whether a user can manag... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Resource BDII :: Check if the resource bdii publishes all the rele... | PASS |
------------------------------------------------------------------------------
Old BLParser Restart :: Configure a CREAM CE using the old blah bl... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
37 critical tests, 37 passed, 0 failed
37 tests total, 37 passed, 0 failed
==============================================================================
Output:  /home/traldi/output.xml
Log:     /home/traldi/log.html
Report:  /home/traldi/report.html

  • Functionality testsuite loglog

CREAM PBS ARGUS

[traldi@cert-16 ~]$ pybot -e glue -e lb /opt/cream_test/testsuite/cream_test_suite.htmlINFO: The files of this testsuite will be stored under: /tmp/tmpD0jX37.cream_testing/
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Admin Manage Job :: This test case checks whether a user can manag... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Resource BDII :: Check if the resource bdii publishes all the rele... | PASS |
------------------------------------------------------------------------------
Old BLParser Restart :: Configure a CREAM CE using the old blah bl... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
37 critical tests, 37 passed, 0 failed
37 tests total, 37 passed, 0 failed
==============================================================================
Output:  /home/traldi/output.xml
Log:     /home/traldi/log.html
Report:  /home/traldi/report.html
  • Functionality testsuite loglog

CREAM LSF

The test "Automatic Job Purge" fails with the error "Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/log4j/Logger".

$ /usr/bin/pybot -i auto_job_purge /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpk2GhTW.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Automatic Job Purge :: This test case is testing the functionality... | FAIL |
_error: JobDBAdminPurger non-zero return value detected! Check report file.
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | FAIL |
1 critical test, 0 passed, 1 failed
1 test total, 0 passed, 1 failed
==============================================================================

  • Automatic job purge log

To fix it it is needed to add to

/usr/sbin/JobDBAdminPurger.sh
the row:
classPath=${classPath}:/usr/share/java/log4j.jar

Regression tests

Verification attached bug for WMS/UI - issue CREAM-125 FIXED

  • regression done on prod-wms-01.pd.infn.it (WMS & prod-ui-02.pd.infn.it (UI) - see LOG for details

Verification attached bugs for CREAM Torque

issue CREAM-111

Verification attached bugs for CREAM LSF

issue CREAM-111

Standard conformance tests

Glue 1 Compliance LSF

  • glue-validator -t glue1 -h cert-41.pd.infn.it -p 2170 -b o=grid 
    log

Glue 1 Compliance PBS OK

  • [traldi@cert-16 ~]$  glue-validator -H cream-30.pd.infn.it -p 2170 -b o=grid -s general -g glue1 -v 3
    OK - errors 0, warnings 0, info 0 | errors=0;warnings=0;info=0
    

Glue 2 Compliance PBS

  • [traldi@cert-16 ~]$  glue-validator -H cream-30.pd.infn.it -p 2170 -b o=glue -s general -g glue2 -v 3
    WARNING - errors 0, warnings 6, info 0 | errors=0;warnings=6;info=0
     
    W037 Description: Wrong type
    W037 Affected DN: GLUE2ShareID=creamtest1_testers.eu-emi.eu_cream-30.pd.infn.it_ComputingElement
                      GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement
                      GLUE2GroupID=resource
                      o=glue
    W037 Affected attribute: GLUE2ComputingShareServingState
    W037 Published value: ['testing'] 
    W037 Additional information: Expected type is ServingState_t
    
     
    W037 Description: Wrong type
    W037 Affected DN: GLUE2ShareID=creamtest2_dteam_cream-30.pd.infn.it_ComputingElement
                      GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement
                      GLUE2GroupID=resource
                      o=glue
    W037 Affected attribute: GLUE2ComputingShareServingState
    W037 Published value: ['testing'] 
    W037 Additional information: Expected type is ServingState_t
    
     
    W037 Description: Wrong type
    W037 Affected DN: GLUE2ShareID=creamtest1_dteam_cream-30.pd.infn.it_ComputingElement
                      GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement
                      GLUE2GroupID=resource
                      o=glue
    W037 Affected attribute: GLUE2ComputingShareServingState
    W037 Published value: ['testing'] 
    W037 Additional information: Expected type is ServingState_t
    
     
    W037 Description: Wrong type
    W037 Affected DN: GLUE2ShareID=cert_dteam_cream-30.pd.infn.it_ComputingElement
                      GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement
                      GLUE2GroupID=resource
                      o=glue
    W037 Affected attribute: GLUE2ComputingShareServingState
    W037 Published value: ['testing'] 
    W037 Additional information: Expected type is ServingState_t
    
     
    W037 Description: Wrong type
    W037 Affected DN: GLUE2ShareID=creamtest2_testers.eu-emi.eu_cream-30.pd.infn.it_ComputingElement
                      GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement
                      GLUE2GroupID=resource
                      o=glue
    W037 Affected attribute: GLUE2ComputingShareServingState
    W037 Published value: ['testing'] 
    W037 Additional information: Expected type is ServingState_t
    
     
    W037 Description: Wrong type
    W037 Affected DN: GLUE2EndpointID=cream-30.pd.infn.it_ComputingElement_org.glite.ce.ApplicationPublisher_1068561884
                      GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement
                      GLUE2GroupID=resource
                      o=glue
    W037 Affected attribute: GLUE2EndpointInterfaceName
    W037 Published value: ['org.glite.ce.ApplicationPublisher'] 
    W037 Additional information: Expected type is InterfaceName_t
    

Performance and scalability tests

Integration testing

Topic attachments
I AttachmentSorted descending Action Size Date Who Comment
Unknown file formatlog update_cream_SL5_X86_64_lsf_cert.txt.log manage 20.3 K 2013-09-25 - 15:12 SaraBertocco  
Texttxt fix_CREAM_125.txt manage 8.7 K 2013-10-07 - 07:26 CristinaAiftimiei regression CREAM-125
Unknown file formatlog automatic_job_purge.html.log manage 195.4 K 2013-10-04 - 12:52 SaraBertocco  
Edit | Attach | PDF | History: r15 | r12 < r11 < r10 < r9 | Backlinks | Raw View | More topic actions...
Topic revision: r10 - 2013-10-08 - SergioTraldi
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback