Summary
- Product: CREAM v. 1.14.1
- Release Task: Task #31337
- ETICS Subsystem Configuration Name:
- VCS Tag: emi-cream-ce_R_1_14_2_3
- EMI Major Release: EMI 2 (Matterhorn)
- Platform: SL5 epel, SL6 epel
- Author: Sergio Traldi
- Testing report: Testing Report file
- Certification report: Certification Report file
- Outcome: "Certified*
Deployment tests
Clean Installation
CREAM PBS
CREAM LSF
Upgrade Installation
CREAM PBS
CREAM LSF
- SL5:
- [[][Update log file]]
- [[][Configuration log file]]
- SL6:
- [[][Update log file]]
- [[][Configuration log file]]
Unit Tests
http://etics-repository.cern.ch/repository/download/registered/emi/emi.cream-ce.cream-common/1.14.0/noarch/glite-ce-common-java-1.14.0-4-reports.tar.gz
System tests
Functionality tests
CREAM PBS
[traldi@cert-25 ~]$ pybot -e glue -e Job_man cream_test_suite.htmlINFO: The files of this testsuite will be stored under: /tmp/tmp6D7SPS.cream_testing/
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested: | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long! | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
34 critical tests, 34 passed, 0 failed
34 tests total, 34 passed, 0 failed
==============================================================================
Output: /home/traldi/output.xml
Log: /home/traldi/log.html
Report: /home/traldi/report.html
[traldi@cert-25 ~]$ pybot -e glue -e Job_man -e proxy_purge -e cpu_alloc cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpID5iS7.cream_testing/
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested: | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long! | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
27 critical tests, 27 passed, 0 failed
27 tests total, 27 passed, 0 failed
==============================================================================
Output: /home/traldi/output.xml
Log: /home/traldi/log.html
Report: /home/traldi/report.html
CREAM LSF
$ pybot -e glue -e Job_man /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpiKV_Y1.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested: | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'...
| PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long! | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
34 critical tests, 34 passed, 0 failed
34 tests total, 34 passed, 0 failed
==============================================================================
Output: /home/bertocco/mie_certificazioni/task31337/output.xml
Log: /home/bertocco/mie_certificazioni/task31337/log.html
Report: /home/bertocco/mie_certificazioni/task31337/report.html
Regression tests
Verification attached bugs for CREAM Torque
[root@cream-30 ~]# grep GLUE2PolicyRule /var/lib/bdii/gip/ldif/ComputingShare.ldif
GLUE2PolicyRule: VO:dteam
GLUE2PolicyRule: VO:testers.eu-emi.eu
GLUE2PolicyRule: VO:dteam
GLUE2PolicyRule: VO:testers.eu-emi.eu
GLUE2PolicyRule: wrong value
[root@cream-30 ~]# grep outputformat /etc/lrms/scheduler.conf
outputformat: both
[root@cream-30 ~]# /var/lib/bdii/gip/plugin/glite-info-dynamic-scheduler-wrapper
[root@cream-30 ~]#
On CE Host:
[root@cream-30 ~]# grep LRMS /etc/glite-ce-cream/cream-config.xml
<!-- The following parameter sets the sandbox transfer method (GSIFTP/LRMS)-->
<parameter name="SANDBOX_TRANSFER_METHOD" value="LRMS" />
<parameter name="LRMS_EVENT_LISTENER_PORT" value="49152"/>
[root@cream-30 ~]# service tomcat5 restart
Stopping tomcat5: [ OK ]
Starting tomcat5: [ OK ]
From UI:
[traldi@cert-25 ~]$ glite-wms-job-submit -e https://wms-multi.grid.cnaf.infn.it:7443/glite_wms_wmproxy_server -r cream-30.pd.infn.it:8443/cream-pbs-cert -a outputTest.jdl
Connecting to the service https://prod-wms-02.ct.infn.it:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://prod-wms-02.ct.infn.it:9000/03ZQrwN31II_d4p_Gsje3Q
==========================================================================
[traldi@cert-25 ~]$ glite-wms-job-status https://prod-wms-02.ct.infn.it:9000/03ZQrwN31II_d4p_Gsje3Q
/usr/lib64/python
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://prod-wms-02.ct.infn.it:9000/03ZQrwN31II_d4p_Gsje3Q
Current Status: Done (Success)
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: cream-30.pd.infn.it:8443/cream-pbs-cert
Submitted: Tue Aug 28 15:12:29 2012 CEST
==========================================================================
[traldi@cert-25 ~]$ glite-wms-job-output https://prod-wms-02.ct.infn.it:9000/03ZQrwN31II_d4p_Gsje3Q
Connecting to the service https://prod-wms-02.ct.infn.it:7443/glite_wms_wmproxy_server
================================================================================
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
https://prod-wms-02.ct.infn.it:9000/03ZQrwN31II_d4p_Gsje3Q
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/traldi_03ZQrwN31II_d4p_Gsje3Q
================================================================================
[traldi@cert-25 ~]$ cat /tmp/jobOutput/traldi_03ZQrwN31II_d4p_Gsje3Q/stdout
Test bug 95480
[root@cream-30 ~]# /usr/libexec/glite-ce-glue2-endpoint-static /etc/glite-ce-glue2/glite-ce-glue2.conf | grep GLUE2EndpointURL
GLUE2EndpointURL: https://cream-30.pd.infn.it:8443/ce-cream/services
From UI:
[traldi@cert-25 ~]$ glite-ce-job-submit -r cream-30.pd.infn.it:8443/cream-pbs-cert -a simple.jdl
https://cream-30.pd.infn.it:8443/CREAM382717553
[traldi@cert-25 ~]$ glite-ce-job-status https://cream-30.pd.infn.it:8443/CREAM382717553
****** JobID=[https://cream-30.pd.infn.it:8443/CREAM382717553]
Status = [DONE-OK]
ExitCode = [0]
From CE:
[root@cream-30 ~]# tail -10 /var/log/cream/accounting/blahp.log-20120829
"timestamp=2012-08-29 07:57:14" "userDN=/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sergio Traldi" "userFQAN=/dteam/Role=NULL/Capability=NULL" "userFQAN=/dteam/NGI_IT/Role=NULL/Capability=NULL" "ceID=cream-30.pd.infn.it:8443/cream-pbs-cert" "jobID=CREAM382717553" "lrmsID=112.cream-30.pd.infn.it" "localUser=18757" "clientID=cre30_382717553"
Verification old bugs for CREAM LSF
The files of this testsuite will be stored under: /tmp/tmploVIdF.cream_testing/
==========================================================================
Bug 95356 :: Regression test of bug #95356 Better parsing for static defini...
==========================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
bug_95356 | PASS |
Suite Teardown :: Restore original file on CREAM CE | PASS |
Bug 95356 :: Regression test of bug #95356 Better parsing for stat... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==========================================================================
Output: /home/bertocco/mie_certificazioni/task31337/italiangrid-cream_blah_testsuites-c80a30e/cream_regression_testsuite/tests/output.xml
Log: /home/bertocco/mie_certificazioni/task31337/italiangrid-cream_blah_testsuites-c80a30e/cream_regression_testsuite/tests/log.html
Report: /home/bertocco/mie_certificazioni/task31337/italiangrid-cream_blah_testsuites-c80a30e/cream_regression_testsuite/tests/report.html
On CE:
# grep SANDBOX_TRANSFER_METHOD /etc/glite-ce-cream/cream-config.xml
<parameter name="SANDBOX_TRANSFER_METHOD" value="LRMS" /># service tomcat5 restart
# service tomcat5 restart
Stopping tomcat5: [ OK ]
Starting tomcat5: [ OK ]
On UI:
$ cat bug95480.jdl
[
Type = "Job";
#VAR1 = "test1";
#VAR2 = "test2";
executable = "/bin/echo";
Arguments = "hello world!!!";
StdOutput="stdout";
StdError="stderr";
OutputSandbox = {"stdout","stderr"};
]
$ cat bug95480.conf
[
WmsClient = [
Requirements = (other.GlueCEInfoHostName == "cream-20.pd.infn.it");
#requirements = other.GlueCEStateStatus == "Production";
rank =-other.GlueCEStateEstimatedResponseTime ;
WMProxyEndPoints = {"https://wms01.grid.hep.ph.ic.ac.uk:7443/glite_wms_wmproxy_server"};
#WMProxyEndPoints = {"https://prod-wms-01.pd.infn.it:7443/glite_wms_wmproxy_server"};
VirtualOrganisation = "dteam";
MyProxyServer = "myproxy.cnaf.infn.it";
];
]
$ glite-wms-job-submit -a -c bug95480.conf -r cream-20.pd.infn.it:8443/cream-lsf-cert bug95480.jdl
Connecting to the service https://wms01.grid.hep.ph.ic.ac.uk:7443/glite_wms_wmproxy_server
====================== glite-wms-job-submit Success ======================
The job has been successfully submitted to the WMProxy
Your job identifier is:
https://wmslb01.grid.hep.ph.ic.ac.uk:9000/obrIyblaAuDh0yCbY7LgTQ
==========================================================================
$ glite-wms-job-status https://wmslb01.grid.hep.ph.ic.ac.uk:9000/obrIyblaAuDh0yCbY7LgTQ
======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:
Status info for the Job : https://wmslb01.grid.hep.ph.ic.ac.uk:9000/obrIyblaAuDh0yCbY7LgTQ
Current Status: Done (Success)
Logged Reason(s):
- job completed
- Job Terminated Successfully
Exit code: 0
Status Reason: Job Terminated Successfully
Destination: cream-20.pd.infn.it:8443/cream-lsf-cert
Submitted: Mon Aug 13 13:45:02 2012 CEST
==========================================================================
$ glite-wms-job-output https://wmslb01.grid.hep.ph.ic.ac.uk:9000/obrIyblaAuDh0yCbY7LgTQ
Connecting to the service https://wms01.grid.hep.ph.ic.ac.uk:7443/glite_wms_wmproxy_server
================================================================================
JOB GET OUTPUT OUTCOME
Output sandbox files for the job:
https://wmslb01.grid.hep.ph.ic.ac.uk:9000/obrIyblaAuDh0yCbY7LgTQ
have been successfully retrieved and stored in the directory:
/tmp/jobOutput/bertocco_obrIyblaAuDh0yCbY7LgTQ
================================================================================
$ cat /tmp/jobOutput/bertocco_obrIyblaAuDh0yCbY7LgTQ/stdout
hello world!!!
The files of this testsuite will be stored under: /tmp/tmpb2aXuu.cream_testing/
==============================================================================
Bug 95552 :: Regression test of bug #83338 endpointType (in GLUE2ServiceCom...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_95552 | PASS |
------------------------------------------------------------------------------
Bug 95552 :: Regression test of bug #83338 endpointType (in GLUE2S... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Output: /home/bertocco/mie_certificazioni/task31337/italiangrid-cream_blah_testsuites-c80a30e/cream_regression_testsuite/tests/output.xml
Log: /home/bertocco/mie_certificazioni/task31337/italiangrid-cream_blah_testsuites-c80a30e/cream_regression_testsuite/tests/log.html
Report: /home/bertocco/mie_certificazioni/task31337/italiangrid-cream_blah_testsuites-c80a30e/cream_regression_testsuite/tests/report.html
Standard Conformance Tests
Glue 1 Compliance
Result:
PASSED
Glue 2 Compliance
Result:
PASSED
Integration testing
Tests described: