Difference: EMI3CREAMIssue163SL5 (8 vs. 9)

Revision 92013-10-25 - SaraBertocco

Line: 1 to 1

META TOPICPARENT	name="Issue163"

Certification report jira RTC-ISSUE 163: CREAM TORQUE module v. 2.1.2 (EMI3)

Line: 26 to 26

EMI3 CREAM Torque Module SL5 update log .

Added:

>
>

System tests

Changed:

<
<

Unit Tests

>
>

Functionality tests WARNING

Changed:

<
<

>
>

[bertocco@cert-24 ~]$ pybot -e glue -e job_man -e auto_job_purge /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpthdUBG.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
Verify Job Status Output :: This test is checking the output of th... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Resource BDII :: Check if the resource bdii publishes all the rele... | PASS |
------------------------------------------------------------------------------
Logging and Bookkeeping :: Check if the logging and bookkeeping se... | PASS |
------------------------------------------------------------------------------
Old BLParser Restart :: Configure a CREAM CE using the old blah bl... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
36 critical tests, 36 passed, 0 failed
36 tests total, 36 passed, 0 failed
==============================================================================

Functionality testsuite log

The test "Automatic Job Purge" fails with the error "Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/log4j/Logger".

[bertocco@cert-24 ~]$ pybot -i auto_job_purge /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpRgRnQY.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Automatic Job Purge :: This test case is testing the functionality... | FAIL |
_error: JobDBAdminPurger non-zero return value detected! Check report file.
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | FAIL |
1 critical test, 0 passed, 1 failed
1 test total, 0 passed, 1 failed
==============================================================================

Automatic job purge log

To fix - it is needed to add to

/usr/sbin/JobDBAdminPurger.sh

the row:

classPath=${classPath}:/usr/share/java/log4j.jar

Testsuite run:

[bertocco@cert-24 ~]$ pybot -i auto_job_purge /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpq0P3yI.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html

Deleted:

<
<

System tests

Changed:

<
<

Functionality tests

>
>

Automatic job purge log

Changed:

<
<

Dynamic information test

>
>

Dynamic information test PASSED

Changed:

<
<

# /sbin/runuser -s /bin/sh ldap -c "/var/lib/bdii/gip/plugin/glite-info-dynamic-ce"

>
>

[root@cream-30 ~]# runuser -s /bin/bash -c /var/lib/bdii/gip/plugin/glite-info-dynamic-ce -- ldap dn: GlueCEUniqueID=cream-30.pd.infn.it:8443/cream-pbs-cert,mds-vo-name=resource,o=grid GlueCEInfoLRMSVersion: 2.5.7 GlueCEInfoTotalCPUs: 14 GlueCEPolicyAssignedJobSlots: 14 GlueCEStateFreeCPUs: 14 GlueCEPolicyMaxObtainableCPUTime: 2880 GlueCEPolicyMaxWallClockTime: 4320 GlueCEPolicyMaxObtainableWallClockTime: 4320 GlueCEStateStatus: Production

dn: GlueCEUniqueID=cream-30.pd.infn.it:8443/cream-pbs-creamtest1,mds-vo-name=resource,o=grid GlueCEInfoLRMSVersion: 2.5.7 GlueCEInfoTotalCPUs: 14 GlueCEPolicyAssignedJobSlots: 14 GlueCEStateFreeCPUs: 14 GlueCEPolicyMaxObtainableCPUTime: 2880 GlueCEPolicyMaxWallClockTime: 4320 GlueCEPolicyMaxObtainableWallClockTime: 4320 GlueCEStateStatus: Production

dn: GlueCEUniqueID=cream-30.pd.infn.it:8443/cream-pbs-creamtest2,mds-vo-name=resource,o=grid GlueCEInfoLRMSVersion: 2.5.7 GlueCEInfoTotalCPUs: 14 GlueCEPolicyAssignedJobSlots: 14 GlueCEStateFreeCPUs: 14 GlueCEPolicyMaxObtainableCPUTime: 2880 GlueCEPolicyMaxWallClockTime: 4320 GlueCEPolicyMaxObtainableWallClockTime: 4320 GlueCEStateStatus: Production

dn: GLUE2ManagerId=cream-30.pd.infn.it_ComputingElement_Manager,GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement,GLUE2GroupID=resource,o=glue GLUE2ManagerProductVersion: 2.5.7 GLUE2EntityCreationTime: 2013-10-25T08:25:29Z

dn: GLUE2ShareID=creamtest1_dteam_cream-30.pd.infn.it_ComputingElement,GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement,GLUE2GroupID=resource,o=glue GLUE2ComputingShareMaxCPUTime: 172800 GLUE2ComputingShareDefaultWallTime: 259200 GLUE2ComputingShareMaxWallTime: 259200 GLUE2ComputingShareServingState: production GLUE2EntityCreationTime: 2013-10-25T08:25:29Z

dn: GLUE2ShareID=cert_dteam_cream-30.pd.infn.it_ComputingElement,GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement,GLUE2GroupID=resource,o=glue GLUE2ComputingShareMaxCPUTime: 172800 GLUE2ComputingShareDefaultWallTime: 259200 GLUE2ComputingShareMaxWallTime: 259200 GLUE2ComputingShareServingState: production GLUE2EntityCreationTime: 2013-10-25T08:25:29Z

dn: GLUE2ShareID=creamtest1_testers.eu-emi.eu_cream-30.pd.infn.it_ComputingElement,GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement,GLUE2GroupID=resource,o=glue GLUE2ComputingShareMaxCPUTime: 172800 GLUE2ComputingShareDefaultWallTime: 259200 GLUE2ComputingShareMaxWallTime: 259200 GLUE2ComputingShareServingState: production GLUE2EntityCreationTime: 2013-10-25T08:25:29Z

dn: GLUE2ShareID=creamtest2_testers.eu-emi.eu_cream-30.pd.infn.it_ComputingElement,GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement,GLUE2GroupID=resource,o=glue GLUE2ComputingShareMaxCPUTime: 172800 GLUE2ComputingShareDefaultWallTime: 259200 GLUE2ComputingShareMaxWallTime: 259200 GLUE2ComputingShareServingState: production GLUE2EntityCreationTime: 2013-10-25T08:25:29Z

dn: GLUE2ShareID=creamtest2_dteam_cream-30.pd.infn.it_ComputingElement,GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement,GLUE2GroupID=resource,o=glue GLUE2ComputingShareMaxCPUTime: 172800 GLUE2ComputingShareDefaultWallTime: 259200 GLUE2ComputingShareMaxWallTime: 259200 GLUE2ComputingShareServingState: production GLUE2EntityCreationTime: 2013-10-25T08:25:29Z

Added:

>
>

Regression Tests

Issue CREAM-119 FIXED

Two nodes available with 7 CPUs per node:

[root@cream-30 ~]# pbsnodes
cream-wn-030.pn.pd.infn.it
     state = free
     np = 7
     properties = lcgpro
     ntype = cluster
     status = rectime=1382689319,varattr=,jobs=,state=free,netload=8515393750,gres=,loadave=0.00,ncpus=4,physmem=2979076kb,availmem=4545740kb,totmem=5076220kb,idletime=251994,nusers=1,nsessions=1,sessions=17908,uname=Linux cream-wn-030.pn.pd.infn.it 2.6.32-358.6.1.el6.x86_64 #1 SMP Tue Apr 23 16:15:13 CDT 2013 x86_64,opsys=linux
     gpus = 0

cream-wn-038.pn.pd.infn.it
     state = free
     np = 7
     properties = lcgpro
     ntype = cluster
     status = rectime=1382689310,varattr=,jobs=,state=free,netload=8504265010,gres=,loadave=0.00,ncpus=2,physmem=524288kb,availmem=2489524kb,totmem=2621432kb,idletime=243381,nusers=2,nsessions=2,sessions=6046 19153,uname=Linux cream-wn-038.pn.pd.infn.it 2.6.18-238.5.1.el5xen #1 SMP Tue Mar 1 19:22:01 EST 2011 x86_64,opsys=linux
     gpus = 0

[root@cream-30 ~]# runuser -s /bin/bash -c /var/lib/bdii/gip/plugin/glite-info-dynamic-ce -- ldap |grep GlueCEInfoTotalCPUs
GlueCEInfoTotalCPUs: 14
GlueCEInfoTotalCPUs: 14
GlueCEInfoTotalCPUs: 14

Added:

>
>

Setting a node as "down,offline":

Changed:

<
<

Other functionality tests

The functionality tests are performed in the cream testing environment. See here

>
>

[root@cream-30 ~]# qmgr -c 'set node cream-wn-038.pn.pd.infn.it state="down,offline"'
You have new mail in /var/spool/mail/root
[root@cream-30 ~]# pbsnodes
cream-wn-030.pn.pd.infn.it
     state = free
     np = 7
     properties = lcgpro
     ntype = cluster
     status = rectime=1382689093,varattr=,jobs=,state=free,netload=8515298529,gres=,loadave=0.00,ncpus=4,physmem=2979076kb,availmem=4545740kb,totmem=5076220kb,idletime=251769,nusers=1,nsessions=1,sessions=17908,uname=Linux cream-wn-030.pn.pd.infn.it 2.6.32-358.6.1.el6.x86_64 #1 SMP Tue Apr 23 16:15:13 CDT 2013 x86_64,opsys=linux
     gpus = 0

cream-wn-038.pn.pd.infn.it
     state = down,offline
     np = 7
     properties = lcgpro
     ntype = cluster
     status = rectime=1382689088,varattr=,jobs=,state=free,netload=8504174892,gres=,loadave=0.00,ncpus=2,physmem=524288kb,availmem=2489520kb,totmem=2621432kb,idletime=243156,nusers=2,nsessions=2,sessions=6046 19153,uname=Linux cream-wn-038.pn.pd.infn.it 2.6.18-238.5.1.el5xen #1 SMP Tue Mar 1 19:22:01 EST 2011 x86_64,opsys=linux
     gpus = 0

[root@cream-30 ~]# runuser -s /bin/bash -c /var/lib/bdii/gip/plugin/glite-info-dynamic-ce -- ldap |grep GlueCEInfoTotalCPUs
GlueCEInfoTotalCPUs: 7
GlueCEInfoTotalCPUs: 7
GlueCEInfoTotalCPUs: 7

Added:

>
>

Glue compliance tests PASSED

****************************** GLUE2

[bertocco@cert-24 ~]$ glue-validator  -H cream-30.pd.infn.it -p 2170 -b o=glue -s general -g glue2 -v 3
WARNING - errors 0, warnings 1, info 0 | errors=0;warnings=1;info=0

Added:

>
>

W037 Description: Wrong type W037 Affected DN: GLUE2EndpointID=cream-30.pd.infn.it_ComputingElement_org.glite.ce.ApplicationPublisher_1068561884 GLUE2ServiceID=cream-30.pd.infn.it_ComputingElement GLUE2GroupID=resource o=glue W037 Affected attribute: GLUE2EndpointInterfaceName W037 Published value: ['org.glite.ce.ApplicationPublisher'] W037 Additional information: Expected type is InterfaceName_t

**************************** GLUE1

[bertocco@cert-24 ~]$ glue-validator -H cert-42.pd.infn.it -p 2170 -b o=grid -s general -g glue1 -v 3 WARNING - errors 0, warnings 1, info 0 | errors=0;warnings=1;info=0

W037 Description: Wrong type W037 Affected DN: GlueServiceUniqueID=cert-42.pd.infn.it_org.glite.ce.CREAM_2101787807 Mds-Vo-name=resource o=grid W037 Affected attribute: GlueServiceStartTime W037 Published value: ['1970-01-01T01:00:00+01:00'] W037 Additional information: Expected type is DateTime_t

-- SaraBertocco - 2013-10-18

META FILEATTACHMENT	attachment="test.txt" attr="" comment="" date="1382616004" name="test.txt" path="test.txt" size="19" user="SaraBertocco" version="2"
META FILEATTACHMENT	attachment="EMI3_SL5-64_CREAM_Torque_updateonly.html.log" attr="" comment="" date="1382607801" name="EMI3_SL5-64_CREAM_Torque_updateonly.html.log" path="EMI3_SL5-64_CREAM_Torque_updateonly.html.log" size="417942" user="SaraBertocco" version="1"
META FILEATTACHMENT	attachment="EMI3_SL5-64_CREAM_Torque_update.log" attr="" comment="" date="1382615890" name="EMI3_SL5-64_CREAM_Torque_update.log" path="EMI3_SL5-64_CREAM_Torque_update.log" size="4276" user="SaraBertocco" version="1"

Added:

>
>

META FILEATTACHMENT	attachment="EMI3_SL5-64_CREAM_Torque_update.log.txt" attr="" comment="" date="1382690879" name="EMI3_SL5-64_CREAM_Torque_update.log.txt" path="EMI3_SL5-64_CREAM_Torque_update.log.txt" size="4276" user="SaraBertocco" version="1"
META FILEATTACHMENT	attachment="EMI3_SL5-64_CREAM_Torque_gjaf_functionality.html.log" attr="" comment="" date="1382690879" name="EMI3_SL5-64_CREAM_Torque_gjaf_functionality.html.log" path="EMI3_SL5-64_CREAM_Torque_gjaf_functionality.html.log" size="417942" user="SaraBertocco" version="1"
META FILEATTACHMENT	attachment="automatic_job_purge.html.log" attr="" comment="" date="1382691704" name="automatic_job_purge.html.log" path="automatic_job_purge.html.log" size="200006" user="SaraBertocco" version="1"
META FILEATTACHMENT	attachment="automatic_job_purge_OK.html.log" attr="" comment="" date="1382691876" name="automatic_job_purge_OK.html.log" path="automatic_job_purge_OK.html.log" size="201075" user="SaraBertocco" version="1"

META PREFERENCE	name="ALLOWWEBCHANGE" title="ALLOWWEBCHANGE" type="Set" value="SaraBertocco"

View topic | History: r10 < r9 < r8 < r7 | More topic actions...