EMI2CREAMTask34089SL6 < IGIRelease

Tags: , view all tags
---+ Testing report (SL6): [[http://issues.cnaf.infn.it/browse/IGIRTC-120][IGIRTC-120]]

%TOC%

---++ Summary

   * Product: *CREAM v. 1.14.2*
   * Release Task: [[https://savannah.cern.ch/task/?34089][Task #34089]]
   * ETICS Subsystem Configuration Name: emi-cream-ce_R_1_14_3_8, emi-lrms-utils_R_2_0_2_3
   * VCS Tag: emi-yaim-cream_R_4_3_1_4, emi-cream-common_R_1_14_1_1, emi-cream_R_1_14_2_1, emi-cemonitor-api-java_R_1_14_0_4, emi-cemonitor_R_1_14_0_4,  emi-cream-interface_R_1_14_1_1, emi-cream-es_R_1_14_2_1, emi-cream-utils_R_1_2_2_1, emi-cream-api-java_R_1_14_2_1
   * EMI Major Release: *EMI 2 (Matterhorn)*
   * Platform: *SL6*
   * Author: Sara Bertocco
   * Outcome: %GREEN% "In Certification* %ENDCOLOR%


---++ Deployment tests

---+++ Clean Installation

---++++CREAM  PBS 
      * [[%ATTACHURL%/CREAM_SL6_PBS_install_yum.log][Installation log file]]
      * [[%ATTACHURL%/CREAM_SL6_PBS_install_yaim.log][Configuration log file]] 

---+++ Upgrade Installation

---++++ CREAM LSF
      * [[%ATTACHURL%/CREAM_SL6_LSF_update_yum.log][Update log file]]
      * [[%ATTACHURL%/SL6_yaim_update.log][Configuration log file]]

---++ Unit Tests

Available [[http://etics-repository.cern.ch/repository/download/registered/emi/emi.cream-ce.cream-common/1.14.1/noarch/glite-ce-common-java-1.14.1-1-reports.tar.gz][here]]

---++ System tests

---+++ Functionality tests

---++++ CREAM PBS
<verbatim>
$ pybot -e job_man -e cpu_alloc -e glue -e ban -e bdii -e lb -e old_blah -e status /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpZ0hzDT.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
INFO: Non-mandatory variable "argus_root_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | FAIL |
'[]' should not be empty
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | FAIL |
26 critical tests, 25 passed, 1 failed
26 tests total, 25 passed, 1 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html
</verbatim>
   * [[%ATTACHURL%/log0.html.log][log.html]]

Output data test fails because an error in testsuite configuration (lcg_gfal_infosys="" in vars.py)

---++++ CREAM LSF
<verbatim>
 pybot -e job_man -e cpu_alloc -e glue -e ban -e bdii -e lb -e old_blah -e status /opt/cream_test/testsuite/cream_test_suite.html
INFO: The files of this testsuite will be stored under: /tmp/tmpryBt_X.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
------------------------------------------------------------------------------
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
------------------------------------------------------------------------------
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
------------------------------------------------------------------------------
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
------------------------------------------------------------------------------
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
------------------------------------------------------------------------------
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
------------------------------------------------------------------------------
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
------------------------------------------------------------------------------
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
------------------------------------------------------------------------------
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
------------------------------------------------------------------------------
Job Cancel :: Test job cancellation.Two cases are tested:             | PASS |
------------------------------------------------------------------------------
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
------------------------------------------------------------------------------
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
------------------------------------------------------------------------------
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
------------------------------------------------------------------------------
Verify CE service info :: This test case verifies the output of th... | PASS |
------------------------------------------------------------------------------
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
------------------------------------------------------------------------------
Job Purge :: This test case verifies the proper functionality of t... | PASS |
------------------------------------------------------------------------------
Limiter :: NOTE: This test case is about 25 minutes long!             | PASS |
------------------------------------------------------------------------------
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
------------------------------------------------------------------------------
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
------------------------------------------------------------------------------
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
------------------------------------------------------------------------------
Automatic Job Purge :: This test case is testing the functionality... | PASS |
------------------------------------------------------------------------------
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
26 critical tests, 26 passed, 0 failed
26 tests total, 26 passed, 0 failed
==============================================================================
Output:  /home/bertocco/.ssh/output.xml
Log:     /home/bertocco/.ssh/log.html
Report:  /home/bertocco/.ssh/report.html
</verbatim>

   * [[%ATTACHURL%/functionalitySL6_LSF.html.log][log.html]]

<verbatim>
$ pybot -i ban /opt/cream_test/testsuite/cream_test_suite.html  
INFO: The files of this testsuite will be stored under: /tmp/tmpwdRNS1.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Ban User :: This test case tests if the banning of user works. The... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  /home/bertocco/.ssh/output.xml
Log:     /home/bertocco/.ssh/log.html
Report:  /home/bertocco/.ssh/report.html
</verbatim>
   * [[%ATTACHURL%/ban.html.log][log.html]]

<verbatim>
$ pybot -i cpu_alloc /opt/cream_test/testsuite/cream_test_suite.html  
INFO: The files of this testsuite will be stored under: /tmp/tmpAMdB1O.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
6 critical tests, 6 passed, 0 failed
6 tests total, 6 passed, 0 failed
==============================================================================
Output:  /home/bertocco/.ssh/output.xml
Log:     /home/bertocco/.ssh/log.html
Report:  /home/bertocco/.ssh/report.html
</verbatim>
   * [[%ATTACHURL%/cpu_alloc.html.log][log.html]]

<verbatim>
$ pybot -i lb /opt/cream_test/testsuite/cream_test_suite.html  
INFO: The files of this testsuite will be stored under: /tmp/tmpBFbw5R.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Logging and Bookkeeping :: Check if the logging and bookkeeping se... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html
</verbatim>
   * [[%ATTACHURL%/lb.html.log][log.html]]

<verbatim>
$ pybot -i old_blah /opt/cream_test/testsuite/cream_test_suite.html  
INFO: The files of this testsuite will be stored under: /tmp/tmpoyqIJS.cream_testing/
INFO: Non-mandatory variable "sec_cert" has not been set.
INFO: Non-mandatory variable "sec_key" has not been set.
INFO: Non-mandatory variable "argus_host" has not been set.
INFO: Non-mandatory variable "sec_proxy_pass" has not been set.
==============================================================================
Cream Test Suite :: This is the main testing module,needed for testing the ...
==============================================================================
Old BLParser Restart :: Configure a CREAM CE using the old blah bl... | PASS |
------------------------------------------------------------------------------
Cream Test Suite :: This is the main testing module,needed for tes... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output:  /home/bertocco/output.xml
Log:     /home/bertocco/log.html
Report:  /home/bertocco/report.html
</verbatim>
   * [[%ATTACHURL%/old_blah.html.log][log.html]]

Excluded tests:
   * job_man (Admin Manage Job) is excluded because it requires 2 user proxies and the certifier has one only.
   * bdii is excluded because some problem in the testsuite
   * glue is excluded because some not relevant error
 


---+++ Regression tests

---++++ Verification attached bugs for CREAM Torque

---+++++ [[https://savannah.cern.ch/bugs/index.php?97441][Bug #97441: CREAM: Unwanted auto-updating of the field "creationTime" on the creamdb database]] %GREEN% FIXED %ENDCOLOR%

---++++  Verification attached bugs for CREAM LSF

---+++++ [[https://savannah.cern.ch/bugs/index.php?97441][Bug #97441: CREAM: Unwanted auto-updating of the field "creationTime" on the creamdb database  ]] %GREEN% FIXED %ENDCOLOR%

<verbatim>
# mysql -u creminio -p creamdb
Enter password: 
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 19058
Server version: 5.1.66 Source distribution

Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> select startUpTime, creationTime from db_info;
+---------------------+---------------------+
| startUpTime         | creationTime        |
+---------------------+---------------------+
| 2012-12-05 12:18:42 | 2012-11-30 16:40:35 |
+---------------------+---------------------+
1 row in set (0.00 sec)

mysql> exit

# /opt/glite/yaim/bin/yaim -c -s /root/siteinfo/site-info.def -n creamCE -n LSF_utils
...
# mysql -u creminio -p creamdb
....
mysql> select startUpTime, creationTime from db_info;
+---------------------+---------------------+
| startUpTime         | creationTime        |
+---------------------+---------------------+
| 2012-12-05 13:54:15 | 2012-11-30 16:40:35 |
+---------------------+---------------------+
1 row in set (0.00 sec)
</verbatim>

---+++++ [[https://savannah.cern.ch/bugs/index.php?96310][Bug #96310 Wrong lowercase conversion for Glue-1 VO Tags]] %GREEN% FIXED %ENDCOLOR%
<verbatim>
# cat /opt/glite/var/info/cert-41.pd.infn.it/dteam/dteam.list
RMON3.1 
RMon3.1
[root@cert-41 ~]# cat /opt/edg/var/info/dteam/dteam.list
RMON3.1 
RMon3.1
[root@cert-41 ~]# grep GlueHostApplicationSoftwareRunTimeEnvironment: /var/lib/bdii/gip/ldif/static-file-Cluster.ldif
GlueHostApplicationSoftwareRunTimeEnvironment: LCG-2
GlueHostApplicationSoftwareRunTimeEnvironment: LCG-2_1_0
GlueHostApplicationSoftwareRunTimeEnvironment: LCG-2_1_1
GlueHostApplicationSoftwareRunTimeEnvironment: LCG-2_2_0
GlueHostApplicationSoftwareRunTimeEnvironment: LCG-2_3_0
GlueHostApplicationSoftwareRunTimeEnvironment: LCG-2_3_1
GlueHostApplicationSoftwareRunTimeEnvironment: LCG-2_4_0
GlueHostApplicationSoftwareRunTimeEnvironment: LCG-2_5_0
GlueHostApplicationSoftwareRunTimeEnvironment: LCG-2_6_0
GlueHostApplicationSoftwareRunTimeEnvironment: LCG-2_7_0
GlueHostApplicationSoftwareRunTimeEnvironment: GLITE-3_0_0
GlueHostApplicationSoftwareRunTimeEnvironment: GLITE-3_1_0
GlueHostApplicationSoftwareRunTimeEnvironment: R-GMA
GlueHostApplicationSoftwareRunTimeEnvironment: PADOVA
GlueHostApplicationSoftwareRunTimeEnvironment: SI00MeanPerCPU_870
GlueHostApplicationSoftwareRunTimeEnvironment: SF00MeanPerCPU_790
GlueHostApplicationSoftwareRunTimeEnvironment: MPICH
GlueHostApplicationSoftwareRunTimeEnvironment: MPI_HOME_NOTSHARED
GlueHostApplicationSoftwareRunTimeEnvironment: MPIch

</verbatim>

---+++++ [[https://savannah.cern.ch/bugs/index.php?95973][Bug #95973 Missing Glue capability in GLUE2EntityOtherInfo]] %GREEN% FIXED %ENDCOLOR%
<verbatim>
# grep CE_CAPABILITY /opt/nfs_install/jra1_test/cert-41/services/glite-creamce
#CE_CAPABILITY="CPUScalingReferenceSI00=10"
CE_CAPABILITY="CPUScalingReferenceSI00=10 SNMPSupport=yes"

# ldapsearch -h cream-48.pd.infn.it -x -p 2170 -b "o=glue" | grep GLUE2EntityOtherInfo |grep CPUScalingReference
GLUE2EntityOtherInfo: CPUScalingReferenceSI00=10
# ldapsearch -h cream-48.pd.infn.it -x -p 2170 -b "o=glue" | grep GLUE2EntityOtherInfo |grep SNMPSupport
GLUE2EntityOtherInfo: SNMPSupport=yes

</verbatim>

---+++++ [[https://savannah.cern.ch/bugs/index.php?97106][Bug #97106 CREAM JW - fatal_error: command not found.]] %GREEN% FIXED %ENDCOLOR%
In all cluster WNs <verbatim>mv /usr/bin/glite-lb-logevent /usr/bin/glite-lb-logevent.save</verbatim>
<verbatim>
UI: 
for ((i=0;i<20;i++)); do
glite-ce-job-submit -d -r cert-41.pd.infn.it:8443/cream-lsf-cert -a /home/bertocco/jdl/env.jdl;
done
...
https://cert-41.pd.infn.it:8443/CREAM620962289
...
WN:
# cat /home/dteam043/err_crt41_620962289_StandardError
Cannot find lb_logevent command
</verbatim>

---+++++ [[https://savannah.cern.ch/bugs/index.php?94418][Bug #94418The SIGTERM signal should be issued to all the processes belonging to the job.]] %GREEN% FIXED %ENDCOLOR%
<verbatim>
### On CE:
# ls -l /tmp/test_bug94418.sh
-rw-r--r-- 1 dteam043 dteam 378 Dec  5 16:14 /tmp/test_bug94418.sh

# cat /tmp/test_bug94418.sh
#!/bin/bash                                                                                

OUTF="/tmp/sdpgu.out"

MYPID=$$

sleep 3600 & PID1=$!

sleep 3600 & PID2=$!
echo "MYPID=${MYPID}, PID1=${PID1}, PID2=${PID2}" > $OUTF
echo "MYPID=${MYPID}, PID1=${PID1}, PID2=${PID2}"
# supposedly this should kill the child processes on SIGTERM.
trap "kill $PID1 $PID2" SIGTERM

wait

### On UI:
$ cat test_bug94418.jdl
[
   Type = "job";
   JobType = "normal";
   VirtualOrganisation = "dteam";
   executable="test_bug94418.sh";
   InputSandbox = {"test_bug94418.sh"};
   InputSandboxBaseURI = "gsiftp://cert-41.pd.infn.it/tmp"
]

$ glite-ce-job-submit -d -r cert-41.pd.infn.it:8443/cream-lsf-cert -a test_bug94418.jdl
2012-12-05 16:14:42,031 DEBUG - Using certificate proxy file [/tmp/x509up_u33337]
2012-12-05 16:14:42,053 DEBUG - VO from certificate=[dteam]
2012-12-05 16:14:42,053 WARN - No configuration file suitable for loading. Using built-in configuration
2012-12-05 16:14:42,053 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20121205-161442.log]
2012-12-05 16:14:42,054 WARN - VirtualOrganisation specified in the JDL but overrided with [dteam]
2012-12-05 16:14:42,054 DEBUG - Processing file [test_bug94418.sh]...
2012-12-05 16:14:42,054 DEBUG - Inserting mangled InputSandbox in JDL: [{"test_bug94418.sh"}]...
2012-12-05 16:14:42,058 INFO - certUtil::generateUniqueID() - Generated DelegationID: [d9f07700a29f54c52719e5ac3ecab517eec47cb6]
2012-12-05 16:14:44,243 DEBUG - Registering to [https://cert-41.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ BatchSystem = "lsf"; QueueName = "cert"; executable = "test_bug94418.sh"; Type = "job"; VirtualOrganisation = "dteam"; JobType = "normal"; InputSandbox = { "test_bug94418.sh" }; InputSandboxBaseURI = "gsiftp://cert-41.pd.infn.it/tmp" ] - JDL File=[test_bug94418.jdl]
2012-12-05 16:14:45,050 DEBUG - Will invoke JobStart for JobID [CREAM398838952]
https://cert-41.pd.infn.it:8443/CREAM398838952

$ glite-ce-job-status https://cert-41.pd.infn.it:8443/CREAM398838952

******  JobID=[https://cert-41.pd.infn.it:8443/CREAM398838952]
	Status        = [REALLY-RUNNING]

### On WN:

$ cat /tmp/sdpgu.out
MYPID=25552, PID1=25554, PID2=25555

$ ps -ef |grep 25552
dteam043 25552 25549  0 16:14 ?        00:00:00 /bin/bash ./test_bug94418.sh
dteam043 25554 25552  0 16:14 ?        00:00:00 sleep 3600
dteam043 25555 25552  0 16:14 ?        00:00:00 sleep 3600
dteam043 25560 24967  0 16:16 pts/0    00:00:00 grep 25552

$ ps -ef |grep 25554
dteam043 25554 25552  0 16:14 ?        00:00:00 sleep 3600
dteam043 25562 24967  0 16:16 pts/0    00:00:00 grep 25554

$ ps -ef|grep 25555
dteam043 25555 25552  0 16:14 ?        00:00:00 sleep 3600
dteam043 25564 24967  0 16:16 pts/0    00:00:00 grep 25555

### On UI:

$ glite-ce-job-cancel https://cert-41.pd.infn.it:8443/CREAM398838952

Are you sure you want to cancel specified job(s) [y/n]: y

$ glite-ce-job-status https://cert-41.pd.infn.it:8443/CREAM398838952

******  JobID=[https://cert-41.pd.infn.it:8443/CREAM398838952]
	Status        = [CANCELLED]
	ExitCode      = []
	Description   = [Cancelled by user]

### On WN:

$ ps -ef |grep 25552
dteam043 25578 24967  0 16:17 pts/0    00:00:00 grep 25552
$ ps -ef |grep 25554
dteam043 25580 24967  0 16:17 pts/0    00:00:00 grep 25554
$ ps -ef|grep 25555
dteam043 25582 24967  0 16:17 pts/0    00:00:00 grep 25555
</verbatim>

---+++++ [[https://savannah.cern.ch/bugs/index.php?98707][Bug #98707 Wrong warning message form ArgusPEPClient configuration]] %ORANGE%  NOT TESTED %ENDCOLOR%
<verbatim>

</verbatim>

---+++++ [[https://savannah.cern.ch/bugs/index.php?95328][Bug #95328 In cluster mode, YAIM does not set GlueCEInfoHostName for CREAMs]] %GREEN%  FIXED %ENDCOLOR%
<verbatim>
$ ldapsearch -h cert-41.pd.infn.it -x -p 2170 -b "o=grid" objectclass=GlueCE | grep InfoHostName
GlueCEInfoHostName: cert-41.pd.infn.it
GlueCEInfoHostName: cert-41.pd.infn.it
GlueCEInfoHostName: cert-41.pd.infn.it
</verbatim>

---++++ Verification old bugs for CREAM LSF and bugs 96306 and 96512 attached to the patch
<verbatim>
$ pwd
/home/bertocco/cream_blah_testsuites-master/cream_regression_testsuite/tests
$ pybot bug_*.html
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
 batch_system = lsf
 ce_admin_user = root
 ce_admin_pass = cmsgrid
 ce_host = cert-41.pd.infn.it
 ce_endpoint = cert-41.pd.infn.it:8443
 cream_queue = cream-lsf-cert
 vo = dteam
 proxy_pass = sarabINFN
 log_level = TRACE
 tmp_dir = /tmp
 delete_files = False
 tomcat_service = tomcat6
 catalina_home = /usr/share/tomcat6
middleware_version = emi2
 ce_cream_xml = /etc/glite-ce-cream/cream-config.xml
 cream_config_xml = /etc/glite-ce-cream/cream-config.xml
 blah_config = /etc/blah.config
 site_info = /root/siteinfo/site-info.def
 services_glite_creamce = /root/siteinfo/services/glite-creamce
 blah_bupdater_loop_interval = bupdater_loop_interval
 blah_check_children_interval = blah_check_children_interval
 blah_bupdater_use_bhist_for_killed = bupdater_use_bhist_for_killed
 cream_sandbox_path = CREAM_SANDBOX_PATH
 cream_concurrency_level_yaim_name = CREAM_CONCURRENCY_LEVEL
 middleware_version = emi2
 cream_concurrency_level = commandworkerpoolsize
 ce = cert-41.pd.infn.it:8443/cream-lsf-cert
Command "/usr/bin/voms-proxy-info" output follows:
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=1192746910
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco
type      : RFC compliant proxy
strength  : 1024 bits
path      : /tmp/x509up_u33337
timeleft  : 11:47:38

Command's output printed.
 dn = /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Sara Bertocco/CN=1192746910
The files of this testsuite will be stored under: /tmp/tmpNmu7wa.cream_testing/
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_59871                                                             | PASS |
------------------------------------------------------------------------------
Teardown                                                              | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_69857                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_81561                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83238                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83338                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83592                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_83593                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
bug_83749                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_84374                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_86191                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_87361                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_87492                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_89489                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_95356                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
Check Executables :: Check whether the needed executables for the ... | PASS |
------------------------------------------------------------------------------
bug_95552                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_96306                                                             | PASS |
------------------------------------------------------------------------------
Teardown                                                              | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
3 critical tests, 3 passed, 0 failed
3 tests total, 3 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83592 & Bug...
==============================================================================
Set Log Level :: Set the log level used for the test suite. This c... | PASS |
------------------------------------------------------------------------------
bug_96512                                                             | PASS |
------------------------------------------------------------------------------
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Bug 59871 & Bug 69857 & Bug 81561 & Bug 83238 & Bug 83338 & Bug 83... | PASS |
41 critical tests, 41 passed, 0 failed
41 tests total, 41 passed, 0 failed
==============================================================================
Output:  /home/bertocco/cream_blah_testsuites-master/cream_regression_testsuite/tests/output.xml
Log:     /home/bertocco/cream_blah_testsuites-master/cream_regression_testsuite/tests/log.html
Report:  /home/bertocco/cream_blah_testsuites-master/cream_regression_testsuite/tests/report.html
</verbatim>

   *  [[%ATTACHURL%/regressionSL6_LSF.html.log][log.html]]

---+++ Standard conformance tests

---++++ Glue 1 Compliance 
   * <verbatim>glue-validator -t glue1 -h cert-41.pd.infn.it -p 2170 -b o=grid </verbatim> [[%ATTACHURL%/glue1_compliance][log]]

---++++ Glue 2 Compliance 
   *  <verbatim>glue-validator -t glue2 -h cert-41.pd.infn.it -p 2170 -b o=glue </verbatim> [[%ATTACHURL%/glue2_compliance][log]]


---+++ Performance and scalability tests

   * Submission and cancellation with polling (SL5 PBS)
   <verbatim>
   ./bin/cream-test-monitored-cancel -r 30 -n 1000 -m 50 -C 50 -l log4py.conf -j simple.jdl -R cert-42.pd.infn.it:8443/cream-pbs-cert
   </verbatim>
   [[%ATTACHURL%/cream-test-cancel-cert-41.log][log]]

   * Submission with polling and sandbox transfer (SL5 PBS)
   <verbatim>
   ./bin/cream-test-monitored-submit -r 30 -n 1000 -m 50 -C 50 -l log4py.conf -j jdl/testsandbox.jdl -R cert-42.pd.infn.it:8443/cream-pbs-cert
  </verbatim>
   [[%ATTACHURL%/cream-test-sandbox-transfer-cert-42.log][log]]

   * Simple submission with polling, lease updated and proxy renewal
  <verbatim>
  cream-test-monitored-lease-updated -r 60 -n 50 -m 10 -C 10 -l log4py.conf -W 1200 --vo dteam --valid 00:20 -R cert-42.pd.infn.it:8443/cream-pbs-cert
  </verbatim>
   [[%ATTACHURL%/cream-test-poll-leaseupdate-proxyrenew-cert-41.log][log]]

---+++ Integration testing

Tests described:
   * [[https://twiki.cern.ch/twiki/bin/view/EMI/EmiJra1TaskForceIntegrationTesting][https://twiki.cern.ch/twiki/bin/view/EMI/EmiJra1TaskForceIntegrationTesting]]
      * test 2: [[https://wiki.italiangrid.it/twiki/bin/view/CEMon/CemonTestPlan#gJAF_and_ARGUS_authorization_tes]["CEMon to use Argus for authorization "]]
         * NA
      * test 3: "CREAM jobs executed under different backends is properly treated by APEL client "
         * PASSED - proven by functionality tests of different CREAM + LSF, TORQUE, SGE modules
      * test 16: [[https://wiki.italiangrid.it/twiki/bin/view/CREAM/CreamTestWorkPlan#Authz_test]["Do authorization filtering based on VOMS attributes and ARGUS authorization"]]
        * NA



 


-- Main.SaraBertocco - 2012-11-26
Attachments
Topic attachments
I	Attachment	Action	Size	Date	Who
log	CREAM_SL6_LSF_update_yum.log	manage	8.8 K	2012-12-04 - 13:15	SaraBertocco
log	SL6_yaim_update.log	manage	208.9 K	2012-12-04 - 13:15	SaraBertocco
log	ban.html.log	manage	171.3 K	2012-12-07 - 09:56	SaraBertocco
log	cpu_alloc.html.log	manage	191.8 K	2012-12-07 - 10:11	SaraBertocco
log	cream-test-cancel-cert-41.log	manage	2467.2 K	2012-12-12 - 14:49	SaraBertocco
log	cream-test-poll-leaseupdate-proxyrenew-cert-41.log	manage	781.0 K	2012-12-12 - 14:45	SaraBertocco
log	cream-test-sandbox-transfer-cert-42.log	manage	937.4 K	2012-12-12 - 14:50	SaraBertocco
log	functionalitySL6_LSF.html.log	manage	441.1 K	2012-12-07 - 09:54	SaraBertocco
EXT	glue1_compliance	manage	24.9 K	2012-12-06 - 11:10	SaraBertocco
EXT	glue2_compliance	manage	55.7 K	2012-12-06 - 11:10	SaraBertocco
log	lb.html.log	manage	172.6 K	2012-12-07 - 10:11	SaraBertocco
log	log0.html.log	manage	432.5 K	2012-12-06 - 12:36	SaraBertocco
txt	log_regression.html.txt	manage	376.3 K	2012-12-05 - 11:45	SaraBertocco
log	old_blah.html.log	manage	167.7 K	2012-12-07 - 10:11	SaraBertocco
log	regressionSL6_LSF.html.log	manage	376.3 K	2012-12-07 - 10:36	SaraBertocco
Topic revision: r18 - 2012-12-12 - SaraBertocco
Account
- Log In
Edit
Attach