(r15) Task25000 < IGIRelease

Tags: , view all tags
---+ Testing report: [[http://issues.cnaf.infn.it/browse/IGIRTC-18][IGIRTC-18]]

%TOC%

---++ Summary

   * Product: *BLAH 1.16.4*
   * Release Task: [[https://savannah.cern.ch/task/?25000][Task #25000]]
   * ETICS Subsystem Configuration Name: *emi-cream-ce_R_1_13_7_1*
   * VCS Tag: _emi-blahp_R_1_16_4_1_
   * EMI Major Release: *EMI 1 (Kebnekaise)*
   * Platform: *SL5 epel*
   * Author: Sara Bertocco and Alessio Gianelle
   * Testing report: [[%ATTACHURL%/EMI_Test_Report_Task25000.txt][See here]]
   * Certification report: [[%ATTACHURL%/EMI_Certification_Report_Task25000.txt][See here]]
   * Outcome: %ORANGE% *In certification...* %ENDCOLOR%

---++ Deployment tests

---+++ Clean Installation

   * [[%ATTACHURL%/install.txt][Installation log file]]
   * [[%ATTACHURL%/configure.txt][Configuration log file]]

---+++ Upgrade Installation

---++++ LSF CE

   * [[%ATTACHURL%/lsfupdate.txt][Installation log file]]
   * [[%ATTACHURL%/lsfupdate_conf.txt][Configuration log file (using new BLParser model)]]
   * [[%ATTACHURL%/lsfupdate_conf_old.txt][Configuration log file (using old BLParser model)]]


---++++ PBS CE

   * [[%ATTACHURL%/pbsupdate.txt][Installation log file]]
   * [[%ATTACHURL%/pbsupdate_conf.txt][Configuration log file (using new BLParser model)]]
   * [[%ATTACHURL%/pbsupdate_conf_old.txt][Configuration log file (using old BLParser model)]]

---++ Unit Tests

Not Available. The plan is to provide some unit tests starting with EMI-2.

---++ System tests

---+++ Functionality tests

---++++ Test submission 

   * Test result for LSF is available [[%ATTACHURL%/lsfsubmission.log][here]] %GREEN% *PASSED* %ENDCOLOR%
   * Test result for PBS is available [[%ATTACHURL%/pbssubmission.log][here]] %GREEN% *PASSED* %ENDCOLOR%

---++++ BLParser test 

---+++++ Old BLParser
   * Job which finishes normally 
      * LSF %GREEN% *PASSED* %ENDCOLOR% <verbatim>
[ale@cream-12 UI]$ glite-ce-job-submit -a -r cream-22.pd.infn.it:8443/cream-lsf-cert cream.jdl
https://cream-22.pd.infn.it:8443/CREAM053260410

[ale@cream-12 UI]$ glite-ce-job-status https://cream-22.pd.infn.it:8443/CREAM053260410

******  JobID=[https://cream-22.pd.infn.it:8443/CREAM053260410]
  Status        = [DONE-OK]
  ExitCode      = [0]


[root@cream-22 ~]# grep 053260410 /var/log/cream/glite-lsfparser.log
2011-12-20 13:47:29 Adding: ID:551886 Type:BLAHPNAME Value:"cre22_053260410"
2011-12-20 13:47:29 Sent for Cream:[BatchJobId="551886"; JobStatus=1; BlahJobName="cre22_053260410"; ClientJobId="053260410";  ChangeTime="2011-12-20 13:47:28";]
2011-12-20 13:47:33 Sent for Cream:[BatchJobId="551886"; JobStatus=2; BlahJobName="cre22_053260410"; ClientJobId="053260410"; WorkerNode="prod-wn-002"; ChangeTime="2011-12-20 13:47:33";]
2011-12-20 13:49:14 Sent for Cream:[BatchJobId="551886"; JobStatus=4; BlahJobName="cre22_053260410"; ClientJobId="053260410"; WorkerNode="prod-wn-002"; Reason="lsf_reason=0"; ChangeTime="2011-12-20 13:49:14";]</verbatim>
      * PBS/Torque %GREEN% *PASSED* %ENDCOLOR% <verbatim>
[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-submit -a -r cream-41.pd.infn.it:8443/cream-pbs-cert test1.jdl

[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-status https://cream-41.pd.infn.it:8443/CREAM228600831

******  JobID=[https://cream-41.pd.infn.it:8443/CREAM228600831]
	Status        = [DONE-OK]
	ExitCode      = [0]
[root@cream-41 ~]# grep 228600831 /var/log/cream/glite-pbsparser.log
2011-12-20 15:45:34 Adding: ID:41080 Type:BLAHPNAME Value:cre41_228600831
2011-12-20 15:45:34 Sent for Cream:[BatchJobId="41080"; JobStatus=1; BlahJobName="cre41_228600831"; ClientJobId="228600831";  ChangeTime="2011-12-20 15:45:34";]
2011-12-20 15:45:35 Sent for Cream:[BatchJobId="41080"; JobStatus=2; BlahJobName="cre41_228600831"; ClientJobId="228600831";  ChangeTime="2011-12-20 15:45:35";]
2011-12-20 15:47:16 Sent for Cream:[BatchJobId="41080"; JobStatus=4; BlahJobName="cre41_228600831"; ClientJobId="228600831";  Reason="pbs_reason=0"; ChangeTime="2011-12-20 15:47:15";]</verbatim>



   * Job which is cancelled 
      * LSF %GREEN% *PASSED* %ENDCOLOR% <verbatim>
[ale@cream-12 UI]$ glite-ce-job-submit -a -r cream-22.pd.infn.it:8443/cream-lsf-cert cream.jdl
https://cream-22.pd.infn.it:8443/CREAM142681575

[ale@cream-12 UI]$ glite-ce-job-cancel https://cream-22.pd.infn.it:8443/CREAM142681575

Are you sure you want to cancel specified job(s) [y/n]: y

[ale@cream-12 UI]$ glite-ce-job-status https://cream-22.pd.infn.it:8443/CREAM142681575

******  JobID=[https://cream-22.pd.infn.it:8443/CREAM142681575]
  Status        = [CANCELLED]
  ExitCode      = []
  Description   = [Cancelled by user]

[root@cream-22 ~]# grep 142681575 /var/log/cream/glite-lsfparser.log
2011-12-20 13:51:28 Adding: ID:551887 Type:BLAHPNAME Value:"cre22_142681575"
2011-12-20 13:51:28 Sent for Cream:[BatchJobId="551887"; JobStatus=1; BlahJobName="cre22_142681575"; ClientJobId="142681575";  ChangeTime="2011-12-20 13:51:27";]
2011-12-20 13:51:29 Sent for Cream:[BatchJobId="551887"; JobStatus=2; BlahJobName="cre22_142681575"; ClientJobId="142681575"; WorkerNode="prod-wn-003"; ChangeTime="2011-12-20 13:51:29";]
2011-12-20 13:51:55 Sent for Cream:[BatchJobId="551887"; JobStatus=3; BlahJobName="cre22_142681575"; ClientJobId="142681575"; WorkerNode="prod-wn-003"; ChangeTime="2011-12-20 13:51:54";]</verbatim>
      * PBS/Torque %GREEN% *PASSED* %ENDCOLOR% <verbatim>
[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-submit -a -r cream-41.pd.infn.it:8443/cream-pbs-cert test1.jdl
https://cream-41.pd.infn.it:8443/CREAM097109154

[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-status https://cream-41.pd.infn.it:8443/CREAM097109154

******  JobID=[https://cream-41.pd.infn.it:8443/CREAM097109154]
	Status        = [CANCELLED]
	ExitCode      = []
	Description   = [Cancelled by user]

[root@cream-41 ~]# grep 097109154 /var/log/cream/glite-pbsparser.log
2011-12-20 16:04:01 Adding: ID:41082 Type:BLAHPNAME Value:cre41_097109154
2011-12-20 16:04:01 Sent for Cream:[BatchJobId="41082"; JobStatus=1; BlahJobName="cre41_097109154"; ClientJobId="097109154";  ChangeTime="2011-12-20 16:04:00";]
2011-12-20 16:04:01 Sent for Cream:[BatchJobId="41082"; JobStatus=2; BlahJobName="cre41_097109154"; ClientJobId="097109154";  ChangeTime="2011-12-20 16:04:01";]
2011-12-20 16:04:29 Sent for Cream:[BatchJobId="41082"; JobStatus=3; BlahJobName="cre41_097109154"; ClientJobId="097109154";  ChangeTime="2011-12-20 16:04:28";]
2011-12-20 16:04:29 Sent for Cream:[BatchJobId="41082"; JobStatus=4; BlahJobName="cre41_097109154"; ClientJobId="097109154";  Reason="pbs_reason=271"; ExitReason="Killed by Resource Management System"; ChangeTime="2011-12-20 16:04:28";]</verbatim>

   * Job which is suspended and then resumed 
      * LSF %RED% *NOT PASSED* %ENDCOLOR% see [[https://savannah.cern.ch/bugs/?90085][Bug #90085]]
      * PBS %RED% *NOT PASSED* %ENDCOLOR% see [[https://savannah.cern.ch/bugs/?90085][Bug #90085]]

---+++++ New BLParser
   * Job which finishes normally 
      * LSF %GREEN% *PASSED* %ENDCOLOR% <verbatim>
[ale@cream-12 UI]$ glite-ce-job-submit -a -r cream-20.pd.infn.it:8443/cream-lsf-cert cream.jdl
https://cream-20.pd.infn.it:8443/CREAM587966276

[ale@cream-12 UI]$ glite-ce-job-status https://cream-20.pd.infn.it:8443/CREAM587966276

******  JobID=[https://cream-20.pd.infn.it:8443/CREAM587966276]
  Status        = [DONE-OK]
  ExitCode      = [0]

[root@cream-20 ~]# grep 587966276 /var/log/cream/glite-ce-bnotifier.log
2011-12-20 15:17:00 Sent for Cream:[BatchJobId="551901"; JobStatus=2; ChangeTime="2011-12-20 15:16:28"; WorkerNode="prod-wn-003"; ClientJobId="587966276"; BlahJobName="cre20_587966276";]
2011-12-20 15:18:41 Sent for Cream:[BatchJobId="551901"; JobStatus=4; ChangeTime="2011-12-20 15:18:09"; WorkerNode="prod-wn-003"; JwExitCode=0; Reason="reason=0"; ClientJobId="587966276"; BlahJobName="cre20_587966276";]</verbatim>
      * PBS/Torque %GREEN% *PASSED* %ENDCOLOR% <verbatim>
[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-submit -a -r cream-40.pd.infn.it:8443/cream-pbs-cert test1.jdl
https://cream-40.pd.infn.it:8443/CREAM509451203

[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-status https://cream-40.pd.infn.it:8443/CREAM509451203

******  JobID=[https://cream-40.pd.infn.it:8443/CREAM509451203]
	Status        = [DONE-OK]
	ExitCode      = [0]

[root@cream-40 ~]# grep 509451203  /var/log/cream/glite-ce-bnotifier.log
2011-12-20 16:42:32 Sent for Cream:[BatchJobId="41349.cream-40.pd.infn.it"; JobStatus=2; ChangeTime="2011-12-20 16:41:52"; WorkerNode="cream-wn-040.pn.pd.infn.it"; ClientJobId="509451203"; BlahJobName="cre40_509451203";]
2011-12-20 16:44:13 Sent for Cream:[BatchJobId="41349.cream-40.pd.infn.it"; JobStatus=4; ChangeTime="2011-12-20 16:43:32"; WorkerNode="cream-wn-040.pn.pd.infn.it"; JwExitCode=0; Reason="reason=0"; ClientJobId="509451203"; BlahJobName="cre40_509451203";]</verbatim>


   * Job which is cancelled 
      * LSF %GREEN% *PASSED* %ENDCOLOR% <verbatim>
[ale@cream-12 UI]$ glite-ce-job-submit -a -r cream-20.pd.infn.it:8443/cream-lsf-cert cream.jdl
https://cream-20.pd.infn.it:8443/CREAM260205441
[ale@cream-12 UI]$ glite-ce-job-cancel https://cream-20.pd.infn.it:8443/CREAM260205441

Are you sure you want to cancel specified job(s) [y/n]: y

[ale@cream-12 UI]$ glite-ce-job-status https://cream-20.pd.infn.it:8443/CREAM260205441

******  JobID=[https://cream-20.pd.infn.it:8443/CREAM260205441]
  Status        = [CANCELLED]
  ExitCode      = []
  Description   = [Cancelled by user]

[root@cream-20 ~]# grep 260205441 /var/log/cream/glite-ce-bnotifier.log
2011-12-20 15:20:26 Sent for Cream:[BatchJobId="551902"; JobStatus=3; ChangeTime="2011-12-20 15:20:02"; JwExitCode=-999; Reason="reason=-999"; ClientJobId="260205441"; BlahJobName="cre20_260205441";]</verbatim>
      * PBS/Torque %GREEN% *PASSED* %ENDCOLOR% <verbatim>
[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-submit -a -r cream-40.pd.infn.it:8443/cream-pbs-cert test1.jdl
https://cream-40.pd.infn.it:8443/CREAM887070151

[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-cancel https://cream-40.pd.infn.it:8443/CREAM887070151

Are you sure you want to cancel specified job(s) [y/n]: y

[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-status https://cream-40.pd.infn.it:8443/CREAM887070151

******  JobID=[https://cream-40.pd.infn.it:8443/CREAM887070151]
	Status        = [CANCELLED]
	ExitCode      = []
	Description   = [Cancelled by user]

[root@cream-40 ~]# grep 887070151  /var/log/cream/glite-ce-bnotifier.log
2011-12-20 16:58:33 Sent for Cream:[BatchJobId="41350.cream-40.pd.infn.it"; JobStatus=3; ChangeTime="2011-12-20 16:58:20"; JwExitCode=-999; Reason="reason=-999"; ClientJobId="887070151"; BlahJobName="cre40_887070151";]</verbatim>

   * Job which is suspended and then resumed 
      * LSF %GREEN% *PASSED* %ENDCOLOR%<verbatim>
[ale@cream-12 UI]$ glite-ce-job-submit -a -r cream-20.pd.infn.it:8443/cream-lsf-cert cream.jdl
https://cream-20.pd.infn.it:8443/CREAM908720454
[ale@cream-12 UI]$ glite-ce-job-suspend https://cream-20.pd.infn.it:8443/CREAM908720454

Are you sure you want to suspend specified job(s) [y/n]: y

[ale@cream-12 UI]$ glite-ce-job-status https://cream-20.pd.infn.it:8443/CREAM908720454

******  JobID=[https://cream-20.pd.infn.it:8443/CREAM908720454]
  Status        = [HELD]

[ale@cream-12 UI]$ glite-ce-job-resume https://cream-20.pd.infn.it:8443/CREAM908720454

Are you sure you want to resume specified job(s) [y/n]: y

[ale@cream-12 UI]$ glite-ce-job-status https://cream-20.pd.infn.it:8443/CREAM908720454

******  JobID=[https://cream-20.pd.infn.it:8443/CREAM908720454]
  Status        = [DONE-OK]
  ExitCode      = [0]

[root@cream-20 ~]# grep 908720454 /var/log/cream/glite-ce-bnotifier.log
2011-12-20 15:23:27 Sent for Cream:[BatchJobId="551904"; JobStatus=5; ChangeTime="2011-12-20 15:23:05"; ClientJobId="908720454"; BlahJobName="cre20_908720454";]
2011-12-20 15:31:12 Sent for Cream:[BatchJobId="551904"; JobStatus=4; ChangeTime="2011-12-20 15:30:33"; JwExitCode=0; Reason="reason=0"; ClientJobId="908720454"; BlahJobName="cre20_908720454";]</verbatim>
      * PBS %GREEN% *PASSED* %ENDCOLOR%<verbatim>
[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-submit -a -r cream-40.pd.infn.it:8443/cream-pbs-cert test1.jdl
[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-status https://cream-40.pd.infn.it:8443/CREAM089011081

******  JobID=[https://cream-40.pd.infn.it:8443/CREAM089011081]
	Status        = [IDLE]

[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-suspend https://cream-40.pd.infn.it:8443/CREAM089011081

Are you sure you want to suspend specified job(s) [y/n]: y

[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-status https://cream-40.pd.infn.it:8443/CREAM089011081

******  JobID=[https://cream-40.pd.infn.it:8443/CREAM089011081]
	Status        = [HELD]

[bertocco@cream-12 mie_certificazioni]$ glite-ce-job-resume https://cream-40.pd.infn.it:8443/CREAM089011081

Are you sure you want to resume specified job(s) [y/n]: y

[root@cream-40 ~]# grep 089011081 /var/log/cream/glite-ce-bnotifier.log
[BatchJobId="41400.cream-40.pd.infn.it"; JobStatus=1; ChangeTime="2011-12-20 17:13:10"; ClientJobId="089011081"; BlahJobName="cre40_089011081";]
2011-12-20 17:14:35 Sent for Cream:[BatchJobId="41400.cream-40.pd.infn.it"; JobStatus=5; ChangeTime="2011-12-20 17:14:27"; ClientJobId="089011081"; BlahJobName="cre40_089011081";]
2011-12-20 17:21:17 Sent for Cream:[BatchJobId="41400.cream-40.pd.infn.it"; JobStatus=2; ChangeTime="2011-12-20 17:21:14"; WorkerNode="cream-wn-040.pn.pd.infn.it"; ClientJobId="089011081"; BlahJobName="cre40_089011081";]
2011-12-20 17:23:17 Sent for Cream:[BatchJobId="41400.cream-40.pd.infn.it"; JobStatus=4; ChangeTime="2011-12-20 17:22:55"; WorkerNode="cream-wn-040.pn.pd.infn.it"; JwExitCode=0; Reason="reason=0"; ClientJobId="089011081"; BlahJobName="cre40_089011081";]</verbatim>

---+++ Regression tests

---++++ Verification attached bugs

---+++++ [[https://savannah.cern.ch/bugs/?88974][Bug #88974: BUpdaterSGE and BNotifier don't start if sge_helperpath var is not fixed]] %RED% TBD %ENDCOLOR%

---+++++ [[https://savannah.cern.ch/bugs/?89859][Bug #89859: There is a memory leak in the updater for LSF, PBS and Condor]] %GREEN% FIXED %ENDCOLOR%

Submit 1000 jobs, one every 3 seconds monitoring the Used RSS memory of the */usr/bin/BUpdaterLSF* process:

%ATTACHURL%/LSFmem.png

Submit 1000 jobs, one every 3 seconds monitoring the Used RSS memory of the */usr/bin/BUpdaterPBS* process:

%ATTACHURL%/PBSmem.png

---++++ Verification old bugs

   * [[https://savannah.cern.ch/bugs/?75854][Bug #75854 Problems related to the growth of the blah registry)]]

Submitted 5000 jobs to a CREAM CE configured using the new blparser, and with job_registry_use_mmap=yes.

Monitored the used RSS of the blahpd processes. At the end the maximum value between all the process is *14040*.

%GREEN%Test PASSED%ENDCOLOR%

   * [[https://savannah.cern.ch/bugs/?77776][Bug #77776 (BUpdater should have an option to use cached batch system commands)]]

Configure /etc/blah.config:
<verbatim>
[root@cream-40 ~]# tail -4 /etc/blah.config
# Verify fix for bug #77776
pbs_batch_caching_enabled=yes
batch_command_caching_filter=/usr/bin/runcmd.pl
</verbatim>

Where runcmd.pl is:

<verbatim>
#!/usr/bin/perl
#---------------------#
#  PROGRAM:  argv.pl  #
#---------------------#

$numArgs = $#ARGV + 1;
open (MYFILE, '>>/tmp/xyz');
foreach $argnum (0 .. $#ARGV) {
    print MYFILE "$ARGV[$argnum] ";
}
print MYFILE "\n";
close (MYFILE); 
</verbatim>

Restart the services and submit 10 jobs to the CE.

<verbatim>
[root@cream-40 ~]# cat /tmp/xyz 
/usr/bin/qstat -f 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43450.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43451.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43452.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43453.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43454.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43455.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43456.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43457.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43458.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43459.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43460.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43461.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43462.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43463.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43464.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43465.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43466.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43467.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43468.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43469.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43470.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43471.cream-40.pd.infn.it 
/usr/bin/tracejob -p /var/torque -m -l -a -n 2 43472.cream-40.pd.infn.it 
/usr/bin/qstat -f 
</verbatim>

%GREEN%Test PASSED%ENDCOLOR%

   * [[https://savannah.cern.ch/bugs/?80805][Bug #80805 (BLAH job registry permissions should be improved)]]

<verbatim>
[root@cream-40 ~]# ls -l /var/blah
total 12
-rw-r--r-- 1 tomcat tomcat    4 Dec 22 13:41 blah_bnotifier.pid
-rw-r--r-- 1 tomcat tomcat    4 Dec 22 13:41 blah_bupdater.pid
drwxrwx--t 4 tomcat tomcat 4096 Dec 22 14:37 user_blah_job_registry.bjr
[root@cream-40 ~]# ls -l /var/blah/user_blah_job_registry.bjr/
total 32548
-rw-rw-r-- 1 tomcat tomcat 25467712 Dec 22 14:38 registry
-rw-r--r-- 1 tomcat tomcat  7735260 Dec 22 14:37 registry.by_blah_index
-rw-rw-rw- 1 tomcat tomcat        0 Dec 22 14:38 registry.locktest
drwxrwx-wt 2 tomcat tomcat     4096 Dec 22 14:38 registry.npudir
drwxrwx-wt 2 tomcat tomcat    65536 Dec 22 14:38 registry.proxydir
-rw-r--r-- 1 tomcat tomcat      200 Dec 22 13:40 registry.subjectlist
[root@cream-40 ~]# ls -l /var/blah/user_blah_job_registry.bjr/registry.npudir
total 0
[root@cream-40 ~]# ls -l /var/blah/user_blah_job_registry.bjr/registry.proxydir/
total 108
lrwxrwxrwx 1 dteam009 dteam 192 Dec 22 13:39 proxy_43450.cream-40.pd.in_5YGF6T -> /var/cream_sandbox/dteam/_C_IT_O_INFN_OU_Personal_Certificate_L_Padova_CN_Alessio_Gianelle_dteam_Role_NULL_Capability_NULL_dteam009/proxy/e65639ca3adc874ae7aa7504652d83d2f5a2ad7c19364155241627
lrwxrwxrwx 1 dteam009 dteam 192 Dec 22 13:39 proxy_43451.cream-40.pd.in_tlAfpa -> /var/cream_sandbox/dteam/_C_IT_O_INFN_OU_Personal_Certificate_L_Padova_CN_Alessio_Gianelle_dteam_Role_NULL_Capability_NULL_dteam009/proxy/55e80b2a9b68a2cb7019ac69cda5390dd6489c4719364155241627
</verbatim>

%GREEN%Test PASSED%ENDCOLOR%


   * [[https://savannah.cern.ch/bugs/?81354][Bug #81354 (Missing 'Iwd' Attribute when trasferring files with the 'TransferInput' attribute causes thread to loop)]]

<verbatim>
[root@cream-40 ~]# su - tomcat
-sh-3.2$ /usr/bin/blahpd
$GahpVersion: 1.16.4 Mar 31 2008 INFN\ blahpd\ (poly,new_esc_format) $
BLAH_SET_SUDO_ID dteam001
S Sudo\ mode\ on
blah_job_submit 1 [cmd="/bin/cp";Args="fstab\ fstab.out";TransferInput="/home/dteam001/dir1/fstab";TransferOutput="fstab.out";TransferOutputRemaps="fstab.out=/home/dteam001/dir1/fstab.out";gridtype="pbs";queue="creamtest2";x509userproxy="/tmp/proxy"]
S
results
S 1
1 0 No\ error pbs/20111222/43477.cream-40.pd.infn.it
Connection closed by remote host


[root@cream-40 ~]# ls -l /home/dteam001/dir1/
total 8
-rw-r--r-- 1 dteam001 dteam 527 Dec 22 15:10 fstab
-rw-r--r-- 1 dteam001 dteam 527 Dec 22 15:11 fstab.out
</verbatim>

%GREEN%Test PASSED%ENDCOLOR%


   * [[https://savannah.cern.ch/bugs/?81824][Bug #81824 (yaim-cream-ce should manage the attribute bupdater_loop_interval)]]
<verbatim>
[root@cream-17 cream-40]# grep BUPDATER_LOOP_INTERVAL services/glite-creamce
BUPDATER_LOOP_INTERVAL=42
</verbatim>

After yaim reconfiguration:

<verbatim>
[root@cream-40 ~]# grep bupdater_loop_interval /etc/blah.config
bupdater_loop_interval=42
</verbatim>


%GREEN%Test PASSED%ENDCOLOR%


   * [[https://savannah.cern.ch/bugs/?82281][Bug #82281 (blahp.log records should always contain CREAM job ID)]]

Try first with direct submission:
<verbatim>
[ale@cream-12 UI]$ glite-ce-job-submit -a -r cream-40.pd.infn.it:8443/cream-pbs-creamtest1 cream.jdl
https://cream-40.pd.infn.it:8443/CREAM974280852

[root@cream-40 ~]# grep CREAM974280852 /var/log/cream/accounting/blahp.log-20111222
"timestamp=2011-12-22 14:25:08" "userDN=/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle" "userFQAN=/dteam/Role=NULL/Capability=NULL" "userFQAN=/dteam/NGI_IT/Role=NULL/Capability=NULL" "ceID=cream-40.pd.infn.it:8443/cream-pbs-creamtest1" "jobID=CREAM974280852" "lrmsID=43478.cream-40.pd.infn.it" "localUser=18181" "clientID=cre40_974280852"
</verbatim>

Try submission through a WMS:
<verbatim>
[ale@cream-12 UI]$ glite-wms-job-submit -a -c etc/wmp_devel11.conf -r cream-40.pd.infn.it:8443/cream-pbs-creamtest1 cream.jdl

Connecting to the service https://devel11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://devel11.cnaf.infn.it:9000/B0wtklaUDmXbO1xDDqQ23Q

==========================================================================

[ale@cream-12 UI]$ glite-wms-job-logging-info -v 2 --event Transfer  https://devel11.cnaf.infn.it:9000/B0wtklaUDmXbO1xDDqQ23Q  | grep "Dest jobid"
- Dest jobid                 =    unavailable
- Dest jobid                 =    https://cream-40.pd.infn.it:8443/CREAM794974631

[root@cream-40 ~]# grep B0wtklaUDmXbO1xDDqQ23Q /var/log/cream/accounting/blahp.log-20111222
"timestamp=2011-12-22 14:28:10" "userDN=/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle" "userFQAN=/dteam/Role=NULL/Capability=NULL" "userFQAN=/dteam/NGI_IT/Role=NULL/Capability=NULL" "ceID=cream-40.pd.infn.it:8443/cream-pbs-creamtest1" "jobID=https://devel11.cnaf.infn.it:9000/B0wtklaUDmXbO1xDDqQ23Q" "lrmsID=43479.cream-40.pd.infn.it" "localUser=18181" "clientID=cre40_794974631"
</verbatim>


%GREEN%Test PASSED%ENDCOLOR%

   * [[https://savannah.cern.ch/bugs/?82297][Bug #82297 (blahp.log rotation period is too short)]]

<verbatim>
[root@cream-40 ~]# cat /etc/logrotate.d/blahp-logrotate | grep rotate
        rotate 365
</verbatim>


%GREEN%Test PASSED%ENDCOLOR%


   * [[https://savannah.cern.ch/bugs/?83275][Bug #83275 (Problem in updater with very short jobs that can cause no notification to cream)]]

<verbatim>
[ale@cream-12 UI]$ glite-ce-job-submit -a -r cream-40.pd.infn.it:8443/cream-pbs-creamtest1 creamshort.jdl
https://cream-40.pd.infn.it:8443/CREAM137590769

[root@cream-40 ~]# grep 137590769 /var/log/cream/glite-ce-bnotifier.log
2011-12-22 15:44:59 Sent for Cream:[BatchJobId="43482.cream-40.pd.infn.it"; JobStatus=4; ChangeTime="2011-12-22 15:44:22"; JwExitCode=0; Reason="reason=0"; ClientJobId="137590769"; BlahJobName="cre40_137590769";]
</verbatim>


%GREEN%Test PASSED%ENDCOLOR%

   * [[https://savannah.cern.ch/bugs/?83347][Bug #83347 (Incorrect special character handling for BLAH Arguments and Environment attributes)]]

<verbatim>
[root@cream-40 ~]# su - tomcat
-sh-3.2$ /usr/bin/blahpd
$GahpVersion: 1.16.4 Mar 31 2008 INFN\ blahpd\ (poly,new_esc_format) $
BLAH_SET_SUDO_ID dteam001
S Sudo\ mode\ on
BLAH_JOB_SUBMIT 1 [Cmd="/bin/echo";Args="$HOSTNAME";Out="/tmp/stdout_l15367";In="/dev/null";GridType="pbs";Queue="creamtest1";x509userproxy="/tmp/proxy";Iwd="/tmp";TransferOutput="output_file";TransferOutputRemaps="output_file=/tmp/stdout_l15367";GridResource="blah"]
S
results
S 1
1 0 No\ error pbs/20111222/43483.cream-40.pd.infn.it
Connection closed by remote host

-sh-3.2$ cat /tmp/stdout_l15367 
cream-wn-040.pn.pd.infn.it

[root@cream-40 ~]# tracejob 43483 | grep exec_host
/var/torque/mom_logs/20111222: No such file or directory
/var/torque/sched_logs/20111222: No such file or directory
12/22/2011 15:47:59  A    user=dteam001 group=dteam jobname=bl_f355dbb0979b queue=creamtest1 ctime=1324565278 qtime=1324565278 etime=1324565278 start=1324565279 owner=dteam001@cream-40.pd.infn.it exec_host=cream-wn-040.pn.pd.infn.it/0 Resource_List.neednodes=cream-wn-040.pn.pd.infn.it 
</verbatim>


%GREEN%Test PASSED%ENDCOLOR%


   * [[https://savannah.cern.ch/bugs/?87419][Bug #87419 (blparser_master add some spurious character in the BLParser command line)]]

<verbatim>
[root@cream-41 ~]# ps ax | grep BLParserPBS
  754 pts/1    S+     0:00 grep BLParserPBS
31468 ?        Sl     0:00 /usr/bin/BLParserPBS -d 1 -l /var/log/cream/glite-pbsparser.log -s /var/torque -p 33333 -m 56565
</verbatim>


%GREEN%Test PASSED%ENDCOLOR%
Attachments
Topic attachments
I	Attachment	Action	Size	Date	Who	Comment
txt	EMI_Certification_Report_Task25000.txt	manage	2.8 K	2011-12-23 - 14:43	AlessioGianelle	Certification report
txt	EMI_Test_Report_Task25000.txt	manage	4.5 K	2011-12-23 - 14:43	AlessioGianelle	Test report
png	LSFmem.png	manage	4.4 K	2011-12-22 - 10:51	AlessioGianelle	Test for bug 89859 (lsf)
png	PBSmem.png	manage	4.9 K	2011-12-22 - 11:48	AlessioGianelle	Test for bug 89859 (pbs)
txt	configure.txt	manage	67.2 K	2011-12-23 - 14:20	AlessioGianelle	Clean configuration
txt	install.txt	manage	169.3 K	2011-12-23 - 14:20	AlessioGianelle	Clean installation
log	lsfsubmission.log	manage	1118.6 K	2011-12-20 - 12:43	AlessioGianelle	Test submission for LSF
txt	lsfupdate.txt	manage	15.9 K	2011-12-20 - 10:50	AlessioGianelle	LSF update log file
txt	lsfupdate_conf.txt	manage	44.2 K	2011-12-20 - 10:51	AlessioGianelle	LSF configuration update log file
txt	lsfupdate_conf_old.txt	manage	48.1 K	2011-12-20 - 12:28	AlessioGianelle	LSF configuration with old BLParser update log file
log	pbssubmission.log	manage	27.8 K	2011-12-20 - 14:10	SaraBertocco	PBS submission test
txt	pbsupdate.txt	manage	18.1 K	2011-12-20 - 13:21	SaraBertocco	pbs update log file
txt	pbsupdate_conf.txt	manage	14.3 K	2011-12-20 - 13:32	SaraBertocco	Configuration log file (using new BLParser model)
txt	pbsupdate_conf_old.txt	manage	16.4 K	2011-12-20 - 13:51	SaraBertocco
Topic revision: r15 - 2011-12-23 - AlessioGianelle
Account
- Log In
~~Edit~~
~~Attach~~