Devel03 Work Log

2008-05-29 (Ale)

• Update:

  glite-security-glexec

  i386

  0.5.29-2.slc4

  patch1732

20-08-05-28 (Ale)

• Update:

  glite-security-voms-clients

  i386

  1.8.3-4.slc4

  patch1838

2008-05-26 (Ale)

• Update:

  glite-ce-ce-plugin	noarch	1.9.0-0	Cream-PreCert
  glite-ce-cream	noarch	1.9.0-0	Cream-PreCert
  glite-ce-job-plugin	noarch	1.9.0-0	Cream-PreCert
  glite-ce-monitor	noarch	1.9.1-1	Cream-PreCert
  glite-security-glexec	i386	0.5.27-2.slc4	patch1732
  glite-security-lcas	i386	1.3.7-2.slc4	patch1830
  glite-security-lcas-interface	i386	1.3.6-3.slc4	patch1830
  glite-security-lcas-lcmaps-gt4-interface	i386	0.0.14-2.slc4	patch1830
  glite-security-lcas-plugins-basic	i386	1.3.2-3.slc4	patch1830
  glite-security-lcas-plugins-check-executable	i386	1.2.1-3.slc4	patch1830
  glite-security-lcas-plugins-voms	i386	1.3.4-5.slc4	patch1830
  glite-security-lcmaps	i386	1.4.3-4.slc4	patch1830
  glite-security-lcmaps-plugins-basic	i386	1.3.8-2.slc4	patch1830
  glite-security-lcmaps-plugins-verify-proxy	i386	1.2.8-4.slc4	patch1830
  glite-security-lcmaps-plugins-voms	i386	1.3.7-5.slc4	patch1830
  glite-security-voms-api-c	i386	1.8.3-4.slc4	patch1838
  glite-security-voms-api-cpp	i386	1.8.3-4.slc4	patch1838

2008-05-21 (Ale)

• Problem:

Job fails with error: BLAH error: + submission command failed (exit code = 1) N/A (jobId = CREAM....)

In the catalina.out log it is written this error message: ls_initdebug: Unable to open file lsf.conf

• Solution:

Add this line to the /opt/glite/etc/blah.config file:

. /data/lsf/conf/profile.lsf

2008-05-20 (Ale)

• Updated to the latest CREAM patch delivered to SA3 (#1755)

• Installing for dependencies:

• Run '/opt/glite/yaim/bin/yaim -c -s site-info.def -n creamCE'

2008-04-16 (Elisabetta)

• Updated to the latest CREAM patch delivered to SA3 (#1755)
  • Set up the following yum repo: http://grid-deployment.web.cern.ch/grid-deployment/glite/cert/3.1/patches/1755/sl4/i386
  • Run 'yum update' and 'yum install cert-glite-cream-CE'
  • Run '/opt/glite/yaim/bin/yaim -c -s site-info.def -n creamCE'

2008-01-23 (Elisabetta)

• Updated to last version of Cream following instructions at http://igrelease.forge.cnaf.infn.it/doku.php?id=doc:guides:install-cream31-devel and performing the following additional operations:
  • removed the following .rpms 'glite-security-lcmaps glite-security-lcmaps-interface glite-security-lcas glite-security-lcas-interface glite-security-lcmaps-plugins-voms glite-security-lcas-plugins-voms glite-security-glexec' before running 'yum update'
  • installed the following lsf plugin: cert-glite-LSF_utils-3.1.0-2.noarch.rpm, glite-yaim-lsf-utils-4.0.1-1.noarch.rpm, glite-apel-core-2.0.9-7.noarch.rpm and glite-apel-lsf-2.0.8-2.noarch.rpm Downloaded them from the repo http://grid-deployment.web.cern.ch/grid-deployment/glite/cert/3.1/patches/1571/sl4/i386/RPMS.1571/
  • had to add the following variables ACCESS_BY_DOMAIN=false, CEMON_HOST=devel03.cnaf.infn.it, CE_PHYSCPU=1 and CE_LOGCPU=1 to the site-info.def, otherwise the command

2007-11-16 (Elisabetta)

• Changed the value 'GlueCEStateStatus' from 'Production' to 'CREAM' by doing the following:
  • sed -i 's/Production/CREAM/' /opt/glite/libexec/glite-info-dynamic-lsf

2007-11-13 (Ale)

• To fix problem with the GIP use this rpm: perl-LDAP-0.31-5

2007-11-07 (Ale)

• Continuos the cream installation...
  • Remove the previous installed version of java and install java-1.5.0-sun-1.5.0.12-1jpp, java-1.5.0-sun-devel-1.5.0.12-1jpp and jdk-1.5.0_12-fcs
  • Install tomcat5-5.5.25-1jpp
  • Comment line config_jobmanager_lsf on /opt/glite/yaim/node-info.d/glite-lsf_utils
  • run /opt/glite/yaim/bin/yaim -c -s <site-info.def> -n creamCE -n LSF_utils
  • Fix problem with .pem certificate
• Open issue:
  • Gip doesn't work correctly.

2007-11-06 (Elisabetta)

• Installed and configured CREAM from scratch using the new repository from CERN and yaim scripts. The following steps were performed:
  • wget http://grid-it.cnaf.infn.it/mrepo/repos/cream-ce_cert.repo -O /etc/yum.repos.d/cream-ce.repo
  • yum clean all
  • yum update
  • yum install glite-yaim-core glite-yaim-cream-ce
  • Edited site-info.def, also adding the variables: BATCH_CONF_DIR = /data/lsf/conf and BDII_CREAM_CE_URL = "ldap://$CE_HOST:2170/mds-vo-name=resource,o=grid"
  • Downloaded and installed jdk-1_5_0_13-linux-i586-rpm by hand
  • run yum install cert-glite-cream-CE
  • downloaded and installed glite-yaim-lsf-utils-4.0.1-1.noarch.rpm
  • run /opt/glite/yaim/bin/yaim -c -s <site-info.def> -n creamCE -n LSF_utils

2007-10-15 (Elisabetta)

• Submitted jobs with the requirements to forward in the .jdl, like for ex. requirements = (( other.GlueHostMainMemoryRAMSize > 300 ) && ( other.GlueHostMainMemoryVirtualSize = 996 ) && ( other.GlueCEPolicyMaxCPUTime > 2880 )); but they don't get forwarded to lsf, mainly because they don't appear in the classad passed to blah.

[
Type = "Job";
JobType = "normal";
InputSandbox = {"file:///home/emolinar/test.sh"};
VirtualOrganisation = "atlas";
Executable="test.sh";
Arguments="Hello... ";
requirements = (( other.GlueHostMainMemoryRAMSize > 300 ) && ( other.GlueHostMainMemoryVirtualSize == 996 ) && ( other.GlueCEPolicyMaxCPUTime >= 2880 ));
Rank = other.GlueCEStateWaitingJobs;
rank = 3;
ShallowRetryCount = 3;
StdOutput="message.txt";
StdError="err.log";
OutputSandbox={"message.txt","err.log"};
]

Following is what appears in the '/usr/share/tomcat5/logs/glite-ce-cream.log' file:

16 Oct 2007 11:48:47,636 org.glite.ce.cream.connector.blah.StreamBlahpConnector - BLAH_JOB_SUBMIT 4 [Cmd="/opt/glite/var/cream_sandbox/dteam/C_IT_O_INFN_OU_Personal_Certificate_L_Milano_CN_Elisabetta_Molinari_dteam_Role_NULL_Capability_NULL/CREAM266115941/CREAM266115941_jobWrapper.sh";
gridType="lsf";uniquejobid="https://devel03.cnaf.infn.it:8443/CREAM266115941";ceid="devel03.cnaf.infn.it:8443/cream-lsf-long";
Out="/opt/glite/var/cream_sandbox/dteam/C_IT_O_INFN_OU_Personal_Certificate_L_Milano_CN_Elisabetta_Molinari_dteam_Role_NULL_Capability_NULL/CREAM266115941/StandardOutput";
Err="/opt/glite/var/cream_sandbox/dteam/C_IT_O_INFN_OU_Personal_Certificate_L_Milano_CN_Elisabetta_Molinari_dteam_Role_NULL_Capability_NULL/CREAM266115941/StandardError";
x509userproxy="/opt/glite/var/cream_sandbox/dteam/C_IT_O_INFN_OU_Personal_Certificate_L_Milano_CN_Elisabetta_Molinari_dteam_Role_NULL_Capability_NULL/CREAM266115941/CREAM266115941_proxy";
ClientJobId="266115941";queue="long"] 

2007-10-11 (Elisabetta)

• Installed the following three .rpms in order to verify the forward parameters to the batch system by BLAH works also with CREAM: glite-blah-local-submit-attributes-lsf-3.0.10-2.noarch.rpm, glite-info-dynamic-scheduler-lsf-2.0.1-2.noarch.rpm and glite-info-generic-2.0.2-2.noarch.rpm

-- AlessioGianelle - 11 Oct 2007