Difference: Task23314 (1 vs. 2)

• ETICS Subsystem Configuration Name: emi-lsf-utils-mp_R_2_0_0_1

• Platform: SL5 epel, SL6 epel

• EMI2 CREAM LSF Module SL5 installation from scratch and configuration log here.

• EMI2 CREAM LSF Module SL6 installation from scratch and configuration log here.

• EMI2 CREAM LSF Module SL5 update from EMI1 production version and configuration log here.

Functionality tests

The functionality tests are performed in the cream testing environment.

Verification attached bugs

[https://savannah.cern.ch/bugs/?88720][bug #88720: Too many '9' in GlueCEPolicyMaxCPUTime for LSF] FIXED

The EMI2 cream ce is now publishing the right '9' number

[root@cream-48 ~]# cat /etc/emi-version
2.0.0-1

$ ldapsearch -x -h cream-48.pd.infn.it:2170 -b mds-vo-name=resource,o=grid |grep GlueCEPolicyMaxCPUTime 
GlueCEPolicyMaxCPUTime: 999999999

[https://savannah.cern.ch/bugs/?89767][bug #89767: The LSF dynamic infoprovider shouldn't publish GlueCEStateFreeCPUs and GlueCEStateFreeJobSlots] FIXED

[root@cream-48 ~]# /sbin/runuser -s /bin/sh ldap -c "/var/lib/bdii/gip/plugin/glite-info-dynamic-ce" |grep GlueCEStateFreeJobSlots
[root@cream-48 ~]# /sbin/runuser -s /bin/sh ldap -c "/var/lib/bdii/gip/plugin/glite-info-dynamic-ce" |grep GlueCEStateFreeCPUs

[https://savannah.cern.ch/bugs/?89794][bug #89794: LSF info provider doesn't allow - in a queue name] FIX NOT CERTIFIED

Trying to configure in site-info.def

%PURPLE%
QUEUES="demo cert testers bye-baby"
    
DEMO_GROUP_ENABLE="dteam testers.eu-emi.eu"
CERT_GROUP_ENABLE="dteam testers.eu-emi.eu"
TESTERS_GROUP_ENABLE="testers.eu-emi.eu"
BYE-BABY_GROUP_ENABLE="dteam testers.eu-emi.eu"

/opt/glite/yaim/bin/yaim -d 6 -c -s /root/siteinfo/site-info.def -n creamCE -n LSF_utils
   DEBUG: Checking siteinfo dir is not world readable
   WARNING: 
   WARNING: *****************************************************************************
   WARNING: Your siteinfo directory is world readable. This is generally a bad idea      
   WARNING: as configuration files may contain passwords and other sensitive information.
   WARNING: *****************************************************************************
   WARNING: 
   DEBUG: Checking site-info.def is syntactically correct
   ERROR: The site-info specified: /root/siteinfo/site-info.def is syntactically incorrect. Please, check the syntax.
   ERROR: Configuration file error

[https://savannah.cern.ch/bugs/?90113][bug #90113: missing yaim check for batch system] FIXED

Installation:

mv dag.repo dag.repo.remove
cd /etc/yum.repos.d/
mv dag.repo dag.repo.remove
rpm -Uvh http://dl.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm
wget http://repository.egi.eu/sw/production/cas/1/current/repo-files/EGI-trustanchors.repo -O /etc/yum.repos.d/EGI-trustanchors.repo
wget https://twiki.cern.ch/twiki/pub/EMI/EMI-2/emi-2-rc-sl5.repo -O /etc/yum.repos.d/emi-2-rc-sl5.repo --no-check-certificate
yum install yum-protectbase -y; yum install ca-policy-egi-core -y; yum install xml-commons-apis -y; yum install emi-cream-ce -y
yum install emi-lsf-utils -y 

Running yaim:

/opt/glite/yaim/bin/yaim -c -s /usr/local/nfs1/jra1_test/cream-06/site-info_certification.def  -n LSF_utils
/opt/glite/yaim/functions/config_check_lsf_installation: line 43: /opt/lsf/7.0/linux2.6-glibc2.3-x86_64/bin/lsid: No such file or directory
   WARNING: 
   WARNING: *****************************************************************************
   WARNING: Your siteinfo directory is world readable. This is generally a bad idea      
   WARNING: as configuration files may contain passwords and other sensitive information.
   WARNING: *****************************************************************************
   WARNING: 
   INFO: Configuring HOST: cream-06.pd.infn.it
   DEBUG: Sourcing /opt/glite/yaim/bin/../defaults/site-info.pre
   INFO: Using site configuration file: /usr/local/nfs1/jra1_test/cream-06/site-info_certification.def
   DEBUG: Sourcing site-info.def file: /usr/local/nfs1/jra1_test/cream-06/site-info_certification.def
   DEBUG: Sourcing /opt/glite/yaim/bin/../defaults/site-info.post
   DEBUG: Sourcing /opt/glite/yaim/bin/../defaults/mapping
   INFO: 
         ###################################################################
         
         .             /'.-. ')
         .     yA,-"-,( ,m,:/ )   .oo.     oo    o      ooo  o.     .oo
         .    /      .-Y a  a Y-.     8. .8'    8'8.     8    8b   d'8
         .   /           ~ ~ /         8'    .8oo88.     8    8  8'  8
         . (_/         '===='          8    .8'     8.   8    8  Y   8
         .   Y,-''-,Yy,-.,/           o8o  o8o    o88o  o8o  o8o    o8o
         .    I_))_) I_))_)
         
         
         current working directory: /etc/yum.repos.d
         site-info.def date: Apr 27 17:25 /usr/local/nfs1/jra1_test/cream-06/site-info_certification.def
         yaim command: -c -s /usr/local/nfs1/jra1_test/cream-06/site-info_certification.def -n LSF_utils
         log file: /opt/glite/yaim/bin/../log/yaimlog
         Fri Apr 27 17:25:37 CEST 2012 : /opt/glite/yaim/bin/yaim
         
         Installed YAIM versions:
         glite-yaim-bdii 4.3.9-1
         glite-yaim-core 5.0.3-4
         glite-yaim-cream-ce 4.3.0-4
         glite-yaim-lsf-utils 5.0.0-2
         
         ####################################################################
   INFO: The default location of the grid-env.(c)sh files will be: /usr/libexec
   INFO: Sourcing the utilities in /opt/glite/yaim/functions/utils
   INFO: Detecting environment
   DEBUG: Detect platform: OS flavour detected is: "Scientific Linux SL release 5.5 (Boron)"
   DEBUG: Detected architecture is 64BIT
   DEBUG: Detect platform: OS type detected: sl5
   DEBUG: GROUPS_CONF is defined. Adding global groups to the groups.conf temp file
   DEBUG: GROUPS_CONF points now to the groups.conf temp file
   DEBUG: GROUPS_CONF=/tmp/yaim.pd9165
   DEBUG: Resulted NODE_TYPE_LIST is : LSF_utils
   DEBUG: Setting environment variable GRID_ENV_LOCATION, to value "/usr/libexec".
   DEBUG: Unset environment variable GRID_ENV_LOCATION.
   DEBUG: Setting environment variable LCG_LOCATION, to value "/usr".
   DEBUG: Unset environment variable LCG_LOCATION.
   DEBUG: Setting environment variable GLITE_LOCATION, to value "/usr".
   DEBUG: Unset environment variable GLITE_LOCATION.
   DEBUG: Setting environment variable GLITE_LOCATION_VAR, to value "/var".
   DEBUG: Unset environment variable GLITE_LOCATION_VAR.
   DEBUG: Appending value "/bin" to environment variable PATH.
   DEBUG: Deleting value "/bin" from environment variable PATH.
   DEBUG: Appending value "/opt/glite/share/man" to environment variable MANPATH.
   DEBUG: Deleting value "/opt/glite/share/man" from environment variable MANPATH.
   DEBUG: Sourcing node definition file: /opt/glite/yaim/bin/../node-info.d/glite-lsf_utils
   INFO: Executing function: config_check_lsf_installation_check 
   INFO: Executing function: config_apel_lsf_check 
   INFO: Executing function: config_gip_sched_plugin_lsf_check 
   INFO: Executing function: config_check_lsf_installation_setenv 
   DEBUG: This function currently doesn't set any environment variables.
   INFO: Executing function: config_check_lsf_installation 
   DEBUG: Check if LSF is installed running lsid ...
   ERROR: Problem running lsid: LSF not properly installed
   ERROR: One of the functions returned with error without specifying its nature !

Testing and Certification report savannah task #23314: CREAM LSF module v. 2.0.0 (EMI2)

Summary

• Product: CREAM LSF module v. 2.0.0
• Release Task: Task #23314
• ETICS Subsystem Configuration Name: **
• VCS Tag:
• EMI Major Release: EMI 2 (Matterhorn)
• Platform: SL5 epel
• Author: Sara Bertocco
• Testing report: TBD
• Certification report: TBD
• Date: 27st April 2012
• Outcome: In certification

SL5

Deployment tests

Clean Installation

• EMI2 CREAM LSF Module SL5 installation from scratch and configuration log [[][here]].

• EMI2 CREAM LSF Module SL6 installation from scratch and configuration log [[][here]].

Upgrade Installation

• EMI2 CREAM LSF Module SL5 update from EMI1 production version and configuration log [[][here]].

Unit Tests

??? TODO ???

System tests

Functionality tests after the update

Regression tests

TBD??

-- SaraBertocco - 2012-04-27

• EMI2RC_LSFModule_SL5_install.log: EMI2RC_LSFModule_SL5_install.log

• EMI2RC_LSFModule_SL6_install.log: EMI2RC_LSFModule_SL6_install.log

• EMI1_LSFModule_prod_to_EMI2RC_update.log: EMI1_LSFModule_prod_to_EMI2RC_update.log