Difference: NotesAboutInstallationAndConfigurationOfCREAMForTORQUE (3 vs. 4)

Revision 42012-02-14 - AlessandroPaolini

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

WORK IN PROGRESS Notes about Installation and Configuration of a CREAM Computing Element using an external Torque server as batch system and ARGUS as authorization method

  • These notes are provided by site admins on a best effort base as a contribution to the IGI communities and MUST not be considered as a subsitute of the Official IGI documentation.
Line: 136 to 136
  %TWISTY{ mode="div"
Added:
>
>
showlink=" wn-list.conf " hidelink=" wn-list.conf " remember="off" firststart="hide" showimgright="/twiki/pub/TWiki/TWikiDocGraphics/toggleopen.gif" hideimgright="/twiki/pub/TWiki/TWikiDocGraphics/toggleclose.gif" }%

wn-list.conf

Set in this file the WNs list, for example:

# less wn-list.conf 
wn01.cnaf.infn.it
wn02.cnaf.infn.it
wn03.cnaf.infn.it
wn04.cnaf.infn.it
</>
<--/twistyPlugin-->

%TWISTY{ mode="div"

 showlink=" site-info.def " hidelink=" site-info.def " remember="off" firststart="hide"
Line: 265 to 285
  </>
<--/twistyPlugin-->
Added:
>
>
<--/twistyPlugin twikiMakeVisibleInline-->

authorization on the batch server

In order to allow the submission from the second CE, do the following actions:

  • on the "main CE / batch server" edit the files /etc/hosts.equiv and /etc/ssh/shosts.equiv adding the FQDN on the second CE

  • define the parameter authorized_users in the pbs server:
# qmgr -c "set server authorized_users += *@cremoso.cnaf.infn.it"

<--/twistyPlugin-->

<--/twistyPlugin twikiMakeVisibleInline-->

munge configuration

IMPORTANT: The updated EPEL5 build of torque-2.5.7-1 as compared to previous versions enables munge as an inter node authentication method.

  • verify that munge is correctly installed:
# rpm -qa | grep munge
munge-libs-0.5.8-8.el5
munge-0.5.8-8.el5
  • On one host (for example the batch server) generate a key by launching:
# /usr/sbin/create-munge-key

# ls -ltr /etc/munge/
total 4
-r-------- 1 munge munge 1024 Jan 13 14:32 munge.key
  • Copy the key, /etc/munge/munge.key to every host of your cluster, adjusting the permissions:
# chown munge:munge /etc/munge/munge.key
  • Start the munge daemon on each node:
# service munge start
Starting MUNGE:                                            [  OK  ]

# chkconfig munge on

<--/twistyPlugin-->

<--/twistyPlugin twikiMakeVisibleInline-->

ssh configuration for the cluster hosts

The ssh access of the second CE to the cluster isn't completely handled by yaim, so you have to do some actions in order to configure it.

  • login to your "main CE / batch server" and do a ssh to the second CE, then exit:
[root@cremino ~]# ssh cremoso.cnaf.infn.it
The authenticity of host 'cremoso.cnaf.infn.it (131.154.101.48)' can't be established.
RSA key fingerprint is b6:5e:1f:aa:45:2f:5f:f0:73:d2:8f:9d:a1:86:bb:7e.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'cremoso.cnaf.infn.it,131.154.101.48' (RSA) to the list of known hosts.
root@cremoso.cnaf.infn.it's password: 
Last login: Fri Feb 10 09:33:47 2012 from pcpaolini.cnaf.infn.it
 ___ _   _ _____ _   _        ____ _   _    _    _____
|_ _| \ | |  ___| \ | |      / ___| \ | |  / \  |  ___|
 | ||  \| | |_  |  \| |_____| |   |  \| | / _ \ | |_
 | || |\  |  _| | |\  |_____| |___| |\  |/ ___ \|  _|
|___|_| \_|_|   |_| \_|      \____|_| \_/_/   \_\_|
[root@cremoso ~]# exit
logout
Connection to cremoso.cnaf.infn.it closed.

  • The key produced and stored in /root/.ssh/known_hosts for the second CE should be added in the /etc/ssh/ssh_known_hosts file of the main CE and the WNs of the site.
# cat /root/.ssh/known_hosts |grep cremoso >> /etc/ssh/ssh_known_hosts

  • Assuming that the main CE /etc/ssh/ssh_known_hosts file contains the keys of all WNs perform a copy of it into the second CE:
# scp /etc/ssh/ssh_known_hosts cremoso:/etc/ssh/

<--/twistyPlugin-->

<--/twistyPlugin twikiMakeVisibleInline-->

software area settings

you have to import the software area from the main CE.
  • Edit the file /etc/fstab by adding a line like the following:
cremino.cnaf.infn.it:/opt/exp_soft/ /opt/exp_soft/ nfs rw,defaults 0 0
  • check nfs and portmap status
# service nfs status
rpc.mountd is stopped
nfsd is stopped

# service portmap status
portmap is stopped

# service portmap start
Starting portmap:                                          [  OK  ]

# service nfs start
Starting NFS services:                                     [  OK  ]
Starting NFS daemon:                                       [  OK  ]
Starting NFS mountd:                                       [  OK  ]
Starting RPC idmapd:                                       [  OK  ]

# chkconfig nfs on
# chkconfig portmap on
  • after any modification in /etc/fstab launch
mount -a
  • verify the mount:
# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda3              65G  1.9G   59G   4% /
/dev/sda1              99M   18M   76M  19% /boot
tmpfs                 2.0G     0  2.0G   0% /dev/shm
cremino.cnaf.infn.it:/opt/exp_soft/
                       65G  4.4G   57G   8% /opt/exp_soft

<--/twistyPlugin-->

Revisions

Date Comment By
2012-02-09 First draft Alessandro Paolini
 -- AlessandroPaolini - 2012-02-09 \ No newline at end of file
 
This site is powered by the TWiki collaboration platformCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback