Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Notes about Installation and Configuration of a CREAM Computing Element using an external Torque server as batch system and ARGUS as authorization method
| ||||||||
Line: 131 to 131 | ||||||||
hideimgright="/twiki/pub/TWiki/TWikiDocGraphics/toggleclose.gif"
}%
users and groups configuration | ||||||||
Changed: | ||||||||
< < | here an example on how to define pool accounts (ig-users.conf) and groups (ig-groups.conf) for several VOs | |||||||
> > | here an example on how to define pool accounts (ig-users.conf) and groups (ig-groups.conf) for several VOs | |||||||
</> <--/twistyPlugin-->%TWISTY{ |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Changed: | ||||||||
< < | WORK IN PROGRESS Notes about Installation and Configuration of a CREAM Computing Element using an external Torque server as batch system and ARGUS as authorization method | |||||||
> > | Notes about Installation and Configuration of a CREAM Computing Element using an external Torque server as batch system and ARGUS as authorization method | |||||||
| ||||||||
Line: 163 to 163 | ||||||||
hideimgright="/twiki/pub/TWiki/TWikiDocGraphics/toggleclose.gif"
}%
site-info.def | ||||||||
Changed: | ||||||||
< < | SUGGESTION: you can use the same site-info.def used for the main CREAM computing element and for WNs, with just a few changements. | |||||||
> > | SUGGESTION: you can use the same site-info.def used for the main CREAM computing element and for WNs, with just a few changements
CE_HOST=cremoso.$MY_DOMAIN CE_PHYSCPU=0 CE_LOGCPU=0 BATCH_SERVER=cremino.cnaf.infn.it | |||||||
For your convenience there is an explanation of each yaim variable. For more details look at [8, 9, 10]
</> <--/twistyPlugin--> | ||||||||
Line: 375 to 380 | ||||||||
Connection to cremoso.cnaf.infn.it closed. | ||||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
# cat /root/.ssh/known_hosts |grep cremoso >> /etc/ssh/ssh_known_hosts | ||||||||
Line: 396 to 401 | ||||||||
hideimgright="/twiki/pub/TWiki/TWikiDocGraphics/toggleclose.gif"
}%
import from main CE | ||||||||
Changed: | ||||||||
< < | you have to import several things from the main C£ / batvh server: gridmapdir, torque path, and the software area and tags.
| |||||||
> > |
you have to import several things from the main CE / batch server: gridmapdir, torque path, and the software area and tags.
On the main CE
First of all you have to export the proper directories from the main CE:
/opt/exp_soft/ *.cnaf.infn.it(rw,sync,no_root_squash) /etc/grid-security/gridmapdir cremoso.cnaf.infn.it(rw,sync,no_root_squash) /var/torque/ cremoso.cnaf.infn.it(rw,sync,no_root_squash) /opt/edg/var/info/ cremoso.cnaf.infn.it(rw,sync,no_root_squash)
# exportfs -raOn the second CE
| |||||||
cremino.cnaf.infn.it:/opt/exp_soft/ /opt/exp_soft/ nfs rw,defaults 0 0 cremino.cnaf.infn.it:/etc/grid-security/gridmapdir /etc/grid-security/gridmapdir nfs rw,defaults 0 0 | ||||||||
Line: 465 to 490 | ||||||||
# /opt/glite/yaim/bin/yaim -v -s site-info_cremoso.def -n creamCE -n TORQUE_utils -n DGAS_sensors | ||||||||
Changed: | ||||||||
< < | see details | |||||||
> > | see details | |||||||
</> <--/twistyPlugin--> | ||||||||
Line: 478 to 503 | ||||||||
hideimgright="/twiki/pub/TWiki/TWikiDocGraphics/toggleclose.gif"
}%
yaim config | ||||||||
Added: | ||||||||
> > | # /opt/glite/yaim/bin/yaim -c -s site-info_cremoso.def -n creamCE -n TORQUE_utils -n DGAS_sensorssee details </> <--/twistyPlugin--> Service Checks<--/twistyPlugin twikiMakeVisibleInline-->
TORQUE checks:
# qstat -q # pbsnodes -a ssh checks | |||||||
Added: | ||||||||
> > |
| |||||||
<--/twistyPlugin--> Revisions
| ||||||||
Added: | ||||||||
> > |
| |||||||
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
WORK IN PROGRESS Notes about Installation and Configuration of a CREAM Computing Element using an external Torque server as batch system and ARGUS as authorization method
| ||||||||
Line: 451 to 451 | ||||||||
</> <--/twistyPlugin--> | ||||||||
Added: | ||||||||
> > | <--/twistyPlugin twikiMakeVisibleInline--> <--/twistyPlugin--> <--/twistyPlugin twikiMakeVisibleInline--> <--/twistyPlugin--> | |||||||
Revisions
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
WORK IN PROGRESS Notes about Installation and Configuration of a CREAM Computing Element using an external Torque server as batch system and ARGUS as authorization method
| ||||||||
Line: 295 to 295 | ||||||||
}%
authorization on the batch server | ||||||||
Changed: | ||||||||
< < | In order to allow the submission from the second CE, do the following actions: | |||||||
> > | In order to allow the submission from the second CE, do the following actions on the "main CE / batch server": | |||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
| ||||||||
Line: 389 to 389 | ||||||||
%TWISTY{ mode="div" | ||||||||
Changed: | ||||||||
< < | showlink=" software area settings " hidelink=" software area settings " | |||||||
> > | showlink=" import from main CE " hidelink=" import from main CE " | |||||||
remember="off" firststart="hide" showimgright="/twiki/pub/TWiki/TWikiDocGraphics/toggleopen.gif" hideimgright="/twiki/pub/TWiki/TWikiDocGraphics/toggleclose.gif" }% | ||||||||
Changed: | ||||||||
< < | software area settingsyou have to import the software area from the main CE. | |||||||
> > | import from main CEyou have to import several things from the main C£ / batvh server: gridmapdir, torque path, and the software area and tags. | |||||||
cremino.cnaf.infn.it:/opt/exp_soft/ /opt/exp_soft/ nfs rw,defaults 0 0 | ||||||||
Added: | ||||||||
> > | cremino.cnaf.infn.it:/etc/grid-security/gridmapdir /etc/grid-security/gridmapdir nfs rw,defaults 0 0 cremino.cnaf.infn.it:/var/torque/ /var/torque/ nfs rw,defaults 0 0 cremino.cnaf.infn.it:/opt/edg/var/info/ /opt/edg/var/info/ nfs rw,defaults 0 0 | |||||||
Added: | ||||||||
> > | Remember to create those directories if they don't exist yet | |||||||
# service nfs status | ||||||||
Line: 430 to 435 | ||||||||
# df -h Filesystem Size Used Avail Use% Mounted on | ||||||||
Changed: | ||||||||
< < | /dev/sda3 65G 1.9G 59G 4% / /dev/sda1 99M 18M 76M 19% /boot tmpfs 2.0G 0 2.0G 0% /dev/shm | |||||||
> > | /dev/mapper/VolGroup00-LogVol00 16G 2.8G 12G 19% / /dev/vda1 99M 20M 75M 21% /boot tmpfs 1006M 0 1006M 0% /dev/shm | |||||||
cremino.cnaf.infn.it:/opt/exp_soft/ | ||||||||
Changed: | ||||||||
< < | 65G 4.4G 57G 8% /opt/exp_soft | |||||||
> > | 65G 4.2G 57G 7% /opt/exp_soft cremino.cnaf.infn.it:/etc/grid-security/gridmapdir 65G 4.2G 57G 7% /etc/grid-security/gridmapdir cremino.cnaf.infn.it:/var/torque/ 65G 4.2G 57G 7% /var/torque cremino.cnaf.infn.it:/opt/edg/var/info/ 65G 4.2G 57G 7% /opt/edg/var/info | |||||||
</> <--/twistyPlugin--> |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
WORK IN PROGRESS Notes about Installation and Configuration of a CREAM Computing Element using an external Torque server as batch system and ARGUS as authorization method
| ||||||||
Line: 136 to 136 | ||||||||
%TWISTY{ mode="div" | ||||||||
Added: | ||||||||
> > | showlink=" wn-list.conf "
hidelink=" wn-list.conf "
remember="off" firststart="hide"
showimgright="/twiki/pub/TWiki/TWikiDocGraphics/toggleopen.gif"
hideimgright="/twiki/pub/TWiki/TWikiDocGraphics/toggleclose.gif"
}%
wn-list.confSet in this file the WNs list, for example:# less wn-list.conf wn01.cnaf.infn.it wn02.cnaf.infn.it wn03.cnaf.infn.it wn04.cnaf.infn.it</> <--/twistyPlugin-->%TWISTY{ mode="div" | |||||||
showlink=" site-info.def " hidelink=" site-info.def " remember="off" firststart="hide" | ||||||||
Line: 265 to 285 | ||||||||
</> <--/twistyPlugin--> | ||||||||
Added: | ||||||||
> > | <--/twistyPlugin twikiMakeVisibleInline--> authorization on the batch serverIn order to allow the submission from the second CE, do the following actions:
# qmgr -c "set server authorized_users += *@cremoso.cnaf.infn.it" <--/twistyPlugin--> <--/twistyPlugin twikiMakeVisibleInline--> munge configurationIMPORTANT: The updated EPEL5 build of torque-2.5.7-1 as compared to previous versions enables munge as an inter node authentication method.
# rpm -qa | grep munge munge-libs-0.5.8-8.el5 munge-0.5.8-8.el5
# /usr/sbin/create-munge-key # ls -ltr /etc/munge/ total 4 -r-------- 1 munge munge 1024 Jan 13 14:32 munge.key
# chown munge:munge /etc/munge/munge.key
# service munge start Starting MUNGE: [ OK ] # chkconfig munge on <--/twistyPlugin--> <--/twistyPlugin twikiMakeVisibleInline--> ssh configuration for the cluster hostsThe ssh access of the second CE to the cluster isn't completely handled by yaim, so you have to do some actions in order to configure it.
[root@cremino ~]# ssh cremoso.cnaf.infn.it The authenticity of host 'cremoso.cnaf.infn.it (131.154.101.48)' can't be established. RSA key fingerprint is b6:5e:1f:aa:45:2f:5f:f0:73:d2:8f:9d:a1:86:bb:7e. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'cremoso.cnaf.infn.it,131.154.101.48' (RSA) to the list of known hosts. root@cremoso.cnaf.infn.it's password: Last login: Fri Feb 10 09:33:47 2012 from pcpaolini.cnaf.infn.it ___ _ _ _____ _ _ ____ _ _ _ _____ |_ _| \ | | ___| \ | | / ___| \ | | / \ | ___| | || \| | |_ | \| |_____| | | \| | / _ \ | |_ | || |\ | _| | |\ |_____| |___| |\ |/ ___ \| _| |___|_| \_|_| |_| \_| \____|_| \_/_/ \_\_| [root@cremoso ~]# exit logout Connection to cremoso.cnaf.infn.it closed.
# cat /root/.ssh/known_hosts |grep cremoso >> /etc/ssh/ssh_known_hosts
# scp /etc/ssh/ssh_known_hosts cremoso:/etc/ssh/ <--/twistyPlugin--> <--/twistyPlugin twikiMakeVisibleInline--> software area settingsyou have to import the software area from the main CE.
cremino.cnaf.infn.it:/opt/exp_soft/ /opt/exp_soft/ nfs rw,defaults 0 0
# service nfs status rpc.mountd is stopped nfsd is stopped # service portmap status portmap is stopped # service portmap start Starting portmap: [ OK ] # service nfs start Starting NFS services: [ OK ] Starting NFS daemon: [ OK ] Starting NFS mountd: [ OK ] Starting RPC idmapd: [ OK ] # chkconfig nfs on # chkconfig portmap on
mount -a
# df -h Filesystem Size Used Avail Use% Mounted on /dev/sda3 65G 1.9G 59G 4% / /dev/sda1 99M 18M 76M 19% /boot tmpfs 2.0G 0 2.0G 0% /dev/shm cremino.cnaf.infn.it:/opt/exp_soft/ 65G 4.4G 57G 8% /opt/exp_soft <--/twistyPlugin--> Revisions
| |||||||
-- AlessandroPaolini - 2012-02-09 \ No newline at end of file |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
WORK IN PROGRESS Notes about Installation and Configuration of a CREAM Computing Element using an external Torque server as batch system and ARGUS as authorization method
| ||||||||
Line: 208 to 208 | ||||||||
# Specify the type of job which the CE has to process. # Set ”all” on “the main CE” of the site, ”grid” on the others. # Default value: all | ||||||||
Changed: | ||||||||
< < | #DGAS_JOBS_TO_PROCESS="all" | |||||||
> > | DGAS_JOBS_TO_PROCESS="grid" | |||||||
# This parameter can be used to specify the list of VOs to publish. # If the parameter is specified, the sensors (pushd) will forward | ||||||||
Line: 231 to 231 | ||||||||
# for all hosts sharing the lrms and this value can be arbitrary chosen among # these submitting hostnames (you may choose the best one). # Otherwise leave it commented. | ||||||||
Changed: | ||||||||
< < | #DGAS_USE_CE_HOSTNAME="" | |||||||
> > | # we have 2 CEs, cremino is the main one DGAS_USE_CE_HOSTNAME="cremino.cnaf.infn.it" | |||||||
# Path for the batch-system log files. # * for torque/pbs: |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
WORK IN PROGRESS Notes about Installation and Configuration of a CREAM Computing Element using an external Torque server as batch system and ARGUS as authorization method
| ||||||||
Line: 97 to 97 | ||||||||
</> <--/twistyPlugin--> | ||||||||
Added: | ||||||||
> > | Service configurationYou have to copy the configuration files in another path, for example root, and set them properly (see later):# cp -r /opt/glite/yaim/examples/siteinfo/* . <--/twistyPlugin twikiMakeVisibleInline--> vo.d directoryCreate the vo.d directory for the VO configuration file (you can decide if keep the VO information in the site.def or putting them in the vo.d directory)# mkdir vo.dhere an example for some VOs. | |||||||
Added: | ||||||||
> > | Information about the several VOs are available at the CENTRAL OPERATIONS PORTAL.
<--/twistyPlugin--> <--/twistyPlugin twikiMakeVisibleInline--> users and groups configurationhere an example on how to define pool accounts (ig-users.conf) and groups (ig-groups.conf) for several VOs<--/twistyPlugin--> <--/twistyPlugin twikiMakeVisibleInline--> site-info.defSUGGESTION: you can use the same site-info.def used for the main CREAM computing element and for WNs, with just a few changements. For your convenience there is an explanation of each yaim variable. For more details look at [8, 9, 10]<--/twistyPlugin--> <--/twistyPlugin twikiMakeVisibleInline--> services/glite-creamce# # YAIM creamCE specific variables # # LSF settings: path where lsf.conf is located #BATCH_CONF_DIR=lsf_install_path/conf # # CE-monitor host (by default CE-monitor is installed on the same machine as # cream-CE) CEMON_HOST=$CE_HOST # # CREAM database user CREAM_DB_USER=********* # CREAM_DB_PASSWORD=********* # Machine hosting the BLAH blparser. # In this machine batch system logs must be accessible. #BLPARSER_HOST=set_to_fully_qualified_host_name_of_machine_hosting_blparser_server BLPARSER_HOST=$CE_HOST <--/twistyPlugin--> <--/twistyPlugin twikiMakeVisibleInline--> services/dgas_sensors# # YAIM DGAS Sensors specific variables # ################################ # DGAS configuration variables # ################################ # For any details about DGAS variables please refer to the guide: # http://igrelease.forge.cnaf.infn.it/doku.php?id=doc:guides:dgas # Reference Resource HLR for the site. DGAS_HLR_RESOURCE="prod-hlr-01.pd.infn.it" # Specify the type of job which the CE has to process. # Set ”all” on “the main CE” of the site, ”grid” on the others. # Default value: all #DGAS_JOBS_TO_PROCESS="all" # This parameter can be used to specify the list of VOs to publish. # If the parameter is specified, the sensors (pushd) will forward # to the Site HLR just records belonging to one of the specified VOs. # Leave commented if you want to send records for ALL VOs # Default value: parameter not specified #DGAS_VO_TO_PROCESS="vo1;vo2;vo3..." # Bound date on jobs backward processing. # The backward processing does not consider jobs prior to that date. # Default value: 2009-01-01. #DGAS_IGNORE_JOBS_LOGGED_BEFORE="2011-11-01" # Main CE of the site. # ATTENTION: set this variable only in the case of site with a “singleLRMS” # in which there are more than one CEs or local submission hosts (i.e. host # from which you may submit jobs directly to the batch system). # In this case, DGAS_USE_CE_HOSTNAME parameter must be set to the same value # for all hosts sharing the lrms and this value can be arbitrary chosen among # these submitting hostnames (you may choose the best one). # Otherwise leave it commented. #DGAS_USE_CE_HOSTNAME="" # Path for the batch-system log files. # * for torque/pbs: # DGAS_ACCT_DIR=/var/torque/server_priv/accounting # * for LSF: # DGAS_ACCT_DIR=lsf_install_path/work/cluster_name/logdir # * for SGE: # DGAS_ACCT_DIR=/opt/sge/default/common/ DGAS_ACCT_DIR=/var/torque/server_priv/accounting # Full path to the 'condor_history' command, used to gather DGAS usage records # when Condor is used as a batch system. Otherwise leave it commented. #DGAS_CONDOR_HISTORY_COMMAND="" <--/twistyPlugin--> <--/twistyPlugin twikiMakeVisibleInline--> ---+++ host certificate # ll /etc/grid-security/host* -rw-r--r-- 1 root root 1440 Oct 18 09:31 /etc/grid-security/hostcert.pem -r-------- 1 root root 887 Oct 18 09:31 /etc/grid-security/hostkey.pem <--/twistyPlugin--> | |||||||
-- AlessandroPaolini - 2012-02-09 |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Added: | ||||||||
> > |
WORK IN PROGRESS Notes about Installation and Configuration of a CREAM Computing Element using an external Torque server as batch system and ARGUS as authorization method
References
Service installation<--/twistyPlugin twikiMakeVisibleInline--> O.S. and Repos
# cat /etc/redhat-release Scientific Linux SL release 5.7 (Boron)* Install the additional repositories: EPEL, Certification Authority, UMD # yum install yum-priorities yum-protectbase # cd /etc/yum.repos.d/ # rpm -ivh http://mirror.switch.ch/ftp/mirror/epel//5/x86_64/epel-release-5-4.noarch.rpm # wget http://repo-pd.italiangrid.it/mrepo/repos/egi-trustanchors.repo # rpm -ivh http://repo-pd.italiangrid.it/mrepo/EMI/1/sl5/x86_64/updates/emi-release-1.0.1-1.sl5.noarch.rpm # wget http://repo-pd.italiangrid.it/mrepo/repos/igi/sl5/x86_64/igi-emi.repo
# getenforce Disabled
# ls /etc/yum.repos.d/ egi-trustanchors.repo emi1-third-party.repo emi1-base.repo emi1-updates.repo igi-emi.repo epel.repo epel-testing.repo sl-contrib.repo sl-fastbugs.repo sl-security.repo sl-testing.repo sl-debuginfo.repo sl.repo sl-srpms.repoIMPORTANT: remove the dag repository if present <--/twistyPlugin--> <--/twistyPlugin twikiMakeVisibleInline--> yum install# yum clean all Loaded plugins: downloadonly, kernel-module, priorities, protect-packages, protectbase, security, verify, versionlock Cleaning up Everything # yum install ca-policy-egi-core # yum install xml-commons-apis # yum install emi-cream-ce # yum install emi-torque-utils # yum install glite-dgas-common glite-dgas-hlr-clients glite-dgas-hlr-sensors glite-dgas-hlr-sensors-producers yaim-dgas # yum install nfs-utilssee here for details <--/twistyPlugin-->-- AlessandroPaolini - 2012-02-09 |