Tags:
,
view all tags
---+ IGI (based on EMI) Installation and Configuration %TOC% ---++ *Installation* ---+++ OS installation Install SL5 using [[http://linuxsoft.cern.ch/scientific/5x/][SL5.X repository (CERN mirror)]] or one of the supported <acronym title="Operating System">OS</acronym> (RHEL5 clones). You may find information on official OS repositories at [[https://www.scientificlinux.org/documentation/faq/yum.apt.repo][Repositories for APT and YUM]] <br /> If you want to set up a local installation server please refer to [[http://igrelease.forge.cnaf.infn.it/doku.php?id=doc:tips:mrepo][Mrepo Quick Guide]] *NOTE*: Please check if <em> =NTP= </em>, <em> =cron= </em> and <em> =logrotate= </em> are installed, otherwise install them! ---++++ Check the FQDN hostname Ensure that the hostnames of your machines are correctly set. Run the command: <pre> hostname -f</pre> It should print the fully qualified domain name (e.g. =prod-ce.mydomain.it=). Correct your network configuration if it prints only the hostname without the domain. If you are installing WN on private network the command must return the external FQDN for the CE and the SE (e.g. =prod-ce.mydomain.it=) and the internal FQDN for the WNs (e.g. =node001.myintdomain=). ---++++ Disabling SELinux Please remember to fully disabling SELinux. Disabling will completely disable all SELinux functions including file and process labelling. In RedHat Enterprise, edit /etc/selinux/config and change the SELINUX line to SELINUX=disabled: <pre> # disabled - No SELinux policy is loaded. SELINUX=disabled </pre> ... and then reboot the system. ---+++ Repository Settings To have more details to the repository have a look to the this link [[http://wiki.italiangrid.org/twiki/bin/view/IGIRelease/RepositoriesSpecifications][Repository Specifications]] If not present by default on your SL5/x86_64 nodes, you should enable the EPEL repository (https://fedoraproject.org/wiki/EPEL) EPEL has an _epel-release_ package that includes the gpg key used for package signing and other repository information, like the .repo files. Installing this package, <a target="_top" href="http://download.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm">http://download.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm</a>, should allow you to use normal tools such as yum to install packages and their dependencies. By default the stable EPEL repo is enabled. Example of *epel.repo* file: <pre>[extras] name=epel mirrorlist=http://mirrors.fedoraproject.org/mirrorlist?repo=epel-5&arch=$basearch protect=0 </pre> *IMPORTANT NOTE*: * If present remember to *disable* the _dag.repo_ if it is enabled. You need to have enabled only the following repositories (Operating System, EPEL, Certification Authority, EMI): | *Common repositories *x86_64** | | epel.repo | | emi.repo <br>(emi1-base.repo emi1-third-party.repo emi1-updates.repo) | | [[http://repo-pd.italiangrid.it/mrepo/repos/egi-trustanchors.repo][egi-trustanchors.repo]] | It is *strongly recommended* the use of the lastest version of the [[http://repo-pd.italiangrid.it/mrepo/EMI/1/sl5/x86_64/updates/emi-release-1.0.1-1.sl5.noarch.rpm][emi-release]] package containing the EMI public key and the yum .repo files, that ensures the precedence of EMI repositories over EPEL: <pre> # yum install yum-priorities yum-protectbase # rpm -ivh http://repo-pd.italiangrid.it/mrepo/EMI/1/sl5/x86_64/updates/emi-release-1.0.1-1.sl5.noarch.rpm </pre> ---++ *Generic Configuration* ---+++ Configuration files ---++++ IGI YAIM configuration files YAIM configuration files should be stored in a _directory structure_. All the involved files *HAVE* to be under the same folder <confdir>, in a safe place, which *is not world readable*. This directory should contain: | *File* | *Scope* | *Example* | *Details* | | =<your-site-info.def>= | *whole-site* | [[https://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/branches/BRANCH-4_0_X/ig-yaim/examples/siteinfo/ig-site-info.def?rev=5964&root=igrelease&view=markup][ig-site-info.def]] | List of configuration variables in the format of key-value pairs. <br /> It's a *mandatory* file. <br /> It's a parameter passed to the ig_yaim command. <br /> *IMPORTANT*: You should always check if your <your-site-info.def> is up-to-date comparing with the last /opt/glite/yaim/examples/siteinfo/ig-site-info.def template deployed with ig-yaim and get the differences you find. <br /> For example you may use vimdiff: <pre>vimdiff /opt/glite/yaim/examples/siteinfo/ig-site-info.def <confdir>/<your-site-info.def></pre> | | =<your-wn-list.conf>= | *whole-site* | - | Worker nodes list in the format of hostname.domainname per row. <br /> It's a *mandatory* file. <br /> It's defined by WN_LIST variable in <your-site-info.def>. | | =<your-users.conf>= | *whole-site* | [[https://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/branches/BRANCH-4_0_X/ig-yaim/examples/ig-users.conf?rev=6066&root=igrelease&view=markup][ig-users.conf]] | Pool account user mapping. <br /> It's a *mandatory* file. <br /> It's defined by USERS_CONF variable in <your-site-info.def>. <br /> *IMPORTANT*: You may create <your-users.conf> starting from the /opt/glite/yaim/examples/ig-users.conf template deployed with ig-yaim, but probably you have to fill it on the base of your site policy on uids/guis. We suggest to proceed as explained here: _”<a href="http://igrelease.forge.cnaf.infn.it/doku.php?id=doc:use_cases:users" title="doc:use_cases:users">Whole site: How to create local users.conf and configure users</a>”_. | | =<your-groups.conf>= | *whole-site* | [[https://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/branches/BRANCH-4_0_X/ig-yaim/examples/ig-groups.conf?rev=6075&root=igrelease&view=markup][ig-groups.conf]] | VOMS group mapping. <br /> It's a *mandatory* file. <br /> It's defined by GROUPS_CONF variable in <your-site-info.def>. <br /> *IMPORTANT*: You may create <your-groups.conf> starting from the /opt/glite/yaim/examples/ig-groups.conf template deployed with ig-yaim. | ---++++ Additional files Furthermore the configuration folder can contain: | *Directory* | *Scope* | *Details* ||| | =services/= | *service-specific* | It contains a file per nodetype with the name format: ig-node-type. <br /> The file contains a list of configuration variables specific to that nodetype.<br /> Each yaim module distributes a configuration file in /opt/glite/yaim/examples/siteinfo/services/[ig or glite]-node-type. <br /> It's a *mandatory* directory if required by the profile and *you should copy it* under the same directory where <your-site-info.def> is. | | | | =nodes/= | *host-specific* | It contains a file per host with the name format: hostname.domainname. <br /> The file contains host specific variables that are different from one host to another in a certain site. <br /> It's an *optional* directory. ||| | =vo.d/= | *VO-specific* | It contains a file per VO with the name format: vo_name, but most of VO settings are still placed in ig-site-info.def template. For example, for ”<code>lights.infn.it</code>”: <pre># cat vo.d/lights.infn.it<br />SW_DIR=$VO_SW_DIR/lights<br />DEFAULT_SE=$SE_HOST<br />VOMS_SERVERS="vomss://voms2.cnaf.infn.it:8443/voms/lights.infn.it?/lights.infn.it"<br />VOMSES="lights.infn.it voms2.cnaf.infn.it 15013 /C=IT/O=INFN/OU=Host/L=CNAF/CN=voms2.cnaf.infn.it lights.infn.it"</pre> <p>It's an *optional* directory for “normal” VOs (like atlas, alice, babar), *mandatory* only for “fqdn-like” VOs. In case you support such VOs *you should copy* the structure vo.d/<vo.specific.file> under the same directory where <your-site-info.def> is.</p> ||| | =group.d/= | *VO-specific* | It contains a file per VO with the name format: groups-<vo_name>.conf. <br /> The file contains VO specific groups and it replaces the former <your-groups.conf> file where all the VO groups were specified all together. <br /> It's an *optional* directory. ||| The optional folders are created to allow system administrators to organise their configurations in a more structured way.” ---++ *BDII Site installation and Configuration* Have a look to the section [[#RepositorySettings][Repository Settings]] of this documentation and ensure to have the common .repo files.<BR/> Before starting the installation procedure remember to clean all yum cache and headers: <pre>yum clean all </pre> ---+++ CAs installation: * Install CAs on ALL profiles: <pre>yum install ca-policy-egi-core </pre> ---+++ Service installation * Install the BDII_site metapackage, containing all packages needed by this service: <pre># yum install emi-bdii-site </pre> * It's strongly recommended to install this openldap2.4 server to avoid frequent bdii crashes: <pre> # yum install openldap2.4-servers </pre> ---+++ *Service Configuration* To proper configure the BDII site profile you have to customize this file with you site parameter: * [[https://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/branches/BRANCH-4_0_X/ig-yaim/examples/siteinfo/ig-site-info.def?rev=5964&root=igrelease&view=markup][ig-site-info.def]] If you would like to cutomize the BDII_site service you can modify the variables in the service-specific file in the =services/= directory. You will find an example in: <pre>/opt/glite/yaim/examples/siteinfo/services/glite-bdii_site</pre> * Remember to add the following variables to your site-info.def yaim configuration file and re-run yaim if you installed the openldap2.4-servers as recommended. SLAPD=/usr/sbin/slapd2.4 ---++++ YAIM Verification * Before starting the configuration *PLEASE TEST* that you have defined all the mandatory variables and that all configuration files contain all the site-specific values needed: <pre> /opt/glite/yaim/bin/yaim -v -s <site-info.def> -n BDII_site </pre> The mandatory variables are: SITE_DESC<br /> SITE_EMAIL<br /> SITE_NAME<br /> SITE_LOC<br /> SITE_LAT <br />SITE_LONG<br /> SITE_WEB <br />SITE_SECURITY_EMAIL <br />SITE_SUPPORT_EMAIL<br /> SITE_OTHER_GRID<br /> SITE_BDII_HOST <br />BDII_REGIONS Most of those are in the file [[https://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/branches/BRANCH-4_0_X/ig-yaim/examples/siteinfo/services/ig-bdii_site?rev=5986&root=igrelease&view=markup][ig-bdii_site]] in directory services (the better things is to modify it). Remember in particular to set: <pre>SITE_OTHER_GRID="WLCG|EGI" SITE_OTHER_EGI_NGI="NGI_IT" </pre> If no errors are reported you can proceed to the configuration, otherwise correct them before continuing with the configuration. ---++++ YAIM Configuration Please use the debug flag ( ="-d 6"=) to configure the services in order to have detailed information. For your convenience yo can save all the configuration information in a log file you can look at any time, separated from the =yaimlog= defulat one. <pre>/opt/glite/yaim/bin/yaim -c -d 6 -s -n BDII_site 2>&1 | tee /root/conf_BDII.`hostname -s`.`date`.log</pre> ---+++ Service Testing - Reference Card After service installation to have a look if all were installed in a proper way, you could have a look to [[https://twiki.cern.ch/twiki/bin/view/EMI/GLiteInformationSystem][Service BDII_site Reference Card]]. In this page you can found were all the log files are written, what daemons are running after installation and any other useful service information. ---+++ Documentation References: * The BDII documentation can be found at the following [[https://tomtools.cern.ch/confluence/display/IS/BDII][URL.]] * [[http://twiki.cern.ch/twiki/bin/view/EGEE/InfoTrouble][Troubleshooting guide]] ---++ *BDII Top installation and Configuration* Have a look to the section Repository Settings of this documentation, ensure to have the common repo files.<BR/> Before starting the installation procedure remember to clean all yum cache and headers: <pre>yum clean all </pre> ---+++ CAa installation: * Install CAs on ALL profiles: <pre>yum install ca-policy-egi-core </pre> ---+++ Service installation * Install the BDII_top metapackage, containing all packages needed by this service: <pre>yum install emi-bdii-top </pre> ---+++ *Service Configuration* To proper configure the BDII top profile you have to customize this file with you site parameter: - [[https://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/branches/BRANCH-4_0_X/ig-yaim/examples/siteinfo/ig-site-info.def?rev=5964&root=igrelease&view=markup][ig-site-info.def]] ---++++ YAIM Verification * Before starting the configuration *PLEASE TEST* that you have defined all the mandatory variables and that all configuration files contain all the site-specific values needed: <pre> /opt/glite/yaim/bin/yaim -v -s <site-info.def> -n BDII_top </pre> The mandatory variable is: BDII_HOST If no errors are reported you can proceed to the configuration, otherwise correct them before continuing with the configuration. ---++++ YAIM Configuration Please use the debug flag ( ="-d 6"=) to configure the services in order to have detailed information. For your convenience yo can save all the configuration information in a log file you can look at any time, separated from the =yaimlog= defulat one. <pre>/opt/glite/yaim/bin/yaim -c -d 6 -s <site-info.def> -n BDII_top 2>&1 | tee /root/conf_BDII.`hostname -s`.`date`.log</pre> ---+++ Know Issue and Workaround Missing /etc/bdii/gip/glite-info-site-defaults.conf : https://ggus.eu/tech/ticket_show.php?ticket=72561 <b>Workaround: </b> Check if the file exists and it's contents. If it's missing do: <pre> echo "SITE_NAME=<YOUR SITE NAME>" > /etc/bdii/gip/glite-info-site-defaults.conf </pre> Check also the permission of the directory opt/glite/var/cache/gip if it is not ldap:ldap change it: <pre> chown -R ldap:ldap /opt/glite/var/cache/gip </pre> ---+++ Service Testing - Reference Card After service installation to have a look if all were installed in a proper way, you could have a look to [[https://twiki.cern.ch/twiki/bin/view/EMI/GLiteInformationSystem][Service BDII_top Reference Card]]. In this page you can found were all the log files are written, what daemons are running after installation and any other useful service information. ---+++ Documentation References: * The BDII documentation can be found at the following [[https://tomtools.cern.ch/confluence/display/IS/BDII][URL.]] * [[http://twiki.cern.ch/twiki/bin/view/EGEE/InfoTrouble][Troubleshooting guide]] ---++ *StoRM installation and Configuration* Have a look to the section [[#Repository_Settings][Repository Settings]] and ensure that you have the common repo files.<BR/> Before starting the installation procedure remember to clean all yum cache and headers: <pre>yum clean all </pre> ---+++ !StoRM Prerequisites ---++++ Host certificate installation: Hosts participating to the !StoRM-SE (FE, BE and !GridFTP hosts) must be configured with X.509 certificates signed by a trusted Certification Authority (CA). Usually the hostcert.pem and hostkey.pem certificates are located in the /etc/grid-security/ directory, and they must have permission 0644 and 0400 respectively: <b>Check existence</b><br/> <pre> [~]# ls -l /etc/grid-security/hostkey.pem -r-------- 1 root root 887 Mar 1 17:08 /etc/grid-security/hostkey.pem [~]# ls -l /etc/grid-security/hostcert.pem -rw-r--r-- 1 root root 1440 Mar 1 17:08 /etc/grid-security/hostcert.pem </pre> <b> Check expiration </b><br/> <pre>[~]# openssl x509 -in hostcert.pem -noout -dates</pre> <b> Change permission: (if needed) </b><br/> <pre> [~]# chmod 0400 hostkey.pem [~]# chmod 0644 hostcert.pem </pre> ---++++ ACL SUPPORT If you are installing a new !StoRM this check must be done, if you are updating your install or your storage has ACL you can step out to this issue. !StoRM uses the ACLs on files and directories to implement the security model. Doing so, !StoRM uses the native access to the file system. Therefore in order to ensure a proper running, !ACLs need to be enabled on the underlying file system (sometime they are enabled by default) and work properly. <b>Check ACL: </b> <pre> [~]# touch test [~]# setfacl -m u:storm:rw test </pre> Note: the storm user used to set the ACL entry must exist. <pre> [~]# getfacl test # file: test # owner: root # group: root user::rw- user:storm:rw- group::r-- mask::rw- other::r-- [~]# rm -f test </pre> <b>Install ACL (eventually): </b><br/> If the getfacl and setfacl commands are not available on your host: <pre>[~]# yum install acl </pre> <b>Enable ACL (if needed): </b><br/> To enable ACL, you must add the acl property to the relevant file system in your /etc/fstab file. For example: <pre> [~]# vi /etc/fstab ... /dev/hda3 /storage ext3 defaults, acl 1 2 ... </pre> Then you need to remount the affected partitions as follows: <pre> [~]# mount -o remount /storage </pre> This is valid for different file system types (i.e., ext3, xfs, gpfs and others). ---+++++ EXTENDED ATTRIBUTE SUPPORT !StoRM uses the Extended Attributes (EA) on files to store some metadata related to the file (e.g. the checksum value); therefore in order to ensure a proper running, the EA support needs to be enabled on the underlying file system and work properly. Note: Depending on OS kernel distribution, for Reiser3, ext2 and ext3 file systems, the default kernel configuration should not enable the EA. <b>Check Extended Attribute Support </b>: <pre> [~]# touch testfile [~]# setfattr -n user.testea -v test testfile [~]# getfattr -d testfile # file: testfile user.testea="test" [~]# rm -f testfile </pre> <b>Install attr (eventually): </b><br/> If the getfattr and setfattrl commands are not available on your host: <pre>[~]# yum install attr </pre> <b>Enable EA (if needed):</b><br/> To set extended attributes, you must add the user_xattr property to the relevant file systems in your /etc/fstab file. For example: <pre> [~]# vi /etc/fstab ... /dev/hda3 /storage ext3 defaults,acl,user_xattr 1 2 ... </pre> Then you need to remount the affected partitions as follows: <pre>[~]# mount -o remount /storage </pre> ---+++ !CAs installation: * Install !CAs on ALL profiles: <pre>yum install ca-policy-egi-core </pre> ---+++ Service installation * Install the !StoRM metapackages, containing all packages needed by these four services. You can install !StoRM in one host or in more hosts. The mandatory profiles to install are emi-storm-backend-mp and emi-storm-frontend-mp. The other profiles are optional, have a look to the !StoRM documentation [[http://storm.forge.cnaf.infn.it/_media/documentation/storm-sysadminguide.pdf?id=documentation][System Administrator Guide]] to determinate if you need also emi-storm-globus-gridftp-mp or emi-storm-gridhttps-mp. <pre>yum install emi-storm-backend-mp yum install emi-storm-frontend-mp yum install emi-storm-globus-gridftp-mp yum install emi-storm-gridhttps-mp </pre> ---+++ *Service Configuration* To proper configure the !StoRM !BackEnd and !FrontEnd profiles you have to customize the ig-site-indo.def file with you site parameter: - [[https://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/branches/BRANCH-4_0_X/ig-yaim/examples/siteinfo/ig-site-info.def?rev=5964&root=igrelease&view=markup][ig-site-info.def]]<br/> - [[https://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/branches/BRANCH-4_0_X/ig-yaim/examples/ig-users.conf?rev=6066&root=igrelease&view=markup][ig-users.conf]]<br/> - [[https://forge.cnaf.infn.it/plugins/scmsvn/viewcvs.php/branches/BRANCH-4_0_X/ig-yaim/examples/ig-groups.conf?rev=6075&root=igrelease&view=markup][ig-groups.conf]] ---++++ YAIM Verification * Before starting the configuration *PLEASE TEST* that you have defined all the mandatory variables for all the StoRM profiles. <pre> /opt/glite/yaim/bin/yaim -v -s <site-info.def> -n se_storm_backend -n se_storm_frontend </pre> You can find in this documentation: [[http://storm.forge.cnaf.infn.it/_media/documentation/storm-sysadminguide.pdf?id=documentation][System Administrator Guide]] all mandatory variables. In the section <b>GENERAL YAIM VARIABLES </b> If no errors are reported with the verification you can proceed to the configuration, otherwise correct them before continuing with the configuration. ---++++ YAIM Configuration Before configuring please pay attention: * if you are installing a new !StoRM in a new host you can continue * if you are updating !StoRM to a new release please follow this documentation containing useful information for the service upgrade and for the stored data files:<br/> * [[%ATTACHURL%/Upgrade_Instructions_to_StoRM_v18.pdf][Upgrade_Instructions_to_StoRM_v18.pdf]]: Upgrade !StoRM istructions. Please use the debug flag ( ="-d 6"=) to configure the services in order to have detailed information. For your convenience yo can save all the configuration information in a log file you can look at any time, separated from the =yaimlog= default one. <pre># /opt/glite/yaim/bin/yaim -c -d 6 -s -n se_storm_backend -n se_storm_frontend 2>&1 | tee /root/conf_StroRM_BE_FE.`hostname -s`.`date`.log</pre> <b>IMPORTANT NOTE</b> The order of the profile is important and must be : -n se_storm_backend -n se_storm_frontend ---+++ Service Testing - Reference Card After service installation to have a look if all were installed in a proper way, you could have a look to [[https://twiki.cern.ch/twiki/bin/view/EMI/StoRMPTServiceReferenceCard][Service StoRM Reference Card]]. In this page you can found were all the log files are written, what daemons are running after installation and any other useful service information. ---+++ Documentation References: * [[http://storm.forge.cnaf.infn.it/_media/documentation/storm-servicedescription.pdf?id=documentation][Functional Description]] * [[http://storm.forge.cnaf.infn.it/_media/documentation/storm-sysadminguide.pdf?id=documentation][System Administrator Guide]] * [[http://storm.forge.cnaf.infn.it/documentation/faq][FAQ]] and [[http://storm.forge.cnaf.infn.it/documentation/troubles][User Troubleshooting Guide]] * [[http://storm.forge.cnaf.infn.it/_media/documentation/storm-faq.pdf?id=documentation][Service Troubleshooting Guide]] * [[http://www.gridforum.org/documents/GFD.129.pdf][Service Interface description]] * Client Installation and Configuration : Client is distributed with UI, and does not need configuration * Other Documentation : * [[http://storm.forge.cnaf.infn.it/documentation/inst_and_conf2][Quick Installation guide]] * [[http://storm.forge.cnaf.infn.it/documentation/client_examples][Client Usage Examples]] ---++ *CREAM CE installation and Configuration* Have a look to the section [[#Repository_Settings][Repository Settings]] and ensure that you have the common repo files.<BR/> Before starting the installation procedure remember to clean all yum cache and headers: <pre>yum clean all </pre> The CREAM CE Services were tested with gLite WN SL5 x86_64 and also with ig_WN SL5 x86_64. We remember the Toque Server and client work only if the CE and the WN is SL5 x86_64 and the MAUI version is equal in the server and client side. Please update the WN if you have an old installation. ---+++ CREAM CE Prerequisites ---++++ Host certificate installation: In the host were CREAM CE is intalled must be configured with X.509 certificates signed by a trusted Certification Authority (CA). Usually the hostcert.pem and hostkey.pem certificates are located in the /etc/grid-security/ directory, and they must have permission 0644 and 0400 respectively: <b>Check existence</b><br/> <pre> [~]# ls -l /etc/grid-security/hostkey.pem -r-------- 1 root root 887 Mar 1 17:08 /etc/grid-security/hostkey.pem [~]# ls -l /etc/grid-security/hostcert.pem -rw-r--r-- 1 root root 1440 Mar 1 17:08 /etc/grid-security/hostcert.pem </pre> <b> Check expiration </b><br/> <pre>[~]# openssl x509 -in hostcert.pem -noout -dates</pre> <b> Change permission: (if needed) </b><br/> <pre> [~]# chmod 0400 hostkey.pem [~]# chmod 0644 hostcert.pem </pre> ---++++ Batch System: If you will use LSF (licences are needed). The server/client installation must be done manually. Have a look to [[http://www.platform.com/workload-management/high-performance-computing][Platform LSF documentation]], whereas Torque server/client installation is included in the Toque metapackages. ---+++ !CAs installation: * Install !CAs on ALL profiles: <pre>yum install ca-policy-egi-core </pre> ---+++ Service installation * Install the CREAM CE metapackages, containing all packages needed. Have a look to the CREAM CE documentation before starting to install :[[http://wiki.italiangrid.it/twiki/bin/view/CREAM/SystemAdministratorGuideForEMI1][System Administrator Guide]]. <pre> yum install xml-commons-apis yum install emi-cream-ce </pre> ---++++ Batch system utility installation After the installation of the CREAM CE metapackage it is necessary to install the batch system specific metapackage(s): * If you are running *Torque*, and your CREAM CE node is the torque master, install the emi-torque-server and emi-torque-utils metapackages: <pre> yum install emi-torque-server yum install emi-torque-utils </pre> * If you are running Torque, and your CREAM CE node is NOT the torque master, install the emi-torque-utils metapackage: <pre> yum install emi-torque-utils </pre> * If you are running *LSF*, install the emi-lsf-utils metapackage: <pre> yum install emi-lsf-utils </pre> ---++++ DGAS_sensors installation If you use DGAS to account data remember to install also DGAS sensors. You can found more documentation to [[http://www.to.infn.it/grid/INFNGRID/TESTING/TESTING/files/Documentation/DGAS-4.0-guide_sensors_1.2.pdf ][DGAS sensors guide]] <pre> yum install glite-dgas-common glite-dgas-hlr-clients glite-dgas-hlr-sensors glite-dgas-hlr-sensors-producers </pre> Install also yaim-dgas rpm this could be useful when you will configure DGAS_sensors <pre> rpm -ivh http://repo-pd.italiangrid.it/mrepo/ig_sl5-x86_64/RPMS.3_2_0/yaim-dgas-5.0.0-3.noarch.rpm </pre> ---+++ *Service Configuration* ---++++ YAIM Verification * Before starting the configuration *PLEASE TEST* that you have defined all the mandatory variables for all the CREAM CE profiles. *For Torque*: <pre> /opt/glite/yaim/bin/yaim -v -s <site-info.def> -n creamCE -n TORQUE_server -n TORQUE_utils -n DGAS_sensors </pre> *For LSF*: <pre> /opt/glite/yaim/bin/yaim -v -s <site-info.def> -n creamCE -n LSF_utils -n DGAS_sensors </pre> You can find in this documentation: [[https://twiki.cern.ch/twiki/bin/view/LCG/Site-info_configuration_variables#cream_CE][YAIM CREAM CE Variables]] all mandatory variables. If no errors are reported with the verification you can proceed to the configuration, otherwise correct them before continuing with the configuration. ---+++++ Configuration Suggestions: *Blparser*:<br/> We suggest to use the new *Blparser* runs on the CREAM CE machine and it is automatically installed when installing the CREAM CE. The configuration of the new BLAH Blparser is done when configuring the CREAM CE (i.e. it is not necessary to configure the Blparser separately from the CREAM CE). To use the new BLAH blparser, it is just necessary to set: <pre> BLPARSER_WITH_UPDATER_NOTIFIER=true </pre> *ARGUS*:<br/> If you have an *ARGUS* server installed in your site or in central site we suggest to use it. Please set the proper variables: <pre> USE_ARGUS=yes </pre> In this case it is also necessary to set the following yaim variables: * ARGUS_PEPD_ENDPOINTS The endpoint of the ARGUS box (e.g."https://cream-43.pd.infn.it:8154/authz") * CREAM_PEPC_RESOURCEID The id of the CREAM CE in the ARGUS box (e.g. "http://pd.infn.it/cream-18") If instead gJAF should be used as authorization system, yaim variable USE_ARGUS must be set in the following way: <pre> USE_ARGUS=no </pre> *DGAS_sensors*:<br/> For *DGAS_sensors* you should customize the services file. You can find in this path an example: <pre>/opt/glite/yaim/examples/siteinfo/services/dgas_sensors </pre> ---++++ YAIM Configuration Please use the debug flag ( ="-d 6"=) to configure the services in order to have detailed information. For your convenience yo can save all the configuration information in a log file you can look at any time, separated from the =yaimlog= default one. *For Torque*: <pre># /opt/glite/yaim/bin/yaim -c -d 6 -s <site-info.def> -n creamCE -n TORQUE_server -n TORQUE_utils -n DGAS_sensors 2>&1 | tee /root/conf_CREAM_Torque_DGAS.`hostname -s`.`date`.log</pre> *For LSF*: <pre># /opt/glite/yaim/bin/yaim -c -d 6 -s <site-info.def> -n creamCE -n LSF_utils -n DGAS_sensors 2>&1 | tee /root/conf_CREAM_LSF_DGAS.`hostname -s`.`date`.log</pre> ---+++ Service Testing - Reference Card After service installation to have a look if all were installed in a proper way, you could have a look to [[http://wiki.italiangrid.it/twiki/bin/view/CREAM/ServiceReferenceCard][Service CREAM Reference Card]] and also to the [http://wiki.italiangrid.it/twiki/bin/view/CREAM/CreamTestWorkPlan][Service Troubleshooting Guide]]. In this page you can found were all the log files are written, what daemons are running after installation and any other useful service information. ---+++ Documentation References: * [[http://www.eu-emi.eu/c/document_library/get_file?uuid=32f95c37-1e72-4882-8a06-ce20b5428ffc&groupId=10147][Functional Description]]<br/> * [[http://grid.pd.infn.it/cream/Misc/cream-arch.jpg][Software Design Description]]<br/> * [[http://wiki.italiangrid.org/twiki/bin/view/CREAM/UserDocumentation][User Guide]]<br/> * Client [[http://wiki.italiangrid.org/twiki/bin/view/CREAM/SystemAdministratorGuideForEMI1#Installation_of_the_CREAM_CLI][Installation]] and [[http://wiki.italiangrid.org/twik/bin/view/CREAM/SystemAdministratorGuideForEMI1#Configuration_of_the_CREAM_CLI][Configuration]]<br/> * [[http://wiki.italiangrid.org/twiki/bin/view/CREAM/UserGuide#1_14_CREAM_CLI_configuration_fil][Client Configuration Template]]<br/> * [[http://wiki.italiangrid.org/twiki/bin/view/CREAM/UserGuide#2_Man_pages_for_CREAM_Command_Li][Man Pages/Online Help]]<br/> * [[http://wiki.italiangrid.org/twiki/bin/view/CREAM/TroubleshootingGuide][User Troubleshooting Guide]]<br/> * [[http://wiki.italiangrid.org/twiki/bin/view/CREAM/ClientApiCppDoc][API Documentation]]<br/> * [[http://wiki.italiangrid.org/twiki/bin/view/CREAM/TroubleshootingGuide#3_Error_messages][Error Code Documentation]]<br/> * [[http://wiki.italiangrid.org/twiki/bin/view/CREAM/SystemAdministratorGuideForEMI1][System Administrator Guides]]<br/> * [[http://wiki.italiangrid.org/twiki/bin/view/CREAM/ServiceReferenceCard][Service Reference Card]]<br/> * [[http://wiki.italiangrid.org/twiki/bin/view/CREAM/CreamTestWorkPlan][Service Troubleshooting Guide]]<br/> * Other Documentation available [[http://wiki.italiangrid.org/CREAM][here]]<br/> -- Main.SergioTraldi - 2011-11-10
Attachments
Attachments
Topic attachments
I
Attachment
Action
Size
Date
Who
Comment
pdf
Upgrade_Instructions_to_StoRM_v18.pdf
manage
54.1 K
2011-11-22 - 10:00
SergioTraldi
Upgrade
StoRM
istructions. Useful to the data stored partition
Edit
|
Attach
|
PDF
|
H
istory
:
r77
|
r20
<
r19
<
r18
<
r17
|
B
acklinks
|
V
iew topic
|
More topic actions...
Topic revision: r18 - 2011-12-28
-
SergioTraldi
Home
Site map
CEMon web
CREAM web
Cloud web
Cyclops web
DGAS web
EgeeJra1It web
Gows web
GridOversight web
IGIPortal web
IGIRelease web
MPI web
Main web
MarcheCloud web
MarcheCloudPilotaCNAF web
Middleware web
Operations web
Sandbox web
Security web
SiteAdminCorner web
TWiki web
Training web
UserSupport web
VOMS web
WMS web
WMSMonitor web
WeNMR web
IGI Documentation
Repositories specifications
Installation and Configuration Guides
Updates Guides
Services/Node Types List
IGI Updates Calendar
Tips & Tricks
Use Cases & Troubleshooting
Site Admin Corner
IGI Release Management
Integration Process
TODO List
IGI Testing & Certification
Certification Testbed
Blah testing
CREAM testing
HLR testing
Storm testing
UI testing
VOMS testing
WMS testing
WN testing
IGIRelease Web
Create New Topic
Index
Search
Changes
Notifications
RSS Feed
Statistics
Preferences
P
View
Raw View
Print version
Find backlinks
History
More topic actions
Edit
Raw edit
Attach file or image
Edit topic preference settings
Set new parent
More topic actions
Account
Log In
Edit
Attach
Copyright © 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback