(r58) WebHome < SiteAdminCorner

Tags: , view all tags
---+!! Sita Admin Corner
%TOC%

---+ National Squid service for CVMFS
If you are going to run jobs on your cluster using !CernVM-FS you should also use squids to cache data at your site. In case you decide to not install a squid service at your site or in case of failover at your site, Italian NGI provide a National squid service accessible *only by registered italian sites*.

We have two squids with ACLs based source and destination. If you decide to use this service, please contact igi-noc@lists.italiangrid.it providing:
   * the network information of your WNs (eg 131.154.101.0/255.255.255.0);
   * the cvmfs server(s) your WNs need to contact (eg: cvmfs-gridit.cnaf.infn.it);
   * add the line =CVMFS_HTTP_PROXY="http://squid01.cnaf.infn.it:3128|http://squid02.cnaf.infn.it:3128"= to the configuration of the cvmfs client on each WN (usually under =/etc/cvmfs/config.d/=). 

Eg. for VO gridit: =/etc/cvmfs/config.d/gridit..conf:CVMFS_HTTP_PROXY="http://squid01.cnaf.infn.it:3128|http://squid02.cnaf.infn.it:3128"=

---+++ Using National Squid service for failover
If you run local squid service, you can also add the national squid servers for failover case. =CVMFS_HTTP_PROXY= is used to specify the squid server(s) to be used for local caching. It supports both load balance and failover:
   * *failover mode*: use a semicolon (http://squid1.localdomain:3128;http://squid2.localdomain:3128)
   * *load balance mode*: use a pipe (http://squi1.localdomain.3128|http://squid2.localdomain:3128)
   * *both for failover and load balance* (http://squid1.localdomain:3128|http:squid2.localdomain:3128;http://squid01.cnaf.infn.it:3128|http://squid02.cnaf.infn.it:3128)

---++++ Configuration test for failover
Thanks to E. Mazzoni, INFN-PISA.
<verbatim>
# cmssquid.pi.infn.it and cmssquid2.pi.infn.it primary group, squid01.cnaf.infn.it and squid01.cnaf.infn.it failover group

# Normal behaviour
[root@stormgf1 ~]# cvmfs_talk -i belle.cern.ch proxy info
Load-balance groups:
[0] http://cmssquid.pi.infn.it:3128, http://cmssquid2.pi.infn.it:3128
[1] http://squid01.cnaf.infn.it:3128, http://squid02.cnaf.infn.it:3128
Active proxy: [0] http://cmssquid.pi.infn.it:3128 

# Failover behaviour (cmssquid.pi.infn.it and cmssquid2.pi.infn.it denied by acl on router)
[root@stormgf1 ~]# cvmfs_talk -i belle.cern.ch proxy info
Load-balance groups:
[0] http://cmssquid2.pi.infn.it:3128, http://cmssquid.pi.infn.it:3128
[1] http://squid02.cnaf.infn.it:3128, http://squid01.cnaf.infn.it:3128
Active proxy: [1] http://squid02.cnaf.infn.it:3128 
</verbatim>

---++ Table
List of the cvmfs servers and sites supported by national squid server.
| *cvmfs servers* |
|cernvmfs.gridpp.rl.ac.uk|
|cvmfs02.grid.sinica.edu.tw|
|cvmfs-atlas-nightlies.cern.ch|
|cvmfs.fnal.gov|
|cvmfs-gridit.cnaf.infn.it|
|cvmfs.racf.bnl.gov|
|cvmfs-repo-superb.cnaf.infn.it|
|cvmfs-stratum-one.cern.ch|
|igi-cvmfs.cnaf.infn.it|

| *Sites* | *Note* |
|IGI-BOLOGNA| primario |
|INFN-CATANIA| failover |
|INFN-PISA| failover |
|INFN-ROMA2| primario |
|TRIGRID-INFN-CATANIA| failover |
|UNI-PERUGIA| primario |

---++ Useful link
   * [[https://wiki.egi.eu/wiki/CVMFS_Task_Force][EGI CVMFS Task Force]]
   * [[http://cernvm.cern.ch/portal/filesystem][CVMFS home page]]
   * [[https://indico.egi.eu/indico/getFile.py/access?contribId=7&resId=0&materialId=slides&confId=1235][CVMFS - Beyond LHC Computing]]

---+ Upgrade Plan
   * [[SHA-2 Compliant Campaign]]

---+ Italian Production sites
you can find [[SitesResources][here]] the list of Italian sites.

---+ Tutorial
| *V Corso di formazione INFN per amministratori di siti GRID* |
|^| [[https://agenda.italiangrid.it/conferenceTimeTable.py?confId=785#all.detailed][Agenda]] |
|^| [[TutorialWNoDeS][ Tutorial !WNoDes ]] |
|^| [[TutorialStoRM][ Tutorial StoRM ]] |
|^| [[TutorialCream][ Tutorial Cream ]] |
|^| [[TutorialYaim][ Tutorial Yaim ]] |

---+ Notes about services from IGI middleware, based on EMI/UMD
*These notes are provided by site admins on a best effort base as a contribution to the IGI communities and MUST not be considered as a subsitute of the [[http://wiki.italiangrid.it/twiki/bin/view/IGIRelease/IgiEmi][Official IGI documentation]].*
This document is addressed to site administrators responsible for middleware installation and configuration.


---++ Information about ARGUS and gLexec Deployment
  * *[[ARGUSandGLEXECInstallations][Actions]]* for site-admins

---++Table about Installation and Configuration of Grid services EMI-3
The core services are those that are typically shared by multiple VOs and which interact with the resources made available at the Grid Site level. They should not be installed at Site level.
| *Service Type* | *Service Name* | *Installation Notes* | *Provider*| *O.S.*|
| CORE service | LCG file Catalog (LFC) | [[Notes about Installation and Configuration of EMI-3 (SL6) LFC server]] | EMI-3 | SL6 |
| CORE service | !MyProxy | [[Notes about MyProxy - EMI-3 - SL6]] | EMI-3 | SL6 |

---++Table about Installation and Configuration of Grid services EMI-2
The core services are those that are typically shared by multiple VOs and which interact with the resources made available at the Grid Site level. They should not be installed at Site level.
| *Service Type* | *Service Name* | *Installation Notes* | *Provider*| *O.S.*|
| SITE service | User Interface (UI) | [[Notes about installation and configuration of EMI-UI - EMI-2 SL6]] | EMI-2 | SL6 |
| SITE service | Torque server stand alone (no cream) | [[Notes about torque server - EMI-2 SL6]] | EMI-2 | SL6 |
| SITE service | Cream Computing Element (without TORQUE) with MPI  | [[Notes about Cream without Torque with MPI - EMI-2 SL6]] | EMI-2 | SL6 |
| SITE service | Worker Node (WN) + TORQUE + MPI + GLEXEC | [[Notes about WN (torque, mpi, glexec) - EMI-2 SL6]] | EMI-2 | SL6 |
| SITE service | Cream Computing Element (CE CREAM) + TORQUE | *TODO* | EMI-2 ||
| SITE service | Worker Node (WN) + TORQUE + GLEXEC | *TODO* | EMI-2 ||
| SITE service | Worker Node (WN) + TORQUE + MPI | *TODO* | EMI-2 ||
| SITE service | site-bdii | [[Notes about site-bdii EMI-2 SL6]] | EMI-2 | SL6 |
| SITE service | !StoRM Storage Element (!StoRM SE) | *TODO* | EMI-2 ||
| SITE/CORE service | Home Location Register (HLR) | *TODO* | IGI ||
| CORE service | !MyProxy | [[Notes about MyProxy - EMI-2 - SL6]] | EMI-2 | SL6 |
| CORE service | top-bdii | [[Notes about top-bdii - EMI-2 - SL6]] | EMI-2 | SL6 |
| CORE service | Workload Management System (WMS)| *TODO* | EMI-2 ||
| CORE service | Logging & Bookepping (LB) | *TODO* | EMI-2 ||
| CORE service | LCG file Catalog (LFC) | [[Notes about Installation and Configuration of EMI-2 (SL5) LFC server]] | EMI-2 | SL5 |
| CORE service | File Transfer Service (FTS) | *TODO* | EMI-2 ||
| CORE service |VOMS | [[Notes about Installation and Configuration of EMI2 VOMS-MySQL on SL6]] | EMI-2 ||

---+++ References
   1. [[http://www.italiangrid.it/][About IGI - Italian Grid infrastructure]]
   1. [[http://wiki.italiangrid.it/twiki/bin/view/IGIRelease/WebHome][About IGI Release]]
   1. [[http://wiki.italiangrid.it/twiki/bin/view/IGIRelease/IgiEmi][IGI Official Installation and Configuration guide]]
   1. [[https://wiki.egi.eu/wiki/Tools/Manuals/SiteProblemsFollowUp][Troubleshooting Guide for Operational Errors on EGI Sites]]
   1. [[https://wiki.egi.eu/wiki/Tools/Manuals/AdministrationFaq][Grid Administration FAQs page]]

-------
---+ Outdated Guides
---++++ !gLite middleware (OUTDATED)
[[Notes about services based on gLite middleware]]

---++++ How to join, installing and configure igi.italaingrid.it VO on your site (OUTDATED)
[[HowToEnableIGI][How to join, installing and configure igi.italaingrid.it VO on your site]]

---++++ Table about Installation and Configuration of Grid services EMI-1 (OUTDATED)
The core services are those that are typically shared by multiple VOs and which interact with the resources made available at the Grid Site level. They should not be installed at Site level.
| *Service Type* | *Service Name* | *Installation Notes* | *Provider*|
| SITE service | User Interface (UI) | [[Notes about Installation and Configuration of UI]] | EMI-1 |
| SITE service | Cream Computing Element (CE CREAM) + TORQUE with ARGUS | [[Notes about Installation and Configuration of CREAM and TORQUE]] | EMI-1 |
| SITE service | Cream Computing Element (CE CREAM) for TORQUE | [[Notes about Installation and Configuration of CREAM for TORQUE]] | EMI-1 |
| SITE service | Worker Node (WN) + TORQUE + GLEXEC | [[Notes about Installation and Configuration of WN TORQUE GLEXEC]] | EMI-1 |
| SITE service | Worker Node (WN) + TORQUE + MPI | [[Notes about Installation and Configuration of WN TORQUE MPI]] | EMI-1 |
| SITE service | Stand Alone TORQUE Server | [[Notes about Installation and Configuration of TORQUE]] | EMI-1 |
| SITE service | site-bdii | [[Notes about Installation and Configuration of a Site BDII]] | EMI-1 |
| SITE service | !StoRM Storage Element (!StoRM SE) | *TODO* | EMI-1 |
| SITE/CORE service | Home Location Register (HLR) | *TODO* | EMI-1 |
| CORE service | !MyProxy | [[Notes about Installation and Configuration of myproxy]] | EMI-1 |
| CORE service | top-bdii | [[Notes about Installation and Configuration of a Top BDII]] | EMI-1 |
| CORE service | Workload Management System (WMS)| [[Notes about Installation and Configuration of a WMS and LB]] | EMI-1 |
| CORE service | Logging & Bookepping (LB) | *TODO* | EMI-1 |
| CORE service | LCG file Catalog (LFC) | [[Notes about Installation and Configuration of a LFC server]] | EMI-1 |
| CORE service | File Transfer Service (FTS) | *TODO* | EMI-1 |
| CORE service |VOMS | [[Notes about Installation and Configuration of VOMS-MySQL]] | EMI-1 |
Topic revision: r58 - 2013-10-18 - PaoloVeronesi
Account
- Log In
~~Edit~~
~~Attach~~