NEW Installation for emi-WMS/LB, WMSMonitor 3.0

A completely new version of WMSMonitor is made available, for Pre-View testing.
For the moment being we only deploy sensors in a tarball, and you can use the WMSMonitor server Instance available at INFN-CNAF to visualize your instance data.
Notice that this new version can be installed on emiWMS/LB only on SL5/64 platform.

Here some of the novelties introduced with this new version:

• New web Interface with separate frames for WMS and LB instances
• Data collection is now asynchronous, in fact a cron job executes sensors on monitored WMS/LB instances and send data to WMSMonitor server consumer
• Messaging is now based on Active MQ
• WMS job workload management rates are now derived exploiting LB api
• Handling of several LB instances for each WMS
• both globus and emi-cream JSS case is now handled
• globus JSS error statistics available

WMSMonitor SENSORS INSTALLATION ON INSTANCES TO MONITOR

To be part of the preview, please write to wms-support asking for the tarball. Then follow instruction:

1. Make sure you have your emi WMS / LB instance installed and you have root privileges on it
2. $> cd /opt
3. $> tar -xvzf WMSMonitor.tgz (--> untar the tarball we provided you with)
4. $> cp /opt/WMSMonitor/sensors/bin/WMSMonitor.cron /etc/cron.d/
5. Edit /etc/cron.d/WMSMonitor.cron uncommenting the WMS or LB line respectively (depending on the service hosted in your instance)
6. IMPORTANT --> tell us the hostname of instance to be monitored
7. Wait till first cron job to start and check whether a file like /tmp/WMSLOCKFILE_1312453801.45 exists
8. go to INFN-CNAF WMSMonitor 3.0 monitor server with a valid user certificate and flash player in your browser and enjoy...

Note:

1. WMSMonitor "user mapping" functionality requires wmproxy loglevel set a 6 in glite_wms.conf file
2. Required package lsof.x86_64 installed on WMS/LB instance

WMSMonitor SERVER (Not Available for Download YET: WORK IN PROGRESS)

WMSMonitor Server Instance Installation

Requirements:

1. Make sure you have your emi WMS / LB instances to monitor installed with new sensors as described in previous paragraph.
2. By default the exploited ActiveMQ broker is the one provided by CERN for development purposes. If you use the default broker/topic you can ignore this step. To use your own ActiveMQ server you need to install one and setup a proper topic on it. This HOWTO does not cover the issue.
3. A fresh installation of SL5/x64. Suggested HW: Virtual Machine with 3GB RAM, 30GB disk, 1 Core
4. Install php package:
   1. $> yum install php
5. Install mod_ssl package:
   1. $> yum install mod_ssl
6. Install mysql server package:
   1. $> yum install mysql-server
   2. $> chkconfig mysqld on
   3. $> service mysqld start
7. Install apache server package:
   1. $> yum install httpd
   2. $> chkconfig httpd on
   3. $> service httpd start

Then follow instruction:

1. $> cd /opt
2. $> tar -xvzf WMSMonitor-server.tgz (--> untar the tarball we provided you with)
3. $> cp /opt/WMSMonitor/sensors/bin/WMSMonitor.cron /etc/cron.d/

WMSMonitor Server Instance Configuration

Web Access Configuration:

• Increased php available memory

In order to increase php performance it is advisable that you increase the php allocable memory.
Modify the /etc/php.ini to have the folloving line:
memory_limit = 56M

• Secure http enabled (required for enabling user stats web access)

The WMSMON server needs a valid host certificate stored in a HOST_CERTIFICATE_DIR (i.e. /etc/grid-security)

Install the accepted ca packages, i.e. you can execute the following:
- Create the /etc/yum.repos.d/lcg-ca.repo file containing:

    [CA]

    name=CAs

    baseurl=http://linuxsoft.cern.ch/LCG-CAs/current

    protect=1

- Run : yum install lcg_CA

Edit the /etc/httpd/conf/httpd.con f and add the following inside the <Directory /var/www/html> section the following lines :

         SSLRequireSSL

         SSLVerifyClient      require

         SSLVerifyDepth 10

Edit the /etc/httpd/conf.d/ssl.conf and:

- set the SSLCertificateFile variable to HOST_CERTIFICATE_DIR/hostcert.pem and comment any other line that set this variable.

- set the SSLCertificateKeyFile variable to HOST_CERTIFICATE_DIR/hostkey.pem and comment any other line that set this variable. _ _

- set the SSLCACertificatePath variable to the name of the directory containing the CA file (i.e. /etc/grid-security/certificates if you installed the lcg_CA metapackage) and comment any other line that set this variable.

If you want to change the default https port (443) you should change in the /etc/httpd/conf.d/ssl.conf file the line:
Listen <port_number> (i.e. Listen 8443)

_Oprtional redirect - If you want to automatically redirect http requests to https pages you should add to the /etc/httpd/conf/httpd.conf file the following section (using the proper values for the variables_ SERVER_HOST_IP,SERVER_HOST_NAME and YOUR_DOMAIN):

<VirtualHost SERVER_HOST_IP:80>

   DocumentRoot /var/www/html

   ServerName SERVER_HOST_NAME.YOUR_DOMAIN

   RedirectMatch (/.*)$ https://SERVER_HOST_NAME.YOUR_DOMAIN/$1

</VirtualHost>

Restart httpd

• Monitoring Instance Cluster Configuration:

  Adding instances to monitor to WMSMonitor server

  1. Given an LB and a WMS instance to monitor:
     1. Enter Mysql database wmsmon:
     2. mysql$>call insertHostLabels(<WMS-HOSTANME-WITH-DOMAIN>, 'WMS', <VO(for multi-vo services set 'multi')>, <VO_GROUP(ex. 'analysis','mc_production',etc.)>, <SERVICE_USAGE(ex. 'production','test',etc.)>, 1, <HOST-SITENAME>);
     3. mysql$>call insertHostLabels(<LB-HOSTANME-WITH-DOMAIN>, 'LB', <VO(for multi-vo services set 'multi')>, <VO_GROUP(ex. 'analysis','mc_production',etc.)>, <SERVICE_USAGE(ex. 'production','test',etc.)>, 1, <HOST-SITENAME>);
     4. mysql$> call insertLBHost();
     5. shell$> python /opt/WMSMonitor/collector/bin/data_collector_daemon.py stop
     6. shell$> FROM SHELL: python /opt/WMSMonitor/collector/bin/data_collector_daemon.py start

  Configuring Load Balancing in WMSMonitor server

  1. Set the dns contact in site-info.def
  2. Set the passwd for dns contact in site-info.def
  3. Define aliases in the dns contact
     1. For each given ALIAS and WMS instance associated:
        1. Enter Mysql database wmsmon
        2. ADD ALIAS: mysql$> call insert_loadbalancing_ALIAS(enable_flag #is the alias in use#, numout #number of instances to leave out of alias per period#, subtest_enable #IS a submission test to be used in status metric#, alias_name #without domain#);
        3. ADD HOST TO ALIAS mysql$> call add_wmshost_to_ALIAS(WMS_HOSTNAME_WITH_DOMAIN, ALIAS_NAME_WITHOUT_DOMAIN, SPARE_LABEL #1 if wms associated but not used#);

  -- DaniloDongiovanni - 2011-12-20