Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Introduction to v2.1 Installation and ConfigurationThis installation guide is divided as follows: |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Introduction to v2.1 Installation and ConfigurationThis installation guide is divided as follows: | ||||||||
Line: 119 to 119 | ||||||||
WMSMON Data Collector installation(do all the following as root) | ||||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
| ||||||||
Line: 128 to 128 | ||||||||
| ||||||||
Changed: | ||||||||
< < | wget http://grid-it.cnaf.infn.it/certification/downloads/WMSMonitor.repo | |||||||
> > | wget http://grid-it.cnaf.infn.it/certification/downloads/WMSMonitor.repo | |||||||
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Introduction to v2.1 Installation and ConfigurationThis installation guide is divided as follows: | ||||||||
Line: 35 to 35 | ||||||||
| ||||||||
Changed: | ||||||||
< < | wget http://grid-it.cnaf.infn.it/certification/downloads/WMSMonitor.repo | |||||||
> > | wget http://grid-it.cnaf.infn.it/certification/downloads/WMSMonitor.repo | |||||||
| ||||||||
Line: 119 to 119 | ||||||||
WMSMON Data Collector installation(do all the following as root) | ||||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
|
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Introduction to v2.1 Installation and ConfigurationThis installation guide is divided as follows: | ||||||||
Line: 68 to 68 | ||||||||
The important variable for sensors installation are: | ||||||||
Changed: | ||||||||
< < | - WMSMON_HOST = 'Set here the name of the wmsmon data collector host'
- WMSMON_DB_PWD = Chose a root - password for mysql - if already set use it. (Even if not used by sensors please fiill in this field) - SNMPPASSWD = 'The password you choose for snmp communication | |||||||
> > | - WMSMON_HOST = 'Set here the name of the wmsmon data collector host' - SNMPPASSWD = 'The password you choose for snmp communication | |||||||
between data collector and wms instance !! NOTE: it must be the same on every wmsmon_site-info.def | ||||||||
Line: 83 to 81 | ||||||||
!!!(THIS IS FUNDAMENTAL ON EVERY HOST PLEASE READ CAREFULLY WHAT FOLLOWS)!!! | ||||||||
Changed: | ||||||||
< < | If you follow the instruction below for the server installation without modifying the httpd configuration it s | |||||||
> > | If you follow the instruction below for the server installation without modifying the httpd configuration it is | |||||||
http://<WMSMMON_HOST> | ||||||||
Line: 90 to 88 | ||||||||
# Other examples in case of modified httpd conf
#Examples: # http://host.domain | ||||||||
Added: | ||||||||
> > | ||||||||
# https://host.domain | ||||||||
Added: | ||||||||
> > | ||||||||
# https://host.domain:8443 | ||||||||
Changed: | ||||||||
< < | If this parameters are not set an error will be raised a t configuration time (only a warning for the mail address) | |||||||
> > | In the post installation steps you'll find some basic instruction on how to configure httpd - if you change the httpd configuration (in particular http to https or the port number) remember to change the LB_PARA_HOST on all instances) If the parameters mentioned above are not set an error will be raised a t configuration time (only a warning for the mail address) | |||||||
When setting a password please read the comments in the wmsmon_site-info.def file to know if the password must be enclosed | ||||||||
Line: 115 to 117 | ||||||||
WMSMON Data Collector installation | ||||||||
Changed: | ||||||||
< < | (done all the following as root) | |||||||
> > | (do all the following as root) | |||||||
| ||||||||
Line: 163 to 165 | ||||||||
- WMSMON_SEVER_CONTACT_EMAIL = MAIL CONTACT that will appear in web pages error messages. Users will be invited to send email to this address. | ||||||||
Changed: | ||||||||
< < | - LB_PARA_HOST = Host publishing the LB_PARAMETER FILE that initializes
lb queries. It is the procol://host:port of the http service running on
the collector instances.
If you follow the instruction below for the server installation without modifying the httpd configuration it s
http://<WMSMMON_HOST>
# Other examples in case of modified httpd conf
#Examples: # http://host.domain # https://host.domain # https://host.domain:8443 If this parameters are not set an error will be raised a t configuration time (only a warning for the mail address) | |||||||
> > | If the parameters mentioned above are not set an error will be raised a t configuration time (only a warning for the mail address) | |||||||
When setting a password please read the comments in the wmsmon_site-info.def file to know if the password must be enclosed | ||||||||
Line: 190 to 178 | ||||||||
| ||||||||
Changed: | ||||||||
< < | but note that it is no more called wmsmonlist.con (R1.4) but wmslist.conf. | |||||||
> > | but note that it is no more called wmsmonlist.con (R1.4) but wmslist.conf (since R2.0). | |||||||
This file contains the list of WMS present in your cluster (those were the wmsmon sensors are or will be installed). It must be edited as shown in the template file in the following way: | ||||||||
Line: 375 to 363 | ||||||||
On WMS/LB sensor side you should set snmp in order to listen for request on the port you choose. This is accomplished by adding in the | ||||||||
Changed: | ||||||||
< < | /etc/snmp.conf file the following line: | |||||||
> > | /etc/snmp/snmpd.conf file the following line: | |||||||
agentaddress <port_number> |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Introduction to v2.1 Installation and ConfigurationThis installation guide is divided as follows: | ||||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
This version of the server and of the sensor requires SL4 and snmp (installed by the installation scripts) on all the nodes. | ||||||||
Line: 21 to 22 | ||||||||
has changed! if you are running an update from a version older that 2.0 it will be automatically ported to the new schema by the configuration script. | ||||||||
Changed: | ||||||||
< < | If you want to port the old data to | |||||||
> > | If you run a version earlier to 2.0 and want to port the old data to | |||||||
the new VO statistics page please contact wms-support<at>cnaf.infn.it after the instalaltion/configuration | ||||||||
Changed: | ||||||||
< < | completes. | |||||||
> > | completes. If you are upgrading from 2.0 VO statistics will be automatically ported.
WMSMON Sensors installation on WMS/LB/WMSLB nodes(done all the following as root on all your WMS, LB, WMSLB nodes - the procedure is independent on the node type)
- SNMPPASSWD = 'The password you choose for snmp communication between data collector and wms instance !! NOTE: it must be the same on every wmsmon_site-info.def - SERVER_MYSQL_PASSWORD = 'd3pass' (This is FUNDAMENTAL ON LB NODES) - LB_PARA_HOST = Host publishing the LB_PARAMETER FILE that initializes lb queries. It is the procol://host:port of the http service running on the collector instances. !!!(THIS IS FUNDAMENTAL ON EVRY HOST PLEASE READ CAREFULLY WHAT FOLLOWS)!!! If you follow the instruction below for the server installation without modifying the httpd configuration it s http://<WMSMMON_HOST> # Other examples in case of modified httpd conf #Examples: # http://host.domain # https://host.domain # https://host.domain:8443 If this parameters are not set an error will be raised a t configuration time (only a warning for the mail address) When setting a password please read the comments in the wmsmon_site-info.def file to know if the password must be enclosed between ' ' You can ignore the LOAD BALANCING PARAMETERS section if you are not installing a load balancing arbiter.
If the node is an LB the script will add grants to for wmsmon user on DB lbserver20. It's important that the MYSQL root passwd is set corrrectly in wmsmon_site-info.def file. The script will not remove old WMSMonitor path /root/wmsmon in order not to destroy user manual changes. That directory can be removed manually without creating problems to the sensors. If at the end of the script you see the string: "WMSMONITOR SENSORS SUCCESSFULLY CONFIGURED!" it means that every went fine . In case of problems running the script please contact wms-support<at>cnaf.infn.it . | |||||||
Changed: | ||||||||
< < | WMSMON data collector installation | |||||||
> > | WMSMON Data Collector installation | |||||||
(done all the following as root)
| ||||||||
Line: 299 to 385 | ||||||||
Configuring WMS load balancing ArbiterTo configure the Arbiter parameters in the site_info.def file refer to: | ||||||||
Changed: | ||||||||
< < | https://twiki.cnaf.infn.it/cgi-bin/twiki/view/WMSMonitor/WMSLoadBalancingArbiter
| |||||||
> > | https://twiki.cnaf.infn.it/cgi-bin/twiki/view/WMSMonitor/WMSLoadBalancingArbiter | |||||||
The WMS instances load balancing arbiter is a python script wms_balancing_arbiter.py which must be executed periodically in a cron. It should be executed in cascade to the data_collector script in order to take advantage of latest available metric collected by the WMSMonitor from each WMS instance. Note that also an utility is provided, external_wmsmon_metrics_collector.py, to allow the inclusion of WMS instances monitored by other WMSMonitor servers in the list of defined aliases. This is useful for ROC level definition of some WMS aliases pointing to WMS instances geographycally distributed and momitored by different WMSMonitor instances. To make this work you must edit the external_wmsmon_metrics_collector.py script directly adding the WMSMonitor urls of instances to monitor as in the example below: | ||||||||
Line: 309 to 394 | ||||||||
'https://wmsmon.ct.infn.it:8443/wmsmon/details/details.php?wms=prod-wms-02.ct.infn.it'] and add its execution in the load balancing cron, which is something like: | ||||||||
Changed: | ||||||||
< < | 5,20,35,50 * * * * root /PATH/external_wmsmon_metrics_collector.py; /PATH/wms_balancing_arbiter.py >> /var/www/html/loadbalancing_test.log 2>&1 | |||||||
> > | 5,20,35,50 * * * * root /PATH/external_wmsmon_metrics_collector.py; /PATH/wms_balancing_arbiter.py >> /var/www/html/loadbalancing_test.log 2>&1 | |||||||
Note that /var/www/html/loadbalancing_test.log files readable through the web displays the WMS IP list in the alias for all defined aliases. | ||||||||
Deleted: | ||||||||
< < |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Introduction to v2.1 Installation and ConfigurationThis installation guide is divided as follows: | ||||||||
Line: 294 to 294 | ||||||||
and restarting snmp (service snmpd restart) | ||||||||
Added: | ||||||||
> > |
To configure the Arbiter parameters in the site_info.def file refer to: https://twiki.cnaf.infn.it/cgi-bin/twiki/view/WMSMonitor/WMSLoadBalancingArbiter The WMS instances load balancing arbiter is a python script wms_balancing_arbiter.py which must be executed periodically in a cron. It should be executed in cascade to the data_collector script in order to take advantage of latest available metric collected by the WMSMonitor from each WMS instance. Note that also an utility is provided, external_wmsmon_metrics_collector.py, to allow the inclusion of WMS instances monitored by other WMSMonitor servers in the list of defined aliases. This is useful for ROC level definition of some WMS aliases pointing to WMS instances geographycally distributed and momitored by different WMSMonitor instances. To make this work you must edit the external_wmsmon_metrics_collector.py script directly adding the WMSMonitor urls of instances to monitor as in the example below: urllist=['https://wmsmon.ct.infn.it:8443/wmsmon/details/details.php?wms=prod-wms-01.ct.infn.it', 'https://wmsmon.ct.infn.it:8443/wmsmon/details/details.php?wms=prod-wms-02.ct.infn.it'] and add its execution in the load balancing cron, which is something like: 5,20,35,50 * * * * root /PATH/external_wmsmon_metrics_collector.py; /PATH/wms_balancing_arbiter.py >> /var/www/html/loadbalancing_test.log 2>&1 Note that /var/www/html/loadbalancing_test.log files readable through the web displays the WMS IP list in the alias for all defined aliases. |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Introduction to v2.1 Installation and ConfigurationThis installation guide is divided as follows: | ||||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
| ||||||||
Line: 30 to 30 | ||||||||
WMSMON data collector installation(done all the following as root) | ||||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
| ||||||||
Line: 45 to 46 | ||||||||
| ||||||||
Changed: | ||||||||
< < | In release 2.1 the WMSMonitor rpms installs everythng under /opt/WMSMonitor (in previous releases it was under /root/wmsmon). | |||||||
> > | In release 2.1 the WMSMonitor rpms installs everything under /opt/WMSMonitor (in previous releases it was, by default, under /root/wmsmon). | |||||||
Line: 57 to 57 | ||||||||
| ||||||||
Changed: | ||||||||
< < | correctly all the monitor components. It is important to edit it carefully using a key = value notation. | |||||||
> > | correctly all the monitor components. It is important to edit it carefully using a key = value notation. | |||||||
Comments can be made using # at the beginning of the line. Inline comments help you during the editing. | ||||||||
Changed: | ||||||||
< < | If this is an upgrade please re-edit the file in the new location, now it is much easier to edit. | |||||||
> > | If this is an upgrade please re-edit the file in the new location, now it is much easier to edit. Of course use the same values used in the wmsmon_site-info.def used up to now. | |||||||
The important variable for a collector installation are: | ||||||||
Changed: | ||||||||
< < | - WMSMON_HOST = 'Set here the name of the wmsmon data collector host' | |||||||
> > | - WMSMON_HOST = 'Set here the name of the wmsmon data collector host' | |||||||
- WMSMON_DB_PWD = Chose a root - password for mysql - if already set use it. - LEMONFLAG = 1 'If you do not have a lemon tool on the wms/lb instance set to 0' - LEMONURL = 'Set to the machine lemon url if any' - SNMPPASSWD = 'The password you choose for snmp communication between data collector and wms instance !! NOTE: it must be the same on | ||||||||
Line: 89 to 90 | ||||||||
# https://host.domain # https://host.domain:8443 | ||||||||
Changed: | ||||||||
< < | If this paramemeters are not set an error will be raised a t configuration time (only a warning for the mail address) | |||||||
> > | If this parameters are not set an error will be raised a t configuration time (only a warning for the mail address) | |||||||
When setting a password please read the comments in the wmsmon_site-info.def file to know if the password must be enclosed | ||||||||
Line: 100 to 101 | ||||||||
| ||||||||
Changed: | ||||||||
< < | If this is an upgrade you | |||||||
> > | If this is an upgrade you | |||||||
can maintain the same wmslist.conf file used by the previous release, | ||||||||
Changed: | ||||||||
< < | but note that it is no more called wmsmonlist.con but wmslist.conf. | |||||||
> > | but note that it is no more called wmsmonlist.con (R1.4) but wmslist.conf. | |||||||
Changed: | ||||||||
< < | This file contains the list of wms present in your cluster (those were the wmsmon sensors are or will be installed). It must be edit as shown in the template file in the following way: | |||||||
> > | This file contains the list of WMS present in your cluster (those were the wmsmon sensors are or will be installed). It must be edited as shown in the template file in the following way: | |||||||
wms1.your_domain lb1.your_domain vo1 | ||||||||
Line: 119 to 120 | ||||||||
multiVO. You can also use this tag to group the wms by their role: PROD, DEVEL etc... | ||||||||
Changed: | ||||||||
< < | THE FILE CANNOT BE COMMENTED. | |||||||
> > | IMPORTANT: THE FILE CANNOT BE COMMENTED! | |||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
| ||||||||
Changed: | ||||||||
< < | Errors will be reported, please pay attention to them. | |||||||
> > | The old cron files that trigger the collector execution are moved to /tmp directory and new crons will be installed. | |||||||
Changed: | ||||||||
< < | If an older installation was found a wmsmon_old and /tmp/wmsmon_web_bkp directory are created containing all the old files. | |||||||
> > | The old $INSTALL_PATH/wmsmon directory (by default /root/wmsmon) will not be removed or moved in order not to destroy manual changes - if you want you can remove manually or leave untouched, it will not cause any problems. Errors will be reported, please pay attention to them. | |||||||
When the script completes the /opt/WMSMonitor directory should have been moved to the INSTALL_PATH defined and the /var/www/html/wmsmon directory should now be in /var/www/html/WEBDIR, where WEBDIR is defined in the wmsmon_default.conf file. |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Introduction to v2.1 Installation and ConfigurationThis installation guide is divided as follows: | ||||||||
Line: 9 to 9 | ||||||||
Python, http, php and other packages are also needed on the collector machine - they will be installe automatically when the WMSMonitor packages are installed. | ||||||||
Changed: | ||||||||
< < | If sensors or/and data_collector are already running at your site, instruction on how to upgrade are given highlighted in green. | |||||||
> > | If sensors and/or data_collector are already running at your site, instruction on how to upgrade are given highlighted in green. | |||||||
This version is installed via rpm and yum. | ||||||||
Line: 28 to 28 | ||||||||
WMSMON data collector installation | ||||||||
Changed: | ||||||||
< < | (done all the following as root) | |||||||
> > | (done all the following as root) | |||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
Changed: | ||||||||
< < |
| |||||||
> > |
| |||||||
Changed: | ||||||||
< < | ||||||||
> > |
| |||||||
Changed: | ||||||||
< < |
| |||||||
> > | wget http://grid-it.cnaf.infn.it/certification/downloads/WMSMonitor.repo | |||||||
| ||||||||
Added: | ||||||||
> > | In release 2.1 the WMSMonitor rpms installs everythng under /opt/WMSMonitor (in previous releases it was under /root/wmsmon). | |||||||
| ||||||||
Changed: | ||||||||
< < |
| |||||||
> > | In /opt/WMSMonitor/common are installed all the files needed by all WMSMonitor components. One of this files is the wmsmon_site-info.def, it is now much easier to edit since many default parameters have been moved to the wmsmon_default.conf file. The defaults file should usually not be changed.
- LEMONFLAG = 1 'If you do not have a lemon tool on the wms/lb instance set to 0' - LEMONURL = 'Set to the machine lemon url if any' - SNMPPASSWD = 'The password you choose for snmp communication between data collector and wms instance !! NOTE: it must be the same on every wmsmon_site-info.def - WMSMON_SEVER_CONTACT_EMAIL = MAIL CONTACT that will appear in web pages error messages. Users will be invited to send email to this address. - LB_PARA_HOST = Host publishing the LB_PARAMETER FILE that initializes lb queries. It is the procol://host:port of the http service running on the collector instances. If you follow the instruction below for the server installation without modifying the httpd configuration it s http://<WMSMMON_HOST> # Other examples in case of modified httpd conf #Examples: # http://host.domain # https://host.domain # https://host.domain:8443 If this paramemeters are not set an error will be raised a t configuration time (only a warning for the mail address) When setting a password please read the comments in the wmsmon_site-info.def file to know if the password must be enclosed between ' ' You can ignore the LOAD BALANCING PARAMETERS section if you are not installing a load balancing arbiter. | |||||||
| ||||||||
Changed: | ||||||||
< < |
| |||||||
> > | If this is an upgrade you can maintain the same wmslist.conf file used by the previous release, but note that it is no more called wmsmonlist.con but wmslist.conf. | |||||||
Changed: | ||||||||
< < | Look for errors. Configuration is complete only if a string like "WMSMonitor Successfully Configured" if displayed at the end. | |||||||
> > | This file contains the list of wms present in your cluster (those were the wmsmon sensors are or will be installed). It must be edit as shown in the template file in the following way: | |||||||
Changed: | ||||||||
< < | yum install mysql-server | |||||||
> > | wms1.your_domain lb1.your_domain vo1 | |||||||
Changed: | ||||||||
< < | service mysqld start | |||||||
> > | .... | |||||||
Added: | ||||||||
> > | wmsn.your_domain lbn.your_domain von | |||||||
Changed: | ||||||||
< < |
| |||||||
> > | You should insert the wms/lb pairs monitored and a vo served by the
pair. The vo indication will be used only to group the wms in the
wmsmon web pages, and not for the job counting per vo. If a pair serve more than one VO you can choose a word like multi or multiVO. You can also use this tag to group the wms by their role: PROD, DEVEL etc... | |||||||
Changed: | ||||||||
< < | /root/install_wmsmon_server-v2.0_00.py -i | |||||||
> > | THE FILE CANNOT BE COMMENTED.
| |||||||
The script will look for older wmsmon installations. If none is found a brand new installation will start otherwise an upgrade process will be attempted. Errors will be reported, please pay attention to them. | ||||||||
Added: | ||||||||
> > | If an older installation was found a wmsmon_old and /tmp/wmsmon_web_bkp directory are created containing all the old files. When the script completes the /opt/WMSMonitor directory should have been moved to the INSTALL_PATH defined and the /var/www/html/wmsmon directory should now be in /var/www/html/WEBDIR, where WEBDIR is defined in the wmsmon_default.conf file. Two crons should be present in /etc/cron.d: wmsmon.cron and wmsmon_logrotate.conf. The wmsmon.cron is the cron that launches the main data collector script. By default it is launched every 15 mins, if you want to change this frequency you should change the cron file by hand, and in this case in order to optimize performance you are advised to change also the STEPDATE value in the wmsmon_default.conf file to 2x(cron frequency). By default the data collector script logs to the /var/log/WMSMONITOR.log file, but you can configure this on the default.def file. By default the wmsmon_logrotate cron creates 10 files 100MB big, to modify this parameter you should change by hand the /etc/wmsmon_logrotate.cron file. The standard output of the data collector script is maintained in the /var/log/data_collector_main.log for debugging reasons, this file is rotated as the main log file, please keep it. Look for errors. Configuration is complete only if a string like "WMSMonitor Successfully Configured" is displayed at the end. In case of problems please contact wms-support<at>cnaf.infn.it |
Line: 1 to 1 | ||||||||
---|---|---|---|---|---|---|---|---|
Added: | ||||||||
> > | Introduction to v2.1 Installation and ConfigurationThis installation guide is divided as follows:
It is advisable, even if not required that the sensors are installed before the collector. In case of problems during installation please contact wms-support<at>cnaf.infn.it NOTE: In release 2.0 the database schema has changed! if you are running an update from a version older that 2.0 it will be automatically ported to the new schema by the configuration script. If you want to port the old data to the new VO statistics page please contact wms-support<at>cnaf.infn.it after the instalaltion/configuration completes. WMSMON data collector installation(done all the following as root)
|