Difference: WebDocumentation (18 vs. 19)

Revision 192009-06-15 - DanieleCesini

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Overview

WMSMonitor is a monitoring tool collecting information from a cluster of distributed WMS instances about service status and Job Flow. Collected information is aggregated and presented exploiting two main keys: single WMS instance information and Virtual Organization (VO) information.
These two information aggregation keys lead to two parallel branches of metrics presentation in the GUI:
Line: 21 to 21
 
  • DB ANALYZER: a python daemon that checks the latest status of the cluster and sends notification to a nagios server providing mail and/or sms alert notifications.

  • DB RE-FILLER: I can happen for various reasons (i.e. high dg20 file queue on the wms) that data for some jobs are not available on the LB database when the sensors are triggered on the LB servers, resulting in a loss of data in the wmsmonitor server db. The data collector does its best trying to fix the situation, but if data does not reach the lb server in a reasonable time (about ten hours by default, a configurable timeout) the collector gives up and a manual reconstruction is needed. This utility perform such a reconstruction.
Added:
>
>
wmsmon-arch.png
 

Changed:
<
<
wmsmon_arch_1.4.png
>
>
 

Line: 31 to 33
 

Working On

  • Implementation of estimates of job latency
  • ICE sensors 
Changed:
<
<
  • WMS Load Balancing system 
>
>
  • Apache ActiveMQ communication system
  • DB redesigna
  • Performance improvement
 
Changed:
<
<
META FILEATTACHMENT attachment="wmsmon_arch_1.4.png" attr="" comment="" date="1234532180" name="wmsmon_arch_1.4.png" path="wmsmon_arch_1.4.png" size="40297" stream="wmsmon_arch_1.4.png" user="Main.DanieleCesini" version="1"
>
>
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1245057364" name="wmsmon-arch.png" path="wmsmon-arch.png" size="50269" user="Main.DanieleCesini" version="1"
META FILEATTACHMENT attr="" autoattached="1" comment="" date="1234532181" name="wmsmon_arch_1.4.png" path="wmsmon_arch_1.4.png" size="40297" user="Main.DanieleCesini" version="1"
 
TWIKI.NET
This site is powered by the TWiki collaboration platformCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback