Tags:
, view all tags

Release notes for Patch #1841

New release (08_98) of the WMS for gLite3.1/SL4. Changes with respect to the current production version:

  • Very often, especially under high loads, the virtual memory occupation for the glite-wms-workload_manager process may reach very high values, such as one Gigabyte and more. Despite what one might think at first sight, this is not about a memory leak, but simply the effect of the so called per-thread arenas. The WM in fact, keeps in memory requests and a very large data structure containing up-to-date resource information, the so called information supermarket, which is accessed by several threads. With the linux standard malloc implementation (ptmalloc2) all this data cause the memory to grow large. See tcmalloc for a detailed explanation. Especially wherever RAM is less than or equal to 4Gb, it is highly suggested to workaround this problem using run-time redirection to whatever lock-free, optimized alternative allocator, to avoid excessive swap activity. Here is our recipe which makes use of the TCmalloc, such an alternate allocator distributed by Google under BSD license:
    • after installing the two rpms, google-perftools-devel-???.rpm and google-perftools-???.rpm (whichever version should be fine),
    • you can use tcmalloc this way: export LD_PRELOAD="/usr/lib/libtcmalloc.so" in the glite-wms-wm script. Even if not specifically recommended (actually it may not work with everything) run-time malloc redirection has proven to get well along with the glite workload manager, so that it can be used without any problem in such circumstances.

  • No more support for RGMA as information system.

  • Temporarily removed the purchasing from CEMon.

  • Added the possibility to submit to a CREAM-CE through a new component called ICE

  • DNS load balancing

  • JobDir as input mechanism to WM in place of FileList. Tool available for conversion. Should it be done automatically?

  • Deprecated components:
    • checkpointing (glite-wms-checkpointing)
    • partitioner (glite-wms-partitioner)
    • interactive (glite-wms-interactive and glite-wms-thirdparty-bypass)
    • rgma (info system)

-- AlessioGianelle - 27 May 2008

Edit | Attach | PDF | History: r32 | r9 < r8 < r7 < r6 | Backlinks | Raw View | More topic actions...
Topic revision: r7 - 2008-06-18 - AlessioGianelle
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback