Difference: StorageAccounting (9 vs. 10)

Revision 102011-07-14 - EnricoFattibene

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Storage accounting

Line: 40 to 40
 

Data visualization

Changed:
<
<
HLRmon development server (hlrmon-dev.cnaf.infn.it) collects data from the configured HLR (at the moment the HLR used is the dgas-test-vm01.cnaf.infn.it test instance) typically once a day, it aggregates per day and stores the results in its internal DB. HLRmon does not store only information related to URs but it also stores, in the same table, data related to the free space of each SA, the total space and the free space for each SE taken directly from the Information System. The HLRmon DB table that contains these data is described in the left half of the following table. The remaining columns correspond to: the corresponding field in the HLR table (if applicable), the corresponding field in the Glue Schema (if applicable) and the description of the field.
>
>
HLRmon development server (hlrmon-dev.cnaf.infn.it) collects data from the configured HLR (at the moment the HLR used is the dgas-test-vm01.cnaf.infn.it test instance) typically once a day, it aggregates per day and stores the results in its internal DB. The table ( sedata_new) that contains these data is described in the left half of the following table. The remaining columns correspond to: the corresponding field in the HLR table (if applicable) and the description of the field.
 
Changed:
<
<
Field Type Null Key Default Extra   HLRTableField GlueSchemaField Description
ID bigint(20) NO PRI NULL auto_increment        
YYMMGG date NO   0000-00-00     TimeInstant   Measurements day
Site varchar(45) YES   NULL     GlobalGroup   Grid site name
SEName varchar(45) YES   NULL     Host   Storage Element
VOName varchar(45) YES   NULL     ProjectName   VO
FreeSpace bigint(20) YES   NULL          
UsedSpace bigint(20) YES   NULL     Disk   Used space
totalfree bigint(20) YES   NULL          
totalsize bigint(20) YES   NULL          
Class varchar(45) YES   NULL     ProjectPartition   Storage Area name
last_mod_time timestamp NO   CURRENT_TIMESTAMP          
>
>
Table sedata_new schema
Field Type Null Key Default Extra   HLRTableField Description
ID bigint(20) NO PRI NULL auto_increment      
YYMMGG date NO   0000-00-00     TimeInstant Measurements day
Site varchar(45) YES   NULL     GlobalGroup Grid site name
SEName varchar(45) YES   NULL     Host Storage Element
VOName varchar(45) YES   NULL     ProjectName VO
UsedSpace bigint(20) YES   NULL     Disk Used space
Class varchar(45) YES   NULL     ProjectPartition Storage Area name
last_mod_time timestamp NO   CURRENT_TIMESTAMP        

HLRmon does not store only information related to URs but it also stores, in another table, data related to the total and free space of each SA, the total space and the used space for each SE taken directly from the Information System. This table ( storage_info_system) is described in the left half of the following table. The remaining columns correspond to: the corresponding field in the Glue Schema (if applicable) and the description of the field.

Table storage_info_system schema

Field Type Null Key Default Extra   GlueSchemaField Description
ID bigint(20) NO PRI NULL auto_increment      
YYMMGG date NO   0000-00-00       Measurements day
Site varchar(45) YES   NULL       Grid site name
SEName varchar(45) YES   NULL     GlueSEUniqueID Storage Element
SETotalSpace varchar(45) YES   NULL     GlueSETotalOnlineSize SE total space
SEUsedSpace bigint(20) YES   NULL     GlueSEUsedOnlineSize SE used space
SATotalSpace bigint(20) YES   NULL     GlueSATotalOnlineSize SA total space
SAFreeSpace bigint(20) YES   NULL     GlueSAFreeOnlineSize SA free space
Class varchar(45) YES   NULL       Storage Area name
last_mod_time timestamp NO   CURRENT_TIMESTAMP        
 
Changed:
<
<
Si ritiene oppurtuno visualizzare i dati aggregati per sito, Storage Element e Storage Area. Per ognuna di queste chiavi di aggregazione viene prodotto un grafico con l'andamento temporale nel periodo desiderato e l'aggragato sul periodo stesso. I grafici sono disponibili a questo indirizzo:
https://hlrmon-dev.cnaf.infn.it:8443/hlrmon/report/storage.php
>
>
HLRmon shows data aggregated per site, Storage Element and Storage Area. For each of these aggregation keys, and for the interval of time desired, a set of charts with the temporal trend is produced. Charts are available at:
https://hlrmon-dev.cnaf.infn.it:8443/hlrmon/report/storage.php
 
Changed:
<
<
Gli stessi dati sono disponibili in formato tabellare con la possibilita' di esportare la tabella in formato excel:
https://hlrmon-dev.cnaf.infn.it:8443/hlrmon/report/table_storage.php
>
>
The same information can also be accessed in a tabular form, with the possibility to save it in xls format:
https://hlrmon-dev.cnaf.infn.it:8443/hlrmon/report/table_storage.php
 
Changed:
<
<
Un'aggregazione per VO non e' allo stato attuale possibile perche' possono esistere casi in cui esistono Storage Area condivise da piu' VO. In questi casi il Glue Schema prevede la pubblicazione del dato di spazio utilizzata dalla sola Storage Area e non di quello utilizzato dalla singola VO. Per questi casi non e' quindi possibile risalire alla quota utilizzata da ogni VO.
>
>
A per-VO aggregation is not possible at the moment because a Storage Area can be shared among different VOs. In this case the Glue Schema allows the publication of the space used in the Storage Area, but not of the space used by each VO. For this case is not possible to know the space used by each VO.
 

 
This site is powered by the TWiki collaboration platformCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback