srm monitoring 12 th april 2007 mirco ciriello infn-pisa

SRM Monitoring

12th April 2007

Mirco CirielloINFN-Pisa

GSSD Meeting 12 April 2007 2

Overview

• Analysis of existing monitor tools for the various SRM implementations

• List of a first set of information that can be extracted from current available monitor tools

• For now only DPM and dCache are analyzed

• Analysis of dCache needs more investigations


DPM Existing Tool

• www.pi.infn.it/~ciriello/report_dpm.pdf

• There are two tools to monitor an istance of DPM

• dpm_qryconf: displays the Disk Pool Manager configuration

• dpns_getacl: gets the Access Control List associated with a DPNS directory/file


dpm_qryconf 1/3

Gives information for each pool:

• The pool name;• The default amount of space reserved for a file;• The threshold (in %) at which the garbage collector is

started;• The threshold (in %) at which the garbage collector is

stopped;• The default lifetime;• The default pin time;• The maximum lifetime;• The maximum pin time;


dpm_qryconf 2/3

• The File System Selection policy name;• The Garbage Collection policy name;• The Request Selection policy name;• The group id if pool is restricted;• The space type: V (for Volatile), D (for Durable), P (for

Permanent);• The Migration Policy name;• The Retention policy: R (for Replica), O (for Output), C (for

Custodial);• The capacity of the disk pool;• The amount of free space of the disk pool;


dpm_qryconf 3/3

There is also information on the filesystems belonging to the pool:

• The server name;• The filesystem name;• The capacity;• The amount of free space;• The filesystem’s status.


dpns_getacl 1/4

• Gets the ACL associated with a DPNS directory/file

• For each path it displays:The file name;Owner;The group;The Access Control List (ACL) if

present.


dpns_getacl 2/4• The output looks like#file: filename#owner: username#group: groupnameuser::permuser:uid:permgroup::permgroup:gid:permmask:permother:permdefault:user::permdefault:user:uid:permdefault:group::permdefault:group:gid:permdefault:mask:permdefault:other:perm


dpns_getacl 3/4

• The first user entry gives permissions granted to the owner

• The following user entry shows the permissions granted to specific user

• The first group entry gives permissions granted to the owner

• The following group entry shows the permissions granted to specific group


dpns_getacl 4/4

• The mask entry is the maximum permission granted to specific users or groups

• Default entries associated with a directory are inherited as access ACL by the files or sub-directories created in that directory


DPM: other useful information

• There is other useful information to know

• At the moment there’s no tool for retrieval

• Statistics on the performance• Information about the protocol

available to access/transport files


DPM Performace’s Information

• Amount of reserved space;• Number of transfers for each file;• Number of requests for each file;• Number of requests processed;• Number of movements on each pool;• Number of active users;• Number of files per VO;• Max accessibility latency.


DPM Access protocol’s Information

• Type of access protocol;• Network endpoint of the protocol;• Protocol version;• Function supported by the protocol.


dCache Existing Tool

• The following analysis needs further investigations• For now I only list some tools:• Every dCache has a status web page running on port 2288,

that gives useful information about the PoolManager configuration

• Every dCache has a ssh administration interface, that allows the admin to log into dCache, study the components and make real-time changes to the configuration

• The new component SRM-watch, provides a detailed graphical view of the current and past SRM transfers to and from the dCache


dCache status web-page

• Very useful for someone running a dCache• Unfortunately the information are not in machine readable

format• We can recover information on: Availability and response times of pools; Pool Space Usage (total, used, cached, sticky); Pool selection scheme; Data Transfer Queue from Tapes to disks; Mover queues per pool; List of active transfers; Daily, weekly transfer and repository statistics.


dCache ssh admin interface

• It is accessible with the SSH protocol• Provides a more detailed view than

webpage• Unfortunately, it is difficult to write scripts

for this interface• Useful commands are “info” for general

information and ”show pinboard” for list the last lines of the pinboard

• Many of the commands are only used for debugging and development purposes


dCache SRM-watch

• https://srm.fnal.gov/twiki/bin/view/SrmProject/SrmMonitoring

• Java servlet based application• It’s in a prototype stage• It extracts statistical data from SRM database and

plot it• It provides web accessible, dynamic views of SRM

request states and associated transfers• It provides web accessible, static views of system

parameters per day/month/year

srm monitoring 12 th april 2007 mirco ciriello infn-pisa

Documents