experience of xrootd monitoring for alice at rdig sites g.s. shabratova jinr a.k. zarochentsev spbsu

Experience of xrootd monitoring for ALICE at RDIG sites

G.S. Shabratova JINRA.K. Zarochentsev SPbSU

Xrootd Monitoring

• Static monitoring - Bdii • Dynamic monitoring – Monalisa and “xRootd

federation monitoring”

2 xrootd BDII versions(from Claudiu Schiaua ( schiaua@nipne.ro))

• Xrootd information service (xis) 2009• glite-info-provider-SE_xrootd (gip) 2010

xis

• http://niham.nipne.ro/xis/xis.install.html• 2-d xrootd serivce on xis server :

root://xishost: 2194• Xrootd clients on xrootd servers.• Xrootd client on information provider (bdii

server)

gip

• http://indico.cern.ch/getFile.py/access?contribId=0&resId=0&materialId=slides&confId=77435

• http://niham.nipne.ro/NIHAM-repo/instr.html Xrootd client on gip and bdii server Scheme:GlueSALocalID=xroot:SA

>ClueVOinfoLocalID=xroot:VOID:alice

xrootd in ldap

DPM and xrootd in BDII

http://gstat2.grid.sinica.edu.tw/gstat/site/RU-SPbSU/treeview/bdii_site/alice23.spbu.ru/

http://gstat2.grid.sinica.edu.tw/gstat/ldap

DPM

XROOTD

RDIG monitoring

http://rocmon.jinr.ru:8080

Requirements to dynamic monitoring

• Transfers details:– Host out (ip)– Host in (ip)– Size of file– Number of files

• Statistic details:– Size of packages for host out (in) by time– Errors

Proposed Architecture to Monitoring & Control the Xrootd in ALICE

Long HistoryDB

MonALISA

Network Monitoring

ApMon

XROOTDSERVER

SystemMonitoring

MonaLisaXrootd Repository

Aggregated Data

Alerts

Actions

Xroootd Monitoring and Control, Harish Arora, Cern

ControlModule

Control / Update

MonALISA

Network Monitoring

ApMon

XROOTDSERVER

SystemMonitoring

ControlModule

MonALISA

Network Monitoring

ApMon

XROOTDSERVER

SystemMonitoring

ControlModule

MonALISA on http://alimonitor.cern.ch/display

MonALISA on http://alimonitor.cern.ch/display

MonALISA on http://alimonitor.cern.ch/display

MonALISA from gui client

• GUI client from alimonitor.cern.ch:

• Or form http://monalisa.caltech.edu/monalisa.htm :

MonALISA from gui client

MonALISA from console

• Need:– Monalisa Repository from

http://monalisa.caltech.edu/:

– And monalisaWSClients :

MonALISA from console

• Result:

xRootd federation monitoring

• 17 July 201215.45-16.00ATLAS Off-Grid Sites (Tier-3) Monitoring A.S. Petrosyan, D.A. Oleynik, S.D. Belov, J. Andreeva, I.S. Kadochnikov (on behalf of the ATLAS collaboration)

Data flow for XRootD• Both summary and detailed events

gatherer implemented as Linux daemon• Summary data goes directly to Ganglia• File transfer data can be stored in local

PostgreSQL and then presented via Ganglia

• Detailed data can be delivered to ActiveMQ directly

• Data being sent to global level:• Domain from, host and ip address• Domain to, host and ip address• User• File, size• Bytes read, written• Time transfer started and finished

1917.07.2012 GRID'2012, JINR, Dubna

Conclusions:• Bdii monitoring works, but not supported and

rarely used• Monalisa monitoring works, but can not

monitor separate transfer• “xRootd federation monitoring” – we wait it in

the near future.

Many thanks:

• Sergey Belov• Daniil Oleynik• Artem Petrosyan• Andrey Kiryanov• And etc

Questions?