Transcript
Page 1: Distributed Services for Grid Enabled Data Analysis

Distributed Services for GridEnabled Data Analysis

Distributed Services for GridEnabled Data Analysis

VINCI

Scheduling Service Fermilab

RootletService

OSG ResourceService

Caltech

RootletService

OSG ResourceService

VINCI

Data LocationService

ProdAgent

Execution Service

MonALISA

Monitoring Service

ROOT

Data AnalysisClient

VINCI

WorkflowPlanner

San Diego

RootletService

OSG ResourceService

Florida

RootletService

OSG ResourceService

Clarens

Clarens

Clare

ns

Open Science Grid

Open Science Grid

FD

T

Claren

s

MonALISA

Page 2: Distributed Services for Grid Enabled Data Analysis

Distributed Services for GridEnabled Data Analysis

Distributed Services for GridEnabled Data Analysis

VINCI

Scheduling Service Fermilab

RootletService

OSG ResourceService

Caltech

RootletService

OSG ResourceService

VINCI

Data LocationService

ProdAgent

Execution Service

MonALISA

Monitoring Service

ROOT

Data AnalysisClient

VINCI

WorkflowPlanner

San Diego

RootletService

OSG ResourceService

Florida

RootletService

OSG ResourceService

Clarens

Clarens

Clare

ns

Open Science Grid

Open Science Grid

FD

T

Claren

s

MonALISA

Page 3: Distributed Services for Grid Enabled Data Analysis

Key Features• Distributed Services

Prototype in Data Analysis– Remote Data Service– Replica Location

Service– Virtual Data Service– Scheduling Service– Grid-Execution Service– Monitoring Service

• Smart Replication Strategies for “Hot Data”– Virtual Data w.r.t.

Location

• Execution Priority Management on a Resource Limited Grid– Policy Based Scheduling &

QoS– Virtual Data w.r.t.

Existence

• Collaborative Environment– Sharing of Datasets– Use of Provenance

Page 4: Distributed Services for Grid Enabled Data Analysis

Distributed Services for GridEnabled Data Analysis

Distributed Services for Grid

Enabled Data Analysis

VINCI

Scheduling Framework

Service

Fermilab

RootletService

OSG ResourceService

Caltech

RootletService

OSG ResourceService

DLS

Data LocationService

CMSProd

Execution Service

MonALISA

Monitoring Service

ROOT

Data AnalysisClient

San Diego

RootletService

OSG ResourceService

Florida

RootletService

OSG ResourceService

Cla

rens

Clarens

Open Science Grid

FD

T

Claren

s

MonALISA

Open Science Grid

Cla

rens

Page 5: Distributed Services for Grid Enabled Data Analysis

Distributed Services for GridEnabled Data Analysis

Distributed Services for Grid

Enabled Data Analysis

VINCI

Scheduling Framework

Service

Fermilab

RootletService

OSG ResourceService

Caltech

RootletService

OSG ResourceService

DLS

Data LocationService

CMSProd

Execution Service

MonALISA

Monitoring Service

ROOT

Data AnalysisClient

San Diego

RootletService

OSG ResourceService

Florida

RootletService

OSG ResourceService

Cla

rens

Clarens

Open Science Grid

FD

T

Claren

s

MonALISA

Open Science Grid

Cla

rens


Top Related