distributed services for grid enabled data analysis

5
Distributed Services for Grid Enabled Data Analysis Distributed Services for Grid Enabled Data Analysis VINCI Scheduling Service Fermilab Rootlet Service OSG Resource Service Caltech Rootlet Service OSG Resource Service VINCI Data Location Service ProdAgent Execution Service MonALISA Monitoring Service ROOT Data Analysis Client VINCI Workflow Planner San Diego Rootlet Service OSG Resource Service Florida Rootlet Service OSG Resource Service Clarens Claren s Clarens Open Science Grid Open Science Grid FD T C l a r e n s MonALISA

Upload: marlie

Post on 04-Feb-2016

21 views

Category:

Documents


0 download

DESCRIPTION

Rootlet Service. Rootlet Service. Rootlet Service. Rootlet Service. OSG Resource Service. OSG Resource Service. OSG Resource Service. OSG Resource Service. San Diego. Fermilab. Caltech. Florida. ROOT. VINCI. VINCI. MonALISA. ProdAgent. VINCI. Monitoring Service. Data - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Distributed Services for Grid Enabled Data Analysis

Distributed Services for GridEnabled Data Analysis

Distributed Services for GridEnabled Data Analysis

VINCI

Scheduling Service Fermilab

RootletService

OSG ResourceService

Caltech

RootletService

OSG ResourceService

VINCI

Data LocationService

ProdAgent

Execution Service

MonALISA

Monitoring Service

ROOT

Data AnalysisClient

VINCI

WorkflowPlanner

San Diego

RootletService

OSG ResourceService

Florida

RootletService

OSG ResourceService

Clarens

Clarens

Clare

ns

Open Science Grid

Open Science Grid

FD

T

Claren

s

MonALISA

Page 2: Distributed Services for Grid Enabled Data Analysis

Distributed Services for GridEnabled Data Analysis

Distributed Services for GridEnabled Data Analysis

VINCI

Scheduling Service Fermilab

RootletService

OSG ResourceService

Caltech

RootletService

OSG ResourceService

VINCI

Data LocationService

ProdAgent

Execution Service

MonALISA

Monitoring Service

ROOT

Data AnalysisClient

VINCI

WorkflowPlanner

San Diego

RootletService

OSG ResourceService

Florida

RootletService

OSG ResourceService

Clarens

Clarens

Clare

ns

Open Science Grid

Open Science Grid

FD

T

Claren

s

MonALISA

Page 3: Distributed Services for Grid Enabled Data Analysis

Key Features• Distributed Services

Prototype in Data Analysis– Remote Data Service– Replica Location

Service– Virtual Data Service– Scheduling Service– Grid-Execution Service– Monitoring Service

• Smart Replication Strategies for “Hot Data”– Virtual Data w.r.t.

Location

• Execution Priority Management on a Resource Limited Grid– Policy Based Scheduling &

QoS– Virtual Data w.r.t.

Existence

• Collaborative Environment– Sharing of Datasets– Use of Provenance

Page 4: Distributed Services for Grid Enabled Data Analysis

Distributed Services for GridEnabled Data Analysis

Distributed Services for Grid

Enabled Data Analysis

VINCI

Scheduling Framework

Service

Fermilab

RootletService

OSG ResourceService

Caltech

RootletService

OSG ResourceService

DLS

Data LocationService

CMSProd

Execution Service

MonALISA

Monitoring Service

ROOT

Data AnalysisClient

San Diego

RootletService

OSG ResourceService

Florida

RootletService

OSG ResourceService

Cla

rens

Clarens

Open Science Grid

FD

T

Claren

s

MonALISA

Open Science Grid

Cla

rens

Page 5: Distributed Services for Grid Enabled Data Analysis

Distributed Services for GridEnabled Data Analysis

Distributed Services for Grid

Enabled Data Analysis

VINCI

Scheduling Framework

Service

Fermilab

RootletService

OSG ResourceService

Caltech

RootletService

OSG ResourceService

DLS

Data LocationService

CMSProd

Execution Service

MonALISA

Monitoring Service

ROOT

Data AnalysisClient

San Diego

RootletService

OSG ResourceService

Florida

RootletService

OSG ResourceService

Cla

rens

Clarens

Open Science Grid

FD

T

Claren

s

MonALISA

Open Science Grid

Cla

rens