procedure flow of application...

28th -30th June 07

DAG’07’ at IIT, Mumbai

1

National Grid Computing Initiative - GARUDA Workshop on Developing Applications on Grid -GARUDA

Procedure Flow of Application Enablement

Procedural Flow of

Application Enablement on GARUDA

Bijoy M B

System Software Development Group

CDAC, Bangalore.

[email protected]

28th -30th June 07


2



Computing Evolution

Computing Evolution

•Mainframe

•Mini Computers

•Desktops

•Parallel Processing machines

•Cluster Computing

•Distributed Computing

•Grid Computing

28th -30th June 07


3



Current Day Scientific Applications Require the following:

•High Computation Power

•Large Memory

•Large Database

•High Speed Networks

Scientific Applications

28th -30th June 07


4



Applications

Applications

•Climate Modeling

•Applied Life Science

•Bio Inform

atics

•Simulation

•Astrophysics

–e.g., Simulations of a Supernova Explosion or

–Black Hole Collision

28th -30th June 07


5



Grid GARUDA Usage

Grid GARUDA Usage

Know GARUDA Infrastructure

Acquaintance to use of

Garuda Tools

Accounting & Management

of Jobs

28th -30th June 07


6





•Computing Clusters

•Networks

•Grid Middleware

•Applications

Tool: Steps to bring up a new site

DAG07 Session :

•Steps to bring up a new site

•GlobusMiddleware

DAG07 Session :

•Introduction to Globus

•Grid programming using C and Globus APIs

•Development of Applications for GARUDA

•Applications Enablement on Grid

Storage Resource Broker

DAG07 Session :

•GARUDA Data Management (Storage Resource

Broker-SRB)

Know GARUDA

Infrastructure

Acquaintance to

usage of Garuda

Tools

Accounting &

Management of

Jobs

28th -30th June 07


7



Acquaintance to usage of Garuda Tools

Tool : Grid IDE –GIDE

DAG07 Session :

•Grid Integrated Development Environment -GIDE

Tool : Gridhra

DAG07 Session :

•Grid Debugger and Runtime Analyzer -Gridhra

Tool : Garuda Portal

DAG07 Session:

•GARUDA Job Submission PORTAL

Know GARUDA

Infrastructure

Acquaintance to

usage of Garuda

Tools

Accounting &

Management of

Jobs

28th -30th June 07


8



Accounting & Management of Jobs

Accounting & Management of Jobs

•AccountCreation

Tool : PURSE: Portal-Based User Registration Service

�Web Based Tool

DAG07 Session:

•Registration for GARUDA Certificates using PURSE

•Grid Monitoring

�Resource monitoring

�Network monitoring

Tool :

Paryavekshanam

DAG07 Session:

•Tools on GARUDA

•RT –Grid-Help

�Reporting bugs and suggestions

Tool : Request Tracker -RT

DAG07 Session:

•Tools on GARUDA

Know GARUDA

Infrastructure

Acquaintance to

usage of Garuda

Tools

Accounting &

Management of

Jobs

28th -30th June 07


9



Application Development Procedure

Application Development Procedure

Account Creation

Writing Program Code

Execution

Debugging

Fine tuning

28th -30th June 07


10



Account Creation

Account Creation

Account Creation

Writing Program

Execution

Debugging

Fine tuning

•Need to have a Unix account on submit Node

•Need certificates and Grid proxy pass phrase

•Mapping certificate of user on clusters

•Tool : PURSE: Portal-Based User Registration Service

�Web Based Tool

DAG07 Session:

Registration for GARUDA Certificates using PURSE

28th -30th June 07


11



Writing Program

Writing Program

Account Creation

Writing Program

Execution

Debugging

Fine tuning

•Editor

•Compilation

•Build Script

•Tool :

Grid IDE –GIDE

DAG07 Session :

Grid Integrated Development Environment -GIDE

28th -30th June 07


12



Writing Program

Writing Program

Account Creation

Writing Program

Execution

Debugging

Fine tuning

•Programming Methodology

�Exploit parallelism

�MPI

�Homogeneous cluster

�MPICH

�Heterogeneous Grid

�MPICH-G2

DAG07 Session :

Applications Enablement on Grid

•Resource Specification Language –RSL

DAG07 Session :

Development of Applications for GARUDA

•Storage Resource Broker –SRB

DAG07 Session :

GARUDA Data Management (Storage Resource Broker-SRB)

28th -30th June 07


13



Execution

Execution

Account Creation

Writing Program

Execution

Debugging

Fine tuning

•Submitting Job

•Result Monitoring

•Downloading Output

Tool :

Garuda Portal

DAG07 Session:

GARUDA Job Submission PORTAL

28th -30th June 07


14



Debugging & Fine tuning

Debugging & Fine tuning

Account Creation

Writing Program

Execution

Debugging

Fine tuning

•Breakpoints.

•Stepping

•Watch variables

•Visualization

•Finding perform

ance bottleneck

Tool :

Gridhra

DAG07 Session

Grid Debugger and Runtime Analyzer -Gridhra

28th -30th June 07


15



Enablement of Application on GARUDA


Garuda Infrastructure

Generating Applications

for GARUDA

Submitting Job on

GARUDA

Monitoring Job on

GARUDA

Garuda Environment

Tools

Study Results

28th -30th June 07


16







for GARUDA

Submitting Job on

GARUDA

Monitoring Job on

GARUDA

Garuda Environment

Tools

Study Results

•Computing Clusters

•Networks

•Grid Middleware

•Applications

•Steps to bring up a new site

DAG07 Session :

Steps to bring up a new site

•Globus Middleware

DAG07 Session :

Introduction to Globus

Grid programming using C and Globus APIs

Development of Applications for GARUDA

Applications Enablement on Grid

•Storage Resource broker

DAG07 Session :

GARUDA Data Management (Storage Resource

Broker-SRB)

28th -30th June 07


17



Garuda Environment Tools

Garuda Environment Tools

Garuda Introduction


for GARUDA

Submitting Job on

GARUDA

Monitoring Job on

GARUDA

Garuda Environment

Tools

Study Results

Tool :

Grid IDE –GIDE

DAG07 Session :

Grid Integrated Development Environment -GIDE

Tool :

Gridhra

DAG07 Session :


Tool :

Garuda Portal

DAG07 Session:

GARUDA Job Submission PORTAL

28th -30th June 07


18





Writing Program

Choose Language , Algorithm

Execution

Compilation , Scripting , Submission

Debugging

Breakpoint , Watch Variables , Stepping

Fine tuning

Profiling , Optimization

Garuda Introduction


for GARUDA

Submitting Job on

GARUDA

Monitoring Job on

GARUDA

Garuda Environment

Tools

Study Results

28th -30th June 07


19



Submitting and Monitoring Job

Submitting and Monitoring Job

Garuda Introduction


for GARUDA

Submitting Job on

GARUDA

Monitoring Job on

GARUDA

Garuda Environment

Tools

Study Results

Tool : Paryavekshanam

DAG07 Session: Tools on GARUDA

RT –Grid-Help

�Reporting bugs and suggestions

Tool : Request Tracker -RT

DAG07 Session: Tools on GARUDA

28th -30th June 07


20



Analyse

AnalyseResults

Results

Garuda Introduction


for GARUDA

Submitting Job on

GARUDA

Monitoring Job on

GARUDA

Garuda Environment

Tools

Analyse Results

Tool :

Gridhra

DAG07 Session


28th -30th June 07


21



Intro to W

orkshop

& Grid Computing

Registration using PURSE

Applications Enablement

on Grid

Procedural Flow of

Application Enablement

Introduction to Globus

Development of Applications

for GARUDA

GARUDA PORTAL

Grid Debugger er-Gridhra

Grid Integrated Development

Environment -GIDE

Partners’intended usage of GARUDA

GARUDA Data

Managem

ent (-SRB)

Tools on GARUDA

Grid programming using C

and Globus APIs

Success Stories on GARUDA

Conclusions of the

Workshop

DAY 1

DAY 3

DAY 2

Over view of DAG07 Presentations

28th -30th June 07


22



28th -30th June 07


23



Thank you!

Thank you!

procedure flow of application...

Documents