Hungarian Supercomputing GRID

http://www.iif.hu/mszgrid

General InformationGeneral Information

• Co-ordinator:– Office for National Information Infrastructure

Development (NIIFI)

• Consortium members:– Computer and Automation Research Institute Hungarian

Academy of Sciences (MTA SZTAKI)– BUTE Dept. Control Engineering and Information

Technology– ELTE Network Service Center– BUTE Center of Information Systems– BUTE Intitute of Nuclear Technics– Compaq Computer Hungary Ltd.

Research area: Research area: Grid Grid systemssystems

Interconnected, geographically distributed, and high performance or large number of resources to solve complex problems

Internet

Hungarian and international GRID projects

CERN LHC Grid

VISSZKI-Globus test-Condor test

DemoGrid - file system - monitoring- applications

SuperGrid - P-GRADE- portal- security- accounting

Condor

EU DataGrid

EU COSTSIMBEX

APART-2

EUGridLab

Cactus

InfrasInfrastructure oftructure of thethe HungarianHungarian SupercomputingSupercomputing Grid Grid

P-GRADE

PVM MW

Condor-G

Globus

SUN HPC

Compaq AlphaServer

Compaq AlphaServer

Grid middleware

Grid fabric

High-level parallel development layer

Grid level job management

Condor, SGE

MPI

GRID portal

Web based GRID access

Condor, SGE

GRID application

GRID application

Low-levelparallel development

Layers of Hungarian Supercomputing GRID

Condor, SGEClusters

Condor, SGE

Distributed supercomputing: P-GRADEDistributed supercomputing: P-GRADE

• P-GRADE (Parallel Grid Run-time and Application Development Environment)

• A highly integrated parallel Grid application development system

• Support for programming of GRID: Parallel, supercomputing programming Fast and efficient development Observation and visualization Fault and performance analysis

• Further development in the: – Hungarian Supercomputing Grid project– Hungarian Chemistry Grid project– Hungarian Jini Grid project

Hierarchical design layers of P-GRADEHierarchical design layers of P-GRADE

Pre-defined Communication TemplatesPre-defined Communication TemplatesMeshMesh

Workflow interpretation of Workflow interpretation of P-GRADE applicationsP-GRADE applications

1st job

2nd job 3rd job 4th job

5th job

Features of Features of P-GRADEP-GRADE

Designed for non-specialist programmers Enables fast reengineering of sequential

programs for parallel computers and Grid systems

Unified graphical support in program design, debugging and performance analysis

Portability on supercomputers heterogeneous clusters components of the Grid

Two execution modes: Interactive mode Job mode

Condor/P-GRADE on various Condor/P-GRADE on various parallel and distributed systemsparallel and distributed systems

Super-computers

2100 2100 2100 2100

2100 2100 2100 2100

Clusters Grid

GFlops

Mainframes

P-GRADE

Condor

P-GRADE

Condor

P-GRADE

Condor flocking

P-GRADE Interactive ModeP-GRADE Interactive Mode

P-GRADEInteractive

mode

Design/Edit

Compile

Map Debug

Monitor

VisualizeDevelopment cycle

Typical usage on dedicated supercomputers or clusters

P-GRADE Job Mode with CondorP-GRADE Job Mode with Condor

P-GRADEand

Condor

Compile

Design/Edit

CondorMap

Attach

Detach

Submit job

Typical usage on clusters or in the Grid

Berlin CCGrid Grid Demo workshop: Berlin CCGrid Grid Demo workshop: Flocking of P-GRADEFlocking of P-GRADE programs by Condorprograms by Condor

m0 m1

P-GRADEBudapest

Budapest

n0 n1

Madison

p0 p1

Westminster

P-GRADE program runs at the Madison cluster

P-GRADE program runs at the Budapest cluster

P-GRADE program runs at the Westminster cluster