supercomputing 2002, baltimore, 19.11.2002, sun „grid day” progress access environment to...

24
SUPERCOMPUTING 2002, SUPERCOMPUTING 2002, Baltimore, 19.11.2002, Baltimore, 19.11.2002, SUN „Grid Day” SUN „Grid Day” PROGRESS PROGRESS Access environment to computational Access environment to computational services performed by cluster of SUNs services performed by cluster of SUNs Poznań Supercomputing and Networking Center Poznań Supercomputing and Networking Center Cezary Mazurek Cezary Mazurek

Upload: josephine-payne

Post on 19-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESSAccess environment to computational services Access environment to computational services

performed by cluster of SUNsperformed by cluster of SUNs

Poznań Supercomputing and Networking CenterPoznań Supercomputing and Networking Center

Cezary MazurekCezary Mazurek

Page 2: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESS

Beginning: December 2001 Duration: 18 months (R&D) Budget: ~4,0 MEuro Project Partners

SUN Microsystems PolandPSNC IBCh PoznańCyfronet AMM, KrakówTechnical University Łódź

Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland

Page 3: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PIONIER ProgrammePIONIER Programme

Advanced (GRID-enabled) Applications

Co

mm

un

icatio

nA

pp

lication

Geo

grap

hical

info

rmatio

nap

plicatio

ns

En

viron

men

tM

anag

emen

tA

pp

lication

Distan

ce L

earnin

gA

pp

lication

Intern

et A

ccessA

ided

L

earnin

gA

pp

lication

Co

mp

utatio

na

lS

cience

Ap

plicatio

n

Advanced Network Services (Middleware)

Advanced Network Infrastructure

Advanced Research Specialized Infrastructure

Page 4: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PIONIER NetworkPIONIER Network

Page 5: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESS PROGRESS Main Paradigms Main Paradigms

Dedicated channels in advanced networking infrastructure provided in the scope of the PIONIER program (1-10 Gb/s)

Pilot installation Cluster of 80 processors: 3*SunFire 6800, 2*SUNFire V880 Networked Storage of 1,3 TB Software: ORACLE, Cluster Tools, iPlanet, SUN Grid Engine

Development of novel tools supporting grid-portal architecture (Grid service broker, security, migrating desktop, service provider, data management system, portal)

Development and integration of data management and visualization modules

bioX applications for testing of tools and infrastructure Enabling the created grid-portal environment for other advanced

applications as a solution from the shelf (PIONIER program)

Page 6: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESS PROGRESS ArchitectureArchitecture

Page 7: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESS Service ProviderPROGRESS Service Provider

Page 8: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESS PROGRESS Service ProviderService Provider

Content ProviderData presentationUser interaction

Service ProviderRealization of

services functionsServices data storage

and access

Content P

rovider

Webservice

Session B

ean

Entity B

eans

SOAP

SOAP/XML

Page 9: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESSJob InfoJob Info

create table js_jobs( jb_oid number(10) not null, jb_grid_oid varchar2(100) null, jb_name varchar2(20) not null, jb_description varchar2(250) null, jb_submitter varchar2(100) not null, jb_status number(2) not null, jb_created_on date default sysdate not null, jb_submitted_on date null, jb_finished_on date null, jb_xml_description clob not null, constraint jb_pk primary key(jb_oid), constraint jb_fk1 foreign key(jb_status) references

js_job_statuses(st_value));

Page 10: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESS PROGRESS Data Management SystemData Management System

INTERNET

DBFile System

Data Broker

Data Storage

Mirror & Proxy

Data Storage Data Storage

MetadataManagement

SRS

UniTree

WS

GASSFTPGrid FTP(...)

Clients

PortalPortal

Grid brokerGrid broker

Migrating desktop

Migrating desktop

Page 11: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESSData Management SystemData Management System

Provides seamless access to data and information for grid computing

Uses metadata repository for describing stored data

Stores data on various media such as files, tapes and databases

Page 12: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESS SecurityPROGRESS Security

Intrusion Detection and Security Management SystemReliable and dynamic information sourcesPossibility to automatically react to detected

attacksPossibility to apply different analysis methodsModular architecture

Page 13: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESS Grid BrokerPROGRESS Grid Broker

Page 14: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESS Grid brokerPROGRESS Grid broker

Grid Broker in Progress:Job submission, monitoring and controllingDifferent scheduling and resource

management strategiesFlexible job description language (XRSL)Heterogeneous and service based

environment

Page 15: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESS PROGRESS CommunicationCommunication

SGESGE

HTTP/HTTPSHTTP/HTTPS

DataManagement

GLOBUSGLOBUS

Po

rtal

GridBroker

CORBA

Web

serv

ice

FTP

HTTP/HTTPS

Service Provider

Grid F

TP

Webservice

Page 16: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESSUser Interfaces - PortalUser Interfaces - Portal

Page 17: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESSUser Interfaces - DesktopUser Interfaces - Desktop

Page 18: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESS PROGRESS

http://progress.psnc.pl/

http://progress.psnc.pl/portal

[email protected]

Page 19: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESS

Page 20: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESS

Page 21: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESS

Page 22: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESS

Page 23: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESS

Page 24: SUPERCOMPUTING 2002, Baltimore, 19.11.2002, SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing

SUPERCOMPUTING 2002,SUPERCOMPUTING 2002,Baltimore, 19.11.2002,Baltimore, 19.11.2002,

SUN „Grid Day”SUN „Grid Day”

PROGRESSPROGRESS