hiding grid complexity behind ssh session server framework tomasz kuczyński (1,2)...

46
Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) [email protected] 1) Poznan Supercomputing and Networking Center 2) Czestochowa University of Technology Piotr Kopta (2) [email protected]

Upload: roberta-dickerson

Post on 19-Jan-2016

224 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

Hiding Grid Complexity Behind

SSH Session Server framework

Tomasz Kuczyński (1,2)

[email protected]

1) Poznan Supercomputing and Networking Center2) Czestochowa University of Technology

Piotr Kopta (2)

[email protected]

Page 2: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

Outline

SSH Session Server framework

CLI Model Example

Framework Architecture

Application Managers

Interactions between the components

Demo

Page 3: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

SSH Session Server framework

What exactly is SSH Session Server framework ?

Why SSH ?Installed on each resource

No modifications of existing applications needed

Why PTYs ?utilization of standard SSH client

How does framework work with SSH session ?CLI interaction model

Application descriptors

Page 4: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

SSH Session Server framework (cont.)

Main goal of the framework is to gain high level of business logic – presentation layer separationSSH Session Server - continuation of WebCI portal solutions

Features:Adding user-defined interfaces at portal run-time

Easy adaptation of existing applications

Seamless installation

XML-based application interface description

VRML, X3D, SVG, Charts (jpeg, png) support

Page 5: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

CLI Model Example

Page 6: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

Framework Architecture

Page 7: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

Application Managers

Simple applications that have CLIApplication manager using the grid resource management system such as GRMS may submit many parallel jobs (reduce apps run-time) and control all the computing on user’s behalfOverall system performance is increasedUser interaction is limited to required minimum

run a jobview resultsdo not worry about resourcesApps manager will adjust number of jobs running in parallel to the number of resources available

Page 8: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

Interaction between the components

Portal <-> Application Manager <-> Grid Infrastructure

User sets up the input parameters and orders to start an application

Portal passes input data to Application Manager (APPMGR)

Application manager uses the GRMS GAT adaptor to run an application

Resource and job description generated by APPMGR is sent to

GRMS

GRMS finds appropriate resources and runs a job

GRMS, using replica management system or GRMS’s own file

movement mechanisms, stages the files

GRMS starts a job and returns job handler to the APPMGR

Page 9: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

Interactions (cont.)

APPMGR collects all the results and presents them to the portal

User decides about the next stepsChooses the visualization style

HTML, XML, VRML, X3D, SVG, JFreeChart

Plays with the results and decides about further application runs

Views the history of the application runs

Sets up the notification mechanisms (email, sms, other...)

All user activities are asynchronous and non-blockingA user can for example start a job and then, while waiting for the results, logout, go for a coffee and then return to the application

Page 10: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

Today’s demo

We will show an interactive Heat Transfer application run using GridLab and ClusterIX tools (Portal, GAT, GRMS, GAS, Mobiles Service, other) and SSH Session Server frameworkApplication user perspective

Grid hidden behind the portalNo job description interface

Why should user struggle with it? This is too complex...

No data transfer interfaceNo less complex than job description interface, so why bother user about it?

No resource discovery interfaceWhy should user know anything about the resources he might run the job at?

Page 11: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 12: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 13: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 14: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 15: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 16: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 17: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 18: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 19: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 20: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 21: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 22: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 23: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 24: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 25: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 26: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 27: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 28: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 29: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 30: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 31: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 32: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 33: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 34: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 35: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 36: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 37: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 38: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 39: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 40: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 41: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 42: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 43: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 44: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 45: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center
Page 46: Hiding Grid Complexity Behind SSH Session Server framework Tomasz Kuczyński (1,2) docentt@man.poznan.pl 1) Poznan Supercomputing and Networking Center

Questions

For more information visit:

GridSphere http://www.gridsphere.org

GridLab http://www.gridlab.org

Open Grid Portals http://www.opengridportals.com

ClusterIX http://www.clusterix.pl

Thank you