harald kornmayer (forschungszentrum karlsruhe) on behalf of the g-eclipse consortium

15
Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06 An integrated, Grid enabled workbench tool for Grid application users, Grid developers and Grid operators based on the Eclipse platform Harald Kornmayer (Forschungszentrum Karlsruhe) on behalf of the g-Eclipse consortium

Upload: colette-leach

Post on 02-Jan-2016

18 views

Category:

Documents


0 download

DESCRIPTION

An integrated, Grid enabled workbench tool for Grid application users , Grid developers and Grid operators based on the Eclipse platform. Harald Kornmayer (Forschungszentrum Karlsruhe) on behalf of the g-Eclipse consortium. Grid architecture blue print. Well known: Layered - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

An integrated, Grid enabled workbench tool forGrid application users, Grid developers

and Grid operatorsbased on the Eclipse platform

Harald Kornmayer (Forschungszentrum Karlsruhe) on behalf of the g-Eclipse consortium

Page 2: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

Grid architecture blue print

• Well known:– Layered

– Different solutions available

• gLite

• UNICORE

• Globus

• …Fabrics (computation, storage, networks)

middleware

High level Grid services

Application services

User interfaces

• User interfaces– Most projects use a web server based approach for

user interfaces• http protocol have some limitations (request/response)

Page 3: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

Fat vs thin client

Thin clients

• Only web browser needed

• No software on client required

• http protocol used

• Server required – Single point of entrance

• Examples: – GridSphere

Thin clients

• Only web browser needed

• No software on client required

• http protocol used

• Server required – Single point of entrance

• Examples: – GridSphere

Fat clientsFat clients

• Standard computers grow

• Connectivity grows

• Tools for distributed software management exist

• More flexibility concerning protocols

• Examples: – Migrating Desktop

• User oriented

Fat clients

• Standard computers grow

• Connectivity grows

• Tools for distributed software management exist

• More flexibility concerning protocols

• Examples: – Migrating Desktop

• User oriented

Page 4: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

e-Science infrastructure

• Grid infrastructure are emerging– National level

• AustrianGrid• D-Grid• ….

– European level • EGEE• Deisa• …

– worldwide • LCG computing Grid• …

• Different Grid middleware exists– gLite, UNICORE, GT4, ….

i.e EGEE infrastructure in Europe

Page 5: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

e-Science applications

• Many application domains starts using Grid infrastructures– Grid applications are

workflows

• Even a embarrassingly parallel task is a workflow!

– Grid applications access different computing systems

– Grid applications are written in different programming languages

– Errors are not easy to debug as the infrastructure can change all the time

JAVA, SQL, Linux

FortranLinux, OSF, AIX

C, Linux

C++, Linux

C++, Linux

Page 6: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

The g-Eclipse vision

• Many projects developed promising Grid tools• Each project had its own UI (portal) framework• Easy exchange of results was „impossible“• User centric approaches (application end user)

an integrated platform – Grid users– Grid operators– Grid application developers

• Based on an industry compliant open-source tool

Eclipse communityEclipse community

Grid infrastructure CommunityGrid infrastructure Community

• e-Science

Grid actorsGrid actors

Page 7: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

The project

• Funded by European Union• 24 months

• approx. 2 M€ funding

• Specific targeted research project

• 6 Partners

– Coordinator: Forschungszentrum Karlsruhe• Harald Kornmayer

• More Information: http://www.geclipse.eu

University of CyprusUniversity of Cyprus

Page 8: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

Eclipse

• Started in 2001 – IBM donated their Java development framework as

Open Source

– Pure Java development

– First industrial partners joined

• Eclipse Foundation started in 2004– Independent non-profit organization

• Eclipse management organization

• Councils (requirements, architecture and planning)

• 10 projects (including > 50 subprojects)

– With Eclipse 3.0 not only a Java IDE, but a general framework build for extension

Page 9: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

Grid user roles

• 3 different roles– user– operator– developer

• in general...– job management– resource management

• files• applications• ...

integration in Eclipse is complex

Page 10: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

Grid project

StorageStorage

Resource BrokerResource Broker Replica ManagerReplica Manager

PoliciesPoliciesInfrastructureProvidersInfrastructureProviders

Service ProvidersService Providers

RolesRolesMembersMembers

VirtualOrganisationsVirtualOrganisations

WorkflowsWorkflows

Programming languages

Programming languages

Domain servicesDomain services

InfrastructureInfrastructure

ComputingComputing

ApplicationsApplications

Batch appsBatch apps

Web servicesWeb services

Interactive appsInteractive apps

Grid projectGrid project

Page 11: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

Architecture

Eclipse Platform

Grid AuthenticationCore

Grid Resource ManagementCore

AuthenticationUI

VOMSUI

ResourceManagement

UI

gLite MiddlewareUI

VOMSAuthent.

Impl.

gLite MiddlewareResource Management

Implementation

g-Eclipse

Job Management

Res. Management

Page 12: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

User Interface contributions

AuthenticationToken View

AuthenticationToken View

Job ViewJob View

Resource ViewResource View

Site ViewSite View

Web ViewWeb View

Terminal ViewTerminal View

Job EditorJob Editor

Resource EditorResource Editor

Site Configuration EditorSite Configuration Editor

User PerspectiveUser Perspective Operator PerspectiveOperator Perspective

Developer PerspectiveDeveloper Perspective

Grid Workflow EditorGrid Workflow Editor

Project WizardProject Wizard Job WizardJob Wizard

Authentication TokenWizard

Authentication TokenWizard

Project Preference PageProject Preference Page

Authentication Preference PageAuthentication Preference Page

VO Preference PageVO Preference Page

Page 13: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

Roadmap/milestones

2007-01Version 0.1

authentication, job, file, resource management

exemplary support for gLite

2007-06Version 0.5

core features improvementssupport for gLite

first review

2007-12Version 0.8

core features improvementssupport for second middleware

2008-06Version 1.0

final release with core features support for second middleware

second review

• Milestone candidates on a 4-6 week period

Page 14: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

Status/First results

• First Architecture finished• Implementation started

– VO Management• Declare memberships• Manage identities/roles

– File browser• Knowledge from MD used

– Terminal access– JDL Editor started– …

• Collaboration – With Eclipse Foundation

• Proposed a technology project

– Collaboration with EGEE and int.eu.grid established

Page 15: Harald Kornmayer (Forschungszentrum Karlsruhe)  on behalf of the g-Eclipse consortium

Dr. Harald Kornmayer g-Eclipse Crakov Grid Workshop 06

Summary

• g-Eclipse started 1st of July 2006• Architecture defined• Implementation of prototype version started

The following goals are addressed: • Creation of an “Creation of an “eco systemeco system” of tools to build Grid-” of tools to build Grid-

enabled, interactive enabled, interactive graphical user interfacesgraphical user interfaces– For users, operators and developersFor users, operators and developers

• g-Eclipse open source communityg-Eclipse open source community to guarantee to guarantee sustainabilitysustainability of this “ of this “eco systemeco system” ” – Eclipse project proposed Eclipse project proposed

• To be approved soon!To be approved soon!• AwarenessAwareness of Grid technology in industry by using one of of Grid technology in industry by using one of

their standard “their standard “eco systemeco system””– Participation at the Eclipse summit 2006 last week!Participation at the Eclipse summit 2006 last week!