euforia fp7-infrastructures-2007-1, grant 211804 scientific workflows kepler and java api 4 hpc/grid...

EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804

Scientific Workflows

Kepler andJava API 4 HPC/GRID

ITM meeting Juelich 2009

Michał OwsiakMarcin Płóciennik

PSNC

Accessing tutorial machines

Training room 2 (GRID and HPC from KEPLER)

Participants: itmb1045 ... itmb1069PCs: zam1045-zam1069

The password for all accounts is: itm@fzj09

EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804

Agenda

- Main components: Director, Actor, Port, Relation- Workflow building area- Different workflow types- Actor related details- Concept of composite actor- Java API 4 HPC/GRID


How can I build workflow?

Kepler allows you to build workflows using standard elements:

- Workflow- Director- Actor- Port- Relation


Accessing workflow

- Workflow allows to compose data flow between elements

- Elements can be Dragged and Dropped into Workflow's area

- After workflow is ready it can be started two ways:

• directly from the GUI• from the command line


Accessing workflow


Accessing Actors and Directors

- Available elements can be accessed through the component's browser

- Elements can be Dragged and Dropped into Workflow's area

- You can search for elements if you don't know theexact name of the component

- You can add your own components into library


Accessing Actors and Directors


Accessing Supplementary

Components

- Components that bind all elements together are accessible from toolbar

- Ports, relations, can be Dragged and Dropped into Workflow's area

- You can easily Start/Stop workflow directly from the GUI using toolbar icons


Accessing Supplementary

Components


Main components


Directors

Directors are responsible for the orchestrationof the workflow.

Directors can provide various means of execution:

- CT Director (Continuous Time)

- DDF Director (Dynamic Data flow)

- SDF Director (Sequential Data flow)

- PN Director (Process Network) - parallel executions


Actors

Actors perform actions basing on input ports and parameters


Actors

- You can use already existing actors that are available within Kepler

- You can import actors from the other sources into Kepler

- You can develop your own actors and add them to the Kepler


Concept of composite actor

- Composite actors allow to encapsulate workflows

- Composite actors can be copy-pasted between workflows

- Composite actors can be exported as components


Concept of composite actor


Java API 4 HPC/GRID

Developed within EUFORIA projecthttp://www.euforia-project.eu

- One of the goals of the project is to provide users with convenient way of accessing HPC/GRID infrastructures using Kepler orchestration tool

- Java API 4 HPC/GRID is based on vine:toolkit


What is Java API 4 HPC/GRID


What Java API 4 HPC/GRID provides

Java API 4 HPC/GRID provides:

- set of actors that extends Kepler with HPC access

- set of actors that extends Kepler with GRID access

- already existing workflows that can be modified

- set of composite actors for faster workflow building


Thank you for your attention

http://scilla.man.poznan.pl/IMTLulich2009


Accessing tutorial machines

Training room 2 (GRID and HPC from KEPLER)

Participants: itmb1045 ... itmb1069PCs: zam1045-zam1069

The password for all accounts is: itm@fzj09


euforia fp7-infrastructures-2007-1, grant 211804 scientific workflows kepler and java api 4 hpc/grid...

Documents

actors actors

workflow workflow

workflow director

workflows composite

elements elements

euforia project htt

existing actors

startstop workflow