WP1Grid Workload Management

Massimo SgaravattoINFN Padova

http://www.infn.it/workload-grid

Activities 2001 Driven by deliverables

D1.1 Report on current technology Survey on existing Grid tools and frameworks

C. Anglano (TO), T. Ferrari, F. Giacomini (CNAF), F. Prelz (MI), M. Sgaravatto (PD)

D1.2: Definition of architecture Internal WP1 architecture document

F. Giacomini (CNAF) main author Participation to ATF to define the global EDG

architecture D1.3: Initial Workload Management

System (1st release) Code released to EDG-Integration Team

1st Release (what and who) UI (User Interface) - DATAMAT

Command line for job management operations Job Description Language (JDL) to specify job

characteristics and requirements RB (Resource Broker) – Catania

Responsible to choose the “best” resources where to submit jobs based on the constraint specified in the JDL and characteristics and status of resources (published in the Grid Information Service and Replica Catalog)

1st Release (what and who) JSS (Job Submission Service) – Padova

Responsible for job management operations II (Information Index) – Milano

First filter to the Grid Information Service LB (Logging & Bookkeeping) – CESNET

“State machine” view of each job WP1 – WP2 interfaces - CNAF, PISA Packaging - CNAF, PISA Coordination (internal and with the other

WP’s) - F. Prelz, M. Sgaravatto

Other 2001 activities Grid Accounting – Torino

Economy based model Implementation of a first prototype

on-going Advance reservation and co-

allocation - CNAF Globus GARA evaluation

Planning for 2002 Bug fixes, improvement of functionalities

RB – Catania JSS – Padova II – Milano

Support for interactive jobs RB – Catania JSS - Padova

Grid accounting - Torino Implementation of a prototype system and

integration with the workload management system

Planning for 2002 Analysis of new and smarter scheduling

strategies – Catania Integration of network information in the

matchmaking process within RB – CNAF, Catania, Torino

Advance reservation and co-allocation - CNAF Triggering of data transfers – Catania, Torino

Add the ability to evaluate network throughput and decide on the convenience of transferring data to provide better scheduling options (this may involve some form of network bandwidth reservation)

Planning for 2002 Support for partitionable jobs

Padova Job dependencies

CNAF WP1 – WP2 interfaces

Pisa Packaging of WP1 software,

Participation to EDG-IT CNAF, Pisa

Resources for year 2002 Travel

Travel in Italy: 104 K€ 8 WP1 2-day meetings (Milano)

CT (2 people), CNAF (3 people), PD (4 people), PI (2 people), TO (4 people)

Integration activities (3 weeks) CT (1 people), MI (1 people), CNAF (2 people), PD (1

people), PI (2 people), TO (2 people) TB INFN-GRID and coordination activities (20 days)

MI (1 people), PD (1 people) Conferences and workshops (5 days)

MI (1 people), PD (1 people), PI (1 people), TO (2 people)

Resources for year 2002 Travel abroad: 153 K€

3 EDG workshops (Paris, Edinburgh, ??) CT (2 people), CNAF (3 people), MI (2 people), PD (4 people), PI (2 people), TO (4 people)

GGF4 - Toronto (4 days) CT (1 people), CNAF (1 people), MI (1 people), PD (1 people), TO (1 people)

GGF6 - USA (4 days) CT (1 people), CNAF (1 people), MI (1 people), PD (1 people), TO (1 people)

SC2002 – USA (1 week) MI (1 people), PD (1 people)

7 PTB – CERN MI (1 people), PD (1 people)

Coordination – CERN MI (1 people, 20 days), PD (1 people, 15 days)

Collaboration with Globus and GGF developers on Information Services MI (1 people, 2 weeks)

Collaboration with Globus and GGF developers on Scheduling CT (1 people, 2 weeks)

Collaboration with Condor developers PD (1 people, 2 weeks), CNAF (1 people, 2 weeks)

Releases - CERN CT (1 people, 5 weeks), PI (1 people, 5 weeks), CNAF (1 people, 7 weeks)