4 alien artem harutyunyan [email protected] presented by: predrag buncic [email protected]...

6
4 AliEn Artem Harutyunyan [email protected] Presented by: Predrag Buncic [email protected] Tackling job priorities problem in AliEn using Grid economy approach

Upload: estella-franklin

Post on 17-Jan-2016

224 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 4 AliEn Artem Harutyunyan hartem@mail.cern.ch Presented by: Predrag Buncic predrag.buncic@cern.ch hartem@mail.cern.ch predrag.buncic@cern.ch Tackling job

4 AliEnArtem Harutyunyan

[email protected]

Presented by: Predrag Buncic [email protected]

Tackling job priorities problem in AliEn using Grid economy approach

Page 2: 4 AliEn Artem Harutyunyan hartem@mail.cern.ch Presented by: Predrag Buncic predrag.buncic@cern.ch hartem@mail.cern.ch predrag.buncic@cern.ch Tackling job

CERN, 09/04/2008 - 2

• Jobs in the Task Queue are ordered based on the following criteria Production jobs have low priority (20/100) First user job gets priority 100 For each subsequent the job priority is reduced by 1

• Introducing Grid economy model Users are members of teams and have to pay for Grid resources (alions,

AliEn currency) Jobs with higher price get higher priority Credits are distributed to teams by PWG but teams can also earn

money by providing resources

• Benefits Users gain the control over the priorities of their jobs Teams are motivated to provide more resources Users are aware of the cost of using Grid resources

2

Motivation

Page 3: 4 AliEn Artem Harutyunyan hartem@mail.cern.ch Presented by: Predrag Buncic predrag.buncic@cern.ch hartem@mail.cern.ch predrag.buncic@cern.ch Tackling job

CERN, 09/04/2008 - 33

Site 1

Site 2

Site 3

Job Manager

1. User sends a job (sets price in

JDL)

2. Job is

sent to sit

e

3. Job is

DONE

5. Gets DONE jobs Database

4. Job is stored in DB

Charging serviceBanking service

6. Charges for jobs(from users’ accountsTo sites’ accounts)

... and makes deposit on tax account

Job_Cost = Consumed_SI2K * Nominal_Price*Job_Price_Factor

Grid Economy

Page 4: 4 AliEn Artem Harutyunyan hartem@mail.cern.ch Presented by: Predrag Buncic predrag.buncic@cern.ch hartem@mail.cern.ch predrag.buncic@cern.ch Tackling job

CERN, 09/04/2008 - 44

T0

T1

T2T2

T1

T2T2

T1

T2T2

PWG 1 PWG 2 Physics Board

User group User group User group User group

User group

Money Flow

Page 5: 4 AliEn Artem Harutyunyan hartem@mail.cern.ch Presented by: Predrag Buncic predrag.buncic@cern.ch hartem@mail.cern.ch predrag.buncic@cern.ch Tackling job

CERN, 09/04/2008 - 55

• AliEn Bank based on Gold allocation manager • http://www.clusterresources.com/pages/products/gold-allocation-manager.php

• To execute bank command (e.g. account balance checking) from AliEn shell user has to type:• # gold <command> [options]

• For the description of commands and their options please refer to Gold user’s manual:

http://www.clusterresources.com/products/gold/docs/userguide.pdf

Gold allocation manager

Page 6: 4 AliEn Artem Harutyunyan hartem@mail.cern.ch Presented by: Predrag Buncic predrag.buncic@cern.ch hartem@mail.cern.ch predrag.buncic@cern.ch Tackling job

CERN, 09/04/2008 - 6

• The banking system: Is implemented as an optional add-on to AliEn Provides an additional degree of freedom for the

improvement of job scheduling Provides users with control over job priorities based on

simple and understandable economy model

• Many thanks to: Pablo Saiz, Catalin Cirstoiu and Costin Grigoras

The work was supported by ALICE Offline, Calouste Gulbenkian Foundation and Swiss Fonds “Kidagan”

6

Conclusions