designing parallel operating systems using modern interconnects

Eitan Frachtenberg December 2004

1

Toward Realistic Evaluation of Parallel Job Strategies

Designing Parallel Operating Systems

using Modern Interconnects

Toward Realistic Evaluation of Job Scheduling Strategies

Eitan Frachtenberg

With

Dror Feitelson, Fabrizio Petrini, and Juan Fernandez

Computer and Computational Sciences DivisionLos Alamos National Laboratory

Ideas that change the world

Eitan Frachtenberg December 2004

2

Toward Realistic Evaluation of Parallel Job Strategies

Outline

Eitan Frachtenberg December 2004

3

Toward Realistic Evaluation of Parallel Job Strategies

Parallel Job Scheduling

Eitan Frachtenberg December 2004

4

Toward Realistic Evaluation of Parallel Job Strategies

Scheduling Taxonomy

“”“”

Eitan Frachtenberg December 2004

5

Toward Realistic Evaluation of Parallel Job Strategies

Backfilling

Eitan Frachtenberg December 2004

6

Toward Realistic Evaluation of Parallel Job Strategies

Time Sharing

Eitan Frachtenberg December 2004

7

Toward Realistic Evaluation of Parallel Job Strategies

none implicit hybrid explicit

Local DCS ICS/SB CC PB FCS BCS GS

Time Sharing Spectrum

coordinationcoordination

Eitan Frachtenberg December 2004

8

Toward Realistic Evaluation of Parallel Job Strategies

Without Timesharing

“”“”

Eitan Frachtenberg December 2004

9

Toward Realistic Evaluation of Parallel Job Strategies

Time Sharing - GS

“”“”

Eitan Frachtenberg December 2004

10

Toward Realistic Evaluation of Parallel Job Strategies

Time Sharing - SB

Eitan Frachtenberg December 2004

11

Toward Realistic Evaluation of Parallel Job Strategies

Time Sharing - FCS

Eitan Frachtenberg December 2004

12

Toward Realistic Evaluation of Parallel Job Strategies

FCS Classification

Granularity

Block times

Fine Coarse

Short Long

CS

Always gang-scheduled

F

Preferably gang-scheduled

DC

Locally scheduled

Eitan Frachtenberg December 2004

13

Toward Realistic Evaluation of Parallel Job Strategies

Evaluation Challenges

“”“”

Eitan Frachtenberg December 2004

14

Toward Realistic Evaluation of Parallel Job Strategies

Emulation Methodology

Eitan Frachtenberg December 2004

15

Toward Realistic Evaluation of Parallel Job Strategies

Evaluation by Emulation

––

Eitan Frachtenberg December 2004

16

Toward Realistic Evaluation of Parallel Job Strategies

Experimental Environment

Eitan Frachtenberg December 2004

17

Toward Realistic Evaluation of Parallel Job Strategies

Experiments Overview

’’

Eitan Frachtenberg December 2004

18

Toward Realistic Evaluation of Parallel Job Strategies

Effect of MPL

Eitan Frachtenberg December 2004

19

Toward Realistic Evaluation of Parallel Job Strategies

MPL – Response Time

Eitan Frachtenberg December 2004

20

Toward Realistic Evaluation of Parallel Job Strategies

MPL – Bounded Slowdown

Eitan Frachtenberg December 2004

21

Toward Realistic Evaluation of Parallel Job Strategies

Effect of Backfilling

“”“”

Eitan Frachtenberg December 2004

22

Toward Realistic Evaluation of Parallel Job Strategies

Backfilling – Response time

Eitan Frachtenberg December 2004

23

Toward Realistic Evaluation of Parallel Job Strategies

Effect of Time Quantum

Eitan Frachtenberg December 2004

24

Toward Realistic Evaluation of Parallel Job Strategies

Time Quantum – Response Time

Eitan Frachtenberg December 2004

25

Toward Realistic Evaluation of Parallel Job Strategies

Effect of Load

Eitan Frachtenberg December 2004

26

Toward Realistic Evaluation of Parallel Job Strategies

Load – Response Time

Eitan Frachtenberg December 2004

27

Toward Realistic Evaluation of Parallel Job Strategies

Load - Bounded Slowdown

Eitan Frachtenberg December 2004

28

Toward Realistic Evaluation of Parallel Job Strategies

Response Time Median

Eitan Frachtenberg December 2004

29

Toward Realistic Evaluation of Parallel Job Strategies

Bounded Slowdown Median

Eitan Frachtenberg December 2004

30

Toward Realistic Evaluation of Parallel Job Strategies

500 Shortest jobs CDF

Eitan Frachtenberg December 2004

31

Toward Realistic Evaluation of Parallel Job Strategies

500 Longest jobs CDF

Eitan Frachtenberg December 2004

32

Toward Realistic Evaluation of Parallel Job Strategies

Scientific Applications

Eitan Frachtenberg December 2004

33

Toward Realistic Evaluation of Parallel Job Strategies

Response Time

Eitan Frachtenberg December 2004

34

Toward Realistic Evaluation of Parallel Job Strategies

Bounded Slowdown

Eitan Frachtenberg December 2004

35

Toward Realistic Evaluation of Parallel Job Strategies

Conclusions - methodology

Eitan Frachtenberg December 2004

36

Toward Realistic Evaluation of Parallel Job Strategies

Conclusions - experiments

Eitan Frachtenberg December 2004

37

Toward Realistic Evaluation of Parallel Job Strategies

Time Quantum – Slowdown