designing parallel operating systems using modern interconnects

Eitan Frachtenberg December 2004

1

Toward Realistic Evaluation of Parallel Job Strategies

Designing Parallel Operating Systems

using Modern Interconnects

Toward Realistic Evaluation of Job Scheduling Strategies

Eitan Frachtenberg

With

Dror Feitelson, Fabrizio Petrini, and Juan Fernandez

Computer and Computational Sciences DivisionLos Alamos National Laboratory

Ideas that change the world


2


Outline


3


Parallel Job Scheduling


4


Scheduling Taxonomy

“”“”


5


Backfilling


6


Time Sharing


7


none implicit hybrid explicit

Local DCS ICS/SB CC PB FCS BCS GS

Time Sharing Spectrum

coordinationcoordination


8


Without Timesharing

“”“”


9


Time Sharing - GS

“”“”


10


Time Sharing - SB


11


Time Sharing - FCS


12


FCS Classification

Granularity

Block times

Fine Coarse

Short Long

CS

Always gang-scheduled

F

Preferably gang-scheduled

DC

Locally scheduled


13


Evaluation Challenges

“”“”


14


Emulation Methodology


15


Evaluation by Emulation

––


16


Experimental Environment


17


Experiments Overview

’’


18


Effect of MPL


19


MPL – Response Time


20


MPL – Bounded Slowdown


21


Effect of Backfilling

“”“”


22


Backfilling – Response time


23


Effect of Time Quantum


24


Time Quantum – Response Time


25


Effect of Load


26


Load – Response Time


27


Load - Bounded Slowdown


28


Response Time Median


29


Bounded Slowdown Median


30


500 Shortest jobs CDF


31


500 Longest jobs CDF


32


Scientific Applications


33


Response Time


34


Bounded Slowdown


35


Conclusions - methodology


36


Conclusions - experiments


37


Time Quantum – Slowdown

designing parallel operating systems using modern interconnects

Documents