Transcript
Page 1: How I learned to Stop Worrying and Love Preemption

Condor ProjectComputer Sciences DepartmentUniversity of Wisconsin-Madison

How I learned to Stop Worrying and Love

Preemption

Page 2: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

The Community

Community as Metaphor

Best thing about Condor?

Page 3: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Two Questions› How much more room in OSG?

› How long can jobs (effectively) run?

Page 4: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Page 5: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Not an OSG talk

Page 6: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

3 method for performance analysis

› Modelingh Difficult in opportunistic pools

› Simulationh Difficult in opportunistic pools

› Measurement

Page 7: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Measurement› Simply submit a ton of jobs

› All measurement via user log

Page 8: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

User log trick:› +TheSite="$$(GLIDEIN_Site)"› job_ad_information_attrs = TheSite

Page 9: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

› 028 (4.1.0) 02/17 18:38:03 Job ad information event triggered.› TriggerEventTypeNumber = 1› EventTypeNumber = 28› TriggerEventTypeName = "ULOG_EXECUTE"› Proc = 87› Subproc = 0› TheSite = "Purdue"› CurrentTime = time()› MyType = "ExecuteEvent"

Page 10: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

76,161 total cpu-hours

Page 11: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Page 12: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Page 13: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Page 14: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Page 15: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Page 16: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Page 17: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Wall clock slowdown

Page 18: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

How to fix?› Mix and match

› Opportunistic for throughput

› Local resources for tail chopping

Page 19: How I learned to Stop Worrying and Love Preemption

www.cs.wisc.edu/Condor

Summary› Opportunistic cycles are still very

useful

› Fairness and Throughput can be duals

› Opportunistic + dedicated very powerful


Top Related