wheelfs jeremy stribling, frans kaashoek, jinyang li, robert morris mit csail and new york...

WheelFS

Jeremy Stribling, Frans Kaashoek, Jinyang Li, Robert Morris

MIT CSAIL and New York University

I Want to Publish an SOSP Paper

• But I don’t want to do a lot of work

• Idea: New cooperative Web cache!

Exploit a Network File System

Network File Server(/mnt/awesome-cdn/cache)

ApacheCachingProxy

ApacheCachingProxy

ApacheCachingProxy

ApacheCachingProxy

foo.html

It Is Too Good to Be True

• Tries to mask failures with long timeouts

• Strict consistency prevents use of cached data under failures

• My naïve SOSP strategy might not work

So What Are My Options?

• Give up dream and just not graduate• Submit random paper [Rooter, WMSCI ’05]

• Build an FS that would work for real apps– Apache can use old copies of data– And can always fall back to the origin– Why not tell the FS?

0

5

10

15

20

25

0 5 10 15 20 25

(Joules)

-1.575

-1.57

-1.565

-1.56

-1.555

-1.55

-1.545

0 10 20 30 40 50 60

(Percent)

0

0.5

1

1.5

2

2.5

3

0 5 10 15 20 25 30 35

(dB)

0

5

10

15

20

25

0 100 200 300 400 500 600 700

(# CPUs)

-1.575

-1.57

-1.565

-1.56

-1.555

-1.55

-1.545

0 0.5 1 1.5 2 2.5 3

(# nodes)

WheelFS: Storage for Wide-area Apps

• File system API

• Semantic cues give apps control of behavior under failures

Make Apache distributed with 1 line change

WheelFS WheelFS WheelFS WheelFS

Cooperative Web Cache on WheelFS

ApacheCachingProxy

ApacheCachingProxy

ApacheCachingProxy

ApacheCachingProxy

/wfs/cache/ /.bestversion.maxtime=500 /.lax /$URL

Use newest version you can find quicklyTime out operations after T millisecondsAllow multiple versions of a directory to be updated

I’m Running Out of Time, So:

• A compact but powerful set of cues

• Useful to other applications, including:– PlanetLab measurement studies– Parallel Grid computations– Distribute make

• See you at the next big conference!