wheelfs jeremy stribling, frans kaashoek, jinyang li, robert morris mit csail and new york...
TRANSCRIPT
WheelFS
Jeremy Stribling, Frans Kaashoek, Jinyang Li, Robert Morris
MIT CSAIL and New York University
I Want to Publish an SOSP Paper
• But I don’t want to do a lot of work
• Idea: New cooperative Web cache!
Exploit a Network File System
Network File Server(/mnt/awesome-cdn/cache)
ApacheCachingProxy
ApacheCachingProxy
ApacheCachingProxy
ApacheCachingProxy
foo.html
It Is Too Good to Be True
• Tries to mask failures with long timeouts
• Strict consistency prevents use of cached data under failures
• My naïve SOSP strategy might not work
So What Are My Options?
• Give up dream and just not graduate• Submit random paper [Rooter, WMSCI ’05]
• Build an FS that would work for real apps– Apache can use old copies of data– And can always fall back to the origin– Why not tell the FS?
0
5
10
15
20
25
0 5 10 15 20 25
(Joules)
-1.575
-1.57
-1.565
-1.56
-1.555
-1.55
-1.545
0 10 20 30 40 50 60
(Percent)
0
0.5
1
1.5
2
2.5
3
0 5 10 15 20 25 30 35
(dB)
0
5
10
15
20
25
0 100 200 300 400 500 600 700
(# CPUs)
-1.575
-1.57
-1.565
-1.56
-1.555
-1.55
-1.545
0 0.5 1 1.5 2 2.5 3
(# nodes)
WheelFS: Storage for Wide-area Apps
• File system API
• Semantic cues give apps control of behavior under failures
Make Apache distributed with 1 line change
WheelFS WheelFS WheelFS WheelFS
Cooperative Web Cache on WheelFS
ApacheCachingProxy
ApacheCachingProxy
ApacheCachingProxy
ApacheCachingProxy
/wfs/cache/ /.bestversion.maxtime=500 /.lax /$URL
Use newest version you can find quicklyTime out operations after T millisecondsAllow multiple versions of a directory to be updated
I’m Running Out of Time, So:
• A compact but powerful set of cues
• Useful to other applications, including:– PlanetLab measurement studies– Parallel Grid computations– Distribute make
• See you at the next big conference!