Download - Emphemeral hadoop clusters in the cloud
![Page 3: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/3.jpg)
about etsy
![Page 4: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/4.jpg)
the world’s handmade marketplace
![Page 5: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/5.jpg)
total members: 9,000,000 total acHve shops: 800,000
items listed: 9.5M page views per month: >1B
2010 sales: $314.3M
![Page 6: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/6.jpg)
lots of data
![Page 7: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/7.jpg)
about this talk
![Page 8: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/8.jpg)
ephemeral?
![Page 9: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/9.jpg)
[5]
![Page 10: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/10.jpg)
“elasHc” to the extreme
![Page 11: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/11.jpg)
![Page 12: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/12.jpg)
![Page 13: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/13.jpg)
![Page 14: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/14.jpg)
how did we get here?
![Page 15: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/15.jpg)
wanted to dip our toes stop hiWng the database stop grepping log files
![Page 16: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/16.jpg)
2 data sources -‐> S3
![Page 17: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/17.jpg)
database snapshots
input: nightly diffs
(SELECT * FROM <table> WHERE update_date > 1 day ago)
output: full tables as sequence files
![Page 18: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/18.jpg)
visit logs
input: akamai access logs (event beacons)
output: [visit_id, [event]]
![Page 19: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/19.jpg)
processing the data
![Page 20: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/20.jpg)
[2]
![Page 21: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/21.jpg)
data flow joins, group bys, etc.
![Page 22: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/22.jpg)
cascading Chris Wensel
hhp://www.cascading.org/
![Page 23: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/23.jpg)
great implementaHon
![Page 24: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/24.jpg)
Java syntax
[10]
![Page 25: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/25.jpg)
cascading.jruby Grégoire Marabout (Qualtera), Mah Walker (Etsy), Stefan Karpinski (Etsy), Steve Mardenfeld (Etsy)
github: hhp://bit.ly/o3DNtC blog: hhp://etsy.me/cFytuL
![Page 26: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/26.jpg)
![Page 27: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/27.jpg)
“push” job binaries to S3
run on ElasHc Map/Reduce starts cluster, runs, shuts down
access results on S3
![Page 28: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/28.jpg)
next project: shop recommendaHons
![Page 29: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/29.jpg)
3 steps: ✔ data preparaHon -‐ Cascading
✖ analysis/training ✖ predicHon
![Page 30: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/30.jpg)
sparse implementaHon of SVD
![Page 31: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/31.jpg)
3 steps: ✔ data preparaHon -‐ Cascading ✖ analysis/training -‐ MATLAB
✖ predicHon -‐ MATLAB
![Page 32: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/32.jpg)
“MATLAB, in my Hadoop cluster?”
![Page 33: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/33.jpg)
hadoop streaming
![Page 34: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/34.jpg)
arbitrary scripts for map & reduce
![Page 35: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/35.jpg)
Swiss army knife
[3]
Full dataset analysis Matlab, Ruby scripts
‘ArHfact’ outputs Tokyo Cabinet, Lucene, SQLite
Side-‐effects MySQL, CloudFront
![Page 36: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/36.jpg)
3 steps: ✔ data preparaHon -‐ Cascading ✔ analysis/training -‐ MATLAB
✔ predicHon -‐ MATLAB
![Page 37: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/37.jpg)
[4]
Job 1 Job 2
![Page 38: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/38.jpg)
Barnum
![Page 39: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/39.jpg)
Sinatra web service on EC2
![Page 40: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/40.jpg)
barnum starts job and passes callback URL
when job finishes, hadoop hits callback URL to barnum to proceed
![Page 41: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/41.jpg)
![Page 42: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/42.jpg)
![Page 43: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/43.jpg)
![Page 44: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/44.jpg)
![Page 45: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/45.jpg)
![Page 46: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/46.jpg)
![Page 47: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/47.jpg)
![Page 48: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/48.jpg)
![Page 49: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/49.jpg)
Barnum constructs
![Page 50: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/50.jpg)
![Page 51: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/51.jpg)
![Page 52: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/52.jpg)
![Page 53: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/53.jpg)
![Page 54: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/54.jpg)
3 steps: ✔ data preparaHon -‐ Cascading ✔ analysis/training -‐ MATLAB
✔ predicHon -‐ MATLAB
![Page 55: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/55.jpg)
suggested_shops.yaml:
![Page 56: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/56.jpg)
suggested_shops.yaml:
![Page 57: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/57.jpg)
suggested_shops.yaml:
![Page 58: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/58.jpg)
suggested_shops.yaml:
![Page 59: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/59.jpg)
suggested_shops.yaml:
![Page 60: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/60.jpg)
suggested_shops.yaml:
![Page 61: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/61.jpg)
suggested_shops.yaml:
![Page 62: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/62.jpg)
suggested_shops.yaml:
![Page 63: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/63.jpg)
suggested_shops.yaml:
![Page 64: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/64.jpg)
suggested_shops.yaml:
![Page 65: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/65.jpg)
suggested_shops.yaml:
![Page 66: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/66.jpg)
suggested_shops.yaml:
![Page 67: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/67.jpg)
suggested_shops.yaml:
![Page 68: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/68.jpg)
suggested_shops.yaml:
![Page 69: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/69.jpg)
suggested_shops.yaml:
![Page 70: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/70.jpg)
geWng data back to web stack?
![Page 71: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/71.jpg)
v1 [6]
![Page 72: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/72.jpg)
ad-‐hoc shell scripts TSV into unsharded MySQL
not re-‐usable
[6]
![Page 73: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/73.jpg)
v2
![Page 74: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/74.jpg)
![Page 75: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/75.jpg)
![Page 76: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/76.jpg)
![Page 77: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/77.jpg)
![Page 78: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/78.jpg)
![Page 79: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/79.jpg)
datasets are versioned based upon job execuHon Hme
![Page 80: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/80.jpg)
![Page 81: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/81.jpg)
MySQL Tables:
Memcache Cluster:
![Page 82: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/82.jpg)
Output dataset <-‐> ORM Model
![Page 83: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/83.jpg)
PHP:
![Page 84: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/84.jpg)
Cascading:
PHP:
![Page 85: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/85.jpg)
Cascading:
PHP:
PHP:
![Page 86: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/86.jpg)
Old tables regularly dropped
![Page 87: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/87.jpg)
how we’re using this stack
analyHcs (internal)
products (external)
![Page 88: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/88.jpg)
analyHcs
![Page 89: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/89.jpg)
![Page 90: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/90.jpg)
![Page 91: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/91.jpg)
products
![Page 92: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/92.jpg)
![Page 93: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/93.jpg)
search quality recommendaHons
![Page 94: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/94.jpg)
May 2011: 4,926 successful job runs
![Page 95: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/95.jpg)
[5]
![Page 96: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/96.jpg)
scale up from zero
![Page 97: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/97.jpg)
isolaHon
![Page 98: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/98.jpg)
isolaHon across runs fresh machine each Hme
![Page 99: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/99.jpg)
isolaHon between developers no toe-‐stepping
![Page 100: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/100.jpg)
heterogeneous clusters
![Page 101: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/101.jpg)
big RAM when you need it (but not when you don’t)
![Page 102: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/102.jpg)
need one machine? use one machine.
![Page 103: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/103.jpg)
wriHng jobs
![Page 104: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/104.jpg)
PHENOMENAL COSMIC POWERS
[7]
![Page 105: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/105.jpg)
prototyping run slow, unopHmized version on 500 machine for < $100
![Page 106: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/106.jpg)
parameter tuning Try N=1, 2, 5, 10 and see which results in best output
![Page 107: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/107.jpg)
[9]
![Page 108: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/108.jpg)
quesHons?
![Page 109: Emphemeral hadoop clusters in the cloud](https://reader035.vdocuments.site/reader035/viewer/2022062320/559e98741a28abfc1f8b465f/html5/thumbnails/109.jpg)
photo credits [1] by elfike hhp://www.flickr.com/photos/elfike/157439707/ [2] by Dan4th hhp://www.flickr.com/photos/43264265@N00/5371557240/ [3] by mandolux hhp://www.flickr.com/photos/73935252@N00/34418046/ [4] by The Suss-‐Man hhp://www.flickr.com/photos/8692813@N06/4580254188/ [5] by Stephen Rees hhp://www.flickr.com/photos/60142746@N00/214461223/ [6] by Let Ideas Compete hhp://www.flickr.com/photos/quesHon_everything/3414827746/ [7] by funkandjazz hhp://www.flickr.com/photos/phunk/2484159004/ [8] by ViaMoi hhp://www.flickr.com/photos/12187843@N07/3343619603/ [9] by kreg.steppe hhp://www.flickr.com/photos/spyndle/500305000/ [10] clipart (really) [11] by Chris Pirillo hhp://www.flickr.com/photos/49503157467@N01/34588230/