profiling and tuning hadoop pipelines
DESCRIPTION
Not particularly useful without video of the talk. This discusses some performance problems we found in our hadoop jobs at Etsy, and how we solved them. It also discusses how we used hadoop jobs to summarize information from snapshot data generated by hadoop task jvms -- hadoop analyzing hadoop performance data.TRANSCRIPT
![Page 1: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/1.jpg)
![Page 2: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/2.jpg)
![Page 3: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/3.jpg)
![Page 4: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/4.jpg)
![Page 5: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/5.jpg)
![Page 6: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/6.jpg)
![Page 7: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/7.jpg)
![Page 8: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/8.jpg)
![Page 9: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/9.jpg)
![Page 10: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/10.jpg)
![Page 11: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/11.jpg)
![Page 12: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/12.jpg)
![Page 13: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/13.jpg)
![Page 14: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/14.jpg)
![Page 15: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/15.jpg)
![Page 16: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/16.jpg)
![Page 17: profiling and tuning hadoop pipelines](https://reader033.vdocuments.site/reader033/viewer/2022051610/54833b24b4af9faf0d8b4996/html5/thumbnails/17.jpg)