Download - Robust Stream Processing with Apache Flink
![Page 2: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/2.jpg)
Who am I?• Director of Applications Engineering at data
Artisans• Previously working on streaming
computation at Twitter, Gnip and Boulder Imaging
• Involved in various kinds of stream processing for about a decade
• High-speed video, social media streaming, general frameworks for stream processing
![Page 3: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/3.jpg)
Overview• What is Apache Flink?• What is Stateful Stream Processing?• Windowed computation over streams• Robust Time Handling (Event Time vs Processing
Time)• Robust Failure Handling• Robust Planned Downtime Handling• Robust Reprocessing
![Page 4: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/4.jpg)
What isApache Flink?
Apache Flink is an open source platform for distributed stream and batch data processing.
![Page 5: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/5.jpg)
What isApache Flink?
![Page 6: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/6.jpg)
Stream Processing
Your Code
Data Stream Data Stream
![Page 7: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/7.jpg)
StatefulStream Processing
Your Code
Data Stream Data Stream
State
![Page 8: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/8.jpg)
More ComplexExample
Kafka
Files
RabbitMQ
Filter
Map
Join / Sum
InfluxDB
C*
![Page 9: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/9.jpg)
Distributed and Parallel Deployment
Kafka
Files
Rabbit
MQ
Filter
Parse
Join / Sum
InfluxDB
C*
![Page 10: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/10.jpg)
Robust Stream Processingwith Apache Flink
![Page 11: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/11.jpg)
Code Example!
![Page 12: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/12.jpg)
Windowing
![Page 13: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/13.jpg)
Processing Timevs
Event Time
![Page 14: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/14.jpg)
Windowing in Processing Time
0 1 2 34 56 7 8 9 0 1 2 3 4 5 6 7 8 9
Processing Time
Event Time
![Page 15: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/15.jpg)
Windowing in EventTime
0 1 2 34 56 7 8 9 0 1 2 3 4 5 6 7 8 9
Event Time
![Page 16: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/16.jpg)
Processing Time = Errors!
![Page 17: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/17.jpg)
Event Time = Accuracy
![Page 18: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/18.jpg)
Failure Handling
![Page 19: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/19.jpg)
Downtime Handling
![Page 20: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/20.jpg)
Data Reprocessing
![Page 22: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/22.jpg)
Flink Forward 2016, BerlinSubmission deadline: June 30, 2016Early bird deadline: July 15, 2016www.flink-forward.org
![Page 23: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/23.jpg)
Questions?
![Page 24: Robust Stream Processing with Apache Flink](https://reader036.vdocuments.site/reader036/viewer/2022081604/588002641a28ab3a1e8b7ded/html5/thumbnails/24.jpg)
Thanks!