apache oozie
DESCRIPTION
Apache OOzieTRANSCRIPT
![Page 1: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/1.jpg)
Apache Oozie
Shalish.V.J
![Page 2: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/2.jpg)
Introduction
Apache Oozie is a system for running workflows of dependent jobs.
2 main parts :
workflow engine :
stores and runs workflows composed of different types of Hadoop jobs
coordinator engine :
runs workflow jobs based on predefined schedules and data availability.
![Page 3: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/3.jpg)
WorkFlow
Workflow constitutes of Action nodes and Control flow nodes
Action nodes :
performs a workflow task
Control flow nodes :
governs the workflow execution between actions
![Page 4: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/4.jpg)
Oozie workflow definition : Max temperature MR Job
![Page 5: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/5.jpg)
Oozie workflow definition : Max temperature MR Job contd..
![Page 6: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/6.jpg)
Transition Diagram of Oozie workflow
![Page 7: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/7.jpg)
Oozie workflow Application: Packaging and Deploying
![Page 8: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/8.jpg)
Oozie workflow Application : Running
export the OOZIE_URL environment variable to tell the oozie command
which Oozie server to use
-config option specifies a local Java properties file containing definitions for
the parameters in the workflow XML file
![Page 9: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/9.jpg)
Properties File
![Page 10: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/10.jpg)
Workflow job Status: Command line
output shows the status: RUNNING, KILLED, or SUCCEEDED
![Page 11: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/11.jpg)
Workflow job Status : Web UI
Oozie’s web UI available at http://localhost:11000/oozie
![Page 12: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/12.jpg)
Oozie Coordinator Engine
The Oozie Coordinator system allows the user to define and execute
recurrent and interdependent workflow jobs
![Page 13: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/13.jpg)
Coordinator.xml
The Oozie Coordinator system allows the user to define and execute
recurrent and interdependent workflow jobs
Job runs every 3 minutes between start and end time
![Page 14: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/14.jpg)
Properties File
![Page 15: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/15.jpg)
Workflow job Status : Web UI
Oozie’s web UI available at http://localhost:11000/oozie
![Page 16: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/16.jpg)
Workflow job Status : Web UI
![Page 17: Apache Oozie](https://reader035.vdocuments.site/reader035/viewer/2022081414/54b75f264a7959f71f8b4629/html5/thumbnails/17.jpg)
Thank YOU !!!