hol9396: oracle event processing 12c: fact data ......title: hol9396: oracle event processing 12c:...

HOL9396: Oracle Event Processing 12c Fast Data development with Oracle Event Processing 12c

Lloyd Williams Principal Product Manager Business IntegraFon

October 2, 2014

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |


Safe Harbor Statement

The following is intended to outline our general product direcFon. It is intended for informaFon purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or funcFonality, and should not be relied upon in making purchasing decisions. The development, release, and Fming of any features or funcFonality described for Oracle’s products remains at the sole discreFon of Oracle.

3


Oracle Event Processing ApplicaFons

4


OEP

Oracle Event Processing: From Noise to Value ConnecFng the Internet-‐of-‐Things to Your Enterprise

Distributed Intelligence

•  Filtering •  CorrelaFon •  AggregaFon •  PaYern matching

Devices / Gateways

SOA

Internet of Things SOA / Enterprise

“Sea of data”

Macro-‐event High-‐value AcFonable In-‐context

OEP embedded OEP

•  High Volume •  ConFnuous Streaming •  Sub-‐Millisecond Latency •  Disparate Sources •  Time-‐Window Processing •  PaYern Matching

•  High Availability / Scalability •  Unique Coherence IntegraFon •  GeospaFal, Geo-‐fencing •  Big Data & IoT IntegraFon

•  AcAon!


Modern CompuFng Challenges

Does the problem have any one or more of the following condiFons:

①  Requires high-‐throughput and low latency processing ②  ConFnuously streaming data

③  Real-‐Time correlaFon between mulFple incoming data sources

④  Time-‐sensiFve alerts, aggregaFons and calculaFons

⑤  PaYerns in the data stream

⑥  Problem is more easily solved by analyzing before storing in DB

⑦  Data does not need to be stored, if there is nothing of interest in it

6

CondiAons for Event Processing


Oracle Event Processing (OEP)

8

!  High-‐Volume, Low-‐Latency Event Processing Infrastructure

!  Time-‐SensiFve Processing & PaYern Matching

!  Light-‐weight Java ApplicaFon Server !  Deploy in Data Center or Distributed LocaFons


SoluFon Overview

9

Time Management & PaJern Matching

"  Event “A” NOT followed by Event “B” within 10 minutes "  Event “A”, Event “B” should occur next, but Event “C” occurs instead.

!  PaYern Matching

!  Detect Absence of Events & Missing Events

!  ConFnuous Query Language (CQL)


Input Adapter Channel

Input Adapter

Channel

Business Logic (CQL)

Channel

Channel

Channel

Output Adapter

Output Adapter

Oracle Event Processing ApplicaFon

DB

Input adapters connect to data sources Channels help control the flow of data and can be tuned for opAmal performance Databases, Coherence caches, Hadoop (HDFS) and NoSQL database can be referenced directly in CQL processors CQL processors contain filtering, correlaAon, aggregaAon and paJern matching business logic Output adapters send data and alerts to downstream systems and business processes



Big Data

Coherence


High-‐Performance In-‐Memory Data Processing

Input Adapter

Data

Input Adapter

Data

Channel Business Logic (CQL)

Channel

Data

Data

AnalyFcs Channel Business Logic (CQL)

Enrich Output Adapter Data Data Data Data

AnalyAcs: ConFnuously Sliding Windows of Streaming Data, Filtering, CorrelaFons, CalculaFons, AggregaFons, PaYern Matching, Missing Event DetecFon, SpaFal Analysis, etc.

Enrichment: Integrate with data from DB, Coherence, NoSQL, Hadoop etc.

Oracle Event Processing


What’s new? Oracle Event Processing 12c

①  New development environment (JDev)

②  Big Data extensions ③  Coherence IntegraFon

enhancements

④  Library of paYerns to choose from (ex: missing event rule)

⑤  Easily connects with SOA infrastructure through EDN

1

4

5

2

3

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 13

Service Request SLA Monitoring

Lab


Oracle SOA Infrastructure

Oracle Event Processing

Oracle Coherence

EDN

Oracle Business AcFvity Monitoring

SLA Alert!

Ac.on! Oracle User Messaging Service

Service Request Status = ‘OPEN’

Service Request Status = ‘CLOSED’

Was the service request completed in Fme?

CQL


OEP ApplicaAon SLA Monitoring ApplicaAon

Part 2


SOA Composite with Event Delivery Network (EDN)

Part 2


SOA Composite vs. OEP ApplicaFon

Service Request Status = ‘OPEN’

Service Request Status = ‘CLOSED’

CLOSED OPEN

SOA Composite Instances

OEP ApplicaFon

SOA

OEP SLA Alert!


Stream Explorer

Coming Soon


•  Fast exploraFon of Real Time Streams

•  Fast definiFon & re-‐use of Real Time Event PaYerns

•  Fast TesFng and Deployment of Projects

SX: Empower Business Users for Real-‐Time Streaming Data AnalyFcs

Streaming Event-‐Driven Architecture (EDA) , Server Pla$orm


Stream Explorer Features for Business Users

•  Explorer: The applicaFon User Interface


•  Catalog: The repository for browsing resources



•  ExploraAon: An applicaFon that correlates events from streams, data from data sources, even other ExploraAons. It uses filters, groupings, summaries, ranges, and more to IdenFfy, Qualify and Expose a Real Time Business SoluFon.



•  PaJern: A pre-‐built ExploraFon that addresses a parFcular business scenario in a focused and simplified User Interface



Stream Explorer: Empowers Business Users for Real-‐Time Streaming Data AnalyFcs and IOT

ProacFvely idenFfy and act on emerging threats and opportuniFes in the Streaming data related to your enterprise

Improve operaFonal efficiencies with acFonable insight from real-‐Fme informaFon

Improve signal-‐to-‐noise raFo by only processing and storing data that is relevant

Build real-‐Fme applicaFons in half the Fme and with no complexity


Wire Transfer Fraud Demo •  Check to see if someone is receiving mulFple wire transfers in small amounts within

a few hours to try to avoid detecFon. •  Crosses mulFple SOA composite instances. •  Simple example to demonstrate the EDN – OEP Stream Explorer integraFon.


Wire Transfer 1 $8000

WT 1

> $50,000 received in 3 hours

SOA Composite vs. OEP ApplicaFon

Wire Transfer 2 $9000

WT 2


When to Use OEP? 1 Business Logic Layer for Event-‐Driven Coherence ApplicaFons

2 High-‐Volume Business AcAvity Monitoring ApplicaFons

3 Real-‐Time SpaAal ApplicaFons

4 Fast Data: Real-‐Time Requirements with Big Data Infrastructure

5 High Volume Batch to Real-‐Time Conversion Projects

6 Internet of Things (IoT): Processing Data On and From Devices

7 PaJern Matching / Missing Events / AlerFng / Fraud DetecFon

28


Oracle Event Processing (OEP) #  High-‐Volume Low-‐Latency Event Processing Infrastructure !  Event Processing Network (EPN) !  Light-‐weight Java ApplicaFon Server (embeddable) !  Easily Customizable !  Integrate with exisFng infrastructure and other Oracle Products (e.g. Coherence, BAM, RTD, Database, Big Data, Data Mining, SpaFal, NoSQL Database etc.)

#  Time Management & PaYern Matching !  ConFnuously Perform CalculaFons Over Time Windows or Number of Events !  ParFFon Event Streams By Key Values !  Perform Complex PaYern Matching !  Adjust Core Business Logic in Real-‐Fme without Redeploying

hol9396: oracle event processing 12c: fact data ......title: hol9396: oracle event processing 12c:...

Documents