streaminsight breakthrough
DESCRIPTION
Unobtrusive introduction to basic Complex Event Processing principles and building blocks. Review of the Microsoft StreamInsight.TRANSCRIPT
MICROSOFT STREAMINSIGHT
Breakthrough GuideYulian SlobodyanL’viv, 2011
Introduction to CEP
recap(Strategic, Tactical)
tacticalstrategic
scenarioA
Tokyo Metro
東京メトロ Tōkyō Metoro
scenarioA.Info
Anno 1927 #1 annual passenger rides 3,160,000,000
passengers/year avg 6,330,000
passengers/day 24/7 mode 203.4 km system length 2009 profit
¥63,500,000,000
scenarioA.Issues.Take(1)
Pushers 押し屋 oshiya
scenarioA.Strategic
Reporting Planning Data Mining Constraints
Detection Forecasting
scenarioA.Tactical
Real-time Statistics & Monitoring
On a Fly Analysis Traffic
Optimization Systems
Management Emergency
Response
scenarioA.Solutions[“RDBMS”]
RDBMS
Presentation
Request
Data
tactical
strategic
Humans
Services
Sensors
scenarioA.Solutions[“CEP”]
CEP System
tactical
strategic
Humans
Services
Sensors
Presentation
Google(“CEP”)
Complex event processing (CEP) consists of processing many events happening across all the
layers of an organization identifying the most meaningful events within the
event cloud analyzing their impact taking subsequent action in real time.
CEP Products Sybase CEP, StreamBase
Microsoft StreamInsight
Compare(RDBMS, CEP)
RDBMS CEPRequest Paradigm
On-Demand Continuous
Latency ~ sec * n ~ ms * n
Throughput ~ 100 * n/sec ~ 10,000 * n/sec
Microsoft StreamInsight
StreamInsight.Info
CEP engine from Microsoft Part of MS SQL Server 2008/2008R2
Distributive Uses SQL Server license key to activate Two Editions:
Standard ( SQL Server Standard/Enterprise/Web)
Premium ( SQL Server Datacenter/Developer/Eval)
Current version: 1.1
StreamInsight.Architecture
StreamInsight.EventStream.Trace()
Event Source
Input Adapt
er
Standing
Queries
Output Adapt
er
Event Sink
Stream Insight Runtime
StreamInsight.Event.Structure
Even
tHead
er
Paylo
ad
Event KindTimestamp
Data
Event Model
StreamInsight.EventKind
time
Average
- INSERT event
- CTI (Current Time Increment) event
Average
StreamInsight.EventModel
Point “10:42:56.052 - item #123 passed the gate”
Interval “01:12:00-01:35:00 - active sensor #17”
Edge “12:00:00-∞ - temperature 17˚C” “13:00:00-∞ - temperature 18.5˚C”
StreamInsight.EventModel.Edge
time
paylo
ad
A
B
C
StreamInsight.InputAdapters
StreamInsight.OutputAdapters
StreamInsight.Queries
Standard LINQ operations Projection Filtering Joins Unions Grouping
Event Windows
StreamInsight.EventWindows
StreamInsight.EventWindows