streaminsight breakthrough

MICROSOFT STREAMINSIGHT

Breakthrough GuideYulian SlobodyanL’viv, 2011

Introduction to CEP

recap(Strategic, Tactical)

tacticalstrategic

scenarioA

Tokyo Metro

東京メトロ Tōkyō Metoro

scenarioA.Info

Anno 1927 #1 annual passenger rides 3,160,000,000

passengers/year avg 6,330,000

passengers/day 24/7 mode 203.4 km system length 2009 profit

¥63,500,000,000

scenarioA.Issues.Take(1)

Pushers 押し屋 oshiya

scenarioA.Strategic

Reporting Planning Data Mining Constraints

Detection Forecasting

scenarioA.Tactical

Real-time Statistics & Monitoring

On a Fly Analysis Traffic

Optimization Systems

Management Emergency

Response

scenarioA.Solutions[“RDBMS”]

RDBMS

Presentation

Request

Data

tactical

strategic

Humans

Services

Sensors

scenarioA.Solutions[“CEP”]

CEP System

tactical

strategic

Humans

Services

Sensors

Presentation

Google(“CEP”)

Complex event processing (CEP) consists of processing many events happening across all the

layers of an organization identifying the most meaningful events within the

event cloud analyzing their impact taking subsequent action in real time.

CEP Products Sybase CEP, StreamBase

Microsoft StreamInsight

Compare(RDBMS, CEP)

RDBMS CEPRequest Paradigm

On-Demand Continuous

Latency ~ sec * n ~ ms * n

Throughput ~ 100 * n/sec ~ 10,000 * n/sec

Microsoft StreamInsight

StreamInsight.Info

CEP engine from Microsoft Part of MS SQL Server 2008/2008R2

Distributive Uses SQL Server license key to activate Two Editions:

Standard ( SQL Server Standard/Enterprise/Web)

Premium ( SQL Server Datacenter/Developer/Eval)

Current version: 1.1

StreamInsight.Architecture

StreamInsight.EventStream.Trace()

Event Source

Input Adapt

er

Standing

Queries

Output Adapt

er

Event Sink

Stream Insight Runtime

StreamInsight.Event.Structure

Even

tHead

er

Paylo

ad

Event KindTimestamp

Data

Event Model

StreamInsight.EventKind

time

Average

- INSERT event

- CTI (Current Time Increment) event

Average

StreamInsight.EventModel

Point “10:42:56.052 - item #123 passed the gate”

Interval “01:12:00-01:35:00 - active sensor #17”

Edge “12:00:00-∞ - temperature 17˚C” “13:00:00-∞ - temperature 18.5˚C”

StreamInsight.EventModel.Edge

time

paylo

ad

A

B

C

StreamInsight.InputAdapters

StreamInsight.OutputAdapters

StreamInsight.Queries

Standard LINQ operations Projection Filtering Joins Unions Grouping

Event Windows

StreamInsight.EventWindows

StreamInsight.EventWindows