Learn. Connect. Explore.Learn. Connect. Explore.

Architecture ethos for Internet of Things( IoT)

Muni Pulipalyam

Senior Architect, Microsoft Services, India

The “Internet Of Things” …

… is neither really about “Things” …

… nor really about “The Internet”, …

… it’s about creating systems.

… that make the tools of our daily lives better, …

… safer, more reliable, more efficient, …

… and more fun.

A Changing World – a new perspective

“A computer in every pot and chicken.”~ Steve Teixeira (2014)

Microsoft Director of Program Management | Internet of Things | Operating Systems Group

“A chicken in every pot.”

“A computer on every desk

and in every home.”

~ Henry IV of France – 17th Century

~ Bill Gates (1977)

What is the Internet of Things?

“ ”The network of physical

objects that contain

embedded technology to

communicate and interact

with their internal states or

the external environment.

Source: Gartner

Smart Products

Grid

Renewables

Oil/Gas/Coal

Recovery and

Distribution

Points

of Sale

Restaurants

Hotels

Fuel

Stations

Patients

Clinics

Hospitals

Nursing

Homes

Mobile

Care

SafetySecurity

ComfortLighting

Automation

Manufacturing

Integration and

AutomationRemote

Servicing

Predictive and

Reactive

Maintenance

Water

Waste

Pollution

Control

Fire

Emergency

Public

Safety

Law

Enforcement

Letters

Packages

Containers

Tanks Bulkware

Games

Events

Sports

TelevisionStreaming

Traffic Buses

Cars

Trucks

Trains

Vessels

Aircraft

Bikes

Smart

Energy

Smart Pro

Services

Smart

Retail

Smart

Mobility

Smart

Logistics

Smart

Factory

Smart

Cities

Smart

Entertain-

ment

Smart

Health-

care

Smart

Building

Home

Now we are here….

“No the doctor doesn’t do house calls. But he does do

Skype calls!”

And then….

And think of this….

Bad news –

the scale is

threatening to

cut off our

access to the

refrigerator!!!

The Internet of Things (IoT) is driving significant change

Dramatic growth

in connectable endpoints

By 2020:

26B IoT endpoints

Significant opportunities

for partners

By 2020:

$300B in incremental revenue for

IoT product and service suppliers

Increased capability

to connect

Fix

953:00 PM

25% humidity

70 preset

Train

View Pay

Minimal Wait

👫1

1

12

4

1

13

3

2

1

3

2

1

3

2

3

Ad-Hoc Stop

Traffic Alert!

2

4

1

13

3

3

2

1

3

2

3

🔔 14:30

🚌 14:41

6 (+5)

4 (+2)

E-ChargingPreventive Repairs

45km

7km

What is the Internet of Things (IoT)?

14

3

1

2

3

4

2

How small are the things?

Anyone for Raspberry pie pi?

It’s getting smaller, cheaper and more powerful everyday….

Introducing Intel “Sharks Cove”

Simplifying hardware development for Windows Platforms

Intel® Galileo and Quark X1000

5mm

32-bit x86 @ 400Mhz, single core

Industry-standard I/Os

DDR3 memory controller

15x15mm package

Scalar instruction set architecture

Arduino-compatible board

Quark CPU

256M RAM

USB, SD slot, Ethernet

How is this thing?

The Internet of Things: By the Numbers – How big?

B5075212Predictions….

Information Exchange Patterns

Telemetry

Information flowing

from a device to other

systems for conveying

status of device and

environment

Inquiries

Requests from devices

looking to gather

required information or

asking to initiate

activities

Commands

Commands from other

systems to a device or a

group of devices to

perform specific

activities

Notifications

Information flowing

from other systems to a

device (-group) for

conveying status

changes in the rest of

the world

Telemetry• Scheduled or event-driven stream of device status

information

• Physical or logical status or sensor readings.

• Records are usually tiny; timestamp plus numbers.

• Grand variety in frequencies. Once per week to 10 kHz for each of multiple metering points for factory machines.

Collect, Reduce, Route• Telemetry Processing

• Collect – acquire readings

• Reduce – filter and/or aggregrate

• Route – forward to processing or storage

• Tiered Processing• On-Machine CRR routing aggregates

• Higher-value records representing data aggregate over longer period of time

• Reliable handoff desirable

• Cloud Processing• Collect to cloud

• Higher frequencies may allow lossy transfer

Collect

Reduce

Route

Collect

Reduce

Route

Real-time Analysis• Observe Telemetry “as it happens”

• React to state changes or trends

• React to aggregate observations

• Examples• “device input voltage drops below 11V for more

than 3 minutes”

• “temperature readings from sensors on this floor average above 23°C for last 10 minutes”

• “sensor failed reporting data for 5 minutes”

• Very short reaction time required

fn

Data-At-Rest Analysis• Mine Telemetry through DB Queries

• Find and track trends or maxima

• Analyze expected vs. actual behaviors

• React to longer term observations

• Hoard for future use

• Variety of Data Store Options• SQL/OLAP

• Cassandra, Riak

• Hadoop

• Store choice depends on what questions you’dlike to ask

flt

Command/Control• Tell a device, remotely, to execute a logical or

physical activity• “Give me the status of X”

• “Roll 2 feet forward”

• “Track this object with the camera”

• “Fetch firmware update”

• Remote: Control service, handheld device, etc.

• Latency requirements vary, but often “perceptibly imminent”

The Last Mile• Huge Battleground

• Mobile Carriers try leverage GPRS/UMTS/LTE investments

• Public APNs via Internet

• Private APNs to private networks

• (Analog TV) Whitespace Radio

• Power-line Networks

• Two Models• Datagram Messaging

• IP Connectivity

• Device Direct or via Gateway

Protocol Wars• COM vs. CORBA vs. HTTP and REST vs.

SOAP/WS-* all over again, but much, much worse• Many industries, each probably having

competing consortia

• Field bus and LAN legacy protocol experience

• Proprietary technology is the norm

• Very limited security awareness

• Popcorn Time!

“The IT Pro Way”: VPN• “You Gravitate to What You Know”

• Device makers make devices, not Internet distributed systems

• Networking experience mostly with LAN technology and techniques

• First attempt at command/control path is almost invariably on VPN technology.

• Provides Addressability and Security (well, no, … later)

VPN

VPN Limits• “Ethernet Hub with Virtual Cables”

• One TCP/IP link per Device

• Expensive handshake

• VPN is very expensive to scale• Compute, memory intensive

• Expensive appliances

• Weak failover model

• Pricing models anchored on information worker connections

• Increased device complexity

Relay Technologies• Application-level connectivity

• HTTP (long-polling)

• HTTP + Web Sockets (bi-di)

• AMQP

• Custom

• Device connects outbound to Relay through NAT/FW

• Device becomes addressable at Relay when connected

R

Customer

Relationship

Management

Maintenance

and Dealers

Roadside

AssistanceERP

Notification

Fan-OutWeb PaaS/BaaS Messaging Messaging

Notification Fan-

Out

Scenario Architecture – Vehicles

3G

100,000s of Vehicles100,000s of Drivers 100,000s of Drivers

+ Driving Behavior

+ Predictive Maintenance

+ User Targeting Data

+ Find My Car

+ Geo Fencing

+ Remote Diagnostics

Fleet Information

Systems

+ Points Of Interest

+ Traffic & Parking

+ Seamless Navigation

Web PaaS

Vehicle

Information

Systems

Driver Assistance

Systems

Mobile Experience Portal Experience

3rd Party Content

Points of Interest,

Coupons, Easy Parking

User Profiles

Preferences, Entertainment

Navigation Destinations, Presence

Customer

Relationship

Management

Maintenance

and Dealers

Roadside

AssistanceERP

Notification Hubs Web Sites Service Bus / Device Hub SignalR +

Service BusNotification Hubs

Seamless Navigation / Car Sharing

3G

100,000s of Vehicles100,000s of Drivers

Windows

Push Messaging

100,000s of Drivers

+ Driving Behavior

+ Predictive Maintenance

+ User Targeting Data

+ Find My Car

+ Geo Fencing

+ Remote Diagnostics

Fleet Information

Systems

+ Points Of Interest

+ Traffic & Parking

+ Seamless Navigation

Vehicle

Information

Systems

Driver Assistance

Systems

Mobile Experience

3rd Party Content

Points of Interest,

Coupons, Easy Parking

User Profiles

Preferences, Entertainment

Navigation Destinations

Web Sites

Portal Experience

• Seamless, Urban Door-to-Door Navigation Experience, Pedestrian & Vehicle

• Seamless Handoff between Mobile Phone Experience and Car

• Weather, Traffic, Parking, Points of Interest

• Set up your route at night and get alerted on the phone when it’s time to leave

Scenario-Enabling Technologies

Actor-Based

High-Scale

Computing

Service-Assisted

Trustworthy

Communication

Federated

Identity and

Access Control

Data Storage,

Analysis, and

Machine Learning

Data Storage, Analysis, and Machine Learning

• Insight is based on collection and analysis of vast amounts of data across a multitude of devices and sensors in the system scope

• Real-Time/NRT Analysis: • Aggregation/Reduction, Temporal Queries

• State Correlation, Alerting, Limit Detection

• Data-At-Rest Analysis: • Time-Series, Map/Reduce, Correlation

• Machine Learning• Pattern Detection, Behavior Prediction

• Plausibility Analysis, Fraud Detection

Data Storage,

Analysis, and

Machine Learning

Actor-Based Computing• Scale-appropriate compute model for service-side

logic complementing device functionality on a per-device basis• Distributed compute fabric, hosting simple device- or

device-group scope programs (Actors)

• Message-based activation of Actors and dispatch of messages to active Actors

• Managing of volatile or durable state

• Millions of concurrently active Actors per cluster

• Simple programming experience in vastly scalable compute infrastructure hosts

Actor-Based

High-Scale

Computing

Service Assisted Communication• Service-Based Device Gateways

• Standards-based (AMQP, MQTT, HTTP) messaging

• Millions of concurrent active, bi-di connections

• Integrates with all communication paths including mobile/wireless operator networks

• Minimal idle-chatter and low-footprint session recovery for signal loss and roaming scenarios

• Trustworthiness through strong peering of devices and associated gateways

• No VPN, No Firewall Holes, No DNS, No DHCP, No Public IPv6, No IP Roaming

Service-Assisted

Trustworthy

Communication

Federated Identity and Access Control• Embracing the reality of multitudes of identity authorities and

providers and enabling interoperability in spite of it.• OpenID Connect

• OAuth 2.0

• Cross-Provider Trust Federation

• Scalable, Token-Based Authorization

• Dramatically lighter weight and more flexible and scenario appropriate than PKI

• Strong Device/Gateway peering w/ TLS/PSK Federated

Identity and

Access Control

Why Cloud for IoT? Higher Scale, Lower Risk.• Example

• 2 Million Concurrent Device Goal

• (High Density) 80,000 Concurrent Connections Per Node

• 80,000 * 128KB TCP Buffer, SSL State, Aggregation = ~10GB RAM Footprint

• 25 Front-End Nodes + 3 Failover Capacity Reserve

• 10+ Back-End Nodes for Data Offloading

• Database and Analysis Capacity?

• Disaster Recovery Standby Reserve

• Scale-Ramp? Traffic Volume? Geo-Distribution?

• Product Success?

Microsoft Azure

Actor-Based

High-Scale

Computing

Service-Assisted

Trustworthy

Communication

Federated

Identity and

Access Control

Data Storage,

Analysis, and

Machine Learning

SQL Database

Table Storage

Blob Storage

HDInsight

…

Service Bus

AMQP

Cloud Services

MSR Orleans

Active Directory

Identity

Foundation

Microsoft Azure as IOT Platform

Network

Compute

Storage

VMs

VM Disks

VPN Public IP

Pre-Built

Images +

Open VM

Depot

Un

ifie

d H

TTP

/REST M

an

ag

em

en

t A

PI &

Po

rtal

Inte

llig

en

t Syst

em

s Serv

ices

Syst

em

Cen

ter

Op

era

tio

ns

Man

ag

er

Cloud

Storage SQL

Hadoop

HDInsight

Web SitesCloud

Services

Media

Services

Active

Directory

Multi Factor

Auth

Mobile

Services

Service BusNotification

Hub

BizTalk

Services

Traffic Manager, Load Balancing, Firewall

Partners

Twilio,

SendGrid

Node.js

Java, PHP,

Perl, Python,

Ruby

NoSQL

Team

Fo

un

datio

n S

erv

er, G

it

Visu

al S

tud

io, E

clipse

Office 365, Dynamics, Microsoft Account, Bing

Identity

Serv

ices

(WA

AD

)

Command/Notification APITelemetry/Inquiry Dispatcher

Service Bus + BizTalk Services + BizTalk Server + Virtual Networks

Notification

Hubs

Mobile Services

Web SitesService Bus

SignalR

Service BusNotification Hubs

Microsoft Azure Platform Mapping

3G

Fleet Information

Systems

Web Sites

Vehicle

Information

Systems

Driver Assistance

Systems

Mobile Experience Portal Experience

Corporate and Divisional Line of Business and Information Systems, 3rd Party Systems

Service Bus & Web APITelemetry Adapter Framework

SQL Database, Blob and NoSQL Storage

Real-Time Analytics, HDInsightVirtual Machines (IaaS)

Cloud Services and Web Sites (PaaS)

Media Services

Service Bus & Web APIService Bus & Web API

Communication

IP

TCP UDPICMP

etc.

HTTP/S AMQP/S MQTT Custom Protocols CoAP

PowerLAN/Homeplug

Zigbee IEEE 802.15.4

Ethernet IEEE 802.3WiFi IEEE 802.11x

GSM/GPRS/HSPA/LTE Weightless

Bluetooth IEEE 802.15.1

ATM

White WiFi 802.11af

Device Capabilities• Volume products mean miniscule price

differences having huge impact• Broad array of very special microcontrollers and

communication circuits

• Microcontrollers ~$1+, Ethernet + TCP/IP ~$3+, GSM/GPRS ~$15, RF ~$3

• Physical constraints matter • Small size footprint, minimal energy consumption

• Few KBytes of RAM and program storage are fairly common

Key Challenges• Addressing?

• Domestic and Global Roaming, Base Station Switches

• Sparse Connectivity?• Tunnels, Parking Garages, Mobile Coverage, Congestion

• Security?• Device Isolation, Environment Isolation, Device Identity, Trust

• Scale?• Millions of concurrently active devices with bi-directional

communication needs

Architectural Baseline

Scale Unit

Data Analysis

Cluster(s)

x10,000 devices

Gateway

Filtering and Aggregation

Routing

Control

System

Scale

Unit

Scale

Unit

Scale

Unit

x1,000,000 devices

Scale

Unit

DC

Bo

un

dary

Device

Identity and

Metadata

Store

Provisioning

System

OT/IT Convergence

M2M

Co

nn

ect

ivit

y P

rovid

ers

Mobility

Logistics

Factory

Cities

Entertainment

Energy

Healthcare

Buildings

Retail

Actor-Based

High-Scale

Computing

Service-Assisted

Trustworthy

Communication

Federated Identity

and Access Control

Data Storage,

Analysis, and

Machine Learning

Operational Technology

Workflow, Document

Management and Communication

Sales and Marketing Information

Systems

Procurement and Logistics

Billing, Collections, and Finance

People Management

Production Control

Customer Service and Support

Platform

Services

Information Technology

M2M

Co

nn

ect

ivit

y P

rovid

ers

Mobility

Logistics

Factory

Cities

Entertainment

Energy

Healthcare

Buildings

Retail

Workflow, Document

Management and Communication

Sales and Marketing Information

Systems

Procurement and Logistics

Billing, Collections, and Finance

People Management

Production Control

Customer Service and Support

Platform

ServicesActor-Based

High-Scale

Computing

Service-Assisted

Trustworthy

Communication

Federated Identity

and Access Control

Data Storage,

Analysis, and

Machine Learning

Operational and Information Technology Convergence

M2M

Co

nn

ect

ivit

y P

rovid

ers

Actor-Based

High-Scale

Computing

Service-Assisted

Trustworthy

Communication

Federated Identity

and Access Control

Data Storage,

Analysis, and

Machine Learning

Common Information

Technology Services

Workflow, Document

Management and Communication

Sales and Marketing Information

Systems

Procurement and Logistics

Billing, Collections, and Finance

People Management

Production Control

Customer Service and Support

Skype

Office 365

SharePoint

Dynamics CRM

Dynamics AX

Mobility

Logistics

Factory

Cities

Entertainment

Energy

Healthcare

Buildings

Retail

Smart Products

Platform Services

Windows

Server/Azure

SQL

Server

Hyper-V

ReferencesRelated references for you to expand your knowledge on IoT

• Things. M2M. IoT - Connecting Special Purpose Devices to and through the Cloud

http://channel9.msdn.com/Blogs/Subscribe/Things-M2M-IoT-Connecting-Special-Purpose-Devices-to-and-through-the-Cloud

• Intelligent Systems Service

http://www.microsoft.com/windowsembedded/en-us/intelligent-systems-service .aspx

technet.microsoft.com/en-in

aka.ms/mva

msdn.microsoft.com/

Your Feedback is Important

OPTION 3: Feedback stations outside the hall

Fill out evaluation of this session and help shape future events.

OPTION 1 OPTION 2

Follow us online

Facebookfacebook.com/MicrosoftDeveloper.India

twitter.com/msdevindia

Twitter

Twitter: @munipuli

Email: munipuli@microsoft.com