momentum in big data, iot and machine intelligence

25
Big Data Analytics for Internet of Things and Machine Intelligence Shamshad Ansari President & CEO Accure Inc.

Upload: shamshad-ansari

Post on 13-Apr-2017

8.630 views

Category:

Data & Analytics


1 download

TRANSCRIPT

Page 1: Momentum in Big Data, IoT and Machine Intelligence

Big Data Analytics for Internet of Things and Machine Intelligence

Shamshad AnsariPresident & CEO

Accure Inc.

Page 2: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Agenda

• Introduction• Iot & Big Data• IoT Reference Architecture• IoT on Momentum

Page 3: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Year 2020

Page 4: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Big Numbers of Small ThingsYear 2020

$7.1 Trillion

$1.9 Trillion

50 Billion Connected Devices | Cisco

IoT Economic Vaule Added| Gartner

IoT Solutions Revenue| IDC

IoT Processor Cost Less

Than

$1Gartner

Page 5: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

What is IoT?

• Objects connected to Internet and communicating with each other.

• Any object that can be turned on and off could be a part of the IoT.

Page 6: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Business Opportunities

Monitor

OptimizeControl

Improved performance

Reduced costNew innovative

products

1% savings across all industries $150 Billion Savings

Source: GE

Page 7: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Is IoT New?

We’ve doing this for many years Yes

This is really very facinating and looks like IoT will change

the world

If IoT is not new, why is this buzz now?- Widespread cell phone usage- Reduced price of sensors- Cheaper Internet connection- Improvded technology to handle and make use of data

Page 8: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

How Big Data Relates to IoT?How much data?

Gas turbine comressor blade: 500GB/ day | GE

2015 2020

4.4

44

0.1324.4

OverallIoT

Zettabyte

An IoT Sensor generates about 0.5MB per variable per day

1000 sensors & 1000 variables = 500GB per day

IoT generates big data

Page 9: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

IoT and Big Data

Data Ingestion Data Storage Data Processing

Data Reporting Action

A new mindset and technology is needed to handle IoT data

Page 10: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

IoT Challanges

• Scale– Size and fast growing data– Large number of users

• Pace– Fast pace analysis, command and control and cost– Skill required to do data science and learn new platform

• Environment– Complex IoT infrastructure– Security and privacy– Lack of standards in data interoperability

Page 11: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

IoT Solutions Until Now

• Complex and expensive• Cost of failing was huge• Mostly high-volume, homogenous devices,

where software needs are simple– For simple things like thermostat, refrigerator etc.

Page 12: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Practical Solution Approach

• Think big. Start small• Start small– Experiment, learn, and refine

• Think big– scale

Page 13: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Big Data IoT Architecture Requirements

• Be able to handle hardware and software hetrogenity

• Be able to scale big• Provide low latency

Page 14: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Momentum as an IoT Platform

Momentum provides a configurable platform to manage IoT

• Per device level security• Massive scalability – millions of concurrent sensors• Real-time and batch analytics• Predictive analytics• Smart alerts

Page 15: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

IoT Reference Architecture

Streaming Gateway

Adapter

Local Gateway

Scalable storage

Batch analytics

Realtime analytics Visualiza

tion

Page 16: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Working Example:Smart Street Light Analytics

Environment Internal parts Weather

Temperature Temperature Temperature

Pressure Input voltage Pressure

Humidity Output voltage Humidity

Noise Light intensity Sand storm

Rain

Snow

Fog

External DataSensor Data

Page 17: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Momentum in Smart Street Lights

• Data Ingestion• Predictive Model Building• Predictive analytics – batch• Realtime analytics

Page 18: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Momentum Demo – How to create Streaming Hub

Page 19: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Predictive ModelingFeature Engineering• Set A = weather + holiday + weekday + weekend features for the predicted day• Set B = number of vehicles that passed each pole in each of the previous 12

hours• Set C = number of vehicles that passed in each of the previous 12 days at the

same hour• Set D = number of vehicles that passed in each of the previous 12 weeks at the

same hour and the same dayTraing Sets• Training set 1: feature set A only• Training set 2: feature sets A+B• Training set 3: feature sets A+B+C• Training set 4: feature sets A+B+C+D

Page 20: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Load Data to Momentum

-Specify your source data- RDBMS- NoSQL- Delimited files

- Full or continuos/incremental mode

Page 21: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Pre-processing & Transformation

Provide transformation logic in the form of familiar SQL statement

Page 22: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Predictive Modeling

Predictive Modeling without any programming

Page 23: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Scoring

Model A+B+C is preferred as it has the lowest RMS

Page 24: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Conclusion

• Momentum provide highly scalable IoT platform

• Big data analytics without any programming• Reduce implementation time and cost

Page 25: Momentum in Big Data, IoT and Machine Intelligence

© Copyright Accure Inc. All rights reserved. www.accureanalytics.com

Next Step

Visit us at www.accureanalytics.com

For an online demo email us at [email protected]