momentum in big data, iot and machine intelligence
TRANSCRIPT
Big Data Analytics for Internet of Things and Machine Intelligence
Shamshad AnsariPresident & CEO
Accure Inc.
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Agenda
• Introduction• Iot & Big Data• IoT Reference Architecture• IoT on Momentum
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Year 2020
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Big Numbers of Small ThingsYear 2020
$7.1 Trillion
$1.9 Trillion
50 Billion Connected Devices | Cisco
IoT Economic Vaule Added| Gartner
IoT Solutions Revenue| IDC
IoT Processor Cost Less
Than
$1Gartner
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
What is IoT?
• Objects connected to Internet and communicating with each other.
• Any object that can be turned on and off could be a part of the IoT.
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Business Opportunities
Monitor
OptimizeControl
Improved performance
Reduced costNew innovative
products
1% savings across all industries $150 Billion Savings
Source: GE
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Is IoT New?
We’ve doing this for many years Yes
This is really very facinating and looks like IoT will change
the world
If IoT is not new, why is this buzz now?- Widespread cell phone usage- Reduced price of sensors- Cheaper Internet connection- Improvded technology to handle and make use of data
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
How Big Data Relates to IoT?How much data?
Gas turbine comressor blade: 500GB/ day | GE
2015 2020
4.4
44
0.1324.4
OverallIoT
Zettabyte
An IoT Sensor generates about 0.5MB per variable per day
1000 sensors & 1000 variables = 500GB per day
IoT generates big data
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
IoT and Big Data
Data Ingestion Data Storage Data Processing
Data Reporting Action
A new mindset and technology is needed to handle IoT data
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
IoT Challanges
• Scale– Size and fast growing data– Large number of users
• Pace– Fast pace analysis, command and control and cost– Skill required to do data science and learn new platform
• Environment– Complex IoT infrastructure– Security and privacy– Lack of standards in data interoperability
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
IoT Solutions Until Now
• Complex and expensive• Cost of failing was huge• Mostly high-volume, homogenous devices,
where software needs are simple– For simple things like thermostat, refrigerator etc.
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Practical Solution Approach
• Think big. Start small• Start small– Experiment, learn, and refine
• Think big– scale
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Big Data IoT Architecture Requirements
• Be able to handle hardware and software hetrogenity
• Be able to scale big• Provide low latency
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Momentum as an IoT Platform
Momentum provides a configurable platform to manage IoT
• Per device level security• Massive scalability – millions of concurrent sensors• Real-time and batch analytics• Predictive analytics• Smart alerts
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
IoT Reference Architecture
Streaming Gateway
Adapter
Local Gateway
Scalable storage
Batch analytics
Realtime analytics Visualiza
tion
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Working Example:Smart Street Light Analytics
Environment Internal parts Weather
Temperature Temperature Temperature
Pressure Input voltage Pressure
Humidity Output voltage Humidity
Noise Light intensity Sand storm
Rain
Snow
Fog
External DataSensor Data
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Momentum in Smart Street Lights
• Data Ingestion• Predictive Model Building• Predictive analytics – batch• Realtime analytics
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Momentum Demo – How to create Streaming Hub
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Predictive ModelingFeature Engineering• Set A = weather + holiday + weekday + weekend features for the predicted day• Set B = number of vehicles that passed each pole in each of the previous 12
hours• Set C = number of vehicles that passed in each of the previous 12 days at the
same hour• Set D = number of vehicles that passed in each of the previous 12 weeks at the
same hour and the same dayTraing Sets• Training set 1: feature set A only• Training set 2: feature sets A+B• Training set 3: feature sets A+B+C• Training set 4: feature sets A+B+C+D
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Load Data to Momentum
-Specify your source data- RDBMS- NoSQL- Delimited files
- Full or continuos/incremental mode
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Pre-processing & Transformation
Provide transformation logic in the form of familiar SQL statement
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Predictive Modeling
Predictive Modeling without any programming
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Scoring
Model A+B+C is preferred as it has the lowest RMS
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Conclusion
• Momentum provide highly scalable IoT platform
• Big data analytics without any programming• Reduce implementation time and cost
© Copyright Accure Inc. All rights reserved. www.accureanalytics.com
Next Step
Visit us at www.accureanalytics.com
For an online demo email us at [email protected]