analyzing fleet test data using matlab€¦ · data collection –types of data analog/pwm/digital...

21
1 © 2015 The MathWorks, Inc. MATLAB汽车大数据分析平台的构建及应用 卓金武 MathWorks 中国 [email protected]

Upload: others

Post on 12-Aug-2020

11 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

1© 2015 The MathWorks, Inc.

MATLAB汽车大数据分析平台的构建及应用

卓金武

MathWorks 中国

[email protected]

Page 2: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

2

“Today's cars produce upwards of 25GB of information

per hour … information is helping us understand how

people move, see patterns that most customers don't …”

Mark Fields, CEO, Ford

牛人如何看汽车大数据分析?

Page 3: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

3

从大数据中挖掘信息对车企的意义

Active safety

testingPrognostics

algorithms

Sound quality

analysis

Decision

support

Page 4: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

4

Why MATLAB: 从分析到产品

From Prototype to Production

Page 5: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

5

汽车大数据平台的架构

数据预处理 数据探索 建模 验证

研发部门 测试部门 生产部门 市场部门

数据层

开发层

应用层

Page 6: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

6

数据收集

Data collection

– Types of data

Analog/PWM/Digital

CAN

– Data integrity

Detect intermittent

connections

Signal threshold limits

Analog (V,I) CAN

Page 7: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

7

从硬件设备获取数据

Data Acquisition Toolbox

Plug-in data acquisition devices

and sound cards

Instrument Control Toolbox

Instruments and RS-232

serial devices

MATLAB

Interfaces for communicating

with everything

Image Acquisition Toolbox

Image capture devices

Vehicle Network Toolbox

CAN bus interface devices

Page 8: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

8

Image Processing

• Active Safety

Statistics

• Summary Statistics

• Regression, ANOVA, Machine Learning

Signal Processing

• Sound quality analysis

• LIDAR analysis

分析的内容

MPG Acceleration Displacement Weight Horsepow er

MP

GA

ccele

ratio

nD

ispla

cem

ent

Weig

ht

Hors

epow

er

50 1001502002000 4000200 40010 2020 40

50

100

150

200

2000

4000

200

400

10

20

20

40

Location/Mapping

• Analyzing GPS Data

• Custom Visualizations

Page 9: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

9

File I/O• Text

• Spreadsheet

• XML

• CDF/HDF

• Image

• Audio

• Video

• Geospatial

• Web content

Hardware Access• Data acquisition

• Image capture

• GPU

• Lab instruments

Communication Protocols• CAN (Controller Area Network)

• DDS (Data Distribution Service)

• OPC (OLE for Process Control)

• XCP (eXplicit Control Protocol)

Database Access• Financial Data

• ODBC

• JDBC

• HDFS (Hadoop)

PhysicalSensors

Data

Information

Knowledge

Action

Observation• Sensing

• Collecting

• Health Status

• Data Acquisition

Organization• Filtering

• Signal Analysis

• Data Reduction

• Plotting

Understanding• Analytics

• Frequency & Time-domain

• Predictive Analytics

• Extrapolation

Decisions & Design• Reporting & Apps

• Scalable Deployment

• Design Optimization

分析流程

Page 10: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

10

MPG Acceleration Displacement Weight Horsepow er

MP

GA

ccele

ratio

nD

ispla

cem

ent

Weig

ht

Hors

epow

er

50 1001502002000 4000200 40010 2020 40

50

100

150

200

2000

4000

200

400

10

20

20

40

Data ProcessingConvert, Sync, Clean, Reduce

Visualization

Exploratory AnalysisDerived metrics, events, conditions

PhysicalSensors

Data

Information

Knowledge

Action

Observation• Sensing

• Collecting

• Health Status

• Data Acquisition

Organization• Filtering

• Signal Analysis

• Data Reduction

• Plotting

Understanding• Analytics

• Frequency & Time-domain

• Predictive Analytics

• Extrapolation

Decisions & Design• Reporting & Apps

• Scalable Deployment

• Design Optimization

分析流程

Page 11: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

11

Predictive

Analytics

Machine Learning

Analysis Domains• Time & Frequency

• Image, video

• Location, mapping

• Custom

Decision Tree

Ensemble

Method

Neural

Network

Support

Vector

Machine

Classification

Linear

Non-linear

Non-

parametric

Regression

0 20 40 60 80 100 120 140 160 180 200

0.5

0.6

0.7

0.8

0.9

1

time secs

active p

ow

er

per-

unit

NN

measured

PhysicalSensors

Data

Information

Knowledge

Action

Clustering

k-Means,

Fuzzy C-

Means

Hierarchica

l

Neural

Networks

Gaussian

Mixture

Hidden

Markov

Model

Supervised Learning Unsupervised Learning

Observation• Sensing

• Collecting

• Health Status

• Data Acquisition

Organization• Filtering

• Signal Analysis

• Data Reduction

• Plotting

Understanding• Analytics

• Frequency & Time-domain

• Predictive Analytics

• Extrapolation

Decisions & Design• Reporting & Apps

• Scalable Deployment

• Design Optimization

分析流程

Page 12: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

12

Custom Reports

MATLAB

Apps

Integration into Existing

Systems &

Production

DeploymentExcel

Design Optimization• Maximize Fuel

Efficiency

• Minimize Risk

• Maximize Profits

PhysicalSensors

Data

Information

Knowledge

Action

Observation• Sensing

• Collecting

• Health Status

• Data Acquisition

Organization• Filtering

• Signal Analysis

• Data Reduction

• Plotting

Understanding• Analytics

• Frequency & Time-domain

• Predictive Analytics

• Extrapolation

Decisions & Design• Reporting & Apps

• Scalable Deployment

• Design Optimization

分析流程

Page 13: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

13

案例1: 汽车运行参数分析

Leverage fleet data for design decisions

– Emissions, fuel economy, prognostics, vehicle

dynamics, ride and handling, durability, …

Reproduce full range of real-world conditions

in MIL/HIL tests

– Engine, prognostics, active safety, hybrid/EV, …

Page 14: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

14

构建数据收集系统

Page 15: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

15

汽车设置

OBD2 Data from a variety of

automobiles.

COTS hardware ($8-10)

Off-the-shelf logging software

Torque-BHP (Android)

Samsung Galaxy Note® II

AT&TTM 4G, AmazonTM EC2TM,

ApacheTM Hadoop®

Page 16: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

16

分析内容 (8 mile traffic)

Traffic Patterns (the case for roundabouts)

0.0351 Gal/car at the intersection

12 cars a minute on the average

A saving of 121.3 gallons of

gasoline per day if the traffic lights

were replaced with a round-about.

A rough saving of 4.5 million

pounds of CO2 per year.

Page 17: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

17

分析内容 (Engine Fuel Consumption and Efficiency)

Understanding of Real-world

driving patterns

Design Value based on calibration

driven by real world data

Optimization of Fuel Consumption

and Shift Schedules

Driver Variability (FFT of Throttle

Position)

Page 18: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

18

案例2:汽缸缺陷预警

Data logged from car engine

Goal: Identify the bad cylinder

Challenges:

– Import data spread across several files

– Identify best algorithm to detect failure

Page 19: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

19

机器学习故障预警

衍生特征变量

训练分类树模型

用模型进行预测

Page 20: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

20

总结:MATLAB汽车大数据平台相关工具箱

Developing Predictive

Models

Accessing and

Exploring DataPreprocess Data

Integrating Analytics

with Systems

MATLAB

PCT, MDCS

Database Toolbox

Mapping Toolbox

Vehicle Network Toolbox

MATLAB

PCT, MDCS

Statistics Toolbox

Signal Processing Toolbox

Image Processing Toolbox

MATLAB

PCT, MDCS

Statistics Toolbox

Neural Network Toolbox

Curve Fitting Toolbox

Computer Vision Toolbox

MATLAB

MATLAB Compiler

MATLAB Builder NE

MATLAB Builder JA

MATLAB Builder EX

MATLAB Production Server

Page 21: Analyzing Fleet Test Data using MATLAB€¦ · Data collection –Types of data Analog/PWM/Digital CAN –Data integrity Detect intermittent connections Signal threshold limits Analog

21© 2015 The MathWorks, Inc.

Questions?