how to build an autonomous anything - mathworks€¦ · how to build an autonomous anything focus...
TRANSCRIPT
1© 2015 The MathWorks, Inc.
How to build an
autonomous
anything
Mischa Kim
2
3
4
5
6
7
8
Autonomous Technology
9
Autonomous Technology
Having the power for self-governance
10
Autonomous Technology
Provides the ability of a system to act
independently of direct human control
under unrehearsed conditions
11
12
Capabilities of an Autonomous System
Sense
13
Capabilities of an Autonomous System
Sense
Perceive
14
Capabilities of an Autonomous System
Learning Algorithms
Optimization
Sense
Perceive
Decide
& Plan
15
Capabilities of an Autonomous System
Control Algorithms
Sense
Perceive
Decide
& Plan
Act
16
Autonomous Technology Transfers Responsibility to Computers
Human
Computer
Resp
on
sib
ilit
y
Degree of Autonomy
17
Bazille’s Studio
Bazille 1870Shuffleton’s Barbershop
Rockwell 1950
18
Autonomous Artistic Style Classification
Rutgers University
Image
Feature
Extraction
Visual Features
Genre
Classifier
(SVM)
Artist
Classifier
(SVM)
Style
Classifier
(SVM)
Style:
Regionalism
Genre:
Interior
Artist:
Rockwell
Machine
Learning
Classification
Sense
Perceive
Decide
& Plan
Act
19
Where to add autonomy with perception?
Analyze more data
Reduce bias
Reduce variability
Save time
Improve performance
Determine
Loudspeaker
Quality
Virtual Semiconductor
Manufacturing Calibration
21
22
23
24
25
Autonomous Service for Predictive Maintenance
Which sensor values should they use?
Decide
& Plan
Act
Perceive
Sense
Pressure
Other
variables
Vibration Timing
Temperature
26
Normal Operation Maintenance NeededMonitor Closely
Autonomous Service for Predictive Maintenance
Sense
Act
Perceive
Decide
& Plan
27
What are the best predictors?
Data
Models
Jet Engine Monitoring
Name of Presenter
Time and Location
29
Autonomous Glucose Level Management
30
Autonomous Glucose Level Management
Bigfoot Biomedical
Sense
Perceive
Decide
& Plan
Act
Continuous
Glucose Monitor
Target
Glucose
Level
+ -
Insulin PumpPerson
31
Autonomous Glucose Level Management
Bigfoot Biomedical
Continuous
Glucose Monitor
Target
Glucose
Level
+ -
Insulin PumpPerson
+ +
Mobile App
Sense
Act
Perceive
Decide
& Plan
32
Autonomous Glucose Level Management
Bigfoot Biomedical
Continuous
Glucose Monitor
Target
Glucose
Level
+ -
Insulin Pump
+ +
Mobile App
Sense
Act
Decide
& Plan
Perceive
Person
Virtual Lab
Simulink, Stateflow
Polyspace
33
Autonomous Glucose Level Management
Bigfoot Biomedical
Continuous
Glucose Monitor
Target
Glucose
Level
+ -
Insulin Pump
+ +
Mobile App
Person
Perceive
Decide
& Plan
Act
Sense
34
Autonomous Glucose Level Management
Bigfoot Biomedical
Continuous
Glucose Monitor
Target
Glucose
Level
+ -
Insulin Pump
+ +
Mobile App
Person
Perceive
Decide
& Plan
Act
Sense
Virtual Clinic
MATLAB, Toolboxes
35
Virtual Clinic
Generating data through simulation
36
Virtual Clinic
Scaling computations to simulate 50 million patients a day
37
Where will you get your data?
Simulation
Public repositories
In the lab
In the field
Internet of Things (IoT)
39
CNH Develops Intelligent Filling System for Forage Harvesters
40
41
Autonomous Trailer Filling
Control Algorithms
Perceive
Act
Sense
Decide
& Plan
42
Autonomous Trailer Filling
Control AlgorithmsAct
Decide
& Plan
Perceive
Sense
43
44
Autonomous Trailer Filling
Control Algorithms
3D Camera
Computer vision and
controls algorithms
• User Input
• Visualization
Embedded Platform
MPC5121e
CANActuators
ECUAct
Perceive
Decide
& Plan
Sense
45
Autonomous Trailer Filling
Control AlgorithmsMonitoring
CANEmbedded Coder
3D Camera
Actuators
ECU
• User Input
• Visualization
• Computer
Vision
• Controls
Embedded Platform
MPC5121e
Act
Perceive
Decide
& Plan
Sense
46
How will you put it into production?
Embedded Systems
IT Systems
Desktop Apps
48
49
50
51
How to build an autonomous anything
Focus on Perception
• Data-driven
• Model-driven
• Reduce to actionable data
• Take advantage of Big Data
• Use simulation to supplement available data
• Address the architecture
• Leverage Model-Based Design for embedded
• Automate integration with enterprise IT systems
• Look for autonomy in creative places
• Do more than manually possible
Use the Best Predictors
Get the Right Data
Flow to Production
53
What is your
autonomous anything?