External Use

TM

IoT sensors design trend for

wearable system

Sep. 2015

Eric Wu | Sr. FAE

TM

External Use 1

Agenda

• Sensor application type

• Wearable system & Applications

• MEMS devices and application

• Summary

TM

External Use 2

Sensor application type

TM

External Use 3

Types of Sensor Applications

• Real time output

• Data logging

• Event trigger

TM

External Use 4

Real Time Output

• Sample, filter and report

• Typical applications

− Measuring instruments (including

artificial horizon)

− Pointing user interfaces

− Dead reckoning

• Careabouts

− Balance between accuracy

(specifics application dependent)

and power consumption

− Sometimes more than 1 sensor

− Sometimes filtering is required

TM

External Use 5

Data Logging

• Sample, store, transmit

− Store and sends sensor data along

with a time stamp to off-chip

− Sometimes data is processed and

only higher level info is logged

• Typical applications

− Asset tracking

− Safe driving tracker

− Exercise/fitness bands

− Industrial process monitor

• Careabouts

− Active or standby power (sampling

frequency dependent)

− Sampling control/timestamp

TM

External Use 6

Event Triggers

• Level trigger

− Simple: provided in hardware

− Vulnerable to offset drift

− Usually applied to filtered data

• Event trigger

− Recognize a signature over time

Time domain signature, e.g. footstep,

gesture, pulse, breath

Frequency domain (statistical)

signature, e.g. prognostics

− Sensor Data Analytics and

Context Aware

• Trigger accuracy

− False negative

− False positive

TM

External Use 7

4.6BILLIONOWN A

TOOTHBRUSH

24.0BILLIONUNMANNED

INTERNET

DEVICES7.3BILLIONUSE A

CELL PHONE,

TABLET

OR PC

2025 – Huge Growth Ahead: The Internet of Things

Number of sensors at work

• 5 sensors typically for connected

devices in 2015

• Predicted to be 20 sensors in 2025

• 480 billion/half a trillion sensors

2015 20252013

TM

External Use 8

25BILLION

* Sources: Ericsson, February 2011; Cisco Internet Business Solutions Group (IBSG), April 2011

The Internet of Things is Driving

In Connected Devices

Explosive Growth50

BILLION

World Population

2003 2010 2015 20202008

<1x 2x 3.5x 6.5x 1x # ConnectedDevices/Person

12.5BILLION

7.2B6.8B

6.5B6.3B

7.6B

2025

4 to 5 Sensors per

connected Device

10 to 20 Sensors per

connected Device

TM

External Use 9

INTERNET OF THINGSDifferent Services,

Different TechnologiesDifferent Meanings for Everyone

Miniaturization & advances in packaging technologies

Advances in flash

New class of powerfulbut low-cost & low-power MCUs

Cloud-based services

And the Word

“SMART”Is Everywhere!

TM

External Use 10

Wearable system & Applications

TM

External Use 11

What Is A Wearable Device?

• Products that enhance the user’s experience as a result

of the product being worn through sensing, connectivity

and processing of data

Key Market Trends

for Wearables:

• Miniaturization

• Low power

• Connectivity

• Multiple sensors

TM

External Use 12

Wearable Blocks

Manage Power

PMIC

Battery

Battery charging

Connect

Wi-Fi

Bluetooth

Bluetooth LE

NFC

ANT+

USB

Sense & Store

Sensors

GPS

External Memory

Internal Memory

Compute

CPU

HW

Accel.

Display

Display Glass

Display drivers

Interface

Buttons and Dials

I/O

Touch and Proximity

Audio In/Out

Image and Voice

Recog.

TM

External Use 13

Wearable functional diagram

Freescale

Technology

Optional

Main Processor

(MCU/MPU)

USB

Mini-AB

Power Management

(Batt. Charge)

Battery

BLE Wi-FiBluetooth

GPS

Ext.

FLASH

Display

Piezo

Vibe

Audio

Codec

I2C

USB

I2SCo-Processor

MCU

Sensor

Fusion

UART

SPI

Ext.

SRAM

Ext.

Bus

I2C(s)

UART SDIO

UART

SPI

Timer

USB

Timer

Ext.

Bus

SPI

Ext.

Bus I2C

I2C

Or

Analog

3-axis

Magnetometer

3-axis

Accelerometer

3-axis

Gyro

Pressure

Sensor

Sensor Fusion

TM

External Use 14

Wearable Market: Segmentation

Vertical Categories

Fitness &

Wellness

Sports & Heart Rate Monitors

Pedometers, Activity Monitors

Smart Sport Glasses

Smart Clothing

Sleep Monitors

Emotional Measurements

Healthcare &

Medical

CGM (Continuous Glucose Monitoring )

ECG Monitoring

Pulse Oximetry

Blood Pressure Monitors

Drug Delivery (Insulin Pumps)

Wearable Patches (ECG, HRM, SpO2)

Infotainment

Smart Watches

Augmented Reality Headsets

Smart Glasses

Wearable Imaging Devices

Industrial &

Military

Hand-worn Terminals

Augmented Reality Headsets

Smart Clothing

TM

External Use 1515

Wearable Market: Diverse Usage Models

TM

External Use 16

Application Example: Smart Fitness Coach

TM

External Use 17

Wearables is Not Just Smart Watches…

Wearable Ring

Scanner

Headset Running

Voice Recognition

Nymi, Heart-rate Based

Password Authentication

Kiwi Wearables –

Personal Tracker

Fitness/

Activity Monitors

Smart Glasses

Virtual Reality

HeadsetHeadset

Computer

Angel – first open

sensor for health and

fitness

Bone Conduction

Bluetooth headset cap

TM

External Use 18

Wearable in Military

TM

External Use 19

Wearable airbag for rider

„Invisible Helmet“

Airbag helmet to protect the neck

with sensors located under the seat

TM

External Use 20

Wearable airbag for workman

TM

External Use 21

Wearable airbag for Healthcare

TM

External Use 22

MMA9555 Ref Design in Wearable Device

• Ref Design with main Bluetooth chipset vendors such as

Broadcom on wearable reference design

− SMART RING (BCM20736S + MMA9555)

• Power consumption optimized from system design

• Promote jointly with Broadcom

TM

External Use 23

Wearable/Active Lifestyle: Freescale Sensors Proposal

What is this?

• Related to ubiquitous computing, wearable sensor

technology share the vision of interweaving

technology into the everyday life.

Variants

• Altimeter, GPS

• Gaming

• Pedometer—running style, how much shock, pace etc.

• Black box for GoPro type devices

• Concussion monitoring

• Augmented reality headsets

• Wearable computing

• Smart clothing

• Smart watches

TM

External Use 24

Wearable/Active Lifestyle: Freescale Sensors Proposal

Enabled by Freescale Accelerometers, Gyroscopes, Sensing Platforms, Magnetic

Sensors and Touch Sensors

• MMA9555 is the intelligent pedometer platform

• FXLC95000 as a sensor hub and datalogger

• MAG3110 and MMA8491 combined in the FXOS8700, for orientation, motion,

vibration, shock, fall, g-force, etc. are present

• MPL3115A digital pressure

sensor for altimetry

• FXAS21002 gyroscope

provides the stability

needed for a drift free

readings; when talking

accelerometer think gyroscope too…

TM

External Use 25

MEMS devices and application

TM

External Use 26

Pressure/Altimetry Smart Sensing Sensor Fusion

GyroscopeMagnetometerAccelerometer

From Simple Function to Smart Sensing www.freescale.com/sensors

Mobile&

Entertainment

Medical & Health Appliance Industry

Automation

Automotive

TM

External Use 27

Sensor Type: Accelerometers

• Acceleration sensors detect changes in force resulting from tilt, motion,

positioning, shock, and vibration.

• Capable of single, dual, or triple axis sensing capability with range from

1.5g to 250g.

• Devices are system-in-a-package (two chip) solutions comprised of:

- g-cell: Surface micromachined (MEMS) capacitive sensing cells modeled as a

set of beams attached to a central mass that moves between fixed beams.

- Control IC: Measures g-cell capacitance and extracts acceleration data,

provides amplification, signal conditioning, low pass filtering and temperature

compensation.

TM

External Use 28

Sensor Type: Gyroscope

• Gyroscopes are used for measuring angular rate, measured in deg/s

• They enable both user interface and image stabilization applications

• TAM by 2015 is expected to be $800M+

• When you see an accelerometer opportunity, think gyroscope too!

TM

External Use 29

Sensor Type: Magnetometer

• Magnetometer: An instrument for measuring the magnitude and

direction of a magnetic field.

• When combined with an accelerometer to compensate the tilt, it

is primarily used as an eCompass. It allows map alignment while

moving.

TM

External Use 30

Devices are composed of single silicon, piezoresistive devices capable of monitoring processes in the industrial, medical, automotive, and avionics industries. Pressure sensors are composed of the following reference designs:

− Differential: difference in pressure between two points is measured as pressure is applied to both sides of the die/sensing element

− Gauge: bottom side is exposed to the atmosphere, while pressure is applied to top of die

− Absolute: pressure is applied to the top of the die while the bottom of the die is a vacuum-sealed reference

Sensor Type: Pressure Sensors

TM

External Use 31

Sensor Strengths & Weaknesses

Sensor Strengths Weaknesses

Accelerometer

• Inexpensive

• Extremely low power

• Very linear

• Very low noise

• Measures the difference of gravity

and acceleration. We need them

separate.

Magnetometer

• The only sensor that can orient

itself with regard to “North”

• Insensitive to linear acceleration

• Subject to magnetic interference

• Not “spatially constant”

Gyro

• Independent of linear acceleration

• Can be used to “gyro-compensate”

the magnetometer

• Power hog

• Long startup time

• Zero rate offset drifts over time

Pressure Sensor

• The only stand-alone sensor that

can give an indication of altitude

• A “relative” measurement

• Subject to many interferences and

environmental factors

TM

External Use 32

What is Sensor Fusion

Sensor fusion encompasses a variety of

techniques:

• Trade off strengths and weaknesses of

the various sensors to compute

something more than can be calculated

using the individual components;

• Improve the quality and noise level of

computed results by taking advantage of:

− Known data redundancies between

sensors

− Knowledge of system transfer functions,

dynamics and/or kinematics

TM

External Use 33

• Tangential and Centripetal

acceleration

• Angular velocity

• Magnetic field change

• Camera scenery (interest

points) move

• GPS heading (when there is

sufficient linear movement)

Using More than One Sensor a.k.a. Sensor Fusion

• Different (types of) sensors

have different noise and error

sources

• Sensor fusion uses redundant

information to improve

measurement

− 6-axis (A+G, A+M)

− 9-axis (A+G+M)

− 10-axis (A+G+M+P)

TM

External Use 34

Typical “Minimum” Sensor Complements / Application

Application Acc Mag Gyro Pressure

Portrait/landscape, tap detect, fall

detection

X

Pedometry, vibration analysis, tiltmeter X

eCompass, pointing/remote control,

augmented/virtual reality

X X

Virtual gyro X X

Gyro-compensated eCompass X X X

Activity monitors X X

X X

Motion capture X X X

3D mapping & localization X X X X

Image stabilization, gesture recognition X X

TM

External Use 35

ISF 2.1 for Kinetis MCUs

Differentiating Points

− Sensor application code auto-generation using Processor

Expert technology

− Deployable across entire line of Freedom development

platforms

− Sensor Fusion library has been integrated as an “Orientation”

sensor

− Register Level Interface allows low-level access to sensor

registers

Product Features

− Projects available for FRDM-KL25Z, FRDM-K22F and FRDM-

K64F

− Supports a broad set of Freescale sensors including

MMA8652/8653, MAG3110, FXOS8700, FXAS21002,

FXLS8471, MPL3115 and others

− Example projects available for both CodeWarrior 10.6 and

Kinetis Design Studio 2.0 Integrated Development

Environments

ISF 2.1 for Kinetis MCUs allows you to write an embedded sensor application in less than 30

minutes without writing a single line of code using Processor Expert technology

ISF 2.1 for Kinetis MCUs allows you to write an embedded sensor application in less than 30

minutes without writing a single line of code using Processor Expert technology

Applications

− Sensor Data Analytics

− Internet of Things

− Consumer Electronics

− Wearable Electronics

− Medical Devices

TM

External Use 36

Intelligent Sensing Framework (ISF)

High-level code

Low-level code

Reuse this stuff

over and over

Defined Interface

Application

Code

ISF accelerates embedded software engineering efforts to

integrate sensors into FXLC95000 and Kinetis MCUs

Applications specific code

TM

External Use 37

Freescale Sensor Fusion Library

Product Features

• Functionality

• 3-axis, 2-axis heading, 6-axis

eCompass,6-axis indirect Kalman

filter, 3-axis relative rotation, and 9-

axis indirect Kalman filter

• Programmable sampling, fusion

rates, and frame of reference,

• Included projects

• Kinetis K20, KL25Z, KL26Z, KL46Z,

and K64F Freedom boards

• Use of Freescale Multi sensor

boards

• CodeWarrior and Kinetis Design

Studio

• Additional commercial support and

services available

Full featured sensor fusion library, including the award winning e-compass software

Fully open source, eliminating proprietary constraints, increasing flexibility, and decreasing time-to-market

$

Learn more by searching sensor fusion

So

ftw

are

an

d H

ard

wa

re

Eva

lua

tio

n &

De

v T

oo

ls

Sta

cks

(TC

P/IP

, U

SB

)

Mid

dle

wa

re

Operating

System

Bootloader

Ap

pli

ca

tio

n

Sp

ecif

ic

BSP, Drivers &

HAL

Libraries(DSP, Math,

Encryption)

MCU Hardware

Customer Application

TM

External Use 38

Key Development Tools

FRDM-STBC-AGM01 FRDM-FXS-MULT2-B

Part Number Freescale DevicesOnline

AvailabilityPrice Comments

BRKT-STBC-AGM01 FXAS21002, FXOS8700 NOW $11.95 Breakout board with access to all I/O

FRDM-STBC-AGM01 FXAS21002, FXOS8700 NOW $15.95

Sensor Shield Board. Pairs with a variety

of Kinetis MCU boards including KL25Z,

KL26Z, K22F, K64F

FRDM-K64F-AGM01FXAS21002, FXOS8700,

FRDM-K64FNOW $52.95 Sensor Shield + MCU sold as a single kit

FRDM-FXS-MULTI-B

FRDM-FXS-MULT2-B

FXAS2100x, FXOS8700,

MPL3115, MAG3110,

MMA955x, MMA8652,

FXLS8471

MULT2-B

available

May 2015

$99.00

Sensor shield board with Bluetooth.

MULT2-B updates gyro from pre-

production version (FXAS21000) to

released version (FXAS21002)

BRKT-STBC-AGM01 FRDM-K64F-AGM01

TM

External Use 39

Freescale opty for Airbag Wearable system

• Provide MCU + 6-axis or 9 axis sensor fusion solutions

TM

External Use 40

Sport/Smart Band mainly control by Freescale Sensors, MCUs, battery charging,

wireless charging…

Bluetooth

(BlueRadios nBlue BR-

LE4.0-D2A)

Android or iOS

Pedometer eCompassTemp.

Kinetis MCU M0+

FRDM-FXS-MULTI-B + FRDM-KL25Z

(81 mm x 53 mm)

Wireless Charger

(5W TX&RX)

Pressure

MC34673 Li-Ion Charger

Sensor (MMA9553, MPL3115, FXOS8700, FXAS21002, MAG3110)

Gryo Mag

TM

External Use 41

Sensors and the Wearable/IoT: Limitless Opportunities

Serving150+ different

applications per year

TM

External Use 42

SummaryMEMS sensors continue to proliferate rapidly

More diverse markets are being served

More complete solution =

Sensor + Connecitivty + Processing

Continuing innovation: Freescale

has been leading sensor innovation

for almost 35 years

TM

© 2014 Freescale Semiconductor, Inc. | External Use

www.Freescale.com