mg3130 gesture recognition kit

GestIC® TechnologyGesture Recognition Kit

https://www.pantechsolutions.net/gesture

-kit

https://www.pantechsolutions.net/gesture-kit

https://www.pantechsolutions.net/gesture-kit

© 2014 www.pantechsolutions.net All Rights Reserved. Slide 2

Agenda

• Introduction

• MGC3130 System

• Core Features (Colibri Suite)

• Pantech Gesture Kit

• Resources & Summary


more intuitive and fun

gadgetswe love

making the

Applications


Technology Basics –How it works

Utilizes Electrical Near Field (E-field) sensing for advanced proximity sensing

E-Field is generated by electrical charges

Field distortion translated into 3D hand tracking and gestures

Very low power consumption since nearly no energy is transported


No Blind Spots

Detection range

of up to


fast data sampling at 200 Hz

32-bit signal processing unit

mouse-like resolution of 150 dpi

super low noise analog front end

self calibration

70-130 kHz range - no RF interference

frequency hopping against noise

no environmental influences

self wake-up at 150 µW

field upgradable

Colibri Gesture Suite on-chip

Smart Features


Colibri Gesture Suite

wake-up on approach

x/y/z hand position

flick gestures

circle gestures

symbol gestures

Ease of Design

sensor signals

free-space gestures

and x/y/z hand position

intuitive and natural

using Hidden Markov Model

Highestgesture recognition rate


0

200

400

600

800

1000

1200

Battery Efficiency

mW

>

GestIC®

TechnologyOther

45µA to

max 30mA!*

lowest power free-space

of any 3D sensing technology

up to 90% lower than

camera systems

always-on gesture sensing

even for mobile devices


Low Power

9 µA

30 mA

Iavg

curr

ent

Deep Sleep Mode

Self Wake-Up Modeunder self control with presence detection

Processing Mode

under Host control Approach Scan Calibration Approach Scan Calibration Approach Scan full operation

* @ 3.3V, typical

IScan = 45 µA*@ 150 ms

scan

time

10-150ms

2sec-10sec

Note: Not relevant for gesture only apps!

ICalib = 440 µA* @ 10 sec calib (incl. 150 ms Iscan)

IPeak = 30 mA*

Mobile friendly power modesFast wake-up cycle time of < 1 ms

self activation: user approach detection

de-activation: if no user interaction

Approach recognized!

Isleep = 9 µA*


Agenda

• Introduction

• MGC3130 System





Near Field Sensing

Host Controller

MCU/APPS Processor

Electrode

E-Field

MGC3130

Dig

ital

Position Tracking

Gestures

Recognizer

Anal

og

GestIC® Technology

I2C™ Interface

Utilizes electrical near field sensing to sense user‘s action

MGC3130 processes signals into positions and gestures

Host uses the gesture data to control the user interface


MGC3130 System

Main System Building Blocks

MGC3130 Controller

Embedded GestIC® Technology Library / Colibri Suite

External electrodes


MGC3130 System

low noise AFE

5 ch Rx / 1Tx

Storage

32k Flash / 12K RAM

28-pin QFN package

5 x 5 x 0.9 mm

4pin IO

2x I2C™ / SPI

E-field lines

Electrode

Colibri Suite


External Electrodes

Frame shape electrodes

1x Transmitter electrode Tx

4–5x Receiving electrodes Rx

2-Layer stack-up

Optional GND layer

MGC3130 System

South

Wes

t

Eas

t

Center

North

Top Rx Layer

Bottom Tx Layer

Rx

Tx

GND

Isolation

GND

Initially MGC3130 will only support

frame shape electrodes

with an aspect ratio of 1:1 to 1:2.


MGC3130 System

GestIC® Technology LibraryOperational code for MGC3130 SPU

Binary preprogrammed in the chip’s flash memory

Configurable, updatable


Agenda

• Introduction

• MGC3130 System


• Sabrewing Evaluation Kit



Colibri Suite

Data acquisition

Digital signal processing

Interpretation

Included:Signal Validation

Digital filtering

Automatic Frequency Hopping

Calibration

Output of data streams

Output of position / gesture events

Digital Signal Processing

Core Features

Colibri Suite

Position Tracking

Gesture Recognition

Approach Detection

Frequency Hopping CalibrationSignal

Validation

Approach Detection


Hidden Markov Model Gesture Recognition model to detect and classify hand movement patterns performed inside the sensing area. classification based

Gesture Recognition

Gesture begins when:

Entering the active space from outside

Moving after a resting period

Gesture ends when:

Resting within the active space

Leaving active space

Max. gesture duration exceeded

Sen

sor

Sig

nals

Sen

sor

Sig

nals

startstart timetimeendend

Sequence of sensor signals during a fl ickSequence of sensor signals during a fl ick


Position Tracking

Three-dimensional hand position over time and area

Absolutely to the defined origin of the Cartesian coordinate system (x, y, z)

Continuously acquired in parallel to Gesture RecognitionPerformance:

Position rate: 200 positions/sec

Spatial resolution: up to 150 dpi

Parameterization:

Alpha2 release: Sabrewing 7”

Beta releases: Parameters variable to fit to customized electrodes

Position xyzPosition xyz


Approach Detection for Power saving

Average current consumption in a calibration aware Approach Detection Mode is 466 µA at VDD= 3.3V, 20 ms Approach Scans and 10 sec Calibration Scans

Wake-up signal from host detected

Gesture detected(Approach)

No user interaction(Timeout)

t[s]

I

Ids=9uA

Ipeak=30mA

Iavg=50...700uA(*)

Deep sleep Self Wake-Up Self Wake-UpProcessing

Calibration Approach scans

(*) depending on use case

MGC3130 V1.1: 20 mA

466 µA


Dependencies for Custom Designs

Parameterization of AFE & DSP required

- Electrode design rules required

- Development Kit and reference designs required

Analog Front End (AFE) parameterization

DSP parameterization:

Tracking: Beta 1 release (CQ2)

Gestures: Beta 2 release (CQ3)

HMM Trainer: Beta 3 release (CQ4)GestIC Design Guide:

Beta 1 release (CQ2)

Hillstar + Aurea Tooling:

Beta 1 release in (CQ2)


Agenda

• Introduction

• MGC3130 System





MGC3130 Pantech Single Zone Evaluation Kit

Pantech Gesture Kit

1. Microchip MGC3130 MCU

2. Built in 7” electrodes

3. I²C™ to USB bridge (PIC)

4. USB powered

and Microchip Colibri Suite


Electrodes and Usage

Built in 7” electrodes

3 Layer PCB (Rx – Tx - GND)

Parameterization for 45° hand posture

Rx electrode Rx electrode

Tx electrode

45° hand posture

Tx: 35 µm

Rx Electrode: 18 µm

GND: 18 µm

Not Used: 35 µm935

µm

1.54

6 m

m

540

µm


MGC3130 Interface Model

Application Software

e.g. Aurea - GUI for MGC3130 Visualization and Control

GestIC® Technology API

Abstraction layer for MCG3130 messages

Bridge

Optional conversion of HW interfaces (e.g. I²C™ to USB withPIC 18F14K50)

For provisioning of data within the OS an OS driver may be needed

GestIC Technology Library

Operational code for MGC3130 including Colibri Suite

Note: GestIC Technology library streams Position data every 5 ms and Gestures as they occur

MGC3130 Software Interface

Application Host

MGC3130


GestIC® API- Message decoding- Buffering

GestIC® Library

API Structures

Message Interface

Bridge

Application Host

MGC3130


- Message decoding- Buffering

GestIC® Library

Message Interface

I²CUSB

I²C


Aurea Visualization Software

Evaluate Colibri Suite Discover Signals Setup MGC3130

1. Positions Tracking

2. Gesture Recognition

3. Demo applications

1. View signals

2. Write log file

3. Advanced features

1. Signal matching

2. Tx settings

3. Update GestIC Library


Pantech Gesture Start-up

Requirements

1. PC with Windows® XP, Windows 7 or Windows 8 operating system and USB 2.0 port

2. Sabrewing Evaluation Board

3. Latest MGC3130 software release package

• STEP 1: CONNECT

TO PC

• STEP 2: WINDOWS

CDC DRIVER

• STEP 3:START AUREA


Agenda

• Introduction

• MGC3130 System


• Sabrewing Evaluation Kit



Resources

http://www.microchip.com/GestIC


MGC3130 Summary

Thank You


Trademarks

The Microchip name and logo, the Microchip logo, dsPIC, KeeLoq, KeeLoq logo, MPLAB, PIC, PICmicro, PICSTART, PIC32 logo, rfPIC and UNI/O are registered trademarks of Microchip Technology Incorporated in the U.S.A. and other countries.

FilterLab, Hampshire, HI-TECH C, Linear Active Thermistor, MXDEV, MXLAB, SEEVAL and The Embedded Control Solutions Company are registered trademarks of Microchip Technology Incorporated in the U.S.A.

Analog-for-the-Digital Age, Application Maestro, chipKIT, chipKIT logo, CodeGuard, dsPICDEM, dsPICDEM.net, dsPICworks, dsSPEAK, ECAN, ECONOMONITOR, FanSense, HI-TIDE, In‑Circuit Serial Programming, ICSP, Mindi, MiWi, MPASM, MPLAB Certified logo, MPLIB, MPLINK, mTouch, Omniscient Code Generation, PICC, PICC-18, PICDEM, PICDEM.net, PICkit, PICtail, REAL ICE, rfLAB, Select Mode, Total Endurance, TSHARC, UniWinDriver, WiperLock and ZENA are trademarks of Microchip Technology Incorporated in the U.S.A. and other countries.

SQTP is a service mark of Microchip Technology Incorporated in the U.S.A.

All other trademarks mentioned herein are property of their respective companies.

© 2013, Microchip Technology Incorporated, All Rights Reserved.

mg3130 gesture recognition kit

Education

gesture recognition

gesture data

colibri gesture suite

gesture duration

gesture recognitionperformance

resting period gesture

mgc3130 system low noise

electrodes rx