Click to add title

Click to add subtitle

What’s Newin Kinect for Windows v2

Intro

• Presenter: Dwight Goins– dngoins@Hotmail.com– http://dgoins.wordpress.com

• Agenda– Kinect v1 Introduction and Capabilities– Kinect v2 Introduction and Capabilities– Quick Difference Chart– Demos, Demos, Demos– Potential Usage– Call To Action– Q&A

Kinect for Windows v1

• Color Camera• IR Projector• IR Camera• Depth Camera• Tilt Motor• Microphone Array• SDK - Toolkit

Demos

• Body basics• Color basics• Depth• Speech• Interaction Controls

Kinect for Windows v2

• Color Camera• IR Projector• IR Camera• Depth Camera• Microphone Array• SDK

Demos

• Joints• Color• Depth• Audio• Kinect Studio

Feature Comparison ChartFeature K4W K4W v2

Color Camera 640x480 @30 fps 1920 x1080 @30 fps

Depth Camera 320 x 240 512 x 424

Infra-Red (Spreads Dots) Yes No

Infra-Red (TOF) No Yes

Infra-Red Spectrum ~827 - 850nm ~827-850nm

Max Depth Distance ~4.5M ~4.5M

Min Depth Distance 40cm in near mode 50cm – 1cm (near mode)*

Microphone Array 4 mics 4 channels 16bit 16kHz

4 mics 4Channels 32bit 16kHz IEEE Float

* Experimental firmware provided by K4W Team

Feature Comparison ChartFeature K4W K4W v2

Horizontal Field Of View 57 degrees 70 degrees

Vertical Field of View 43 degrees 60 degrees

Tilt Motor Yes No

Body Joints 20 26

Skeletons Tracked 2 6

USB version 2 3.0

Supported OS Win 7, Win 8 Desktop Win 8

Price $299 $199

Types of Applications Desktop, x86, x64, JavaScript, Web

Desktop, x86, x64, Win 8 Store, JavaScript, Web

Programming The Kinect v2

• COM – C++ Powerful• .Net – C#/VB.Net Fast development• WinRT – C#/C++/JavaScript

– Sources and Reader Pattern– Events– Collections

Programming The Kinect v2

• Data Sources– Infrared– Color– Depth– Body Index– Body– Audio

Programming The Kinect v2

• InfraRed – Two forms– Single frame or Long Exposure– Frame data 2 bytes per pixel– 16bit Intensity value

Programming The Kinect v2

• Color– Frames have multiple formats (RGBA, BGRA,

YUY2)– Buffer is array of pixels

• Pixel is multiple bytes per pixel depending on format

Programming The Kinect v2

• Depth– Frames 2 bytes per pixel: 16-bit values are

distance in millimeters

Programming The Kinect v2

• Body Index– Frames 1 byte per pixel

• Index of body as determined by body tracking

Programming The Kinect v2

• Body (Known as Skeleton in v1)– Frame array of Bodies

• More joints

Programming The Kinect v2

• Body (Known as Skeleton in v1)• Hand states (open, closed, “lasso”)• Activities (eye closed, mouth opened, looking

away)• Appearance (wearing glasses)• Level of user engagement• Facial expressions (Happy, neutral)• Lean direction (2D vector, “human joystick”)

Programming The Kinect v2

• Audio– Audio Beaming– Audio Body Correlation

• Which bodies are in the path of a beam

– Raw Frame is 32bit 4 channel IEEE Float per sample

Potential Usage

• Medical – Physical Therapy– Providing Sterile Operating Environments– Aiding Physically Challenged

• Robotics• Marketing – Advertising

– POS, Kiosk

• Conferences

Custom Demos

• Raise Hand Demo – Source Code• Kinect Office Pack Plug-In• Heart Rate Sample

Call To Action

• Kinect For Windows Blog/Forums• Coding For Fun: Kinect• YouTube – Kinect Videos• Kinect Hackathon – June 21-22 in NYC• Kinect Common Bridge v2• Pre-Order Device Now