towards solving real-world vision problems with rgb-d cameras

Download Towards Solving Real-World Vision Problems with RGB-D Cameras

Post on 25-Feb-2016




2 download

Embed Size (px)


CPVR 2013 Tutorial. Towards Solving Real-World Vision Problems with RGB-D Cameras. Kinect for Windows SDK+Toolkit Alisson Sol Microsoft. Before I Forget…. Lots of people helped to create the content for this presentation… Not only from K4W, but also DPE, Xbox, MSR, etc. - PowerPoint PPT Presentation


CVPR 2013

Towards Solving Real-World Vision Problems with RGB-D CamerasKinect for Windows SDK+ToolkitAlisson SolMicrosoftCPVR 2013 Tutorial

Before I ForgetLots of people helped to create the content for this presentationNot only from K4W, but also DPE, Xbox, MSR, etc.Kinect for Windows releases1.0: Feb/01/20121.5: May/21/20121.6: Oct/04/20121.7: Mar/18/2013Future1.X investmentNew sensorBuild 2013 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.6/24/20133Environment DifferencesXboxKnown CPU: PPCKnown bus1 device per machineOnly 1 supportedKnown architectureKnown GPUSelected audienceMainly gamesWindowsIntel, AMD, USB 2.0+Multiple devices1 per USB controllerWin32, x64V1: no GPU requirementGeneral audienceUnbounded scenariosK4W SDK Block DiagramNativeManagedApplicationsToolkitDriversRuntimeSkeletal TrackingKINECT SENSOR

IR EmitterColor SensorIR Depth SensorTilt MotorMicrophone ArrayDrivers

RuntimeSensor discovery, initialization and notificationFrame delivery supports event-based notification and polling modelsEmphasis on low-latency, low per-frame allocationsSupports virtual sensors, including test tools and Kinect Studio

Note: Virtual Sensors still require a physical sensor for business reasons at this time8

Skeletal Tracking - OutputKinectSensor kinect = null;

void StartKinectST(){ kinect = KinectSensor.KinectSensors.FirstOrDefault(s => s.Status == KinectStatus.Connected); // Get first Kinect Sensor kinect.SkeletonStream.Enable(); // Enable skeletal tracking

skeletonData = new Skeleton[kinect.SkeletonStream.FrameSkeletonArrayLength]; // Allocate ST data

kinect.SkeletonFrameReady += new EventHandler(kinect_SkeletonFrameReady); // Get Ready for Skeleton Ready Events kinect.Start(); // Start Kinect sensor}private void kinect_SkeletonFrameReady(object sender, SkeletonFrameReadyEventArgs e){ using (SkeletonFrame skeletonFrame = e.OpenSkeletonFrame()) // Open the Skeleton frame { if (skeletonFrame != null && this.skeletonData != null) // check that a frame is available { skeletonFrame.CopySkeletonDataTo(this.skeletonData); // get the skeletal in this frame ... HANDLE SKELETAL DATA HERE ... } }}

Questions?K4W linksDownload the SDK & Toolkit support forums support and repair online


View more >