はじめてのkinect for windows v2

68
はじめての Kinect for Windows v2 2014/09/24,26 東京エレクトロンデバイス株式会社主催 Kinect for Windows v2 最新情報セミナー Natural Software 中村 薫

Upload: kaoru-nakamura

Post on 28-Nov-2014

1.665 views

Category:

Technology


2 download

DESCRIPTION

2014/09/24,26に行われた、東京エレクトロンデバイス株式会社主催「Kinect for Windows v2最新情報セミナー」の資料です。 大阪開催時に最初のスライドをいくつか追加しました。

TRANSCRIPT

  • 1. Kinect for Windows v2 2014/09/24,26 Kinect for Windows v2 Natural Software
  • 2. Depth Microsoft MVP for Kinect for Windows [email protected] Copyright 2014 Natural Software.jp All rights reserved. 3
  • 3. Copyright 2014 Natural Software.jp All rights reserved. 4
  • 4. Copyright 2014 Natural Software.jp All rights reserved. 5
  • 5. 1 Copyright 2014 Natural Software All rights reserved.
  • 6. 1 Copyright 2014 Natural Software All rights reserved. Microsoft Intel Apple Google
  • 7. 2 Copyright 2014 Natural Software All rights reserved. Intel RealSense Leap Motion
  • 8. Copyright 2014 Natural Software.jp All rights reserved. 9 Kinectv2 API
  • 9. Kinect for Windows v2 Kinect for Windows v2 Kinect for Windows v1v2 Copyright 2014 Natural Software.jp All rights reserved. 10
  • 10. Copyright 2014 Natural Software.jp All rights reserved. 11
  • 11. KINECTFOR WINDOWS V2 Copyright 2014 Natural Software.jp All rights reserved. 12
  • 12. Kinect for Windows v2 (Color,Depth) () () WinRT,Unity Copyright 2014 Natural Software.jp All rights reserved. 13
  • 13. Kinect for Windows v2 Kinect1PC Copyright 2014 Natural Software.jp All rights reserved. 14
  • 14. Kinect v2 201311 Xbox One(Kinect v2) 201312 Kinect for Windows v2 DeveloperPreview 201407 Kinect for Windows v2 PublicPreview 201409 XboxOne Copyright 2014 Natural Software.jp All rights reserved. 15
  • 15. Kinectfor Windows v2 Xbox OneKinect 20147 () Copyright 2014 Natural Software.jp All rights reserved. http://www.microsoftstore.com/store/msjp/ja_JP/pdp/productID.298959900 16
  • 16. () Copyright 2014 Natural Software.jp All rights reserved. 17
  • 17. http://www.youtube.com/watch?v=624N3-nIieI Copyright 2014 Natural Software.jp All rights reserved.
  • 18. Copyright 2014 Natural Software All rights reserved. http://monoist.atmarkit.co.jp/mn/articles/1310/02/news063_2.html
  • 19. Copyright 2014 Natural Software.jp All rights reserved.
  • 20. http://www.facebook.com/photo.php?fbid=3392874617478 Copyright 2014 Natural Software.jp All rights reserved.
  • 21. Copyright 2014 Natural Software.jp All rights reserved.
  • 22. Copyright 2014 Natural Software.jp All rights reserved. http://www.naturalsoftware.jp/blog/7906
  • 23. Photo by Ben Lorph Kinectx 8 Copyright 2014 Natural Software All rights reserved.
  • 24. KINECT FOR WINDOWS SDKV2 Copyright 2014 Natural Software.jp All rights reserved. 25
  • 25. Kinectfor WindowsSDK v2 201312DeveloperPreview 201407PublicPreview1407 201408PublicPreview1408 201409PublicPreview1409 Kinect for Windows Dev Center Kinect for Windows SDK 2.0 Public Preview Copyright 2014 Natural Software.jp All rights reserved. 26
  • 26. Kinect Copyright 2014 Natural Software.jp All rights reserved. Kinectfor Windows v2 Depth() () Kinect for Windows SDK v2 Kinect 27
  • 27. Kinect for Windows SDKv2 Color: Depth Body:() Copyright 2014 Natural Software.jp All rights reserved. Audio: Infrared: PlayerIndex: 28
  • 28. Kinect for Windows SDKv2 Control: (NUI) Fusion: 3 Face: () Copyright 2014 Natural Software.jp All rights reserved. HDFace: (3D) Speech: Gesture: 29
  • 29. Kinect for Windows SDKv2 KinectStudio: Kinect Visual Gesture Builder: Copyright 2014 Natural Software.jp All rights reserved. Kinect v2 Configuration Verifier: 30
  • 30. Kinectfor WindowsSDK v2 Copyright 2014 Natural Software.jp All rights reserved. 31 http://www.youtube.com/watch?v=Hi5kMNfgDS4
  • 31. KINECT FOR WINDOWS V2 Copyright 2014 Natural Software.jp All rights reserved. 32
  • 32. OS(*) Windows8(x64) Windows8.1(x64) Windows Embedded 8(x64) Windows Embedded 8.1(x64) CPU Corei7 3.1GHz64bitCPU 4GB USB(*) USB3.0 USB(*) IntelRenesas (*) DirectX11 Copyright 2014 Natural Software.jp All rights reserved. 33 *:
  • 33. KinectforWindows v2(1) Copyright 2014 Natural Software.jp All rights reserved. Color 1920x1080 Depth 512x424 Depth TOF(Time of Fright) Depth 500mm-8000() 500mm-4500mm(Body) 70 60 34
  • 34. KinectforWindows v2(2) Copyright 2014 Natural Software.jp All rights reserved. 6 6 25/ 35
  • 35. KinectforWindows v2(3) Copyright 2014 Natural Software.jp All rights reserved. 4() () 36
  • 36. KinectforWindows v2(4) Copyright 2014 Natural Software.jp All rights reserved. USB USB 3.0 1PCKinect 1PC 37
  • 37. Visual Studio 2012(Express) (C++) (.NET:C#VB) WinRT(WindowsC# HTML&JavaScript) Unity(ProC#) Copyright 2014 Natural Software.jp All rights reserved. 38
  • 38. WinRT Unity Control Fusion Face HD Face Speech Gesture Copyright 2014 Natural Software.jp All rights reserved. Color,Depth,Infrared,BodyIndex,Body,Audio 39
  • 39. KINECT FORWINDOWS V1V2 Copyright 2014 Natural Software.jp All rights reserved. 40
  • 40. Copyright 2014 Natural Software.jp All rights reserved. Kinect v1 Kinectv2 Color 640x480,1280x960 1920x1080 Color 30FPS,12FPS 30FPS,15FPS() Depth 80x69,320x240,630x480 512x424 Depth 30FPS 30FPS Depth LightCoding TOF(Time of Fright) Depth 800mm-4000mm(Default) 400mm-3500mm(Near) 400mm-10000mm(Extend) 500mm-8000mm 57 70 43(27:) 60 41
  • 41. Copyright 2014 Natural Software.jp All rights reserved. Kinect v1 Kinectv2 6 6 800mm-4000mm(Default) 400mm-3500mm(Near) 500mm-4500mm 2 6 20/ 25/ () (Kinect Interaction) () 42
  • 42. Copyright 2014 Natural Software.jp All rights reserved. Kinect v1 Kinectv2 (Kinect Interaction:) 4() 4() API 43
  • 43. Copyright 2014 Natural Software.jp All rights reserved. Kinect v1 Kinectv2 USB USB 2.0 USB 3.0 1PCKinect 4 1 1PC 44
  • 44. KINECT FORWINDOWS V1V2 Copyright 2014 Natural Software.jp All rights reserved. 45
  • 45. Depth Copyright 2014 Natural Software.jp All rights reserved. Kinectv1 Kinectv2 Kinectv2API 46
  • 46. Depth(v1:Light Coding) Copyright 2014 Natural Software.jp All rights reserved. 47
  • 47. Kinect v2 Depth(v2:ToF) Copyright 2014 Natural Software.jp All rights reserved. 48
  • 48. Copyright 2014 Natural Software.jp All rights reserved. 49
  • 49. Copyright 2014 Natural Software.jp All rights reserved. Kinectv1: 20/ Kinectv2: 25/ 50
  • 50. Copyright 2014 Natural Software.jp All rights reserved. 51
  • 51. Copyright 2014 Natural Software.jp All rights reserved. http://www.innovotion.co.jp/blog/2013/11/27/22/ 52
  • 52. Copyright 2014 Natural Software.jp All rights reserved. http://www.innovotion.co.jp/blog/2013/11/27/22/ 53
  • 53. KINECT FOR WINDOWS SDK Copyright 2014 Natural Software.jp All rights reserved. 54
  • 54. () Microsoft.Kinect.dll Control Microsoft.Kinect.Wpf.Controls.dll Fusion Microsoft.Kinect.Fusion.dll Face Microsoft.Kinect.Face.dll HD Face Microsoft.Kinect.Face.dll Speech SpeechSDK Gesture Microsoft.Kinect.VisualGestureBuilder.dll Copyright 2014 Natural Software.jp All rights reserved. Color,Depth,Infrared,BodyIndex,Body,Audio 55
  • 55. () Kinect20.lib Control Fusion Kinect20.Fusion.lib Face Kinect20.Face.lib HD Face Kinect20.Face.lib Speech SpeechSDK Gesture Kinect20.VisualGestureBuilder.lib Copyright 2014 Natural Software.jp All rights reserved. Color,Depth,Infrared,BodyIndex,Body,Audio 56
  • 56. (WinRT) WindowsPreview.Kinect Control Microsoft.Kinect.Toolkit.Input Microsoft.Kinect.Xaml.Controls Fusion Microsoft.Kinect.Fusion Face Microsoft.Kinect.Face HD Face Microsoft.Kinect.Face Speech Gesture Microsoft.Kinect.VisualGestureBuilder Copyright 2014 Natural Software.jp All rights reserved. Color,Depth,Infrared,BodyIndex,Body,Audio 57
  • 57. (Unity) Unity K4W_Unity_XXXX_1(ProOnly).unitypackage Copyright 2014 Natural Software.jp All rights reserved. 58
  • 58. Kinect for Windows SDK v1() ColorImageStream RGB IR DepthImageStream Depth PlayerIndex SkeletonStream Copyright 2014 Natural Software.jp All rights reserved. 59
  • 59. Kinect for Windows SDK v2 ColorFrameReader DepthFrameReader InfraredFrameReader BodyIndexFrameReader BodyFrameReader LongExposureInfraredFrameReader AudioBeamFrameReader MultiSourceFrameReader Copyright 2014 Natural Software.jp All rights reserved. 60
  • 60. DepthPlayerIndex(BodyIndex) V1DepthPlayerIndex ColorIR V1ColorIR(PrimeSense ?) AudioBeamBodyIndex Copyright 2014 Natural Software.jp All rights reserved. 61
  • 61. Sensor Source Reader Frame Data Copyright 2014 Natural Software.jp All rights reserved. 62
  • 62. () void Initialize() { // Kinect kinect= KinectSensor.GetDefault(); kinect.Open(); // colorFrameReader= kinect.ColorFrameSource.OpenReader(); colorFrameReader.FrameArrived+= colorFrameReader_FrameArrived; } Copyright 2014 Natural Software.jp All rights reserved. 63
  • 63. () void colorFrameReader_FrameArrived( object sender, ColorFrameArrivedEventArgse ) { // using ( varcolorFrame= e.FrameReference.AcquireFrame() ) { if ( colorFrame== null ) { return; } // BGRA colorFrame.CopyConvertedFrameDataToArray(colorBuffer, ColorImageFormat.Bgra); // ... } } Copyright 2014 Natural Software.jp All rights reserved. 64
  • 64. Copyright 2014 Natural Software.jp All rights reserved. 65
  • 65. Kinect v2 (Color,Depth) () () WinRT,Unity Copyright 2014 Natural Software.jp All rights reserved. 66
  • 66. (MVP for Kinect) http://www.naturalsoftware.jp/ (MVP for Kinect) http://unanancyowen.com/ http://www.buildinsider.net/small/kinectv2cpp (MVP for Visual Basic) http://www.buildinsider.net/small/kinect2dp Copyright 2014 Natural Software.jp All rights reserved. 67
  • 67. Kinect for Windows (Facebook) https://www.facebook.com/groups/320184018036066/ Tokyo MotionControlNetwork(Facebook) https://www.facebook.com/TokyoMotioncontrolNetwork TMCN forum(Facebook) https://www.facebook.com/groups/271384549699385/ Copyright 2014 Natural Software.jp All rights reserved. 68
  • 68. www.naturalsoftware.jp Copyright 2014 Natural Software.jp All rights reserved. 69