itcamp 2013 - tim huckaby - the engaging user experience & natural user interface
TRANSCRIPT
![Page 1: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/1.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
The Engaging User Experience& The Natural User Interface
Tim HuckabyInterKnowlogy Chairman/Founder
Actus Interactive Software Founder & CEO
Microsoft® Regional Director – Southern California
Microsoft® MVP – Kinect for Windows
E-mail: [email protected]@Actus-Software.com
Blog:team.interknowlogy.com/blogs/timhuckaby
FaceBook:www.facebook.com/Tim.Huckaby.Carlsbad
LinkedIn: www.linkedin.com/in/timhuckaby
Twitter: @TimHuckaby
![Page 2: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/2.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteHuge thanks to our sponsors!
![Page 3: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/3.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
Keynote
A little bit about me and why I am here…
The Engaging User Experience & the Natural User Interface
![Page 4: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/4.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteAbout Tim, InterKnowlogy & Actus…
InterKnowlogy (www.InterKnowlogy.com)
Tim Huckaby, Founder/Chairman ([email protected])
◦ 13+ year old services firm – Custom Application Development
◦ focused on building NUI solutions
◦ Web, mobile, and desktop
◦ Windows 7/8, PixelSense, WP7/8, Azure, Kinect, XAML stack
- Largest Client: Microsoft
Actus Interactive Software (www.Actus-Software.com)
Tim Huckaby, Founder/CEO ([email protected])
◦ Software Product Company
◦ Interactive Kiosk and Active Digital Signage
◦ Multi-Touch, Gesture, and Voice Driven Solutions
![Page 5: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/5.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
NUI enabled applications improve the communication, education and user experience across the software continuum.
Objectives And Agenda
There are a number of tenants of an engaging user interface that will last the test of time
The 4 Manifestations of NUI: Multi-Touch, Vocal, Gesture, Neural
Where We have Been and Where we are Going
Demos, Demos, Demos….
The Natural User Interface (NUI)
![Page 6: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/6.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
The Tenants of an Engaging UX
Use the Power of Faces – People love faces; We see faces where they don’t exist
– We have DNA with the sole purpose of recognizing faces
– Take advantage of this by putting faces on your App
• Have the faces to look at important part of your App
• People instinctively follow the eyes of the face.
Use Food, Sex and Danger– When someone sees something new, they place it into one of four
categories:
1. Can I Eat it?
2. Can it Eat Me?
3. Can I Mate with it?
4. …and everything else.
• If you want your App to be engaged and interesting, put it in one of the first three categories.
![Page 7: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/7.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
![Page 8: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/8.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
The Tenants of an Engaging UXTell a story
– We learn through stories. It’s how we teach our children. It’s the Bible; It’s what we see in movies.
– Stories are a big part of how information is conveyed to us. – If you have information to give to the user, put it in story form. – It doesn’t matter what medium you use (words, pictures, music), but
using a story narrative will help your user understand and retain your information.
Build commitment over time
– Let the user choose how they want to interact with you (RSS, Twitter, Facebook)
– Make sure that you don’t take advantage of the trust that is implicit in that interaction.
Use Natural Interactions of Objects
– Natural Movements– Fluidity– Animate / Exaggerate: Slow things down so the eye can follow
![Page 9: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/9.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
![Page 10: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/10.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
![Page 11: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/11.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
January 27, 2010
![Page 12: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/12.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
![Page 13: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/13.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteThe “Cancer App” & The “Autocad App”
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 14: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/14.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteEMN8
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 15: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/15.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
The “Green Screen”
We have come a long way…
![Page 16: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/16.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
Image Courtesy of Computer History Museum
![Page 17: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/17.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteTouch Capable Computing Devices Are Not New
Past
1972: PLATO IV Touch Screen Terminal
The Samsung SUR40 for Microsoft PixelSense
Windows 8 - Metro
Apple iPad
Present Future (now)
![Page 18: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/18.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteWhat is Relatively New is:
– Inexpensive Touch Capable, Non Proprietary Hardware
– A Operating Systems designed for Multi-Touch
– A Consistent Multi-Touch API for the major Hardware/Software Platforms
– Developer Productivity in Touch Capable Apps
– The Forecast of Multi-Touch Hardware Capability in Every New Computing Device in the Short Term
![Page 19: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/19.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
NUI: The Natural User Interface
Multi-Touch Capable•Common Gestures of Touch•Physical Object Interaction•Virtual Object Interaction
Gesture Capable•Motion Based Interface•Tracking of full-body movement, facial expression, and voice with precision
Voice Capable•Multi-array Microphone•Uniquely Distinguish Audio & Voices
Nueral Capable•Conscious and non-conscience interfaces•Non Invasive
![Page 20: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/20.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteGrey’s Anatomy
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 21: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/21.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteGesture Heart
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 22: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/22.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
HTML 5 Touch Events, Version 1W3C Working Draft 24 January 2013
Source: https://dvcs.w3.org/hg/webevents/raw-file/tip/touchevents.html
Defines a set of low-level events that represent one or more points of contact with a touch-sensitive surface
Changes of those points with respect to the surface and any DOM elements displayed upon it (e.g. for touch screens) or associated with it (e.g. for drawing tablets without displays).
Addresses pen-tablet devices, such as drawing tablets, with consideration toward stylus capabilities.
“This specification is the 24 January 2013 Last Call Working Draft. The comment period for this Last Call Working Draft ends 14 February 2013.”
![Page 23: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/23.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
Keynote
![Page 24: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/24.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
![Page 25: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/25.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteDemocratic National Convention Voting App
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 26: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/26.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteWhat is also Relatively New:User Experience with Naturally Behaving Objects
– Large Form Factors demand natural behaviors
– The User Experience is “never done”
– It can always be improved
– Tablet Computing paved the way
– Software Physics Engines are readily available in open source
![Page 27: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/27.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteFluid Layout & Pixelsence Craps
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 28: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/28.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
“Game-ification” CultureUser Experiences that Enhance Learning
Learning made Fun / EntertainingProven as a learning tool beyond just ChildrenComputer based Games are a significant part of popular cultureEducational Video Game Curriculums
– MIT, UC Irvine, Minnesota, Michigan State, etc.
![Page 29: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/29.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteNASA Marsbound
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 30: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/30.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteKinect for Windows
World's Fastest-Selling Consumer Electronics Device
… a Future Beyond Gaming
Combination of RGB camera, depth sensor and multi-array microphone– RGB camera delivers three basic color components
– Depth sensors “sees” in 3-D
– Microphone locates voices by sound and excludes ambient noise
Consumer Priced: $249.99
Tracks full-body movement, facial expression, and voice with precision
Kinect sensor bar scans and monitors 1 million points on the body
Kinect for Windows SDK– Skeletal Tracking
– Face, Gesture Recognition
– Audio Echo cancellation
– Audio Beam Forming
– Speech Recognition
– Machine Learning
![Page 31: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/31.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteActus Interactive Digital Content System (Kiosk), IK Physical Therapy, IK Touch-less Operating Room
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 32: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/32.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
Keynote3D Modeler
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 33: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/33.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteKinect for Windows Competitors
Leap Motion– $70– https://leapmotion.com– Not available yet
SoftKinetic– http://www.softkinetic.com– $249– Distance and Near Mode– Multiple Products– In the space for over a decade
Panasonic– Works outside in broad daylight– $2,600
![Page 34: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/34.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteNeural Interfaces:Conscious and Non-Conscious
High fidelity EG acquisition device
No conductive gel, etc.
Non-invasive
Use Case Examples:• Conscious: mind manipulation of objects
• Non-Conscious: Ranking music
• First target market: gaming
• $300!!!
![Page 35: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/35.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteEmotiv
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 36: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/36.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteWe are within a decade of building the Holodeck“The Ultimate NUI Application”
![Page 37: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/37.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
KeynoteHoloDesk - Direct 3D Interactions with a
Situated See-Through Display
Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP
![Page 38: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/38.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
Summary
We are at the cusp of a revolution in software & hardware
Using Natural User Interface (NUI) technologies improve the User
Experience
The hardware, tools, plumbing and platforms for NUI computing are
powerful and available now.…and will just continue to get better, cheaper, powerful and
more available
Within a realistic time frame NUI computing will be the norm
The concepts of NUI change the way we design and build software
There are a number of design tenants that can enhance User Experience
![Page 39: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/39.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
More info on InterKnowlogy:
www.InterKnowlogy.com www.vimeo.com/InterKnowlogy
More info on Actus Software:
◦www.Actus-Software.comAbout Tim Huckaby…
◦Founder/Chairman, InterKnowlogy
◦Founder/Chairman, Actus Software
◦Microsoft® Regional Director – Southern California
◦Microsoft® .NET Partner Advisory Council Founder / Member
◦Microsoft® MVP – Kinect for Windows
◦INETA Speaker – International .NET Users Group Association
◦Board Member: Association for Competitive Technology
◦Board Member: Microsoft Healthcare Partner Advisory Board
◦Author / Speaker
Contact me:E-mail:
[email protected]@Actus-Software.com
Phone: • Office: 760-444-8640• Mobile:: 619 990 9200
Blog:http://team.interknowlogy.com/blogs/timhuckaby
FaceBook:http://www.facebook.com/Tim.Huckaby.Carlsbad
LinkedIn:http://www.linkedin.com/in/timhuckaby
Twitter: @TimHuckaby
Tim Huckaby
![Page 40: ITCamp 2013 - Tim Huckaby - The Engaging User Experience & Natural User Interface](https://reader034.vdocuments.site/reader034/viewer/2022042714/555265b4b4c905d41d8b500b/html5/thumbnails/40.jpg)
itcampro@ itcamp13# Premium conference on Microsoft technologies
Q & A