ce-4026, new interfaces, by david brebner
DESCRIPTION
Presentation CE-4026 by David Brebner at the AMD Developer Summit (APU13) November 11-13, 2013TRANSCRIPT
![Page 1: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/1.jpg)
NEW INTERFACES
DAVID BREBNER
![Page 2: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/2.jpg)
New InterfacesGestural & Cinematic experiences
![Page 3: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/3.jpg)
3 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
� The continuum of interaction
From precise to casual
Content Creation & Productivity Content Consumption and Entertainment
![Page 4: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/4.jpg)
4 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
� Interaction with others
Individual Online Together
![Page 5: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/5.jpg)
5 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
� Ergonomics
Lots of publicly available research and
recommendations
Very little publicly available research and no industry
guidelines
Un-answered questions…
• How will people use large form factor systems?
• How long do they use these devices for?
• Do they stand or sit?
• What angle is their arm, wrist, hand?
• What % of interaction is touch vs. keyboard vs.
mouse?
• How do the ratios change depending on task?
![Page 6: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/6.jpg)
6 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
Gestural Cinematic
FunctionMinimal
Consistent
Obvious
What does the App do?
NEW INTERFACES
![Page 7: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/7.jpg)
7 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
Gestural Cinematic
Function
Responsive
Animated
Explanatory
Revelatory
Delightful
How does the App look?
NEW INTERFACES
![Page 8: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/8.jpg)
8 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
Gestural Cinematic
Function
Manipulate
Direct
Responsive
Reversible
Hinted
Consistent
How do you interact?
NEW INTERFACES
![Page 9: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/9.jpg)
9 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
� Gestural
‒ Direct manipulation – not memorizing gestures
‒ Touch, voice, 3D and more
‒ Sweeping movements
‒ Allow for mastery
� Cinematic
‒ Great visuals
‒ Show actions with animation and state
‒ Use lighting, particles, focus, depth of field to highlight elements
‒ Use warps and motion to transition between elements
‒ Use 3D content and environments but provide 2D workspaces
NEW INTERFACES
![Page 10: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/10.jpg)
10 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
� Give feedback of action triggered
� Provide a way to undo the action
� Actions to be commutative (any order)
� Physical ‘manipulation’ should be obvious and
reversible (move, rotate, resize etc)
� Actions should be repeatable and reliable (don’t rely on gestures which the sensor cannot repeat)
� Reveal the gestures and their function (with hints)
ACTIONS
Classic animation techniques like bounce, squash &
stretch, follow through are now being used (often on
abstract shapes) to illustrate actions
![Page 11: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/11.jpg)
11 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
� Using a 3D camera can have lighting issues
� It’s NOT touch at a distance
� Because there is no control surface it is hard
distinguishing between actions and movement
� Support spatial control surfaces
� Add speech for actions
� We need to find new gestural rules
� 3D Gesture has tracking but no ‘action’
� Fingers, hands and arms obscuring the view of
the screen
SPATIAL GESTURE
![Page 12: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/12.jpg)
12 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
� Touch
� Multi touch
� Near touch
� Touch + pressure
� Stylus + touch
� Stylus + pressure + angle
� 3D camera
� Gaze + voice
� Wearable's + GPS + Gyro
GESTURAL INPUT
![Page 13: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/13.jpg)
13 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
� Reach towards the screen and receive localised hints
� Touch the screen to manipulate (move, resize, rotate,
drag, pick)
� Reach towards the screen with pen and receive hints
� Touch the screen to act (cut, draw, circle)
� Also speak to act on any visible hints
VOICE, PEN, NEAR TOUCH, TOUCH
![Page 14: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/14.jpg)
14 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GESTURAL AND CINEMATIC
� GUI point and click replaced with touch is
hard for users
� New interfaces with touch, supporting fluid
dragging and picking is a big improvement
� New interfaces with multi-touch, allowing
multi finger gestures like resizing and
rotation is better
� Multi-user is a new challenge on larger
devices, and requires the designer to set
aside localised and orientated workspaces
for multiple users
TOUCH - MULTITOUCH - MULTIUSER
![Page 15: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/15.jpg)
15 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
NATURAL USER INTERFACE
� NUI is not a fixed toolkit (like a GUI)
� Don’t just mimic GUI or web apps
� NUI is still abstract, it’s not real world
� NUI should seem an extension of the body
� NUI can leverage previously learned skills
� Involves game aspects
‒ enjoyable interaction
‒ a path to skilled usage
‒ but NOT challenge
� Direct manipulation
� Aim for skilled and fluid actions
IT’S A BROAD CONCEPT – NOT A DETAILED FRAMEWORK
![Page 16: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/16.jpg)
Technology stack is
growing & improving
![Page 17: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/17.jpg)
17 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
HIGH SPEED ACCURATE MULTI TOUCH
![Page 18: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/18.jpg)
18 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
FLEXIBLE PERFORMANT COMPUTE ARCHITECTURES
![Page 19: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/19.jpg)
19 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
A GROWING RANGE OF GESTURE TECHNOLOGIES
![Page 20: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/20.jpg)
20 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
A GROWING RANGE OF VOICE CAPABILITIES
Client side – cloud side – hybrid
![Page 21: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/21.jpg)
21 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
ATTENTION TRACKING
� Turned
away
� Paying
attention
![Page 22: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/22.jpg)
22 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
VR
![Page 23: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/23.jpg)
23 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
GPU EFFECTS
Fluid
simulation
Paint, glass, chrome, plastic, environment, AO
![Page 24: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/24.jpg)
BUT needs hardcore development
![Page 25: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/25.jpg)
25 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
UMAJIN APP BUILDER
![Page 26: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/26.jpg)
26 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
UMAJIN APP BUILDERANYONE CAN BUILD NEW INTERFACES
![Page 27: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/27.jpg)
27 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
NEW INTERFACESMANY SCREENS
From 4” to 80”
![Page 28: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/28.jpg)
28 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
NEW INTERFACESTOUCH, VOICE, GESTURE
Demo…
![Page 29: CE-4026, New Interfaces, by David Brebner](https://reader035.vdocuments.site/reader035/viewer/2022062418/554bdc62b4c905ac708b544f/html5/thumbnails/29.jpg)
29 | NEW INTERFACES | NOVEMBER 22, 2013 | CONFIDENTIAL
DISCLAIMER & ATTRIBUTION
The information presented in this document is for informational purposes only and may contain technical inaccuracies, omissions and typographical errors.
The information contained herein is subject to change and may be rendered inaccurate for many reasons, including but not limited to product and roadmap
changes, component and motherboard version changes, new model and/or product releases, product differences between differing manufacturers, software
changes, BIOS flashes, firmware upgrades, or the like. AMD assumes no obligation to update or otherwise correct or revise this information. However, AMD
reserves the right to revise this information and to make changes from time to time to the content hereof without obligation of AMD to notify any person of
such revisions or changes.
AMD MAKES NO REPRESENTATIONS OR WARRANTIES WITH RESPECT TO THE CONTENTS HEREOF AND ASSUMES NO RESPONSIBILITY FOR ANY
INACCURACIES, ERRORS OR OMISSIONS THAT MAY APPEAR IN THIS INFORMATION.
AMD SPECIFICALLY DISCLAIMS ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE. IN NO EVENT WILL AMD BE
LIABLE TO ANY PERSON FOR ANY DIRECT, INDIRECT, SPECIAL OR OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF ANY INFORMATION
CONTAINED HEREIN, EVEN IF AMD IS EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
ATTRIBUTION
© 2013 Advanced Micro Devices, Inc. All rights reserved. AMD, the AMD Arrow logo and combinations thereof are trademarks of Advanced Micro Devices,
Inc. in the United States and/or other jurisdictions. SPEC is a registered trademark of the Standard Performance Evaluation Corporation (SPEC). Other names
are for informational purposes only and may be trademarks of their respective owners.