Eyes-free Computing

Looking Back, Looking Forward

T. V. RamanGoogle

http://emacspeak.sf.net/ramanVideo Of Talk

June 09, 2018

http://emacspeak.sf.net/ramanhttps://www.youtube.com/watch?v=LJzcThyT0Pg

OverviewGoal Insights Conclusion

Eyes-free Computing 2 / 13

Goal

Insights

Conclusion

Efficient Eyes-free Interaction

Goal Insights Conclusion

Effective Information AccessGoal Insights Conclusion

Eyes-free Computing 4 / 13

■ When we want,■ Where we want,■ The way we want!

This Journey Began 30 Years Ago!

Milestones Along The WayGoal Insights Conclusion

Eyes-free Computing 5 / 13

■ ASTER —Audio System For Technical Readings —(1990s).■ PDF —Capture and extract document structure —(1995).■ Web —Design standards for multimodal interaction —(2000).■ Search —Deliver results the way the user wants —(2005).■ Mobile —Ubiquitous information access —(2008).■ Smart speakers —Mainstream eyes-free information access —(2014).

Insights Gathered Along The WayGoal Insights Conclusion

Eyes-free Computing 6 / 13

■ Electronic information is display-independent.■ Leverage features of specific interaction modalities e.g., speech.■ User Interface is a means to an end.■ UI —Capture User Intent, Grab User Attention.■ UI peripherals determine the size and shape of computing devices.

Insights Along The Way

Goal Insights Conclusion

Information Is Display IndependentGoal Insights Conclusion

Eyes-free Computing 8 / 13

Single Source, Multiple Outputs

Info

Visual Audio

PrintSpeak

UI —Capture Intent, Grab AttentionGoal Insights Conclusion

Eyes-free Computing 9 / 13

C

Input Output

U

data res

intent attn

UI Defines The DeviceGoal Insights Conclusion

Eyes-free Computing 10 / 13

■ Desktop: Keyboard, Monitor, Mouse.■ Laptop: LCD Panel, Keyboard, Trackpad.■ Smart Phone: Shiny piece of glass.■ Smart Speaker: Microphone array.

UI Peripherals Determine Device Form-factor!

Conclusion

Goal Insights Conclusion

ConclusionGoal Insights Conclusion

Eyes-free Computing 12 / 13

■ UI determines size and shape of computing.■ Ubiquitous information access requires User Aware UI.

Watch Computing Take Off!Goal Insights Conclusion

Eyes-free Computing 13 / 13

Efficient Eyes-free InteractionEffective Information AccessMilestones Along The WayInsights Gathered Along The Way

Insights Along The WayInformation Is Display IndependentUI —Capture Intent, Grab AttentionUI Defines The Device

ConclusionConclusionWatch Computing Take Off!