Slide 1

Research Momentum Latest Technologies From Microsoft Research

Slide 2

Overview of MSR Motivation MSR mission & culture Interactions with academia Demonstration of New Technologies Telepresence Station Zhengyou Zhang Situated Interaction Dan Bohus InkSeine Ken Hinckley

Slide 3

portable media center pocket PC Xbox 360 cable TV box RoundTable Zune tablet PC media center PC Laptop PC smart phone portable media center IP phone desktop PC MS Surface

Slide 4

Slide 5

Expand the state of the art in each of the areas in which we do research Rapidly transfer innovative technologies into Microsoft products Ensure that Microsoft products have a future

Slide 6

Redmond Silicon Valley New England Cambridge India Asia

Slide 7

Slide 8

Investments in basic research are an important part of innovation at Microsoft Prestigious Sr. Researchers and a new generation of Leaders Nearly all products and services from Microsoft include technologies from MSR MSR incubations have spawn new products

Slide 9

Slide 10

D-Link Quanta Uniden

Slide 11

Slide 12

University organizational model Flat structure, critical-mass groups Over 30 Research groups in Redmond, over 60 worldwide From classic groups Databases, Operating Systems, Graphics, Visual Media, Natural Language, Speech, Security, HCI, Networking, To new kinds: Sensor Networks, Human Interaction in Programming, Personalized Search, Knowledge Tools, Machine Translation, Computer Architecture. Empowered researchers Receive legal training for better understanding and managing of IP Make decisions on papers and patents

Slide 13

Speech and Signal Processing Communication/Collaboration Systems Natural Language Processing Machine Translation Interactive Visual Media Sensor Networks Human-Computer Interaction Social Computing Computer Architecture Adaptive Systems & Interaction Hardware Cyber Security & Sys Management Distributed Sys & Security Foundations of Software Engineering Program Testing and Verification Computer Systems and Networks Math Theory and Algorithms Text Mining & Search Personalized Search & Info Retrieval Graphics Machine Learning & Statistics Knowledge Tools Data Mining & Exploration Databases Cryptography Software Design & Implementation Operating Systems Human Interaction in Programming Programming Languages and Analysis Programming Languages and Methods

Slide 14

Open research environment Aggressive publication of results in peer-reviewed literature Frequent visitors, daily seminars Many software packages available for download Toolkits for Networking, Robotics, Mesh Networks, Singularity, Academic programs Nearly 15% of basic research budget directly invested in Universities Lab grants, research grants, fellowships, etc. Faculty Summit, MSR Summits in Europe, Latin America, Hundreds of interns and visitors (in Redmond, over 300 in 2008) http://research.microsoft.com/ur

Slide 15

Zhengyou Zhang Principal Researcher Microsoft Research

Slide 16

A videoconferencing experience that creates the illusion that the remote participants are in the same room with you. - Wainhouse Research 2007 Cisco Telepresence $299k HP Halo $425k + $18k/mo Tandberg Experia $225k Polycom RPX210M $269k + $18.5k/mo

Slide 17

Economic globalization and workforce mobilization 7-38-55% rule for communicating feelings and altitudes 7%: Verbal (Words, What you say) 38%: Vocal (Tone of voice, How you say them) 55%: Visual (Gaze, Facial expression, Body language) Bandwidth & Hardware Costs Customer Pains Product cycles dependent on remote teams Increased travel time and costs Energy consumption, CO2 production

Slide 18

Replicate experience people enjoy in face-to-face meeting Dedicated camera-display-speaker for remote stand-in Tailored to a single person Correct spatial cues Prototypes Full Mesh Geometry

Slide 19

Slide 20

Make it more immersive? Design user interface for both audio-visual and data? Adapt to network conditions? Combine HW & SW for better capture and rendering?

Slide 21

LR Listener Provide virtual seating Improve understanding by remote participants Decrease cognitive load (cocktail party effect) sorry, cant demo in this room

Slide 22

Computer-controllable lighting system Automatically adjust light intensity based on video analysis Skin tone model learned from hundreds of celebrity images Optimization of face image quality with physical parameters in the loop

Slide 23

Slide 24

Zicheng Liu Rajesh Hegde Qin Cai Cha Zhang Sasa Junuzovic Christian Huitema Jayman Dalal Wanghong Yuan

Slide 25

Dan Bohus, Eric Horvitz Microsoft Research

Slide 26

Embed interaction deeply into the flow of everyday situations & collaborations Long-term goal Sample challenge Conversational agent that can serve as a Microsoft receptionist

Slide 27

Behavioral control Dialog management & Interaction Planning Speech Synthesis Output Management Avatar Synthesis Tracker Speech Recognition Conversational Scene Analysis wide-angle camera 4-element microphone array touch screen card reader speakers quad core PC Microsoft Robotics Studio [Concurrency, Coordination and Distributed Services]

Slide 28

detect and track multiple participants infer roles and needs infer and track current speaker and the conversational floor maintain engagement with both participants via gaze and direct interaction

Slide 29

Ken Hinckley Senior Researcher Microsoft Research

Slide 30

New user interfaces Natural language translation Robotics and much more

Slide 31

2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Slide 32

Microsoft Research Faculty Summit 2008

Slide 33

Slide 34

Welcome Back