microsoft research - turning ideas into reality

Microsoft ResearchMicrosoft ResearchTurning ideas into realityTurning ideas into reality

Behrooz ChitsazBehrooz ChitsazDirectorDirectorMicrosoft ResearchMicrosoft Research

BTB037BTB037

Rapidly Changing Rapidly Changing TechnologyTechnology

Computational power Computational power Multi-core CPUsMulti-core CPUs

Graphics 3x per yearGraphics 3x per year

Storage 2x per yearStorage 2x per year

Networking 4x per yearNetworking 4x per year

DevicesDevices

ConnectivityConnectivity

Nano scale technologyNano scale technology

The WebThe Web

Global communication hubGlobal communication hub

Ultimate storage of human knowledgeUltimate storage of human knowledge

A place to socialize and express A place to socialize and express yourselfyourself

Source of entertainmentSource of entertainment

A marketplace for all thingsA marketplace for all things

Microsoft ResearchMicrosoft Research

Founded in 1991Founded in 1991Staff of over 700 in over 50 areasStaff of over 700 in over 50 areasOpen research environmentOpen research environmentContributions to the field, Microsoft Products Contributions to the field, Microsoft Products and Commercial companies of all sizesand Commercial companies of all sizesResearch lab locations Research lab locations

Redmond, Washington Redmond, Washington Silicon Valley/Bay area, CaliforniaSilicon Valley/Bay area, CaliforniaCambridge, United KingdomCambridge, United KingdomBeijing, People’s Republic of ChinaBeijing, People’s Republic of ChinaBangalore, IndiaBangalore, India

Technology ThemesTechnology Themes

MobilityMobilityAdaptive systems, Adaptive systems, wireless computing…wireless computing…

Media and Media and EntertainmentEntertainment

3D-Models, Interactive 3D-Models, Interactive Video, Media search…Video, Media search…

Software DevelopmentSoftware DevelopmentTools, Specifications, Tools, Specifications, Programming langs …Programming langs …

HardwareHardwareHCI, Mobile devices…HCI, Mobile devices…

Human-Computer Human-Computer InteractionInteraction

Natural language, Natural language, speech, vision, ink…speech, vision, ink…

Information analysis, Information analysis, management and management and retrievalretrieval

Databases, data mining, Databases, data mining, scalable computing…scalable computing…

CollaborationCollaborationDistributed meetings, Distributed meetings, Social Computing, Online Social Computing, Online communities…communities…

MSR Contributions To MSR Contributions To Microsoft ProductsMicrosoft Products

Decision-theory onboard troubleshooting Decision-theory onboard troubleshooting tools for MTStools for MTSReliable multicast protocol algorithmsReliable multicast protocol algorithmsRegistry performance improvementsRegistry performance improvementsDirectX: several contributions to DirectX: several contributions to graphics algorithms and librariesgraphics algorithms and librariesNetwork monitor IPv6 supportNetwork monitor IPv6 supportNetwork packet classifier & schedulerNetwork packet classifier & schedulerSingle Instance Store for ZAWSingle Instance Store for ZAWVirtual Server FailoverVirtual Server FailoverPerformance optimization technologiesPerformance optimization technologiesSpeech: recognition and synthesisSpeech: recognition and synthesis

Encarta, Phone, AgentEncarta, Phone, Agent

XBOX graphics, net probing, player XBOX graphics, net probing, player rankingrankingMSN & Outlook junk mail filter MSN & Outlook junk mail filter SPOTSPOTSmart tags technology Smart tags technology Grammar checker improvements, more Grammar checker improvements, more languages. languages. Outlook® mobile manager (notification Outlook® mobile manager (notification system, IntelliShrink™)system, IntelliShrink™)

Source code analysis tools for kernel data Source code analysis tools for kernel data structure tuningstructure tuningSource code analysis tools for identifying Source code analysis tools for identifying bugs and security attack vectorsbugs and security attack vectorsPublic key cryptography libraryPublic key cryptography libraryPID signature schemePID signature schemePPP extensible authentication protocol PPP extensible authentication protocol designdesignFont subset signature designFont subset signature designProtected store domain controller backup Protected store domain controller backup encryption designencryption designKernel optimization toolsKernel optimization toolsClearTypeClearTypeCryptography librariesCryptography librariesWindows Media Format audio codecWindows Media Format audio codecHandwriting recognitionHandwriting recognitionSpeech recognition enginesSpeech recognition enginesMandarin Chinese data entryMandarin Chinese data entryInformation Retrieval for SPS, MSNInformation Retrieval for SPS, MSNDevelopment toolsDevelopment toolsAND MORE …AND MORE …


Media & EntertainmentMedia & Entertainment3D-Models, Interactive 3D-Models, Interactive Video, Media search…Video, Media search…





Information analysis, Information analysis, management and retrievalmanagement and retrieval


CollaborationCollaborationDistributed meetings, Social Distributed meetings, Social Computing, Online Computing, Online communities…communities…


Wireless And NetworkingWireless And Networking

Public UMTSNetworks

Public GPRS

Networks

Airport

Home

Office

IP backbone

WLAN

Ethernet

WLAN & Bluetooth

??

? Which network?? Which network? GPRS, UMTS, WLAN, Bluetooth, Ethernet,… GPRS, UMTS, WLAN, Bluetooth, Ethernet,…

??

? Which device?? Which device? Phone, PDA, Tablet, Laptop, Desktop Phone, PDA, Tablet, Laptop, Desktop

??

? ? How to maintain How to maintain connectivityconnectivity??

?? What servicesWhat services do people need? do people need?

??

multiple technology islandsmultiple technology islands

Adaptive UIAdaptive UI

Page Analysis

…

Page segmentation/ Auto-positioning

Thumb nail

Details

Enable easy navigation and auto-positioningEnable easy navigation and auto-positioning

Smart Thumbnail ViewSmart Thumbnail View

Traditional ThumbnailTraditional Thumbnail Smart ThumbnailSmart Thumbnail

MSR And Inrix, Inc.MSR And Inrix, Inc.

Max likely time until bottleneck goneMax likely time until bottleneck gone

Standard deviationStandard deviation

Web service for predictive reasoning

Data store Inference User logs

System-wide status & dynamicsIncident reportsSporting eventsWeatherTime of dayDay of weekSeasonHoliday status

Handling anomaliesHandling anomalies

Base-level predictionsBase-level predictions

Context-sensitive error modelsContext-sensitive error models

Anomaly forecasting modelsAnomaly forecasting models

The Evolution Of Traffic The Evolution Of Traffic ServicesServices

Bryan MisteleBryan MisteleCEOCEOInrix, Inc.Inrix, Inc.

The EvolutionThe Evolution

Traffic Information is Traffic Information is evolving to greater evolving to greater levels of customer levels of customer valuevalue

Of Traffic InformationOf Traffic Information

Flow DataFlow DataReal-time speed informationReal-time speed informationUseful for digital consumptionUseful for digital consumption

Prediction & RelevancePrediction & RelevanceSystem-wide analysis of trafficSystem-wide analysis of trafficUseful for planning, re-routing, Useful for planning, re-routing, analysis and decisionsanalysis and decisions

Incident DataIncident DataIdentifying trouble spots for Identifying trouble spots for consumersconsumers““Nuggets of usefulness”Nuggets of usefulness”

Aggregate traffic-related content Aggregate traffic-related content from public and private sourcesfrom public and private sources

Enhance real-time data using Enhance real-time data using proprietary error detection and proprietary error detection and correction. Utilize sophisticated correction. Utilize sophisticated Bayesian modeling for prediction Bayesian modeling for prediction and forecastingand forecasting

Distribute to Distribute to customers via customers via XML servicesXML services

What We DoWhat We Do

Prediction And ForecastingPrediction And ForecastingLeveraging Bayesian NetworksLeveraging Bayesian Networks

Inrix MetadataInrix MetadataCurrent/ Historical TrafficCurrent/ Historical Traffic

Time of DayTime of Day

Day of WeekDay of Week

WeatherWeather

Sporting EventsSporting Events

SeasonSeason

School SchedulesSchool Schedules

Holiday StatusHoliday Status

Incident/ Construction Incident/ Construction ReportsReports

Express Lane DirectionExpress Lane Direction

• A Bayesian network is a graphical model that can be used to A Bayesian network is a graphical model that can be used to uncover causal relationships between a large number of variablesuncover causal relationships between a large number of variables

• Inrix utilizes sophisticated Bayesian modeling incorporating Inrix utilizes sophisticated Bayesian modeling incorporating “metadata” – attributes that we would expect to influence the “metadata” – attributes that we would expect to influence the observed sensor data both now and some time in the futureobserved sensor data both now and some time in the future

The Inrix ModelThe Inrix ModelA Complete SolutionA Complete Solution

137+ Markets of 137+ Markets of Incident Data Incident Data from Clear from Clear ChannelChannel20+ Markets of 20+ Markets of Flow Data fromFlow Data from

DOT SensorsDOT SensorsGPS-based GPS-based probe vehiclesprobe vehicles

Inrix Traffic Inrix Traffic DatabaseDatabase

Real-TimeReal-TimeDataData

PredictivePredictiveDataData

ImprovedImprovedAccuracyAccuracy

BroaderBroaderCoverageCoverage

16+ Markets of 16+ Markets of Predictive DataPredictive Data

Speed & Flow Speed & Flow PredictionPredictionTime EstimationTime EstimationCongestionCongestionComparativeComparativeQuickest RoutingQuickest Routing

Corrected speed Corrected speed data based ondata based on

Bad sensor Bad sensor detection & detection & correctioncorrectionStatistical Statistical analysis and analysis and averaging across averaging across data sources data sources

Expanding Expanding market market coverage as coverage as GPS sources GPS sources growgrowCoverage to Coverage to secondary secondary and tertiary and tertiary roadsroads

Press Coverage Press Coverage Leveraging our Microsoft RelationshipLeveraging our Microsoft Relationship

Inrix, Inc.Inrix, Inc.

Inrix Data FeedsInrix Data FeedsDeveloper OverviewDeveloper Overview

Common CharacteristicsCommon CharacteristicsFormat: XMLFormat: XMLAccess Protocol: file transfer using HTTPAccess Protocol: file transfer using HTTPAccess Permissions: based on contractual agreements per Access Permissions: based on contractual agreements per market and file type market and file type

Basic Types of Data FeedsBasic Types of Data FeedsReal Time FlowReal Time FlowReal Time IncidentsReal Time IncidentsPredictive/ForecastingPredictive/ForecastingBy Inrix Traffic Segment or by TMC codeBy Inrix Traffic Segment or by TMC codeDefinition Files Definition Files

Mappings to Inrix Traffic Segment, TMCsMappings to Inrix Traffic Segment, TMCsMappings to NAVTEQ and/or Tele Atlas map databasesMappings to NAVTEQ and/or Tele Atlas map databasesdev.inrix.com dev.inrix.com









CollaborationCollaborationDistributed meetings, Social Distributed meetings, Social Computing, Online Computing, Online communities…communities…


Interactive VideoInteractive Video

Video TexturesVideo Textures

Computer VisionComputer Vision

Human FaceHuman FaceDetection in imagesDetection in images

Tracking on videoTracking on video

IdentificationIdentification

Object recognitionObject recognition

Turning “dead bits Turning “dead bits to live bits”to live bits”

Toolkit available for face detection in images and Toolkit available for face detection in images and face tracking in videoface tracking in video









CollaborationCollaborationRealtime Collaboration, Social Realtime Collaboration, Social Computing, Online Computing, Online communities…communities…


SNARF – E-mail AssistantSNARF – E-mail AssistantSocial Network and Relationship FinderSocial Network and Relationship Finder

Side bar for peripheral awarenessSide bar for peripheral awareness

Multiple Multiple PanesPanes

List of people with associated List of people with associated messagesmessages

Sorted by relationshipSorted by relationship

Yellow bars, for visual indication Yellow bars, for visual indication of scaleof scale

Double-click on person to see Double-click on person to see their messagestheir messages

http://www.research.microsoft.com/community/snarf

http://www.research.microsoft.com/community/snarf

SNARF Views – Visualizations of SNARF Metadata using Data Visualization Components

BubbleChartGeneratorBubbleChartControl

SpireChartGeneratorSpireChartControl

TreemapGeneratorTreemapControl

ThreadTreeGeneratorThreadTreeControl

ThreadTreeScrollBar

PianoRollControl

COMPONENTS!

http://research.microsoft.com - Downloads

Mobile Social SoftwareMobile Social Software“MoSoSo”“MoSoSo”

SLAMSLAMSharing Location and MediaSharing Location and Media

AURAAURAAdvanced User Resource AnnotationAdvanced User Resource Annotation

Scott Counts :: Shelly Farnham :: Jordan Schwartz :: Scott Counts :: Shelly Farnham :: Jordan Schwartz :: Henky AliminHenky Alimin

Lightweight Grouping for Mobile Lightweight Grouping for Mobile Communication, Coordination, and SharingCommunication, Coordination, and Sharing

SLAMSLAM

Smartphone application for:Smartphone application for:(Real-time) communication (Real-time) communication and media sharingand media sharing

Continuous access to Continuous access to social circlessocial circles

Social networking across Social networking across eventsevents

Aura PortalAura PortalUser Community and BlogUser Community and Blog

Research Download SiteResearch Download Site

Learn moreLearn more

Visit Microsoft Research at Visit Microsoft Research at http://research.microsoft.comhttp://research.microsoft.com

Check out the Microsoft Research Check out the Microsoft Research download sitedownload site

microsoft research - turning ideas into reality

Technology

data mining

realtime data

markets of incident

decisions incident data

ink information analysis

evolution traffic information

msn development tools

social computing