![Page 1: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/1.jpg)
Predictiction, Expection, …and Surprise
Eric HorvitzPrincipal ResearcherMicrosoft Research
![Page 2: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/2.jpg)
Learning & reasoning prowess
Computation
Memory
Sensors, connectivity, content
![Page 3: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/3.jpg)
Structured & messy content
+
Streaming data about world & people
+
Advances in learning & inference
Predictive models at core
of services & experiences
Behind the scenes…and in the foreground
![Page 4: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/4.jpg)
Learning &
reasoningSensing
Local sensingPortable
device
Continual sensing, learning, and reasoning always available in stream of daily life
Web service
![Page 5: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/5.jpg)
• Event store
• Learning
• Reasoning
Multiple views on traffic
Operator ID: Nick
Heading: INCIDENT
Message: INCIDENT
INFORMATION
Cleared 1637: I-405 SB
JS I-90 ACC BLK RL CCTV
1623 – WSP, FIR ON SCENE
Incident reports
Weather
Major events
e.g., Forecasting traffic
![Page 6: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/6.jpg)
![Page 7: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/7.jpg)
![Page 8: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/8.jpg)
System-wide status & dynamics
Incident reports
Sporting events
Weather
Time of day
Day of week
Season
Holiday status
Max likely time until bottleneck gone
Standard deviation
Traffic forecasting service
Data store
Inference
User logs
Base-level predictions
![Page 9: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/9.jpg)
Time until
jams
appear?
Times until
jams
disappear?
![Page 10: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/10.jpg)
Predicting low probability or umodeled future outcome of significant consequence.
E1 E2 E3
H1 H2
E4
World model
E2 E3
H1 H2
E4
Cognitive model
![Page 11: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/11.jpg)
Learn what surprises people
…now and in the future
Expectations
Major events
Weather
Time of day
Day of week
Holiday status
Real
World
Outcome
System-wide status & dynamics
Incident reports
Sporting events
Weather
Time of day
Day of week
Season
Holiday status
Database of surprising events
Data store
Future traffic
Pro
ba
bility
!! Events at t
Human
Forecaster
![Page 12: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/12.jpg)
Learn what surprises people
…now and in the future
Expectations
Major events
Weather
Time of day
Day of week
Holiday status
Real
World
Outcome
System-wide status & dynamics
Incident reports
Sporting events
Weather
Time of day
Day of week
Season
Holiday status
Database of surprising events
Data store
Future traffic
Pro
ba
bility
!! Events at t
Human
Forecaster
System-wide status & dynamics
Incident reports
Sporting events
Weather
Time of day
Day of week
Season
Holiday status
Events at t-T
![Page 13: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/13.jpg)
Base-level predictions
Surprise
& surprise forecasting
Surprise forecasting models
System-wide status & dynamics
Incident reports
Sporting events
Weather
Time of day
Day of week
Season
Holiday status
Traffic forecasting service
Data store
Inference
User logs
![Page 14: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/14.jpg)
![Page 15: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/15.jpg)
World event streams
Surprise Forecaster
Machine learning
Past Future
!
Real-time sensing
Surprise Forecasts
!
Surprise stream
! !
![Page 16: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/16.jpg)
![Page 17: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/17.jpg)
![Page 18: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/18.jpg)
![Page 19: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/19.jpg)
![Page 20: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/20.jpg)
![Page 21: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/21.jpg)
![Page 22: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/22.jpg)
![Page 23: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/23.jpg)
![Page 24: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/24.jpg)
![Page 25: Predictiction, Expection, and Surprise - Eric Horvitzerichorvitz.com/emtech/emTech_Horvitz_.pdf•Event store •Learning •Reasoning Multiple views on traffic Operator ID: Nick Heading:](https://reader035.vdocuments.site/reader035/viewer/2022071414/610e5d9e80c860652a4f1c1d/html5/thumbnails/25.jpg)
Large-scale data & computation to predict surprises
Predictive models for people + world
Forecasts we really care about