an incident just occured. how severe will its impact be?

19
© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential. Mahalia Miller, HP Labs, NSF Research Associate / Stanford University *Chetan Gupta, HP Labs Date: August 12, 2012 An incident just occured. How severe will its impact be?

Upload: chidi

Post on 04-Jan-2016

37 views

Category:

Documents


1 download

DESCRIPTION

An incident just occured. How severe will its impact be?. Mahalia Miller, HP Labs, NSF Research Associate / Stanford University *Chetan Gupta, HP Labs Date: August 12, 2012. Our research questions in traffic management:. Understanding the past - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Mahalia Miller, HP Labs, NSF Research Associate / Stanford University*Chetan Gupta, HP LabsDate: August 12, 2012

An incident just occured. How severe will its impact be?

Page 2: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Our research questions in traffic management:Understanding the past

• What was the spatial and temporal impact of a given incident on traffic congestion?

• What was the non-recurrent delay associated with a given incident?

Predicting the future

• An incident just occurred. How severe will its impact be?

2

Photo credit: Jim Frasier/Flickr

Page 3: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Research combines disparate sources of data

3

Page 4: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Spatial graph helps link police reports, sensor records, and weather• Graph is created from sensor

metadata–Sensors in each corridor (I-605 North, e.g.) linked by

parsing postmile and freeway for each sensor location

–Free text in sensor metadata including on-ramp/off-ramp information aids linking corridors (I-605 South with I-5 South, e.g.)

• Reported incident start locations mapped to closest upstream sensor on given corridor

• Sensors linked to closest weather station

4

Sensor map created for District 7 highways (Los Angeles)

Page 5: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Spatial graph helps link police reports, sensor records, and weather• Graph is created from sensor

metadata–Sensors in each corridor (I-605 North, e.g.) linked by

parsing postmile and freeway for each sensor location

–Free text in sensor metadata including on-ramp/off-ramp information aids linking corridors (I-605 South with I-5 South, e.g.)

• Reported incident start locations mapped to closest upstream sensor on given corridor

• Sensors linked to closest weather station

5

Diagram of relative sensor locations

Traffic flow

Reported incident location

Closest upstream sensor, “b”

Downstream sensor, “a”

Upstream sensor, “c”

Page 6: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Results of deriving delay definitions

By integrating the delay definitions over space and time the following equations result:

6

Page 7: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Algorithms track spatial and temporal spread of incidents to build baseline model

7

Spread of sample incident on I-5 in Los Angeles

4 minutes after incident start

14 minutes after incident start

29 minutes after incident start

Page 8: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Impact Prediction Results

8

Yes

False alarm

YesNo

No

Accident

No

AccidentFalse alarm

v-v* > 4.6

ρ > 0.22

#vehicles > 0

Yes

Experiment Classes Bounds (min) Counts Accuracy(%)

SF-1 2 5 146, 92 95.59

SF-2 2 30 188, 50 87.86

SF-3 3 5, 30 146,42, 50 81.09

LA-1 2 5 85, 87 91.40

LA-2 2 30 118, 54 88.84

LA-3 3 5, 30 85, 33, 54 82.33

Experiment Classes Bounds (in $) Counts Accuracy (%)

SF-1 2 10 114, 124 95.59

SF-2 2 100 157,81 87.86

SF-3 3 10, 250 114, 54, 70 81.09

SF-4 4 10, 250, 1000 114, 54, 34, 36 73.73

LA-1 2 10 75, 97 91.40

LA-2 2 250 94, 78 88.84

LA-3 3 1000 120, 52 82.33

LA-4 3 10, 1000 75, 45, 52 75.87

Page 9: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

With high accuracy, model predicts which of 2 accidents will have higher impact

• Preliminary results indicate 90%+ accuracy for predicting relatively which incident will have a higher impact–Impact metric is economic losses from travel time delay

–Determination done within 2 minutes of reported times

• Future work will compare incidents with both starting in a given time and space window to simulate traffic dispatcher’s decision where to focus limited resources

9

Page 10: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Results indicate high degree of transfer learning possible

Table: Prediction accuracy (%) by each bin selection choice for k classes of incident impact trained on the SF dataset and tested directly on LA:

10

Measure Bounds Accuracy

Cost $10 90.07

Cost $10, $100 86.05

Duration 5 minutes 91.28

Duration 5, 30 minutes 73.84

Page 11: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Summary of key contributions

• Build baseline model for traffic conditions across time and space

• Predict the impact of an incident for an incident that just occurred using classification models as measured by incident duration and travel delay-induced economic losses

• Models show high level of transfer learning

11

Page 12: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Thank you

Contact:

[email protected]

[email protected]

Photo credit: ShaojingBJ/Flickr

Page 13: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

For two regions, models predict incident duration and travel delay-induced economic lossesTable: Example results from travel delay-induced economic losses

13

Experiment Classes Bounds ($) Counts Accuracy f-Measure

SF-1 2 10 114,124 95.59 0.95-0.96

SF-3 4 10,250,1000 114,54,34,36 73.73 0.47-0.95

LA-1 2 10 75,97 91.40 0.90-0.92

LA-4 3 10,100 75,52,45 75.87 0.55-0.89

Page 14: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Model is good predictor of incident false alarmsResults

•With 90%+ accuracy, within 2 minutes can determine if an incident will have a non-negligible delay or instead be a “false alarm”

14

Sample classification tree for incident delay impact < 1 veh-hr

Yes

False alarm

YesNo

No

(v*-v)up>4.6

Accident

YesNo

ρ>0.22

# vehicles>0

Accident

False alarm

Page 15: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

State of California records highway traffic conditions• California-based system (PeMS) stores billions of traffic records

–from ~34,000 sensors across ~30,000 directional miles of highways (some offline)

–at frequencies up to every 30 seconds for over a decade

Schema: <time, station_id, district, route, direction, road_type, length, tot_samples, %observed, ave_flow, ave_occupancy, ave_speed, samples_i, flow_i, occupancy_i, speed_i, imputed_boolean_i … samples_N, flow_N, occupancy_N, speed_N, imputed_boolean_N>

Sample: <01/06/2009_00:00:00,715918,7,5,N,ML,.615,30,100,55,.015,66.8,10,8,.0048,71.9,1,

10,22,.0155,69.7,1,10,25,.0246,62.7,1,,,,,0,,,,,0,,,,,0,,,,,0,,,,,0>

• We used aggregated 5-minute inductive loop Los Angeles (D7) data–Test study has ~300 sensors

–Results from 5 minute periods for 2 months

–Approximately 5 million records

15

Page 16: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

California Highway Patrol (CHP) provides incident reports• Summarized incident reports are available

–Schema: <ID, district, area, freeway, start_time, duration, abs_postmile, state_postmile, location_description, incident_type>

• We grouped incident types into 9 categories

• Approximate location, time, and raw incident details are in free text

16

Page 17: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Weather data gives insight into rain and wind conditions facing drivers

• California Department of Water Resources records rain, wind, temperature, etc.

• We scraped this data for our test temporal period (January 1-March 1 2009) from their website

• Schema: <date, hour, cumulative rainfall>

• Sample: 20090101 0 5.50

20090101 100 5.50

20090101 200 5.50

17

Page 18: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Algorithms query database to access raw data• Incident summary table

–Schema: <date, day (0=Sunday…7=Saturday), holiday_boolean (0=not holiday, 1=holiday), minutes (since midnight that is reported as start time), duration (in minutes), incidentID, district, area, route, direction, abs_postmile, state_postmile, location_description, incident_type>

• Devices table–Schema: <sensorID, route, direction, district, county, city, state_postmile, abs_postmile, latitude,

longitude, length, road_type, lanes, name, user_id_1, user_id_2, user_id_3, user_id_4715897>

• Sensors table–Schema: <date, day (0=Sunday…7=Saturday), holiday_boolean (0=not holiday, 1=holiday), minutes

(since midnight), sensorID, district, route, direction, road_type, length, tot_samples, %observed, average flow, average occupancy, flow-weighted average speed>

• Recurrent speed table (created after analysis of raw data)–Schema: sensorID, minutes (since midnight), computed recurrent speed>

18

Page 19: An incident just occured. How severe will its impact be?

© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.

Spatial graph helps link police reports, sensor records, and weather• Graph is created from sensor

metadata–Sensors in each corridor (I-605 North, e.g.) linked by

parsing postmile and freeway for each sensor location

–Free text in sensor metadata including on-ramp/off-ramp information aids linking corridors (I-605 South with I-5 South, e.g.)

• Reported incident start locations mapped to closest upstream sensor on given corridor

• Sensors linked to closest weather station

19

Diagram of relative sensor locations

Traffic flow

Reported incident location

Closest upstream sensor, “b”

Downstream sensor, “a”

Upstream sensor, “c”