crime risk forecasting and predictive analytics - esri uc
DESCRIPTION
Presentation at the 2011 Esri User Conference that included an overview of HunchLab features related to forecasting, specifically near repeat forecasts and load forecasts.TRANSCRIPT
![Page 1: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/1.jpg)
Risk Forecasting & Predictive AnalyticsHunchLab Research Update
Robert [email protected]
@rcheetham
Michael [email protected]
![Page 2: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/2.jpg)
Philadelphia Police Department
Crime Analysis Unit founded in 1997
Desktop ArcGIS– Analysis to support investigations
– Support COMPSTAT process
Web-based crime analysis
3 staff
![Page 3: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/3.jpg)
Who is Azavea?
25 people- software engineers- spatial analysts- project managers
Spatial Analysis
Web & Mobile
High Performance Geoprocessing
User Experience
R&D
![Page 4: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/4.jpg)
10% Research ProgramPro Bono ProgramTime-to-Give-Back ProgramEmployee-focused Culture Projects with Social Value
![Page 5: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/5.jpg)
web-based crime analysis, early warning, and risk forecasting
![Page 6: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/6.jpg)
Crime Analysis– Mapping (spatial / temporal densities)
– Trending
– Intelligence Dashboard
Early Warning– Statistical & Threshold-based Hunches (data mining)
– Alerting
Risk Forecasting– Near Repeat Pattern
– Load Forecasting
![Page 7: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/7.jpg)
Dashboard
![Page 8: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/8.jpg)
Space + Time
![Page 9: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/9.jpg)
Space + Time
![Page 10: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/10.jpg)
Animation
![Page 11: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/11.jpg)
Early Warning & Notification
![Page 12: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/12.jpg)
![Page 13: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/13.jpg)
Risk Forecasting
![Page 14: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/14.jpg)
Crime Analysis– Mapping (spatial / temporal densities)
– Trending
– Intelligence Dashboard
Early Warning– Statistical & Threshold-based Hunches (data mining)
– Alerting
Risk Forecasting– Near Repeat Pattern
– Cyclical Forecasting
![Page 15: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/15.jpg)
![Page 16: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/16.jpg)
Near Repeat Pattern
![Page 17: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/17.jpg)
Contagious Crime? Near repeat pattern analysis
“If one burglary occurs, how does the risk change nearby?”
![Page 18: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/18.jpg)
What Do We Mean By Near Repeat? Repeat victimization
– Incident at the same location at a later time
Near repeat victimization– Incident at a nearby location at a later time
Incident A (place, time) --> Incident B (place, time)
![Page 19: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/19.jpg)
Near Repeat Pattern Analysis The goal:
– Quantify short term risk due to near-repeat victimization “If one burglary occurs, how does the risk of burglary for the
neighbors change?”
What we know:– Incident A (place, time) --> Incident B (place, time)
Distance between A and B Timeframe between A and B
What we need to know:– What distances/timeframes are not simply random?
![Page 20: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/20.jpg)
Near Repeat Pattern Analysis The process
– Observe the pattern in historic data– Simulate the pattern in randomized
historic data– Compare the observed pattern to the
simulated patterns– Apply the non-random pattern to new
incidents
![Page 21: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/21.jpg)
Near Repeat Pattern Analysis
An example– 180 days of burglaries – Philadelphia Division 6
![Page 22: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/22.jpg)
Near Repeat Pattern Analysis
An example– 180 days of burglaries – Philadelphia Division 6
![Page 23: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/23.jpg)
Near Repeat Pattern Analysis
An example– 180 days of burglaries – Philadelphia Division 6
![Page 24: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/24.jpg)
Near Repeat Pattern Analysis
![Page 25: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/25.jpg)
Online Version
![Page 26: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/26.jpg)
Near Repeat Pattern AnalysisHow can you test your own data?
– Near Repeat Calculator http://www.temple.edu/cj/misc/nr/
Papers– Near-Repeat Patterns in Philadelphia
Shootings (2008) One city block & two weeks after one
shooting– 33% increase in likelihood of a second
event
Jerry Ratcliffe
Temple University
![Page 27: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/27.jpg)
Cyclical Patterns
![Page 28: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/28.jpg)
Improving CompStat– “Given the time of year, day of week, time of
day and general trend, what counts of crimes should I expect?”
![Page 29: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/29.jpg)
What Do We Mean By Load Forecasting?– Generating aggregate crime counts for a
future timeframe using cyclical time series analysis
Measure cyclical patterns
Identify non-cyclical trend
Forecast expected count
+
bit.ly/gorrcrimeforecastingpaper
![Page 30: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/30.jpg)
Cyclical Forecasting Measure cyclical patterns
Take historic incidents (for example: last five years) Generate multiplicative seasonal indices
– For each time cycle:» time of year» day of week» time of day
– Count incidents within each time unit (for example: Monday)– Calculate average per time unit if incidents were evenly
distributed– Divide counts within each time unit by the calculated average
to generate multiplicative indices» Index ~ 1 means at the average» Index > 1 means above average» Index < 1 means below average
![Page 31: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/31.jpg)
Cyclical Forecasting
![Page 32: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/32.jpg)
Cyclical Forecasting
![Page 33: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/33.jpg)
Cyclical Forecasting
![Page 34: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/34.jpg)
Cyclical Forecasting
![Page 35: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/35.jpg)
Cyclical Forecasting Identify non-cyclical trend
Take recent daily counts (for example: last year daily counts)
Remove cyclical trends by dividing by indices
Run a trending function on the new counts– Simple average
» Last X Days– Smoothing function
» Exponential smoothing» Holt’s linear exponential smoothing
![Page 36: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/36.jpg)
Cyclical Forecasting Forecast expected count
Project trend into future timeframe– Always flat
» Simple average» Exponential smoothing
– Linear trend» Holt’s linear exponential smoothing
Multiple by seasonal indices to reseasonalize the data
![Page 37: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/37.jpg)
Cyclical Forecasting
Measure cyclical patterns
Identify non-cyclical trend
Forecast expected count
+
bit.ly/gorrcrimeforecastingpaper
![Page 38: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/38.jpg)
Cyclical Forecasting
![Page 39: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/39.jpg)
Cyclical Forecasting
![Page 40: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/40.jpg)
Cyclical Forecasting
![Page 41: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/41.jpg)
Cyclical Forecasting
![Page 42: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/42.jpg)
How Do We Know It Works? Testing
Generated forecasting packages (examples)– Commonly Used
» Average of last 30 days» Average of last 365 days» Last year’s count for the same time period
– Advanced Combinations» Different cyclical indices (example: day of year vs. month of year)» Different levels of geographic aggregation for indices» Different trending functions
Scoring methodologies (examples)– Mean absolute percent error (with some enhancements)– Mean percent error– Mean squared error
Run thousands of forecasts through testing framework Choose the right technique in the right situation
![Page 43: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/43.jpg)
Ongoing R&D
![Page 44: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/44.jpg)
Research Topics Analysis
– Real-time Functionality Consume real-time data streams Conduct ongoing, automated analysis Push real-time alerts
Risk Forecasting– Load forecasting enhancements
Machine learning-based model selection Weather and special events
– Combining short and long term risk forecasts NIJ project with Jerry Ratcliffe & Ralph Taylor Neighborhood composition modeling using ACS data
– Risk Terrain Modeling
![Page 45: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/45.jpg)
Research Topics
Current Implementation Funding– Local Byrne Memorial JAG solicitation due July 21,
2011 Research Funding
![Page 46: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/46.jpg)
Acknowledgements
National Science Foundation – SBIR Program– Grant #IIP-0637589– Grant #IIP-0750507
Philadelphia Police Department Jerry Ratcliffe, Temple University Tony Smith, University of Pennsylvania Peirce County, WA
![Page 47: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/47.jpg)
Upcoming Conferences
Crime Mapping Research Conference, October IACP, October
![Page 48: Crime Risk Forecasting and Predictive Analytics - Esri UC](https://reader033.vdocuments.site/reader033/viewer/2022061217/54b3a88f4a79599c5c8b4798/html5/thumbnails/48.jpg)
Many Thanks!© Photo used with permission from Alphafish, via Flickr.com