geographic data science - lecture vidarribas.org/gds15/slides/lecture_06.pdf · lecture vi...

47
Geographic Data Science - Lecture VI Exploring Space in Data Dani Arribas-Bel

Upload: others

Post on 19-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

GeographicData Science -

Lecture VIExploring Space in Data

Dani Arribas-Bel

Page 2: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

TodayESDASpatial AutocorrelationMeasures

GlobalLocal

Page 3: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

ESDA

Page 4: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Exploratory

Spatial

Data

Analysis

Page 5: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

[Exploratory]

Focus on discovery and assumption-free investigation

[Spatial]

Patterns and processes that put space and geography at thecore

[Data Analysis]

Statistical techniques

Page 6: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Questions that ESDA helps...

AnswerIs the variable I'm looking at concentrated over space? Dosimilar values tend to locate closeby?Can I identify any particular areas where certain values areclustered?

Page 7: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Questions that ESDA helps...

AnswerIs the variable I'm looking at concentrated over space? Dosimilar values tend to locate closeby?Can I identify any particular areas where certain values areclustered?

AskWhat is behind this pattern? What could be generating theprocess?Why do we observe certain clusters over space?

Page 8: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Spatial Autocorrelation

Page 9: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Everything is related to everything else, but near things are morerelated than distant things

Waldo Tobler (1970)

Page 10: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Spatial Autocorrelation-Statistical representation of Tobler's law

-Spatial counterpart of traditional correlation

Page 11: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Spatial Autocorrelation-Statistical representation of Tobler's law

-Spatial counterpart of traditional correlation

Degree to which similar values are located in similarlocations

Page 12: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Spatial Autocorrelation-Statistical representation of Tobler's law

-Spatial counterpart of traditional correlation

Degree to which similar values are located in similarlocations

Two flavors:Positive: similar values  →  similar location (closeby)Negative: similar values  →  disimilar location (furtherapart)

Page 13: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

ExamplesPositive SA:

Negative SA:

Page 14: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

ExamplesPositive SA: income,

Negative SA:

Page 15: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

ExamplesPositive SA: income, poverty,

Negative SA:

Page 16: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

ExamplesPositive SA: income, poverty, vegetation,

Negative SA:

Page 17: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

ExamplesPositive SA: income, poverty, vegetation, temperature...

Negative SA:

Page 18: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

ExamplesPositive SA: income, poverty, vegetation, temperature...

Negative SA: supermarkets,

Page 19: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

ExamplesPositive SA: income, poverty, vegetation, temperature...

Negative SA: supermarkets, police stations,

Page 20: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

ExamplesPositive SA: income, poverty, vegetation, temperature...

Negative SA: supermarkets, police stations, fire stations,

Page 21: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

ExamplesPositive SA: income, poverty, vegetation, temperature...

Negative SA: supermarkets, police stations, fire stations,hospitals...

Page 22: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Scales[Global]

Clustering: do values tend to be close to other (dis)similarvalues?

Page 23: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Scales[Global]

Clustering: do values tend to be close to other (dis)similarvalues?

[Local]

Clusters: are there any specific parts of a map with anextraordinary concentration of (dis)similar values?

Page 24: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Global Spatial Autocorr.

Page 25: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Global Spatial Autocorr."Clustering"

Overall trend where the distribution of values follows a particularpattern over space

Page 26: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Global Spatial Autocorr."Clustering"

Overall trend where the distribution of values follows a particularpattern over space

[Positive] Similar values close to each other (high-high,low-low)

Page 27: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Global Spatial Autocorr."Clustering"

Overall trend where the distribution of values follows a particularpattern over space

[Positive] Similar values close to each other (high-high,low-low)

[Negative] Similar values far from each other (high-low)

Page 28: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Global Spatial Autocorr."Clustering"

Overall trend where the distribution of values follows a particularpattern over space

[Positive] Similar values close to each other (high-high,low-low)

[Negative] Similar values far from each other (high-low)

How to measure it???

Page 29: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Moran PlotGraphical device that displays a variable on thehorizontal axis against its spatial lag on the vertical oneVariable and spatial weights matrix are preferablystandardizedAsssessment of the overall association between a variablein a given location and in its neighborhood

Page 30: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global
Page 31: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global
Page 33: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Moran's IFormal test of global spatial autocorrelation

Statistically identify the presence of clustering in a variable

Slope of the Moran plot

Inference based on how likely it is to obtain a map likeobserved from a purely random pattern

Page 34: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Moran's IFormal test of global spatial autocorrelation

Statistically identify the presence of clustering in a variable

Slope of the Moran plot

Inference based on how likely it is to obtain a map likeobserved from a purely random pattern

I =N

∑ i∑ jwij

( )( )∑ i∑ jwij Zi Zj(∑ i Zi)2

Page 35: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Local Spatial Autocorr.

Page 36: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Local Spatial Autocorr."Clusters"

Pockets of spatial instability

Portions of a map where values are correlated in aparticularly strong and specific way

Page 37: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Local Spatial Autocorr."Clusters"

Pockets of spatial instability

Portions of a map where values are correlated in aparticularly strong and specific way

[High-High] Positive sp. autocorr. of high values (hotspots)

Page 38: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Local Spatial Autocorr."Clusters"

Pockets of spatial instability

Portions of a map where values are correlated in aparticularly strong and specific way

[High-High] Positive sp. autocorr. of high values (hotspots)

[Low-Low] Positive sp. autocorr. of low values (coldspots)

Page 39: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Local Spatial Autocorr."Clusters"

Pockets of spatial instability

Portions of a map where values are correlated in aparticularly strong and specific way

[High-High] Positive sp. autocorr. of high values (hotspots)

[Low-Low] Positive sp. autocorr. of low values (coldspots)

[High-Low] Negative sp. autocorr. (spatial outliers)

Page 40: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Local Spatial Autocorr."Clusters"

Pockets of spatial instability

Portions of a map where values are correlated in aparticularly strong and specific way

[High-High] Positive sp. autocorr. of high values (hotspots)

[Low-Low] Positive sp. autocorr. of low values (coldspots)

[High-Low] Negative sp. autocorr. (spatial outliers)

[Low-High] Negative sp. autocorr. (spatial outliers)

Page 41: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Local Spatial Autocorr."Clusters"

Pockets of spatial instability

Portions of a map where values are correlated in aparticularly strong and specific way

[High-High] Positive sp. autocorr. of high values (hotspots)

[Low-Low] Positive sp. autocorr. of low values (coldspots)

[High-Low] Negative sp. autocorr. (spatial outliers)

[Low-High] Negative sp. autocorr. (spatial outliers)

How to measure it???

Page 42: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

LISAsLocal Indicators of Spatial Association

Statistical tests for spatial cluster detection  →  Statisticalsignificance

Compares the observed map with many randomlygenerated ones to see how likely it is to obtain the observedassociations for each location

Page 43: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

LISAsLocal Indicators of Spatial Association

Statistical tests for spatial cluster detection  →  Statisticalsignificance

Compares the observed map with many randomlygenerated ones to see how likely it is to obtain the observedassociations for each location

= ; =IiZim2 ∑

jWijZj m2

∑ i Z2iN

Page 44: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global
Page 45: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global
Page 46: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

RecapitulationESDA is a family of techniques to explore and spatiallyinterrogate data

Main function: characterize spatial autocorrelation, whichcan be explored:

Globally (e.g. Moran Plot, Moran's I)Locally (e.g. LISAs)

Page 47: Geographic Data Science - Lecture VIdarribas.org/gds15/slides/lecture_06.pdf · Lecture VI Exploring Space in Data Dani Arribas-Bel. Today ESDA Spatial Autocorrelation Measures Global

Geographic Data Science'15 - Lecture 6 by is licensed under a

.

Dani Arribas-BelCreative Commons Attribution-

NonCommercial-ShareAlike 4.0 International License