accuracy and uncertainty - home | ubc...
TRANSCRIPT
![Page 1: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/1.jpg)
Accuracy and Uncertainty
Uncertainty
Variability
Temporal Individual Heterogeneity Spatial
Incomplete Knowledge
Model Parameter Decision
![Page 2: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/2.jpg)
Accuracy and Uncertainty
Why is this an issue?
What is meant by accuracy and uncertainty (data vs rule)?
How things have changed in a digital world.
Spatial data quality issues (Metadata).
![Page 3: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/3.jpg)
Why an Issue?
Imperfect or uncertain reconciliation[science >< practice][concepts >< application][analytical capability >< social context]
It is impossible to make a perfect representation of the world, so uncertainty about it is inevitable
Changing (temporal) patterns (e.g., census)Fractals (e.g., coastlines)
![Page 4: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/4.jpg)
Why an Issue?GIGO (?)
Often little is known of the input data quality, and far too much is assumed about the output quality
GIS fosters data merging
Single municipal database
Taxation
Engineering
Planning
![Page 5: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/5.jpg)
Accuracy and Uncertainty
Why is this an issue?
What is meant by accuracy and uncertainty (data vs rule)?
How things have changed in a digital world.
Spatial data quality issues (Metadata).
Accounting for uncertainty.
![Page 6: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/6.jpg)
Sources of ErrorMeasurement error: different observers, measuring instruments, etc.
ErrorEnvironment
Procedure
Setup Observer
Software
Equipment
![Page 7: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/7.jpg)
Sources of ErrorSpecification error: omitted variables(regression discussion)
Ambiguity, vagueness and the quality of a GIS representation
Blunders or spurious errors
Uncertainty has become a catch-all for ‘incomplete’ representations or a ‘quality’ measure. It can be characterized and managed but not eliminated.
![Page 8: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/8.jpg)
Uncertainty
Uncertainty: a reflection of our imperfect and inexact knowledge of the world.
Data uncertainty: our observations or measurements encompass ambiguity / inherent variability.
(e.g., standard deviation)Rule uncertainty: how we reason with observations—we are unsure of the conclusions we can draw from even perfect data. (e.g., linear versus non-linear models)
![Page 9: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/9.jpg)
Real World
Conception
Measurement & Representation
Analysis
Uncertainty: Data to Rule
![Page 10: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/10.jpg)
Data UncertaintySpatial uncertainty
Natural geographic units?Multivariate extensions?
Census vs samplesVagueness
Statistical, cartographic (i.e., generalization), cognitiveAmbiguity
Values, language (semantics, ontologies)
http://xkcd.com/776/
![Page 11: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/11.jpg)
Data Uncertainty (& MAUP)
RegionsUniformity (one or all aspects?)
# of regions r48 .218924 .296312 .57576 .76493 .9902
Relations typically grow stronger when based on larger geographic units (statistical uncertainty appears to decrease while our ability to assign characteristics to individuals decreases)
![Page 12: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/12.jpg)
Dealing with Data UncertaintyIn fuzzy set theory, it is possible to have partial membership in a set
membership can vary, e.g., from 0 to 1this adds a third option to classification: yes, no, and possibly
Fuzzy approaches have been applied to the mapping of soils, vegetation cover, and land use
![Page 13: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/13.jpg)
Fuzzy Membership FunctionsM
embe
rshi
p
Height50
1
6
Short Medium Tall
![Page 14: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/14.jpg)
Measurement/RepresentationRepresentational models filter reality differently
Vectorcrisp
Rastercan be fuzzy
0.9 – 1.0
0.5 – 0.9
0.1 – 0.5
0.0 – 0.1
Forest
Savannah
Forest membership
![Page 15: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/15.jpg)
Measures of UncertaintyGiven that uncertainty exists in every layer in a GIS, and that decisions are made based on analyses of that data, how can we quantify the ‘certainty’ we have in our data?
The measures of uncertainty we can use are dependent on the type of data we are working with (NOIR).
Measures of central tendencyMeasures of dispersion
![Page 16: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/16.jpg)
Measures of Uncertainty
How to measure the accuracy of nominal attributes?e.g., a vegetation cover map
The confusion or misclassification matrixcompares recorded classes (the observations) with classes obtained by a more accurate process, or from a more accurate source (the reference)
![Page 17: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/17.jpg)
Collecting the Reference Data
Examining every parcel (or pixel) may not be practical
Rarer classes should be sampled more often in order to reliably assess accuracy
sampling is often stratified by class(recall notes on spatial sampling) °
°
°
°°
°°
°°
°
°
°
![Page 18: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/18.jpg)
The bolded numbers reflect correct classification (i.e., where the land use in the database equaled the land use observed in the field). The off-diagonal numbers reflect incorrect land use records in the database.
A B C D E Total
A 80 4 0 15 7 106
B 2 17 0 9 2 30
C 12 5 9 4 8 38
D 7 8 0 65 0 80
E 3 2 1 6 38 50
Total 104 36 10 99 55 304
Misclassification Matrix
Land
use
: in
the
data
base
Land use: in the field
![Page 19: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/19.jpg)
The bolded numbers reflect areas where the land use has not changed. The off-diagonal numbers reflect areas where the land use has changed over time. Looks similar to a confusion matrix, but this time reflects a real change.
A B C D E Total
A 80 4 0 15 7 106
B 2 17 0 9 2 30
C 12 5 9 4 8 38
D 7 8 0 65 0 80
E 3 2 1 6 38 50
Total 104 36 10 99 55 304
Transition Matrix
Land
use
: at t
ime
A
Land use: at time B
Markov models
![Page 20: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/20.jpg)
Misclassification StatisticsPercent correctly classified
total of diagonal entries divided by the grand total, times 100
209/304*100 = 68.8%but chance would give a score of better than 0
Kappa statistic (more)
normalized to range from 0 (chance) to 100evaluates to 58.3%
![Page 21: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/21.jpg)
Per-Polygon and Per-Pixel Assessment
Error can occur in the attributes of polygons, but it can also occur in the positions of the boundaries
better to conceive of the map as a field, and to sample pointsthis also reflects how the data are likely to be used (to query the class at a point)
![Page 22: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/22.jpg)
AssessmentAn example of a vegetation cover map. Two strategies for accuracy assessment are available: to check by area (polygon), or to check by point. In the former case a strategy would be devised for field checking each area, to determine the area's correct class. In the latter, points would be sampled across the state and the correct class determined at each point.
It will be much easier to
sample using points.
![Page 23: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/23.jpg)
Measures of Uncertainty
Errors typically distort interval / ratio measurements by small amounts (unless a blunder or outlier)
Accuracy refers to the amount of deviation from the ‘true’ value
Precisionthe variation among repeated measurements, and also the amount of detail in the reporting of a measurement
![Page 24: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/24.jpg)
The term precision is often used to refer to the repeatability of measurements. On the left, successive measurements have similar values (they are precise), but show a bias away from the correct value (they are inaccurate). On the right, precision is lower but accuracy is higher (no apparent bias).
Precision
![Page 25: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/25.jpg)
Reporting Measurements
The amount of detail in a reported measurement [precision] (e.g., output from a GIS) should reflect its accuracy
“14.4 m” implies an accuracy of ±0.05 m“14 m” implies an accuracy of ±0.5 m
Excess precision should be removed by rounding
![Page 26: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/26.jpg)
Measuring AccuracyRoot Mean Square Error is the square root of the average squared error or deviation
the primary measure of accuracy in map accuracy standards and GIS databasese.g., elevations in a digital elevation model might have an RMSE of 6.1m (TRIM Specs)the abundances of errors of different magnitudes often closely follow a Gaussian or normal distribution
Standard deviations
where yi is an elevation from the DEM, yj is the "true" known or measured elevation of a test point
and N is the number of sample points.
![Page 27: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/27.jpg)
Uncertainty based on an assumed RMSE of 7 m. The Gaussian distribution with a mean of 350 m and a standard deviation of 7 m gives a 95% probability that the true location of the 350 m contour lies in the colored area, and a 5% probability that it lies outside.
Visualizing Uncertainty
![Page 28: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/28.jpg)
A Useful Rule of Thumb
Positional accuracy of features on a paper map is roughly 0.5mm on the map
e.g., 0.5mm on a map at scale 1:20,000 gives a positional accuracy of 10m
this is approximately the U.S. National Map Accuracy Standard, used by BC TRIM
and also allows for digitizing error, stretching of the paper, and other common sources of positional error
![Page 29: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/29.jpg)
Correlation of ErrorsAbsolute positional errors may be high
reflecting the technical difficulty of measuring distances from the Equator and the Greenwich Meridian, or elevations from mean sea level or the geoide
Relative positional errors over short distances may be much lower
positional errors tend to be strongly correlatedover short distances
As a result, positional errors can largely cancel out in the calculation of properties such as distance or area
![Page 30: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/30.jpg)
Rule Uncertainty
Measures of central tendency: Mean (Arithmetic, geometric, harmonic), median or mode?The form of the relation? (linear, nonlinear, multiple regression models)Alternative approaches to many operations such as slope, spatial interpolation.
More than just incomplete knowledge.
Interpolation methods
![Page 31: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/31.jpg)
What is the slope?
Use a 2x2 windowor a 3x3 window?
Maximum difference(2262 - 2017)
Best fitting surface
Several other options
Slope Uncertainty
![Page 32: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/32.jpg)
Slope UncertaintySAGA GIS has nine different slope derivation methods
![Page 33: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/33.jpg)
Accuracy and Uncertainty
Why is this an issue?
What is meant by accuracy and uncertainty (data vs rule)
How things have changed in a digital world.
Spatial data quality issues (Metadata)
Accounting for uncertainty
![Page 34: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/34.jpg)
The Digital Divide: Paper Maps
Standards, such as the National Map Accuracy Standard (NMAS), defined positional accuracy but little else.
Most maps were made by governmental mapping agencies with typically high standards.
Scale, accuracy and resolution are linked on paper maps.
![Page 35: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/35.jpg)
The Digital Divide: Digital Data
Digital data can come from anyone (unknown standards)
Data entry can create problemsDigitizing errorsConflation of data layersDatum differences, scale differencesGeoregistration (rubber sheeting)Mixed pixels
Mandates
An OpenStreetMap.org trace
Filter FilterMandates
Software Data
GIS
![Page 36: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/36.jpg)
Trust in the data provider?How the ‘big three’ of online maps compare to a more precise source.
![Page 37: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/37.jpg)
Geocoding results
Bing Maps Google Maps Yahoo! Maps
Threshold Quantile 95% 67.08 15.36 42.62
Threshold Outlier 111.76 40.81 68.41
![Page 38: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/38.jpg)
Digitizing errors
Data Entry
Map conflation problems
![Page 39: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/39.jpg)
Data entryA common source of error—working directly off-of an aerial photograph (ignoring relief displacement)
But even orthophotosaren’t perfect.
![Page 40: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/40.jpg)
Georegistration error?
Rubber sheet transformation
![Page 41: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/41.jpg)
Analysis: Error PropagationAddresses the effects of errors and uncertainty on the results of GIS analysis
Typical mathematical or statistical approaches are not appropriate.
Almost every input to a GIS is subject to error and uncertaintyIn principle, every output should have confidence limits or some other expression of uncertainty
![Page 42: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/42.jpg)
Showing your [uncertainty] colours
Geostatistical interpolation (kriging)
Zinc data: Predicted values Zinc data: Estimated standard deviation
![Page 43: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/43.jpg)
Accounting for Uncertainty
Traditional statistics vsspatial statistics
spatial autocorrelation is assumed when using spatial data, but it is the antithesis to aspatialstatistics [IID]Analytical error propagation is not possible in such cases.
Vision Vancouver vs NPA in the 2008 elections
![Page 44: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/44.jpg)
Accounting for UncertaintyMonte Carlo Simulation (MCS) or sensitivity analysis
Elevation
Add random value
Determine slope
Repeat 100 times
How likely is the slope we determinethe actual slope value,given that we know theelevation values have anunderlying uncertainty?
Iterators in ArcMap ToolboxGenerate a random raster
Examples of Iterators
![Page 45: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/45.jpg)
Three realizations of a model simulating the effects of error on a digital elevation model. The three data sets differ only to a degree consistent with the known error. Error has been simulated using a model designed to replicate the known error properties of this data set – the distribution of error magnitude, and the spatial autocorrelation between errors.
Error Modelling: M C Simulation
![Page 46: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/46.jpg)
Error in the measurement of the area of a square 100 m on a side. Each of the four corner points has been surveyed; the errors are subject to bivariate Gaussian distributions with standard deviations in xand y of 1 m (dashed circles). The red polygon shows one possible surveyed square (one realization of the error model).
In this case the measurement of area is subject to a standard deviation of 200 sq m; a result such as 10,014.603 is quite likely, though the true area is 10,000 sq m. In principle, the result of 10,014.603 should be rounded to the known accuracy and reported as 10,000 sq m.
Error Modelling
![Page 47: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/47.jpg)
Living with Uncertainty
It is easy to see the importance of uncertainty in GISbut much more difficult to deal with it effectivelybut we may have no option, especially in disputes that arelikely to involve litigation
![Page 48: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/48.jpg)
Some Basic PrinciplesUncertainty is inevitable in GISData obtained from others should never be taken as truth
efforts should be made to determine quality
Effects on GIS outputs are often much greater than expected
there is an automatic tendency to regard outputs from a computer as the truth
![Page 49: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/49.jpg)
Some Basic Principles
Use as many sources of data as possibleand cross-check them for accuracy
Be honest and informative in reporting resultsadd relevant caveats and cautions
Interactive Map DisclaimerData presented should be considered in conjunction with the report. Product demand projections detailed in the report will vary depending on the amount of retrofit activity the 1200 Buildings program stimulates and the extent of retrofit that is implemented in buildings. As there are inherent uncertainties in predicting demand from future activity the product demand projections and findings may not be accurate. Specific advice should be sought and further detailed analysis undertaken before acting or relying on the product demand projections
![Page 50: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/50.jpg)
Accuracy and Uncertainty
Why is this an issue?
What is meant by accuracy and uncertainty (data vs rule)
How things have changed in a digital world.
Spatial data quality issues (Metadata)
![Page 51: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/51.jpg)
MetadataDefinition: Metadata are "data about data“
They describe the content, quality, condition, and other characteristics of data. Metadata help a person to locate and understand data.
In epistemology the word meta means "about (its own category)“. Thus metadata is "data about the data".
![Page 52: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/52.jpg)
MetadataLineage (author, manipulations)
Positional accuracy (∆x, ∆y, ∆z)
Attribute accuracy (misclassification)
Completeness (how thorough?)
Logical consistency (turn tables)
Semantic accuracy (one-to-many)
Temporal information (date obtained, entered into system)
Air photo taken
Event happens
Air photo entered into
GIS
Why event not
recorded?
![Page 53: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/53.jpg)
Examples of Metadata
IdentificationTitle? Area covered? Themes? Currentness? Restrictions?
Data QualityAccuracy? Completeness? Logical Consistency? Lineage?
Spatial Data OrganizationVector? Raster? Type of elements? Number?
Spatial ReferenceProjection? Grid system? Datum? Coordinate system?
![Page 54: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/54.jpg)
Examples of MetadataEntity and Attribute Information
Features? Attributes? Attribute values?Distribution
Distributor? Formats? Media? Online? Price?Metadata Reference
Metadata currentness? Responsible party?
![Page 55: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/55.jpg)
A classification of uncertainty
![Page 56: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/56.jpg)
ConclusionUncertainty is ever-present in GIS analyses—from the source data through to the analyses and to the final output.It is important to be conscious of uncertainty in your data / analyses / presentation and, if necessary, determine the impact of it on your results. (MCS)Knowledge of uncertainty allows us to make estimates of the confidence limits of the results.Metadata!
![Page 57: Accuracy and Uncertainty - Home | UBC Blogsblogs.ubc.ca/advancedgis/files/2019/11/Lecture11AU.pdf · Spatial. Incomplete Knowledge. Model. Parameter. Decision. Accuracy and Uncertainty](https://reader035.vdocuments.site/reader035/viewer/2022062607/60513d1e4006c11fe972d20f/html5/thumbnails/57.jpg)