empirical statistical downscaling - value: cost · empirical statistical downscaling robustness...

23
Empirical Statistical Downscaling Robustness & limitations

Upload: others

Post on 11-Jul-2020

14 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Empirical Statistical Downscaling

Robustness & limitations

Page 2: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Limitations: Observations

●Can only model variables for which there is sufficient observations. ●Observations are also needed for evaluation of all simulations.●Gridding can provide a means of filling in informations where the variable is a smooth function in space and dependent on geographical character●Time scales limitations – depends on observations and dependencies.

Page 3: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Quality of observations

●The observations may contain errors.● Instrument● Digitising & logging.

●Homogeneous?● History of observer● Relocation● Environment● Instruments● Practices (time of day)● Quality control?

Page 4: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Quality flags

Page 5: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Large-scale pattern

Page 6: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Why the poor scores?

Page 7: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Geographical gaps

●Locations with no useful observations of the required variable.●Nothing can replace measurements – but we can nevertheless make som tentative estimates...

Page 8: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Geographical information

●Expect some geographical dependency●Gridding (geographical regression models) can provide some indication of skill (ANOVA).●Cannot evaluate results where there is no data.●Can test by witholding data from some locations and then compare these with gridded results.●Useful to apply ESD to locations from different regions for testing purposes – robustness.

Page 9: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical
Page 10: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Stationarity●This is a limitations for all models (parameterisation)●Depends on the choice of predictors – physics basis...●Can be tested using RCMs/GCMs as pseude-reality.

● Sign in the results suggesting changing character between large and small scale dependency?

●Test: predict past trends in a split sample exercise.

Page 11: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Spatial coherence/consistency

● Also temporal structure and dependencies between quantiles (consistent PDF).

● Some types of models (analogs) can provide description of a set of variables

● Variable-inter-dependencies depend on choice of predictors.

● Perfect DS should capture large scales. Question about intermediate scales.

Page 12: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Physical, scale, & internal consistency?

● No downscaling is guaranteed physical consistent.● There should be scale consistency – aggrigation should

give the same answer as the original predictor/GCM.● Fluxes & energy budgets: rate of evaporation &

precipitation. ● Inter-relation between different variables and

spatial/temporal coherency?● Validation: both in terms of statistics & physics.● Remedy: two-way coupling for RCMs.

Page 13: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

MisconceptionsMisconceptions Wrong to regard RCMs as 'physical consistent' Non-stationarity not only an ESD-relevant issue

Latent heat flux at surface/precip: METNOHIRHAM driven by ERA40 - ERA40.

Implications for the large-scale vertical heat flow

Page 14: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Extreme tails

● The upper tail is often not well captured.● Methods resampling past (analogs) not able to

predict new record-breaking values.● Possible solution: predict the PDFs.

Page 15: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Scarce information space

● Only a few variables (those observed)● Not a comprehensive picture.

Page 16: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Changes to local conditions

● Changes in vegetation & landscape.● Pollution or urbanisation.● Need to account for in calibration – depends

on f(.) in y = f(X).

Page 17: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

The important thing to remember

● Testing, evaluating, and assessing.● Independent data.● Sensitivity tests.● Use all relevant information.● Apply method to other locations.● Pseudo-reality.● Look for physics.

Page 18: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Dependency to large scales

● Cannot correct invalid GCM predictions.● Account for GCM-predicted ranges – use

ensembles.● Ensemble spread = PDF.● Some idea of range.

Page 19: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Deser et al (2012), Nature Climate Change

Page 20: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Deser et al (2012), Nature Climate Change

Page 21: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Uncertainties:

●Large-scales.● Sampling, GCMs, emission scenario,...

●Downscaling.● Independent and different to RCMs.

●Observations.

Page 22: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

ESD & RCMs: compllimentary!

T(2m):ESD & ENSEMBLES

After bias Correction:

Consistent pictureRobust response

Page 23: Empirical Statistical Downscaling - VALUE: COST · Empirical Statistical Downscaling Robustness & limitations. Limitations: Observations ... No downscaling is guaranteed physical

Summary: Caveats associated with ESD

Stationarity & non-stationarity (detrend, split sample, physics, perfect model studies, pseudo-reality)

Signal & predictors (past trends, physics)

Strength of dependency (R2)

Risk of coincidental fit (cross-validation, split sample, stepwise, geographical distribution)

Skillful simulation (common EOFs, diagnostics of PP-fit, past trends, climatology)

Remedy – always test, explore, and validate!Remedy – always test, explore, and validate!