goes-r awg & risk reduction review meeting, university of maryland, 20-24 july, 2009

1
GOES-R AWG & Risk Reduction Review Meeting, University of Maryland, 20-24 July, 2009 Developing an Algorithm for Validation of GOES-R Retrieved Land Surface Temperature Using SURFRAD Observed LST as Ground Truth and Taking into Account Systematic Diurnal-Seasonal Cycles in the Differences Konstantin Y. Vinnikov (University of Maryland), Yunyue Yu, Ming Chen, Dan Tarpley, Kevin Gallo, and Mitchell D. Goldberg (NOAA/NESDIS) AWG LAND TEAM THREE YEAR (2001, 2004 & 2005) STATISTICS OF CLEAR SKY LAND SURFACE TEMPERATURE SIMULTANEOUSELY OBSERVED AT GOES-10 SATELLITE AND AT SIX SURFRAD STATIONS. Version 2 of Clear Sky Detection Algorithm by Ming Chen et al. (2009) N obs – is Number of observations; SD(T G -T S ) – is Standard Deviation of LST validation difference; SD(T G ’-T S ’) – is Standard Deviation of diurnal/seasonal cycles adjusted LST validation difference; SD(<T G -T S >) – is Standard Deviation of diurnal/seasonal component LST validation difference; SURFRAD STATION LAND COVER Lat ºN Lon ºE N obs SD (T G -T S ) ºC SD (T G '-T S ') ºC SD <T G -T S > ºC Goodwin Creek, MS Needle-Leaf Forest 34. 25 89.87 1,70 0 1.5 1.1 0.9 Desert Rock, NV Open Shrub Land 36. 63 116.0 2 11,8 70 1.3 1.0 0.7 Bondville, IL Cropland 40. 05 88.37 6,88 0 1.8 1.5 1.0 Boulder, CO Cropland 40. 13 105.2 4 7,08 0 1.5 1.3 0.7 Fort Peck, MT Grassland 48. 31 105.1 0 7,44 0 1.5 1.4 0.6 Penn State, PA Mixed Forest 40. 72 77.93 700 1.9 1.7 1.0 Testing Two-Observational Validation Approach: GOES-10 vs. SURFRAD. DATA: 2001, 2004, 2005 Testing Three- Observational Validation Approach: GOES-8 vs. SURFRAD vs. GOES-10. DATA: 2001 Three-Observational Validation Strategy 1. Select land based stations with observation of LST (SURFRAD and CRN). 2. Use three instantaneous LST observations at surface station y S (t) and two satellites GOES-W y W (t), & GOES-E y E (t). 3. Compute three differences between each pair of independently observed LST for each time: y W (t)-y S (t), y E (t)-y S (t), & y E (t)-y W (t). 4. Monitor these mean differences and their standard deviations in the moving time window. The optimal width of the window and the acceptable thresholds for these parameters should be determined. 5. As soon as at least one full year of observed data is available, it should be used to obtain estimates of time dependent expected values Y S (t), Y W (t), & Y E (t). 6. Compute residuals r S (t)=y S (t)-Y S (t), r W (t)=y W (t)-Y W (t), & r E (t)=y E (t)-Y E (t) and differences of the residuals: r W (t)-r S (t), r E (t)-r S (t), & r E (t)-r W (t). 7. Monitor these mean residual differences and their standard deviations in the moving time window. Assessment of Opportunity to Use CRN Observed LST as Ground Truth to Validate GOES-R CLR Sky. Bondville, IL. 40.05 o N, 88.37 o W Estimates of Standard Deviations (σ) and Standard Errors (δ) of LST Observations at SURFRAD Stations, and Satellites GOES-8 & GOES-10 Theory of errors : y 1 (t)=Y 1 (t)+y’(t)+ ε 1 (t), SURFRAD y 2 (t)=Y 2 (t)+y’(t)+ ε 2 (t), GOES-W y 3 (t)=Y 3 (t)+y’(t)+ ε 3 (t). GOES-E LST Variance: σ 2 =E(y’ 2 ); Variances of Observation Errors: δ 1 2 =E(ε 1 2 ), δ 2 2 =E(ε 2 2 ), δ 3 2 =E(ε 3 2 ). VAR[y 1 (t)-Y 1 (t)-y 2 (t)+Y 2 (t)]=δ 1 2 2 2 , VAR[y 2 (t)-Y 2 (t)-y 3 (t)+Y 3 (t)]=δ 2 2 3 2 , VAR[y 3 (t)-Y 3 (t)-y 1 (t)+Y 1 (t)]=δ 3 2 1 2 . SD Standard Errors σ ºC δ SURFRAD ºC δ GOES-8 ºC δ GOES-10 ºC Goodwin Creek, MS 3.7 0.6 0.8 0.7 Desert Rock, NV 3.0 0.6 1.2 0.8 Bondville, IL 3.5 1.3 0.8 0.8 Boulder, CO 4.3 0.9 1.3 1.0 F ort Peck, MT 5.1 1.1 1.1 0.8 Empirical estimates of Standard Errors in SURFRAD and GOES satellites observed LST. Data: Hourly observations for 2001: Version 1 of Clear Sky Detection Algorithm - Manual screening by Rama Varma Raja. M. K. et al. (2008) CONCLUSIONS: Estimated Standard Errors of LST observation at SURFRAD stations are found to be in the range of 0.6-1.3ºC. Standard Errors of GOES-E and GOES-W LST observation at location of these stations are found to be almost in the same range of 0.7-1.3ºC. All these random errors of observation are relatively small compared to Standard Deviation of LST signal which is in the range of 3.0-5.1ºC. Systematic (bias) differences between SURFRAD and GOES-E & W observed LST have noticeable diurnal-seasonal cycles that are evaluated using observations of GOES-8 & 10 GOES satellites, the predecessors to GOES-R. This systematic diurnal-seasonal cycles are found to be equivalent to random error with Standard Deviation in range of 0.6-1.0ºC. Raw validation differences, LST SURFRAD – LST GOES , have standard deviations in the range 1.3-1.9ºC. The adjustment of these differences for systematic diurnal-seasonal cycles decreases their standard deviations to 1.0-1.7ºC. The adjusted validation differences can be analyzed as zero mean normally distributed random errors. Analysis of multi-year parallel observation of LST at four collocated Climate Reference Network (CRN) and SURFRAD stations revealed significant irregularities and instabilities in CRN LST records. Currently unavailable, five-minute averages of LST observed at CRN stations should be included in the list of archived variables. They could be better alternative to currently archived one hourly averages. More work on quality control, validation and improvement of CRN LST observation itself is needed before it can be used as ground truth for validation of satellite observed LST. Testing of three-observational approach should be continued using more data. More observation of GOES-8 / SURFRAD observation is needed to improve statistics of diurnal-seasonal LST variations that is needed to increase GOES-R retrieved LST validation accuracy. RAW VALIDATION DIFFERENCES OF GOES-10 AND SURFRAD OBSERVRD LST DIURNAL-SEASONAL CYCLES ADJUSTED LST VALIDATION DIFFERENCES CLR Sky. Desert Rock, NV. 36.63ºN, 116.02ºW CLR Sky. Fort Peck, MT. 48.31ºN, 105.10ºW CLR Sky. Sioux Fall, SD. 43.81ºN, 96.95ºW Communicating author: Kostya Vinnikov, [email protected] , Approximation of diurnal-annual cycles in Land Surface Temperature y(t)=Y(t)+y’(t)+ε(t). (1) y(t) – observed LST, Y(t) – time (t) dependent expected value (diurnal and annual cycles), y’(t) – weather/ climate related signal, ε(t) – random error of observation. The mathematical model for approximation of Y(t) is the same as in [Vinnikov & Grody, 2003; Vinnikov et al., 2004; Vinnikov et al., 2006], but without trend component: . ) ( ) ( 2 H k T n t i K K k N N n kn e a t Y Two harmonics of annual and diurnal periods (N=K=2) are used to describe the annual (T=1 year) and diurnal (H=1 day) variation in the expected value of the land surface temperature, Y(t).

Upload: xyla-cantu

Post on 03-Jan-2016

35 views

Category:

Documents


3 download

DESCRIPTION

GOES-R AWG & Risk Reduction Review Meeting, University of Maryland, 20-24 July, 2009 Developing an Algorithm for Validation of GOES-R Retrieved Land Surface Temperature Using SURFRAD Observed LST as Ground Truth and Taking into Account Systematic Diurnal-Seasonal Cycles in the Differences - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: GOES-R AWG & Risk Reduction Review Meeting, University of Maryland, 20-24 July, 2009

GOES-R AWG & Risk Reduction Review Meeting, University of Maryland, 20-24 July, 2009

Developing an Algorithm for Validation of GOES-R Retrieved Land Surface Temperature Using SURFRAD Observed LST as Ground Truth and Taking into Account Systematic Diurnal-Seasonal Cycles in the Differences

Konstantin Y. Vinnikov (University of Maryland), Yunyue Yu, Ming Chen, Dan Tarpley, Kevin Gallo, and Mitchell D. Goldberg (NOAA/NESDIS)

AWG LAND TEAM

THREE YEAR (2001, 2004 & 2005) STATISTICS OF CLEAR SKY LAND SURFACE TEMPERATURE SIMULTANEOUSELY OBSERVED AT GOES-10 SATELLITE AND AT SIX SURFRAD STATIONS.Version 2 of Clear Sky Detection Algorithm by Ming Chen et al. (2009)Nobs – is Number of observations;

SD(TG-TS) – is Standard Deviation of LST validation difference;

SD(TG’-TS’) – is Standard Deviation of diurnal/seasonal cycles adjusted LST validation difference;

SD(<TG-TS>) – is Standard Deviation of diurnal/seasonal component LST validation difference;

SURFRAD STATION

LAND COVERLatºN

LonºE

Nobs SD(TG-TS)

ºC

SD(TG'-TS')

ºC

SD<TG-TS>

ºC

Goodwin Creek, MS

Needle-Leaf Forest

34.25 89.87 1,700 1.5 1.1 0.9

Desert Rock, NV Open Shrub Land

36.63 116.02 11,870 1.3 1.0 0.7

Bondville, IL Cropland 40.05 88.37 6,880 1.8 1.5 1.0

Boulder, CO Cropland 40.13 105.24 7,080 1.5 1.3 0.7

Fort Peck, MT Grassland 48.31 105.10 7,440 1.5 1.4 0.6

Penn State, PA Mixed Forest 40.72 77.93 700 1.9 1.7 1.0

Testing Two-Observational Validation Approach:GOES-10 vs. SURFRAD. DATA: 2001, 2004, 2005

Testing Three- Observational Validation Approach:GOES-8 vs. SURFRAD vs. GOES-10. DATA: 2001

Three-Observational Validation Strategy1.Select land based stations with observation of LST (SURFRAD and CRN). 2.Use three instantaneous LST observations at surface station yS (t) and two

satellites GOES-W yW(t), & GOES-E yE(t). 3.Compute three differences between each pair of independently observed LST

for each time: yW(t)-yS (t), yE(t)-yS(t), & yE(t)-yW(t).4.Monitor these mean differences and their standard deviations in the moving

time window. The optimal width of the window and the acceptable thresholds for these parameters should be determined.

5.As soon as at least one full year of observed data is available, it should be used to obtain estimates of time dependent expected values YS(t), YW(t), & YE(t).

6.Compute residuals rS(t)=yS(t)-YS(t), rW(t)=yW(t)-YW(t), & rE(t)=yE(t)-YE(t) and differences of the residuals: rW(t)-rS(t), rE(t)-rS(t), & rE(t)-rW(t).

7.Monitor these mean residual differences and their standard deviations in the moving time window.

Assessment of Opportunity to Use CRN Observed LST as Ground Truth to Validate GOES-R Observed LST Data

CLR Sky. Bondville, IL. 40.05oN, 88.37oW

Estimates of Standard Deviations (σ) and Standard Errors (δ) of LST Observations at SURFRAD Stations, and Satellites GOES-8 & GOES-10

Theory of errors:y1(t)=Y1(t)+y’(t)+ ε1(t), SURFRADy2(t)=Y2(t)+y’(t)+ ε2(t), GOES-Wy3(t)=Y3(t)+y’(t)+ ε3(t). GOES-E

LST Variance: σ2=E(y’2); Variances of Observation Errors: δ12 =E(ε1

2), δ22=E(ε2

2), δ32=E(ε3

2).

VAR[y1(t)-Y1(t)-y2(t)+Y2(t)]=δ12+δ2

2,VAR[y2(t)-Y2(t)-y3(t)+Y3(t)]=δ2

2+δ32,

VAR[y3(t)-Y3(t)-y1(t)+Y1(t)]=δ32+δ1

2.

SD Standard Errors σ ºC

δSURFRAD ºC

δGOES-8 ºC

δGOES-10 ºC

Goodwin Creek, MS 3.7 0.6 0.8 0.7

Desert Rock, NV 3.0 0.6 1.2 0.8

Bondville, IL 3.5 1.3 0.8 0.8

Boulder, CO 4.3 0.9 1.3 1.0

Fort Peck, MT 5.1 1.1 1.1 0.8

Empirical estimates of Standard Errors in SURFRAD and GOES satellites observed LST.

Data: Hourly observations for 2001: Version 1 of Clear Sky Detection Algorithm - Manual screening by Rama Varma Raja. M. K. et al. (2008)

CONCLUSIONS:

• Estimated Standard Errors of LST observation at SURFRAD stations are found to be in the range of 0.6-1.3ºC. Standard Errors of GOES-E and GOES-W LST observation at location of these stations are found to be almost in the same range of 0.7-1.3ºC. All these random errors of observation are relatively small compared to Standard Deviation of LST signal which is in the range of 3.0-5.1ºC.

• Systematic (bias) differences between SURFRAD and GOES-E & W observed LST have noticeable diurnal-seasonal cycles that are evaluated using observations of GOES-8 & 10 GOES satellites, the predecessors to GOES-R. This systematic diurnal-seasonal cycles are found to be equivalent to random error with Standard Deviation in range of 0.6-1.0ºC.

• Raw validation differences, LSTSURFRAD – LSTGOES, have standard deviations in the range 1.3-1.9ºC. The adjustment of these differences for systematic diurnal-seasonal cycles decreases their standard deviations to 1.0-1.7ºC. The adjusted validation differences can be analyzed as zero mean normally distributed random errors.

• Analysis of multi-year parallel observation of LST at four collocated Climate Reference Network (CRN) and SURFRAD stations revealed significant irregularities and instabilities in CRN LST records. Currently unavailable, five-minute averages of LST observed at CRN stations should be included in the list of archived variables. They could be better alternative to currently archived one hourly averages. More work on quality control, validation and improvement of CRN LST observation itself is needed before it can be used as ground truth for validation of satellite observed LST.

• Testing of three-observational approach should be continued using more data. More observation of GOES-8 / SURFRAD observation is needed to improve statistics of diurnal-seasonal LST variations that is needed to increase GOES-R retrieved LST validation accuracy.

RAW VALIDATION DIFFERENCES OF GOES-10 AND SURFRAD OBSERVRD LST

DIURNAL-SEASONAL CYCLES ADJUSTED LST VALIDATION DIFFERENCES

CLR Sky. Desert Rock, NV. 36.63ºN, 116.02ºW

CLR Sky. Fort Peck, MT. 48.31ºN, 105.10ºW

CLR Sky. Sioux Fall, SD. 43.81ºN, 96.95ºW

Communicating author: Kostya Vinnikov, [email protected], 301-405-5382

Approximation of diurnal-annual cycles in Land Surface Temperature

y(t)=Y(t)+y’(t)+ε(t). (1)

y(t) – observed LST,Y(t) – time (t) dependent expected value (diurnal and annual cycles),y’(t) – weather/ climate related signal,ε(t) – random error of observation.

The mathematical model for approximation of Y(t) is the same as in [Vinnikov & Grody, 2003; Vinnikov et al., 2004; Vinnikov et al., 2006], but without trend component:

.)()(2

H

k

T

ntiK

Kk

N

Nnkn eatY

Two harmonics of annual and diurnal periods (N=K=2) are used to describe the annual (T=1 year) and diurnal (H=1 day) variation in the expected value of the land surface temperature, Y(t).