james l. franklin nhc/tpc
DESCRIPTION
National Hurricane Center 2007 Forecast Verification Interdepartmental Hurricane Conference 3 March 2008. James L. Franklin NHC/TPC. Summary: Atlantic Track. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/1.jpg)
National Hurricane Center 2007 Forecast Verification
Interdepartmental Hurricane Conference
3 March 2008
James L. FranklinNHC/TPC
![Page 2: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/2.jpg)
Summary: Atlantic Track OFCL track errors set records for accuracy from
36-96 h. Errors continue their downward trends, although skill has been flat for several years.
OFCL track forecasts beat consensus models at some time periods, but trailed the best of the dynamical models (an atypical result).
GFS and UKMET provided best dynamical track guidance. GFDL and NGPS had relatively poor years. ECMWF was mediocre.
A respectable first season for the HWRF, but it isn’t ready to replace the GFDL. A combination of the two is better than either alone.
![Page 3: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/3.jpg)
Summary: Atlantic Intensity Very difficult year (as measured by Decay-
SHIFOR), and OFCL errors were up considerably compared to 2006. OFCL in 2007 was more skillful, however, than in 2006.
Best models were statistical, as has almost always been the case. Four-model consensus (DSHP/LGEM/HWRF/GHMI) seems promising.
![Page 4: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/4.jpg)
Summary: East Pacific Track OFCL track errors set records at 12-36 h. OFCL beat individual dynamical models but not
the consensus (the typical result). There continues to be a much larger difference
between the dynamical models and the consensus in the eastern North Pacific than there is in the Atlantic, which is suggestive of different error mechanisms in the two basins.
![Page 5: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/5.jpg)
Summary: East Pacific Intensity OFCL added considerable value over the
guidance through 48 h, but lagged the guidance thereafter.
Best guidance was statistical. LGEM did very well, as did the 4-model consensus.
![Page 6: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/6.jpg)
Season and May 2007 Aug 2007 Observed Activity Type Outlook Outlook Activity Climatology
Chance Above Normal 75% 85% 33%Chance Near Normal 20% 10% Near Normal 33%Chance Below Normal 5% 5% 33%
Named Storms 13-17 13-16 15 11Hurricanes 7-10 7-9 6 6Major Hurricanes 3-5 3-5 2 2ACE % of Median 125-210 140-200 84 ~100
NOAA’s 2007 Atlantic Hurricane OutlookSlide Courtesy of Eric Blake (NHC)
![Page 7: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/7.jpg)
NOAA’s Atlantic Hurricane Outlooks (ACE)Graphic Courtesy of Gerry Bell (CPC)
Last 6 forecasts have been outside the predicted range.
The Hurricane Specialists have been very concerned about the effect that the seasonal forecasts, and the media hype that surrounds them, have on the hurricane warning program, and are glad to see that NOAA will be looking at ways to minimize these problems.
![Page 8: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/8.jpg)
Verification Rules Verification rules unchanged for 2007. Results
presented here are final. System must be a tropical or subtropical cyclone
at both forecast initial time and verification time. All verifications include depression stage except for GPRA goal verification.
Special advisories ignored (original advisory is verified.
Skill baselines are recomputed after the season from operational compute data. Decay-SHIFOR5 is the intensity skill benchmark.
![Page 9: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/9.jpg)
2007 Atlantic VerificationVT NT TRACK INT(h) (n mi) (kt)============================ 000 208 7.9 2.1012 177 32.8 8.1 024 145 51.2 11.0036 116 70.7 14.0048 93 91.9 17.9072 62 146.0 23.5096 39 167.2 28.6120 23 258.4 30.0
Values in green meet or exceed all-time records.
* 48 h track error for TS and H only was 86.2 n mi, a record.
![Page 10: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/10.jpg)
Atlantic Track Errors by Storm
Fewer than half the storms had any 72-h forecasts, only Dean and Noel had any 5-day forecasts.
![Page 11: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/11.jpg)
Atlantic Track Errors vs. 5-Year Mean
Official forecast was lower than the 5-year mean, but so was CLP5 (statistics dominated by Dean, a “west-runner”).
![Page 12: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/12.jpg)
Atlantic Track Error Trends
Errors have been cut in half since 1990. Sharpest recent declines in 2003-4.
![Page 13: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/13.jpg)
Atlantic Track Skill Trends
Skill has increased since the 1990’s, in particular at the end of the decade, but has been relatively flat for the past few years.
![Page 14: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/14.jpg)
Atlantic 5-Year Mean Track Errors
Track errors increase by about 55 n mi per day.
Intensity errors level off because intensity is a much more bounded problem.
![Page 15: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/15.jpg)
OFCL Error Distributions and Cone Radii
Last year’s 4- and 5-day cones were 252 and 326 n mi, respectively.
![Page 16: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/16.jpg)
2007 Track Guidance
Official forecast beat consensus models at some time periods.
Best models were GFS and UKMET (especially using subjective tracker - EGRI). UKMET was last in 2006!
GFDL/NOGAPS had rough years, so much so that they were a drag on the consensus.
GFNI, AEMI, FSSE excluded due to insufficient availability (less than 67% of the time at 48 or 120 h).
![Page 17: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/17.jpg)
GFDL-HWRF ComparisonGood first year for the HWRF; competitive for intensity, better than GFDL for track (mainly Dean). Consensus of the two better than either alone.
![Page 18: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/18.jpg)
Guidance Trends
UKMET goes from worst to first. NOGAPS has 5th poor season in a row (and 9th out of the last 10, at least at 48 h). Even so, it contributes positively to the consensus.
![Page 19: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/19.jpg)
Guidance Trends
Relative performance at 120 h is more variable, although GFSI has been strong every year except 2005. NGPI is better at the longer periods, GFDL less so.
![Page 20: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/20.jpg)
Consensus Models
Use of EGRI (subjective tracker) improves the GUNA consensus (GENA). Mixed bag for FSSE, which appeared to lag behind at longer forecast intervals.
![Page 21: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/21.jpg)
Consensus Models
Second year in a row AEMI trailed the control run. Multi-model ensembles remain far more effective for TC forecasting. ECMWF ensemble mean is also not as good as the control run.
![Page 22: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/22.jpg)
Goerss Corrected ConsensusContinues to be of benefit, or at least no harm.
![Page 23: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/23.jpg)
Forecaster Consensus
Forecasters appear to have been successful in selecting their own consensus (in the Atlantic).
![Page 24: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/24.jpg)
Atlantic Intensity Errors vs. 5-Year Mean
In contrast to 2006, 2007 had storms that were difficult to forecast, as measured by D-SHIFOR (Dean and Felix, presumably), and OFCL suffered as a result, with errors significantly above the 5-year mean.
![Page 25: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/25.jpg)
Atlantic Intensity Error Trends
No progress with intensity.
![Page 26: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/26.jpg)
Atlantic Intensity Skill Trends
Skill returns to previous levels, with little net change over the past several years.
![Page 27: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/27.jpg)
2007 Intensity Guidance
OFCL beat the available guidance through 72 h. Statistical models back in their accustomed position, ahead of dynamical models. With the advent of the LGEM and HWRF, we now can form a 4-member intensity consensus…
![Page 28: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/28.jpg)
2007 Intensity Guidance
…which is at least as good as the best individual model at all time periods except 120 h.
![Page 29: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/29.jpg)
2007 Intensity Guidance
FSU Superensemble trailed the simple intensity consensus.
![Page 30: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/30.jpg)
2007 East Pacific VerificationVT NT TRACK INT(h) (n mi) (kt)============================000 223 10.2 1.2012 208 30.0 5.1024 182 50.2 8.2036 156 71.4 11.6048 140 92.5 14.4072 108 117.2 18.1096 77 146.9 20.8120 52 186.3 17.0
Values in green tied or exceeded all-time lows.
![Page 31: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/31.jpg)
2007 vs 5-Year Mean
CLIPER errors in 2007 were above their previous 5-yr means. Despite this, OFCL errors were below their previous 5-yr means.
![Page 32: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/32.jpg)
EPAC Track Error Trends
Since 1990, track errors have decreased by about 1/3.
![Page 33: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/33.jpg)
EPAC Track Skill Trends
Skill continues to improve.
![Page 34: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/34.jpg)
OFCL Error Distributions and Cone Radii
![Page 35: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/35.jpg)
2007 Track Guidance
UKMI, EGRI, AEMI, FSSE, GUNA excluded due to insufficient availability.
Official forecast beat the CONU consensus at some time periods; beat each individual model.
EMXI best by wide margin (largely due to Kiko).
![Page 36: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/36.jpg)
GFDL-HWRF Comparison
Overall, HWRF performance not as good as the GFDL, especially at longer periods. Consensus did add value for intensity through 72 h.
![Page 37: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/37.jpg)
Consensus Models
No standouts. Substitution of EGRI for UKMI improves GUNA.
![Page 38: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/38.jpg)
Goerss Corrected Consensus
Did not help in 2007.
![Page 39: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/39.jpg)
Forecaster Consensus
Unlike the Atlantic, forecaster’s selective consensus didn’t work in the eastern Pacific. Suggests that error mechanisms in the eastern Pacific are more subtle than the Atlantic, making erroneous outliers harder to detect.
![Page 40: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/40.jpg)
Eastern North Pacific Intensity Errors vs. 5-year Mean
OFCL errors were lower than 5-yr means, but so were the Decay-SHIFOR errors.
![Page 41: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/41.jpg)
EPAC Intensity Error Trends
Same as it ever was…same as it ever was…
♫♫
![Page 42: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/42.jpg)
EPAC Intensity Skill Trends
Skill does seem to be inching upward…
![Page 43: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/43.jpg)
2007 Intensity Guidance
OFCL added significant value over the guidance through 48 h. Wind biases turn sharply negative at 96-120 h.
LGEM provided most skillful guidance overall. HWRF had trouble, presumably with decay over cooler waters?
![Page 44: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/44.jpg)
2007 Intensity Guidance
Good value in multi-model consensus.
![Page 45: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/45.jpg)
Consensus Changes for 2008 Fixed consensus models (require all present)
TCON: AVNI EGRI NGPI GHMI HWFI ICON: DSHP LGEM GHMI HWFI
Variable consensus models (require 2 present) TVCN: AVNI EGRI NGPI GHMI HWFI GFNI EMXI IVCN: DSHP LGEM GHMI HWFI GFNI
Corrected versions of TCON and TVCN will be TCCN and TVCC, respectively.
Substitute EGRI for UKMI in GUNA. Discontinue CONU (it's superseded by TVCN),
CCON (superseded by TVCC), GUNS, GENA (superseded by GUNA), CONE, and INT4.
![Page 46: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/46.jpg)
Genesis Forecast Verification
Good correlation between forecast and verifying genesis rates in the Atlantic with only a weak over-forecast bias.
Poor correlation (except at the extremes), with a large under-forecast bias.
![Page 47: James L. Franklin NHC/TPC](https://reader036.vdocuments.site/reader036/viewer/2022062315/5681662a550346895dd98c5d/html5/thumbnails/47.jpg)
Genesis Verification by BinsATLANTIC
Range (%) % Expected % Verified # Forecasts0-10 (Low) 5 3 389
20-50 (Med) 28 18 26360-100 (High) 71 66 53
EASTERN NORTH PACIFICRange (%) % Expected % Verified # Forecasts0-10 (Low) 6 6 179
20-50 (Med) 26 47 16260-100 (High) 70 90 29
NHC will issue experimental public quantitative/categorical genesis forecasts in 2008 in association with the Graphical Tropical Weather Outlook.