![Page 1: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/1.jpg)
Stream 1.5 Runs of SPICE
Kate D. Musgrave1, Mark DeMaria2, Brian D. McNoldy1,3, and Scott Longmore1
1CIRA/CSU, Fort Collins, CO2 NOAA/NESDIS/StAR, Fort Collins, CO
3Current Affiliation: RSMAS, University of Miami, Miami, FLAcknowledgements: Yi Jin, Naval Research Lab Michael Fiorino, Jeffrey Whitaker, Philip Pegion, NOAA/ESRL Vijay Tallapragada, NOAA/NWS/NCEP/EMC
![Page 2: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/2.jpg)
2
Outline
• SPICE Overview• 2012 Verification – NHC Delivery• 2012 Verification – Full Season• Global SPICE• Diagnostic Code Updates• Outlier Analysis• Summary
![Page 3: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/3.jpg)
SPICE (Statistical Prediction of Intensity from a Consensus Ensemble)
Model Configuration for Consensus • SPICE forecasts TC intensity using a combination of parameters from:– Current TC intensity and trend– Current TC GOES IR– TC track and large-scale environment from
GFS, GFDL, and HWRF models• These parameters are used to run DSHP
and LGEM based off each dynamical model
3HFIP Telecon, 10/24/2012
• The forecasts are combined into two unweighted consensus forecasts, one each for DSHP and LGEM
• The two consensus are combined into the weighted SPC3 forecast
DSHP and LGEM Weights for Consensus
![Page 4: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/4.jpg)
SPICE VerificationCompare with Parent Models LGEM, DSHP, GHMI, HWFI
4HFIP Telecon, 10/24/2012
• Use working best track [ through AL17 (Rafael), and EP16 (Paul) ]• NHC verification rules – Tropical, subtropical only• Must also have OFCL forecast • Stream 1.5 sample – Only those delivered to NHC• Combined sample – Add cases run at CIRA but not sent to NHC
![Page 5: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/5.jpg)
5
Mean Absolute Errors – Atlantic
HFIP Telecon, 10/24/2012
![Page 6: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/6.jpg)
Skill Relative to SHF5 - Atlantic
6HFIP Telecon, 10/24/2012
![Page 7: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/7.jpg)
7
Mean Absolute Errors – East Pacific
HFIP Telecon, 10/24/2012
![Page 8: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/8.jpg)
Skill Relative to SHF5 – East Pacific
8HFIP Telecon, 10/24/2012
![Page 9: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/9.jpg)
Global SPICE
9HFIP Telecon, 10/24/2012
![Page 10: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/10.jpg)
Diagnostic Code Updates
10HFIP Telecon, 10/24/2012
![Page 11: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/11.jpg)
Outlier Analysis
11HFIP Telecon, 10/24/2012
![Page 12: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/12.jpg)
Improvements to SPICE through Outlier Analysis
• Develop single parameter for intensity error for a given forecast case– Normalize error at each forecast time by standard
deviation of intensity changes from best track over that time interval
– Time averaged normalized intensity errors (TANIE)– Require verification out to at least 36 h
• Identify outliers– Look for common characteristics– Use as guidance for statistical model improvements– Adjust weights in SPICE if errors are systematic
12HFIP Telecon, 10/24/2012
![Page 13: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/13.jpg)
TANIE for 2012 LGEM Forecasts
13HFIP Telecon, 10/24/2012
![Page 14: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/14.jpg)
14
Top 10 TANIE Values for 2012 Models
LGEM DSHP HWFI GHMI
1. Michael 090406 Kirk 083112 Michael 090406 Michael 090412
2. Kirk 083112 Michael 090318 Michael 090418 Michael 090406
3. Michael 090318 Michael 090406 Michael 090412 Michael 090400
4. Michael 090400 Michael 090400 Michael 090400 Gordon 081518
5. Florence 080500 Kirk 083106 Kirk 083112 Michael 090418
6. Ernesto 080406 Michael 090412 Leslie 090606 Ernesto 080806
7. Michael 090412 Leslie 083018 Ernesto 080506 Kirk 083112
8. Kirk 083106 Alberto 052000 Leslie 090600 Michael 090500
9. Alberto 052000 Kirk 083112 Leslie 083012 Michael 090506
10. Michael 090512 Isaac 082112 Michael 090500 Nadine 092518
Blue = Low Bias Red = High Bias
![Page 15: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/15.jpg)
Possible SPICE Improvements
• Low bias for RI cases– Use RII as predictor in SHIPS/LGEM
• High bias for nonlinear combination of dry air and shear (Kirk and several east Pacific cases)– New predictor for SHIPS/LGEM or modified MPI
• Shear direction relative to motion vector may be important (Ernesto, Gordon)– Modify shear direction predictor
• Larger uncertainty for low V(0), high SST cases• Serial correlation of errors– SPICE weight adjustments 15HFIP Telecon, 10/24/2012
![Page 16: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/16.jpg)
Summary
• SPICE was run for most cases during 2012 Hurricane Season
• Atlantic SPICE errors smaller than parent models for 24 thorough 72 hr
• East Pacific SPICE errors larger than some parent models at all forecast times
• Global Ensemble SPICE under development• CIRA diagonstic code to be upgraded for 2013• Outlier analysis may lead to SPICE
improvements for 2013 16HFIP Telecon, 10/24/2012
![Page 17: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/17.jpg)
Back-Up Slides
17HFIP Telecon, 10/24/2012
![Page 18: Stream 1.5 Runs of SPICE Kate D. Musgrave 1, Mark DeMaria 2, Brian D. McNoldy 1,3, and Scott Longmore 1 1 CIRA/CSU, Fort Collins, CO 2 NOAA/NESDIS/StAR,](https://reader035.vdocuments.site/reader035/viewer/2022062519/5697bfbe1a28abf838ca2b8e/html5/thumbnails/18.jpg)
Motivation for Statistical Ensemble
• The Logistic Growth Equation Model (LGEM) and the Statistical Hurricane Intensity Prediction Scheme (SHIPS) model are two statistical-dynamical intensity guidance models
• SHIPS and LGEM are competitive with dynamical models
• Both SHIPS and LGEM use model fields from the Global Forecast System (GFS) to determine the large-scale environment
• Runs extremely fast (under 1 minute), using model fields from previous 6 hr run to produce ‘early’ guidance
Atlantic Operational Intensity Model Errors 2007-2011
18
• JTWC experience with a similar statistical model shows improvements with multiple inputs
We focus on using Decay-SHIPS (DSHP) and LGEM, initialized with model fields from GFS, the Hurricane Weather Research and Forecasting (HWRF) model, and the Geophysical Fluid Dynamics Laboratory (GFDL) model to create an ensemble
HFIP Telecon, 10/24/2012