a gridded snowfall verification method using arcgis: zone-based verification & bias maps joe...
TRANSCRIPT
![Page 1: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/1.jpg)
A Gridded Snowfall Verification Method using ArcGIS: Zone-Based
Verification & Bias Maps
Joe Villani
Ian Lee
Vasil Koleci
NWS Albany, NY
![Page 2: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/2.jpg)
Motivation
Utilize Geographic Information Systems (GIS) technology for a gridded and more representative snowfall verification method
Legacy method (adding reports and dividing by # of reports) has become antiquated:Does not factor in spatial variability
between data points
![Page 3: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/3.jpg)
Methodology
Use ArcGIS 10.2 software ArcCatalog and ArcMap
Create contoured snowfall maps and zonal statistics based on observations
![Page 4: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/4.jpg)
Methodology
Careful QC of snowfall observations is necessary (from trained spotters, public, social media, etc.)Summary of reports issued as Public
Information Statement (PNS)
A Local Hydrometeorological Data Message (RRM) file is generated automatically from PNSContains location name, snowfall amount,
LAT/LON
![Page 5: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/5.jpg)
Methodology
Important to have snowfall reports outside forecast area Allows for more representative interpolation
Gather RRM files from surrounding offices
Python script collects snowfall reports from RRM files and compiles them to a CSV file
Import CSV file into a spreadsheet
![Page 6: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/6.jpg)
RRM File Example
Relevant Data Extracted from
RRM File
![Page 7: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/7.jpg)
Creation of Gridded Snowfall Map
Generate GIS shape file of snowfall reports from spreadsheet using ArcCatalog
Import into ArcMap
![Page 8: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/8.jpg)
Creation of Gridded Snowfall Map
Run an Inverse Distance Weighting (IDW) function in ArcMapCan try other interpolation schemes such
as Natural Neighbor or Spline
Creates a gridded (raster) dataset and contoured snowfall map
Color scheme can be matched to ER standardized forecast snowfall ranges
![Page 9: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/9.jpg)
Gridded (IDW) Snowfall Map
IDW takes into account
distance between points &
interpolates
![Page 10: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/10.jpg)
Zonal Statistics
Run Zonal Statistics (including mean) on
the Gridded
Map
Image source: http://help.arcgis.com
![Page 11: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/11.jpg)
Verification by Forecast Zone
A verification map is
created using ranges
corresponding to local office
advisory & warning criteria
![Page 12: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/12.jpg)
Verification by Forecast Zone
Run Zonal Statistics as a table for statistical values
Output for Mean Snowfall and other stats within each forecast zone
![Page 13: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/13.jpg)
Verification
Table is based on statistics computed from the Gridded (IDW) snowfall map
Mean snowfall used for verification by forecast zone
![Page 14: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/14.jpg)
An Argument for the Gridded Method…
Legacy method would result in mean snowfall skewed towards higher totals in eastern part of the zone where the snowfall reports are concentrated
Gridded method more representative based on incorporating lower amounts west of the zone
![Page 15: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/15.jpg)
Creation of Forecast Bias Maps
Preceding an event, export Forecast Snowfall from GFE to a netCDF file
Script converts netCDF file to a shape file,
Import into ArcMap and convert shape file to raster
![Page 16: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/16.jpg)
Creation of Forecast Bias Maps
Create Gridded snowfall map from observations after event:Subtract
Forecast – Observed to compute bias
![Page 17: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/17.jpg)
Creation of Forecast Bias Maps
Forecast – Observed Snowfall = Bias
Warm colors indicate over-forecast
Cold colors indicate under-forecast
![Page 18: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/18.jpg)
Conclusions
This Gridded GIS-based verification method yields a more representative depiction of snowfall spatially across a region
Aides in computing legacy zone-based verification in a more comprehensive manner
![Page 19: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/19.jpg)
Conclusions Used for official snow verification at ALY
during the 2013-2014 winter season and ALY staff has given positive feedback
Can be used in Social Media posts to give our users a graphical representation of snowfall after an event
![Page 20: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/20.jpg)
Conclusions
Bias Maps show how well or poor a gridded forecast verified spatially
Bias maps of snowfall events can be compiled over entire winter seasons to compute potential positive or negative biasesCan be valuable for determining if
certain areas consistently show a bias
![Page 21: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/21.jpg)
More Examples
![Page 22: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/22.jpg)
More Examples
![Page 23: A Gridded Snowfall Verification Method using ArcGIS: Zone-Based Verification & Bias Maps Joe Villani Ian Lee Vasil Koleci NWS Albany, NY](https://reader035.vdocuments.site/reader035/viewer/2022062308/56649d825503460f94a67b76/html5/thumbnails/23.jpg)
Acknowledgements
John Quinlan – NWS Albany, providing conceptual ideas for computing zone average statistics
Steve Welch – NWS Buffalo, method for creating shape file for snowfall based on reports and LAT/LON
Luigi Meccariello – NWS Albany, assisting in creating observed snowfall maps during the 2013-2014 winter season