making maintenance manageable
DESCRIPTION
As presented by Rob Gaines of the FEMA Risk Management Team, Zimmerman AssociatesTRANSCRIPT
Making Maintenance Manageable
Rob GainesSenior GIS Analyst, Zimmerman Associates (FEMA Ctr)
April 18th, 2012
Using FME to Maintain FEMA’s National Flood Hazard Layer
What is the NFHL?
FEMA’s National Flood Hazard Layer, part of the National Flood Insurance Program.
Nationwide regulatory GIS dataset used to communicate flood risk information.
The Numbers
Compiled from 2081 individual community or countywide flood study datasets (and growing).
Average 95 county/communities updated per month.
32 spatial layers, 18 lookup tables.
Over 85 million records in total.
How is the NFHL Accessed?
MapViewer: 100,000 – 200,000 requests per month.
KMZ/WMS: 3 – 6 million requests per month.
NFHL Extract (via state shapefiles).
What is the NFHL?
What is the NFHL?
What is the NFHL?
What is the NFHL?
FIRM/NFHL Production Structure
FIRM DatabaseCounty Dataset
PTS rFHLRegional Dataset
CDS NFHLNational Dataset
FIRM/NFHL Production Structure
Data Going Effective 4/3/2012
Challenges
Data produced at community level.
Initial QA/QC process not intended for NFHL.
Bureaucracy: 10 exceptions to every rule.
Far removed from data producers.
Inherited systems.
What Is FME Used For?
QA/QC of data submissions.
Data replication.
Extraction.
Report generation / tracking.
LOMA Point creation.
Basic QA/QC Checks
All records have DFIRM_ID value. All required layers are present. No duplicate geometry. Flood hazard lines & areas have valid flood zone
values. Effective date information is correct. New data contains all currently effective LOMRs.
QA/QC FME Model
QA/QC: DFIRM_ID Value
Uses FeatureMerger transformer to check that all records have DFIRM_ID value and all DFIRM_ID values match a record in the STUDY_INFO table.
QA/QC: Required Layers
Uses ListPopulator and ListExploder along with FeatureMerger to create a list of all layers present in submission and then check them against the list of required layers.
QA/QC: Duplicate Geometry
Concatenates a number of geometric attributes (such as coordinate count, length / area, etc) with flat attributes to detect duplicate features and filter them out.
QA/QC: Valid Values
Uses the AttributeFilter to detect any invalid flood zone values.
QA/QC: LOMR Checker
Compares submission LOMR layer with current NFHL LOMR layer to detect any missing information.
Sample QA/QC Sheet
Data Staging & Replication
NFHLData
NFHLData
NFHLData
StagingDB
FMELogger
LogDB
MS Access Interface
NFHL SDEFME
Loader
FME Replicator
StagingLoad Model
StagingLoad Model: Logger
Replicator Access Query
Replicator Access Form
Extraction
Extract all NFHL records into state-based shapefiles.
Generate reports such as panel and LOMR count for each state.
QC: Check current extract against prior extract to ensure completeness of layers.
Extraction: QC FME Model
Runs through each state extract.
Uses ListBuilder to build a list of each state’s layers and check them against previous month’s.
Generates Excel report.
Extraction: QC Sheet
Reporting & Tracking
Inventory of current NFHL holdings.
Status of currently effective LOMRs.
QC of existing NFHL data. Missing layers. Invalid values. Obsolete data.
NFHL Inventory Report
NFHL LOMR Status Report
LOMA Mapper
Daily process which converts flat data with lat/lon attributes to geospatial data in SDE.
Replaced custom-developed VB application.
Original application: 18+ hour runtime.FME Model: <10 minute runtime.
LOMA Mapper Flowchart
LOMA Mapper FME Model
Into the Future… FME Server
Internal Automated data submission & QA/QC process.
External Clip/Zip/Ship via MapViewer. Custom extracts. Custom on-demand GIS services.
Thank You!
Questions?
For more information: Rob Gaines: [email protected]
Zimmerman Associates Inc. (FEMA Contractor)
FEMA Map Service Center: http://msc.fema.gov