Flood Event Data Capture using out-of-the-box ESRI softwareKaren Pinkertonkaren.pinkerton@sepa.org.uk

Enabling more informed decisions for flood risk management

This years devastating floods in Scotland saw rivers reach record levels. Karen Pinkerton was on the front line, running a new pilot for SEPA, using ArcGIS Collector to capture vital survey data. SEPAs ability to capture the extent and impact of flood events, in near real time, has greatly improved the range, quality and confidence of its data which is anticipated to help improve future, sustainable flood risk planning. Join Karen to find out how the use of mobile GIS will feed invaluable insight into the National Flood Risk Assessment and Flood Risk Management strategies.*

Why does SEPA need flood event data?What is observed flood event data?

What is observed flood data?Can be in lots of various formats informal and externalSurvey carried out by SEPA staff as resource allows or by contractors on ad-hoc basisHydrometric data used to infer return periodsPhotos/Videosnewspapers, incident reports flooding reports/FRAsGIS filesPoint for depth and specific location info, photosLine for trashline and routesPolygon for extents and flood risk areas

*

Why does SEPA need flood event data?

Observed flood event data underpins:FF Model calibrationFlood forecasting models Flood hazard maps, model calibration and analysisHigh flow/ rating calibrationsPlanning application reviewsFlood impact assessmentsFlood warning developments

Not only does this allow SEPA to complete its Annual Operating Plan/ Characteristics priorities:of caring for communities, acting to combat climate change etc. Producing information and evidence that people use to make evidence

also means that SEPA can fulfil its statutory obligations under the Flood Risk Management Act.Flood hazard and risk mapping (section 21)NFRA (section 9) reporting significant event s to EEC and EU Floods directiveFRM Strategies (section 27)Planning advice (section 72)Flood warning activities (section 74)

*

The problemCurrent situation Collect data with paper forms on an adhoc basis The problem Tasks are potentially based on incomplete/inaccurate dataset

Current SituationThis data is well used within the organisation and supports some key tasksCurrently collecting data on ad hoc basis with paper formLeads toTime lag between event and data capture not real time (or close to)Time lag between data capture and useable dataInconsistent data capture as no formal structureVarious detail in the content of data e.g. return period, photos, depthsVarious formats of data submission e.g. hand written notes, spreadsheet, photo, GISBig events often have less data relatively as less resource to capture Possible duplication of dataPiecemeal dataset with late or missing dataReduced link between information and spatial environment

Overall problem possibly performing these tasks on data that is:incompleteinaccurate outdated

Realised that this could not continue for much longer and needed to look into available technology to solve the problem*

The solution - FEDCAPFEDCAP A tool for Flood Event Data CAPtureutilising ArcGIS Online and the ESRI Collector App for the winter trial

Free*FlexibleSecureSimple!

FEDCAP A tool for Flood Event Data CAPture

Chose to utilise ArcGIS Online and the ESRI Collector AppRecord point information (with photos/videos attached)Collect rough trashlines and attribute info to themThe collector app is downloaded to a device3 iPads suitable for purpose (apart from move point when wiping off rain)20+ SEPA staff with log ins (1 iPad per Flood Risk area)Data gets synced via the cloud to the internetArcGIS online server manages the data and hosts the platformData gets downloaded to SEPA server

Why did we choose it?Technically free as already held an enterprise license agreementFlexible as it works on multiple platforms and devicesOnline and offline data capture is possibleaccessible from anywhere with internet but secure areaLog-ins provide privacy and securityLess resource required to developSimple to create a solution (as a non-developer)

*

The solution - FEDCAPMethodology

Create two feature classes, add domains

Create a map and adjust symbology to suit

Publish to ArcGIS Online

Set up permissions and share

Choose a suitable basemap

Download offline map

Capture data

Sync data

Created two simple featureclasses point for info, depths, photo and impacts; line for trashline and infoSet up Domains for drop downs Bring into ArcMap to set up symbologyArcMap 10.2 shares to service via wizardPublish to SEPA portal on ArcGIS Online Ensure feature access is all on for full functionalityShared to the SEPA portal in the cloud Adjust sharing and editing permissionsAdd to a map, choose a basemapGeneric basemaps of ESRI topographic and imageryScope to use SEPA basemaps in future e.g. watercourse namesMade the map editable, shared with Mobile App groupAdjusted the form to hide some fields and make senseStarted collecting data in the fieldMultiple maps for multiple study areas at high resolution (limit on download offline)Regional map for areas in between study areas (flooding outside work area)switch between offline and online Collect data Symbology brought acrossGPS automatically zooms to locationCapture location, Add information, Add photo if requiredSimilarly trashline, start streaming and start walkingCan tap on screen if too dangerous to walk trashlineTap submit, Saved to cloud, Saved to device if offlineIcon informs how many features been updated and need to syncSync back up to cloud

Happy to demonstrate in more detail afterwards if any wishes*

FEDCAP Winter TrialWinter trial environment record breaking!Wettest December on record in ScotlandOver 200% of average rainfall fell in NE50/400 river gauges in Scotland experienced record peak flowsMultiple flooding events, widespread over ScotlandOver 1000 properties flooded across Scotland

http://www.metoffice.gov.uk/climate/uk/summaries/2016/winterhttp://www.ceh.ac.uk/news-and-media/news/warmest-wettest-november-january-record

Launched (swiftly) during Storm Desmond, 5th December 2015.As you may or may not know it was a rather wet winter. Record breaking in fact! 3 Named Storms and 4 officially unnamed events which caused severe flood impacts. The UK was in a warm and moist tropical air mass for most of the month mild temperatures but wet and windy conditions due to frequent deep depressions and frontal systems. The UK temperature was 4.1C above the 1981-2010 average warmest December on record by 1C (record spans to 1910). Max temperature of 17.2C recorded in Scotland on the 16th December.

Wettest December on record in ScotlandDecember rainfall was 215% of the average and the wettest by a mile Over 200% of average rainfall for NE fell in in these months50/400 river gauges in Scotland experienced record peak flows By the 8th Jan, Glenmuick raingauge already had recorded 263% of the total ave rainfall for January River Dee at Park was 1.34m higher on the 30th Dec than the previous max.Exceptionally high flows recorded all over the countryMultiple flooding events, widespread over ScotlandOver 1000 properties flooded across Scotland

Storm Desmond (5-6th Dec)Unnamed (15th Dec)Storm Eva (24th Dec)Unnamed Low (26th Dec)Storm Frank (29-30th Dec)Frank Junior (5th Jan)Day of the Don (7th Jan)*

FEDCAP Winter Trial

The map in the centre displays the public reports in this period from Report-A-FloodDesmondOver 100mm rain in western Scotland in 24hrs600 evacuations in Hawick, Newcastleton, Aviemore, Langholm, numerous road closures (>21) and disruption to trafficextensive flooding to properties (150 flooded in Southern Scotland, including a school)79 FWs issued at the peakIssued first 2 severe FW since launch of Floodline service in 2011 (Hawick & Newcastleton)

Frank 5.88m level at Park gauge on river Dee was 1.3m higher than previous highest recorded Catchments saturated110mm rain in river Cree in 12 hoursWidespread flooding (again) and evacuationsHighest flow ever gauged at Ballathie on river Tay101 FWs issued and 2 severe (Peebles and Dumfries)

NEBy 8th January parts of Ne had already experienced 3 times the average rainfallWidespread flooding in NE. Evacuations along the river don (all communities cut off)Severe warnings issued for Inverurie and KintorePerth flood gates protected the city from the largest flow since defences completed in 2004 (30cm off top of banks)370 residential properties flooded in Ballater alone500year old castle now on the brink of collapse as 50+metres of bank were washed away

The Campbus of May Bridge near Ballater (Photo credits: Peter Jolly)*

FEDCAP Winter TrialComparison with traditional methods

Data qualityGeoreferenced photographs

Could georeference videos

High resolution camera on iPad

Focused information captured for specific point

More information available in the field

Too many fields to fill in for all features

Recorded313 point features620 photographs/videos68 line features (trashlines/routes)

Data qualityGeoreferenced photographsCould georeference videos useful for flow estimations collector compressed quality. Capture on Ipad and attachHigh resolution camera including video Focused information captured for specific pointMore information available in the fieldCan possibly add more detail with additional layers or purpose built basemapsToo many fields to fill in for all featuresRecorded*313 point features620 photographs/videos68 line features (trashlines/routes)

*

FEDCAP Winter TrialComparison with traditional methods

Time savedSeconds to log in and load up

Takes a few minutes to capture

Slightly longer in the field than a camera

Reduces survey time by half compared with GPS

Reduces processing time by days

Easy to share data without hardware

Time savedSeconds to log in and load up although need connection, an issue for the northTakes a few minutes to captureSlightly longer in field than just camera possibly more info recordedReduces survey time by half compared with GPS; significantly more with dumpy level Reduces processing time by daysEasy to share data internally/externallyno need for hardware symbology means quick interpretation

*

FEDCAP Winter TrialComparison with traditional methods

Survey accuracy

Winter trial achieveda strong correlation between surveyed data and data captured via the solution

a reduction in the time spent processing data

an increase in the quantity of data received in the immediate aftermath of a flood

an improvement in the quality and consistency of data received in the aftermath of a flood event

positive response from SEPA and Local Authority staff

FEDCAP Winter Trial

Winter trial achieveda strong correlation between surveyed data and data captured via the solution

a reduction in the time spent processing data

an increase in the quantity of data received in the immediate aftermath of a flood

an improvement in the quality and consistency of data received in the aftermath of a flood event

positive response from SEPA and Local Authority staff

Testimonies of staff response at the end.

In terms of a proof of concept this was ideal. However, there are still areas we would like to improve if SEPA is to continue with this technology in the future*

Whats next?Future developmentSEPA Corporate adoption

Simpler form as many fields were not applicable to task

Add more information to FEDCAP e.g. specific SEPA basemaps

Improve processes for increased consistency when capturing data e.g. side of trash line

Improve post processing script to become fully automated

Future developmentSEPA corporate adoptionFeeds into Business requirements to IS for FEDCAPStrong Business case for ArcGIS OnlinePublic body but certain protocols to follow for procurementsecurity of data in the cloud in UK (working with ESRI)Simpler form as many fields were not applicable to taskBetter idea of function so can adapt form to various purposes Add more information to FEDCAP read only layersUse specific SEPA basemapsNeed processes in place to confirm consistency when capturing data hands to hold with the side of trash line, Content of photo and when to capturecore fieldsImprove post processing script to become fully automatedDownloadField populationPhoto name

*

FEDCAP Winter TrialIn summary the trial of the ESRI Collector App hasImproved data quantity and quality, providing great business benefit

Enabled the access of more information in the field

Saved time in capture and processing to attain useable information

Secure way to share with internal and external sources with quick interpretation

Simple to set up, use and modify

Lots of scope to improve further and adapt for other purposes

In summary the trial of the ESRI Collector App hasImproved data quantity and quality, providing great business benefitSpatial aspect improves accuracyQuicker to capture, means more dataMore accurate data means better understandingTIMELINE e.g. trash line creates an extent, which goes into flood modelling, improves knowledge of flooding, improves flood warning, SAVES LIVESEnabled the access of more information in the field and in the officeHad people assessing data in the office whilst colleagues in the field almost instant useable dataCould organise further survey, assess impacts from photos, compare with historic floods, relate depths to locationsSecure way to share with internal and external sources with quick interpretationShared symbology means everyone is looking at the same thingNo hardware required to share data securelySimple For non-developer to set up as no additional code requiredSimple for staff to use with minimal trainingSimple to modify to improve further and adapt for other purposes

*

Thank you for listening!Some FEDCAP users.

Testimonials

Any questions at this time?

Email: karen.pinkerton@sepa.org.uk

So I think you can agree that it has been a great trialSome other points are view are given.

Thank you for listening.Are there any questions at this time?

*

Enabling more informed decisions for flood risk management

This years devastating floods in Scotland saw rivers reach record levels. Karen Pinkerton was on the front line, running a new pilot for SEPA, using ArcGIS Collector to capture vital survey data. SEPAs ability to capture the extent and impact of flood events, in near real time, has greatly improved the range, quality and confidence of its data which is anticipated to help improve future, sustainable flood risk planning. Join Karen to find out how the use of mobile GIS will feed invaluable insight into the National Flood Risk Assessment and Flood Risk Management strategies.*What is observed flood data?Can be in lots of various formats informal and externalSurvey carried out by SEPA staff as resource allows or by contractors on ad-hoc basisHydrometric data used to infer return periodsPhotos/Videosnewspapers, incident reports flooding reports/FRAsGIS filesPoint for depth and specific location info, photosLine for trashline and routesPolygon for extents and flood risk areas

*Observed flood event data underpins:FF Model calibrationFlood forecasting models Flood hazard maps, model calibration and analysisHigh flow/ rating calibrationsPlanning application reviewsFlood impact assessmentsFlood warning developments

Not only does this allow SEPA to complete its Annual Operating Plan/ Characteristics priorities:of caring for communities, acting to combat climate change etc. Producing information and evidence that people use to make evidence

also means that SEPA can fulfil its statutory obligations under the Flood Risk Management Act.Flood hazard and risk mapping (section 21)NFRA (section 9) reporting significant event s to EEC and EU Floods directiveFRM Strategies (section 27)Planning advice (section 72)Flood warning activities (section 74)

*Current SituationThis data is well used within the organisation and supports some key tasksCurrently collecting data on ad hoc basis with paper formLeads toTime lag between event and data capture not real time (or close to)Time lag between data capture and useable dataInconsistent data capture as no formal structureVarious detail in the content of data e.g. return period, photos, depthsVarious formats of data submission e.g. hand written notes, spreadsheet, photo, GISBig events often have less data relatively as less resource to capture Possible duplication of dataPiecemeal dataset with late or missing dataReduced link between information and spatial environment

Overall problem possibly performing these tasks on data that is:incompleteinaccurate outdated

Realised that this could not continue for much longer and needed to look into available technology to solve the problem*FEDCAP A tool for Flood Event Data CAPture

Chose to utilise ArcGIS Online and the ESRI Collector AppRecord point information (with photos/videos attached)Collect rough trashlines and attribute info to themThe collector app is downloaded to a device3 iPads suitable for purpose (apart from move point when wiping off rain)20+ SEPA staff with log ins (1 iPad per Flood Risk area)Data gets synced via the cloud to the internetArcGIS online server manages the data and hosts the platformData gets downloaded to SEPA server

Why did we choose it?Technically free as already held an enterprise license agreementFlexible as it works on multiple platforms and devicesOnline and offline data capture is possibleaccessible from anywhere with internet but secure areaLog-ins provide privacy and securityLess resource required to developSimple to create a solution (as a non-developer)

*Created two simple featureclasses point for info, depths, photo and impacts; line for trashline and infoSet up Domains for drop downs Bring into ArcMap to set up symbologyArcMap 10.2 shares to service via wizardPublish to SEPA portal on ArcGIS Online Ensure feature access is all on for full functionalityShared to the SEPA portal in the cloud Adjust sharing and editing permissionsAdd to a map, choose a basemapGeneric basemaps of ESRI topographic and imageryScope to use SEPA basemaps in future e.g. watercourse namesMade the map editable, shared with Mobile App groupAdjusted the form to hide some fields and make senseStarted collecting data in the fieldMultiple maps for multiple study areas at high resolution (limit on download offline)Regional map for areas in between study areas (flooding outside work area)switch between offline and online Collect data Symbology brought acrossGPS automatically zooms to locationCapture location, Add information, Add photo if requiredSimilarly trashline, start streaming and start walkingCan tap on screen if too dangerous to walk trashlineTap submit, Saved to cloud, Saved to device if offlineIcon informs how many features been updated and need to syncSync back up to cloud

Happy to demonstrate in more detail afterwards if any wishes*Launched (swiftly) during Storm Desmond, 5th December 2015.As you may or may not know it was a rather wet winter. Record breaking in fact! 3 Named Storms and 4 officially unnamed events which caused severe flood impacts. The UK was in a warm and moist tropical air mass for most of the month mild temperatures but wet and windy conditions due to frequent deep depressions and frontal systems. The UK temperature was 4.1C above the 1981-2010 average warmest December on record by 1C (record spans to 1910). Max temperature of 17.2C recorded in Scotland on the 16th December.

Wettest December on record in ScotlandDecember rainfall was 215% of the average and the wettest by a mile Over 200% of average rainfall for NE fell in in these months50/400 river gauges in Scotland experienced record peak flows By the 8th Jan, Glenmuick raingauge already had recorded 263% of the total ave rainfall for January River Dee at Park was 1.34m higher on the 30th Dec than the previous max.Exceptionally high flows recorded all over the countryMultiple flooding events, widespread over ScotlandOver 1000 properties flooded across Scotland

Storm Desmond (5-6th Dec)Unnamed (15th Dec)Storm Eva (24th Dec)Unnamed Low (26th Dec)Storm Frank (29-30th Dec)Frank Junior (5th Jan)Day of the Don (7th Jan)*The map in the centre displays the public reports in this period from Report-A-FloodDesmondOver 100mm rain in western Scotland in 24hrs600 evacuations in Hawick, Newcastleton, Aviemore, Langholm, numerous road closures (>21) and disruption to trafficextensive flooding to properties (150 flooded in Southern Scotland, including a school)79 FWs issued at the peakIssued first 2 severe FW since launch of Floodline service in 2011 (Hawick & Newcastleton)

Frank 5.88m level at Park gauge on river Dee was 1.3m higher than previous highest recorded Catchments saturated110mm rain in river Cree in 12 hoursWidespread flooding (again) and evacuationsHighest flow ever gauged at Ballathie on river Tay101 FWs issued and 2 severe (Peebles and Dumfries)

NEBy 8th January parts of Ne had already experienced 3 times the average rainfallWidespread flooding in NE. Evacuations along the river don (all communities cut off)Severe warnings issued for Inverurie and KintorePerth flood gates protected the city from the largest flow since defences completed in 2004 (30cm off top of banks)370 residential properties flooded in Ballater alone500year old castle now on the brink of collapse as 50+metres of bank were washed away

The Campbus of May Bridge near Ballater (Photo credits: Peter Jolly)*Data qualityGeoreferenced photographsCould georeference videos useful for flow estimations collector compressed quality. Capture on Ipad and attachHigh resolution camera including video Focused information captured for specific pointMore information available in the fieldCan possibly add more detail with additional layers or purpose built basemapsToo many fields to fill in for all featuresRecorded*313 point features620 photographs/videos68 line features (trashlines/routes)

*Time savedSeconds to log in and load up although need connection, an issue for the northTakes a few minutes to captureSlightly longer in field than just camera possibly more info recordedReduces survey time by half compared with GPS; significantly more with dumpy level Reduces processing time by daysEasy to share data internally/externallyno need for hardware symbology means quick interpretation

*Survey comparisonOne example shown in this image. Trashline captured with FEDCAP, point captured with Leica GPS