From STORET to WQXFrom STORET to WQX

New Jersey’s Solution for Integrating New Jersey’s Solution for Integrating Ambient Water Quality, Facility and GIS Ambient Water Quality, Facility and GIS

Information from Federal, State, County & Information from Federal, State, County & Volunteer OrganizationsVolunteer Organizations

Harry ChenHarry ChenNew Jersey Department of Environmental New Jersey Department of Environmental

ProtectionProtection

November 28, 2007November 28, 2007Austin, TXAustin, TX

Project PurposeProject Purpose

• Integrate water quality dataIntegrate water quality data

• Streamline and simplify data transferStreamline and simplify data transfer

• Provide better, more timely access to Provide better, more timely access to water quality datawater quality data– Aid decision-makingAid decision-making– Improve resource efficiencyImprove resource efficiency

GoalsGoals• Develop an up to date, searchable Develop an up to date, searchable

inventory of ambient water quality inventory of ambient water quality monitoring in New Jerseymonitoring in New Jersey

• Integrate ambient water quality monitoring Integrate ambient water quality monitoring data into NJDEP’s enterprise environmental data into NJDEP’s enterprise environmental data management system to enable more data management system to enable more integrated environmental decisionsintegrated environmental decisions

• Make NJ ambient water quality monitoring Make NJ ambient water quality monitoring data available to the publicdata available to the public

• Report ambient water quality monitoring Report ambient water quality monitoring data to USEPAdata to USEPA

Project PartnersProject Partners• NJDEPNJDEP

– Bureau of Freshwater and Biological MonitoringBureau of Freshwater and Biological Monitoring– Bureau of Marine Water Monitoring Bureau of Marine Water Monitoring – Bureau of Water Quality Standards and AssessmentBureau of Water Quality Standards and Assessment– Division of Watershed ManagementDivision of Watershed Management– Division of Science, Research, and Technology Division of Science, Research, and Technology

• USGSUSGS• Department of Health and Senior Services (DHSS)Department of Health and Senior Services (DHSS)• County GovernmentsCounty Governments• Volunteer Monitoring OrganizationsVolunteer Monitoring Organizations• NJ Water Monitoring Coordinating Council NJ Water Monitoring Coordinating Council

(Inventory)(Inventory)

ExistingExistingAmbient Water Quality Data ProducersAmbient Water Quality Data Producers

Field Form

Field Form

Bench Sheet

Bench Sheet

AMNETField/Hab dB

AMNETField/Hab dB

AMNETTaxa dB

AMNETTaxa dB

ReformatField/Habitat

dB

ReformatField/Habitat

dB

FTPOracleExport

NJSTORET

EPA

Migrate

DeleteMigration

Field Form

Field Form

FIBIdB

ExtensiveManual

ReformatOf Text

File

DHSSChem

Results

QC LabsChem

Results

Field Form

LakesdB

ReformatLakes dB

DHSSChem

Results

QC LabsChem

Results

Field Form

Others

ReformatTaxa dB

ReformatTaxa dB

KeypunchKeypunchField MsrHabitat

Taxa countsSample Info

KeypunchKeypunchField MsrHabitat

Sample Info

KeypunchKeypunchTaxa counts

Import e-fileImport e-fileChem Results

Import e-fileImport e-fileChem Results

KeypunchKeypunchField MsrHabitat

Sample Info

ProofreadingdB

ODBCConnect

ManualProofreading

ProofreadingReports

Corrections

Corrections Text file

Text file

Text file Text file

Text file

MakeFinal dB

ChangeResult StatusTo Final

Text file

Text file

KeypunchKeypunchChem Results

KeypunchKeypunchChem Results

KeypunchKeypunchField Msr

Sample Info

Text file

MS AccessLink

OthersOther

Projects dBs

FieldStaff

DataStaff

Existing NJDEPData Entry Mechanisms

Note: Proofreading and correction steps occur for all data, but are not shown due to space limitations.

Sample TrackingdB

ODBCConnect

Water Quality Data Management Water Quality Data Management ModelModel

Data Storage

Data Analysis

Data Access

DataSubmission

TransmissionTo CDX

NJDEP

Internal

FlowData

Core project componentsCore project components

• WQX data flow, consisting of the WQX data flow, consisting of the followingfollowing– Data-in: E2 WQX module with data Data-in: E2 WQX module with data

validationvalidation– Data transmission to and from COMPASSData transmission to and from COMPASS– Data-out: NJ Water Monitoring Inventory / Data-out: NJ Water Monitoring Inventory /

Data PortalData Portal

• Outbound data transmission to EPA Outbound data transmission to EPA CDXCDX

High-Level Data FlowHigh-Level Data Flow

COMPASS E2EPA CDX

ENDS

EPA CDXE2 COMPAS

S ENDS

Data System Integration Data System Integration

• E2E2

• COMPASSCOMPASS

• ENDSENDS

Data will be transmitted through each Data will be transmitted through each component using NJ’s Exchange component using NJ’s Exchange Network NODE.Network NODE.

FutureFutureAmbient Water Quality Data ProducersAmbient Water Quality Data Producers

EPA&

USGSWeb

Services

4

Data Submission OptionsData Submission Options

GIS IntegrationGIS Integration

Link

Monitoring Inventory Data Reports

LinkLink

Web-based Maps

GIS Proposals:GIS Proposals:

• EN Browser hosted by ECOS, a national EN Browser hosted by ECOS, a national solutionsolution

• NJ-GeoWeb, a NJ solutionNJ-GeoWeb, a NJ solution

EN BrowserEN Browser

Web services data discovery toolWeb services data discovery tool– Allows users to discover and execute Data Allows users to discover and execute Data

Requests on Exchange Network NodesRequests on Exchange Network Nodes– Offers users the ability to remove (filter) Offers users the ability to remove (filter)

unwanted sections of the XML data set unwanted sections of the XML data set returned from a Data Service returned from a Data Service

– Users have the option of choosing the format Users have the option of choosing the format that they would like to retrieve the data in that they would like to retrieve the data in

– Can integrate with enterprise data reporting Can integrate with enterprise data reporting toolstools

NJ-GeoWebNJ-GeoWeb

A New Vision for Seeking Spatial A New Vision for Seeking Spatial Intelligence. Integrating customized Intelligence. Integrating customized GIS and analysis tools with enterprise GIS and analysis tools with enterprise databases for improved decision-databases for improved decision-making on the Internet. making on the Internet.

Sustainable Sustainable GrowthGrowth

Align Economic and Env. GoalsAlign Economic and Env. GoalsEnv. Sensitive AreasEnv. Sensitive AreasGreen TechnologiesGreen Technologies

Data ServerData Server

SurveillanceSurveillanceInspectionsInspectionsePermitsePermits

Permitting Permitting Compliance Compliance EnforcementEnforcement Water/Sewer InfrastructureWater/Sewer Infrastructure

Water AllocationWater AllocationStorm Water Runoff Storm Water Runoff MonitoringMonitoring

Taking care of BusinessTaking care of Business

Clean & Plentiful WaterClean & Plentiful Water

Regulated SitesRegulated SitesIncident MgmtIncident MgmtFlood MappingFlood MappingEndangered SpeciesEndangered Species

What’s in My BackyardWhat’s in My Backyard

Economic IncentivesEconomic IncentivesEmployment InfoEmployment InfoRevitalize and RedevelopRevitalize and Redevelop

SDESDE

““NJ-GeoWeb”NJ-GeoWeb”

DataData

Live Feeds from State GovernmentLive Feeds from State GovernmentL.awrence Thornton, NJDEPL.awrence Thornton, NJDEP

WQDE Project ChallengesWQDE Project Challenges

• Pulling data from USGS (web services in Pulling data from USGS (web services in development)development)

• Pulling data from EPA (web services in Pulling data from EPA (web services in development)development)

• Coordinating with a large number of Coordinating with a large number of project partnersproject partners– Requires compromiseRequires compromise

• Re-engineering current reporting Re-engineering current reporting procedures, while designing new WQX procedures, while designing new WQX reporting proceduresreporting procedures– How to teach an old dog new tricks? How to teach an old dog new tricks?

• Business Process AnalysisBusiness Process Analysis

• Functional Requirements Specification Functional Requirements Specification and System Designand System Design

• System Development, Data System Development, Data Preparation and ImplementationPreparation and Implementation

• Acceptance TestingAcceptance Testing

• User Training, Documentation and User Training, Documentation and OutreachOutreach

Project Phases and Tasks:Project Phases and Tasks:

Next StepsNext Steps• Complete System DesignComplete System Design

• Programming and DevelopmentProgramming and Development

• User Acceptance TestingUser Acceptance Testing

• Documentation and TrainingDocumentation and Training

• Production DeploymentProduction Deployment

• Send data to EPASend data to EPA

• Target Date: Target Date: October 2008October 2008

Thanks!Thanks!Contact Info: NJDEP- Office of Info Resources Management

Name: Harry Chen

Phone: (609)-633-1261

E-mail: Harry.Chen@dep.state.nj.us