NJDEP’s Enterprise Data Management System & Use of Exchange Network

Presented by: Mike Matsko, NJDEP/OIRMJune 11, 2008

NJ Water Monitoring Council Meeting

NJDEP’s IT Framework

Data Analysisand Retrieval

Web Site

ExchangeNetwork NJ-GeoWeb

NJEMS

RADIUS, NJDEP Online,

E2

Adminis-trativeSystems

E-Government

Water

Air

SRP

Masterfile &Core Features

Waste

Land Use

Permit applications& reports

FACITSPAS/PPS

SpatialData

Coverages

Environmental data

COMPASSDEP

Data Miner

AirRadiation

RadMatXRAYRadon

SDWIS

3

4

5

6

Exchange Network

7

Components of the Exchange Network

• What is a Network Node?– Hardware and Software used to transmit and receive data, in XML

format, using web services– NJDEP’s solution for data exchanges on the Exchange Network

• What are Web Services?– Allows different web-based applications from different sources to

communicate• What is XML?

– The format of the data that is being shared

8

Traditional Approach to Data Exchange

Currently, different data exchange formats are used for flowing data between two systems. These formats could not be written without an intimate knowledge of each system. In some cases DEP was doing duplicate data entry rather than sending data.

InternetNew Jersey Data Consumer

ApplicationDatabase A

ApplicationDatabase B

ApplicationDatabase C

Database A

Database B

Database C

Exchange Format A

Exchange Format BExchange Format C

Exchange Format D …

Node Background Information

9

New Approach to Data Exchange

A Network Node, based on Web services architecture, is used to initiate and respond to data requests.

InternetNew Jersey Data Consumer

ApplicationDatabase A

ApplicationDatabase B

ApplicationDatabase C

Database A

Database B

Database C

NJDEPNode

Standard data formatsData is exposed as Web services

Node Background Information

10

Node Technology

• Node v.1.1 Network Web Services– NodePing– Authenticate– GetServices– Submit– Query– GetStatus– Notify– Solicit– Download

11

Step 6. Transaction ID

NJDEPe-NodeService

Requestor

Step 1. NodePing

Step 2. PingResponse

Step 5. Submit

EPAService Provider

Step 7. GetStatus

Step 8. TransactionStatus (“received”, “pending”, “failed”, etc.)

Step 3. Authenticate

Step 4. Security Token

Submit Method(EPA accepting data being pushed)

Node Implementation

12

Current NJDEP Data Exchanges

• Annual Beach Monitoring and Closure data• Annual Air Emission Inventory data• Annual Toxic Release Inventory data• Quarterly Drinking Water data• Quarterly AQS data• Monthly Regulated Facility data• Hourly AirNow data• 3 Minute HLS Air data• Hazardous Waste (permitting) data• HLS (Drinking Water, Env. Incidents, Tier II)• Taxation

13

Active NJDEP Data Exchange Projects

• Hazardous Waste eManifest• NJDHSS Drinking Water• OCT Best Management Inspections• RCRA (Handler)• WQX / Water Quality Data Exchange

14

WQX / Water Quality Data Exchange

Data Providers:– NJDEP– NJDHSS– County Health Departments– TMDL Contractors– 319(h) Grantees– Volunteers

Data Consumers:– EPA– Public– USGS– NJ Water Monitoring

Coordination Council

•Many data providers and consumers utilizing EN technology

•Data providers using E2 application or Node-to-Node data transfer•Data consumers using Inventory/Portal or Node-to-Node data transfer

15

Questions?