co presentation on ecodata

Post on 26-Jun-2015

677 Views

Category:

Technology

0 Downloads

Preview:

Click to see full reader

DESCRIPTION

This presentation by Candy Thompson from Colorado HMWMD discusses CO's efforts to share data and set up data standards. This presentation discusses why, who, what kind of data, and other issues regarding the "Data Monster."

TRANSCRIPT

________________________EcoDataEcoData

ECODATA Includes Participation by these ECODATA Includes Participation by these Groups of CDPHEGroups of CDPHE

Hazardous Materials and Waste Management Hazardous Materials and Waste Management DivisionDivision

–– Superfund/CERCLASuperfund/CERCLA–– Hazardous Waste Sites RCRAHazardous Waste Sites RCRA–– Solid Waste LandfillsSolid Waste Landfills

Water Quality Control DivisionWater Quality Control Division–– Waste Water Discharge (NPDES)Waste Water Discharge (NPDES)–– Drinking WaterDrinking Water–– Stream and Groundwater Classification and Stream and Groundwater Classification and

MonitoringMonitoring

Air Pollution Control DivisionAir Pollution Control Division–– Stationary Sources of Air PollutionStationary Sources of Air Pollution

Consumer Protection DivisionConsumer Protection Division–– Limited Distribution Drinking Water WellsLimited Distribution Drinking Water Wells

VISION: VISION: TOWARDS TRANSPARENT TOWARDS TRANSPARENT

GOVERNMENTGOVERNMENTEasily Share and Display Data Across:Easily Share and Display Data Across:DIFFERENT DATABASESDIFFERENT DATABASES, , and from:and from:

FederalFederalTribesTribesStateStateCountyCountyCityCityIndustryIndustryCitizen GroupsCitizen Groups

Environmental Monitoring Environmental Monitoring DataData

Includes: Laboratory and Field Analysis Includes: Laboratory and Field Analysis for Chemical for Chemical AnalytesAnalytes, Flow, Water , Flow, Water Levels, Biologic, etc.Levels, Biologic, etc.Media: Groundwater, Surface Water, Media: Groundwater, Surface Water, Air, Soils, Drinking Water Air, Soils, Drinking Water For: Ambient environmental conditions, For: Ambient environmental conditions, regulatory compliance, site cleanup, regulatory compliance, site cleanup, etc.etc.

Why Share Environmental Why Share Environmental DataData

Minimize costs of collecting dataMinimize costs of collecting dataAllow Government to discern and focus on Allow Government to discern and focus on most pressing environmental problemsmost pressing environmental problemsDetermine historic or baseline conditions in Determine historic or baseline conditions in an areaan areaMap chemical contaminants across wider Map chemical contaminants across wider areas to determine exposure risks and areas to determine exposure risks and communicate to the publiccommunicate to the publicMore completely depict the environmental More completely depict the environmental conditions in an area of interestconditions in an area of interest

Currently Data Sharing is Currently Data Sharing is Nearly ImpossibleNearly Impossible

No methods to determine who has what dataNo methods to determine who has what dataNo common chemical/No common chemical/analyteanalyte parameter parameter codes codes No common data formatNo common data formatIf pertinent data is found, 90% of the project If pertinent data is found, 90% of the project managermanager’’s time is spent manipulating and s time is spent manipulating and converting the data into a different systemconverting the data into a different system

THE DATA MONSTERTHE DATA MONSTER

Questionable Quality or Unknown Questionable Quality or Unknown Quality of Parameter ResultsQuality of Parameter ResultsNo Standard Format of DataNo Standard Format of DataLittle Use of Standard Coding for Little Use of Standard Coding for ParametersParametersInconsistent Spatial Projection Inconsistent Spatial Projection Systems for LocationsSystems for Locations

PresentPresent

TIMETIME

DATA

DATAHISTORICHISTORIC EDDEDD

Rocky Flats ArcIMS Web Rocky Flats ArcIMS Web Mapping of Environmental Mapping of Environmental

Monitoring DataMonitoring Data

http://www.http://www.cdphecdphe.state.co.us/.state.co.us/hmhm//rfrf//rfrfmapsmaps.asp.asp

ECODATAECODATA

Data Streamlining and Sharing Method at Data Streamlining and Sharing Method at Colorado Dept. of Public Health and Colorado Dept. of Public Health and Environment (CDPHE)Environment (CDPHE)Transfer System for Environmental Monitoring Transfer System for Environmental Monitoring DataDataStreamlines data input to storage databases Streamlines data input to storage databases from laboratory and field from laboratory and field Streamlines output from databases for data Streamlines output from databases for data sharing through common web interfacessharing through common web interfaces

ECODATA PROMISEECODATA PROMISE

Save money for CDPHE and Regulated Save money for CDPHE and Regulated Community by creating one lab Electronic Community by creating one lab Electronic Data Deliverable (EDD) format across all Data Deliverable (EDD) format across all environmental programs environmental programs Create the ability to share data across the Create the ability to share data across the major databasesmajor databasesSave time by minimizing data conversion to Save time by minimizing data conversion to storage databasestorage databaseAccommodates different databases, database Accommodates different databases, database models, and parameter codingmodels, and parameter coding

Streamlining Data Input and Streamlining Data Input and SharingSharing

Based upon the concept that no matter for Based upon the concept that no matter for what media or purpose, all environmental what media or purpose, all environmental monitoring sampling and analysis can be monitoring sampling and analysis can be accommodated by one large electronic accommodated by one large electronic wrapperwrapperSampling, Chain of Custody, and Laboratory Sampling, Chain of Custody, and Laboratory procedures are all similar and can be procedures are all similar and can be accommodated by one Universal Electronic accommodated by one Universal Electronic Data Deliverable (EDD) formatData Deliverable (EDD) format

Current SituationCurrent Situation

SolutionSolution

Universal Electronic Data Universal Electronic Data Deliverable FormatDeliverable Format

Based on study of all participating Based on study of all participating groups needs.groups needs.Incorporates EPA StandardsIncorporates EPA StandardsOne standard list of reference valuesOne standard list of reference valuesExpandableExpandable

EDDEDDElectronic Data DeliverableElectronic Data Deliverable

Consists of Consists of -- ROSETTA STONE ROSETTA STONE -- Universal Parameter Code Universal Parameter Code

Universal Parameter List includes 3500 Parameter codes Universal Parameter List includes 3500 Parameter codes based upon CAS ID, IRPMS, and EPA STORET ID in that based upon CAS ID, IRPMS, and EPA STORET ID in that orderorderActs as a translator between universal and program Acts as a translator between universal and program specific reference values. specific reference values.

–– Universal Data Element Mapping (Format)Universal Data Element Mapping (Format) --Data Element Mapping creates one format Data Element Mapping creates one format accommodating the largest, most detailed needs accommodating the largest, most detailed needs for data, I.e., quality control (QC) for data for data, I.e., quality control (QC) for data qualificationqualification

Across all participating databasesAcross all participating databases

Universal EDD Format Universal EDD Format IncludesIncludes

XML or Comma delimited formatsXML or Comma delimited formatsLocation informationLocation informationField Sampling informationField Sampling informationLaboratory Test informationLaboratory Test informationField Readings informationField Readings information

Diagram of Program Diagram of Program vs vs UniversalUniversal

UniversalSAMS/EQuIS

STORET

PM10

PM2.5

SDWIS/State

Fluoridation

CPD

Next StepsNext Steps

Work with data providers to facilitate Work with data providers to facilitate their submission of data in correct their submission of data in correct formats.formats.Require submittal of formats for Require submittal of formats for participating systemsparticipating systemsExpand deliverables to include geologic, Expand deliverables to include geologic, water level formats, and others.water level formats, and others.

CDPHE EDDCDPHE EDD

Based upon the EDD developed by EPA Based upon the EDD developed by EPA Region II and the EPARegion II and the EPA’’s Environmental Data s Environmental Data Registry Registry -- Chemical Identification StandardChemical Identification StandardIncludes data qualifiers (blanks, Includes data qualifiers (blanks, dupsdups, lab , lab batch, and instrument calibration) allowing batch, and instrument calibration) allowing data validationdata validationExpanded to include Air, Safe Drinking Water Expanded to include Air, Safe Drinking Water Information System (SDWIS), and Biological Information System (SDWIS), and Biological DataData

WHAT EDD USE REQUIRESWHAT EDD USE REQUIRES

Formatting a conversion from the EDD to Formatting a conversion from the EDD to underlying Databaseunderlying DatabaseCan accept as few or as many elements/fields Can accept as few or as many elements/fields of the Universal EDD as applicableof the Universal EDD as applicableAlthough Lab format utilizes the Universal Although Lab format utilizes the Universal EDD format, Lab only analyzes and submits EDD format, Lab only analyzes and submits data requested for the sampledata requested for the sample

WHAT EDD USE REQUIRES, WHAT EDD USE REQUIRES, cont.cont.

Does not force changes in underlying Does not force changes in underlying databasesdatabasesDoes require translation between Does require translation between Parameter List and the underlying Parameter List and the underlying database parameter nomenclaturedatabase parameter nomenclatureSame process can be used to extract Same process can be used to extract and share data between underlying and share data between underlying databasesdatabases

Web Applications for Data Web Applications for Data SharingSharing

A Universal EDD and the A Universal EDD and the synchronization afforded across synchronization afforded across individual databases sets the stage individual databases sets the stage to share environmental data across to share environmental data across agencies, industry, and the publicagencies, industry, and the public

InternetInternet

Washington

Oregon

EPA

Data AccessApplication

NODEDataSource

Alaska

Idaho

STORETData

Warehouse

NODEDataSource

HostDatabase

DataCatalog

NODE DataSource

NODE DataSource

CDX

.xml

.xml

.xml

.xml

.xml

Pacific Northwest Pacific Northwest Water Quality Data ExchangeWater Quality Data Exchange

Pacific Northwest Pacific Northwest Water Quality Data ExchangeWater Quality Data Exchange

Provides a single point of access to a Provides a single point of access to a comprehensive source of ambient water quality comprehensive source of ambient water quality monitoring data across the Pacific Northwest monitoring data across the Pacific Northwest region.region.Demonstrates the national Network concept and Demonstrates the national Network concept and principles.principles.Illustrates mechanism and benefits of StateIllustrates mechanism and benefits of State--toto--State information exchanges.State information exchanges.Implements a Implements a ““networknetwork--basedbased”” approach.approach.Will facilitate StateWill facilitate State--toto--EPA data exchange of dataEPA data exchange of dataIllustrates rapid data exchange development Illustrates rapid data exchange development possibilities inherent in the Network principles.possibilities inherent in the Network principles.h //htt // i d l ii d l ti bi /bi / dd //

________________________EcoDataEcoData

top related