towards inter-jurisdictional interoperability for a

Towards Inter-jurisdictional Interoperability for a

Sustainable Management of theSt. Lawrence Ecosystem

J. HamelSt. Lawrence Observatory

Fisheries and Oceans Canada

Symposium on Using Metadata Standards to Achieve Data Interoperability Bedford Institute of Oceanography

Dartmouth, NS

June 13-14, 2006

Presentation outline

St. Lawrence Observatory (OSL)OSL Internet Portal: overview, products, services, clients

Service-Oriented Architecture (SOA) & InteroperabilityDFO national pilot project results, Web data services, data accessibility

St. Lawrence Global Observatory (SLGO)Inter-jurisdictional cooperation

Symposium on Using Metadata Standards to Achieve Data Interoperability..

OSL Internet Portal products & services

Symposium on Using Metadata Standards to Achieve Data Interoperability..

St. Lawrence Observatoryhttp://www.osl.gc.ca

Data Access: real-time data,

data bases, information systems;

Dynamic products: forecasts, SST maps, modelling, georeferenced photographs, …;

Thematic Web sites;

Collaborative projects: governments, universities, industry;

On-line resources: reports, glossary, search engine, …;

Multiplatform accessibility: to reflect diversity of client environments

remote sensing - SST

Marine species identification guideEcosystem modelling

sea ice forecasts

On-line since January 2000

St. Lawrence Observatory (OSL)OSL Internet Portal: overview, products, services, clients

Service-Oriented Architecture (SOA) & InteroperabilityDFO national pilot project results, Web data services, data accessibility

St. Lawrence Global Observatory (SLGO)Inter-jurisdictional cooperation

Symposium on Using Metadata Standards to Achieve Data Interoperability..

Service-Oriented Architecture

• not a new concept, an approach about sharing and decoupling business processes from technology to increase operational efficiency and provide the ability to adapt and change quickly

reduces technological dependency

• enables flexible access to information across platforms and languages through standard protocols which treat all platforms equally in a distributed infrastructure

respects existing technological choices and areas of expertise at the data management level

• involves the use of recognized standards & technologies

SOAP, XML, WSDL…SOA is part of OGC Geospatial Portal Reference Architecture (OGC 04-039, Open Geospatial Consortium, 2004)

SOA & Interoperability concept

Symposium on Using Metadata Standards to Achieve Data Interoperability..

WSDL : Web Service Description Language SOAP : protocol for exchanging XML-based messages over a network

Deliverables included:a common framework (specifications, guidelines)development of data services (physical oceanography) from the following sources:

• On-line Scientific Buoy Network: real-time data• CHS SINECO Water Level Information Network: real-time data• BIO TS Climate Database: archives, 33 million records• ODMS – Oceanographic Data Management System: archives 22 million records

a Web data service browsera client data access interfacea national workshop (held March 28-30, 2006 @ IML)

To develop a strategy for the implementation of a service-oriented architecture (SOA) to enhance accessibility of DFO scientific data assets by taking existing systems to a level of interoperability that will result in a more efficientmanagement of DFO data holdings and an improved capacity to deliver our mandate and serve our clients.

SOA & Interoperability DFO national pilot project

Symposium on Using Metadata Standards to Achieve Data Interoperability..

Objectives:

IML: DFO's Maurice Lamontagne Institute, Mont-Joli, Quebec

allow systems to EXPLORE various heterogeneous data setsdo not require uniformity of formats, data models and technologies on the systems side

use a set of specifications defined in the context of the pilot project

use SOAP technology for data transport

Web Data Services (WDS)

SOA & Interoperability Web data services

Symposium on Using Metadata Standards to Achieve Data Interoperability..

accessible using most programming languages : .Net, Java, Python, etc. using SOAP client interface (API)

accessible directly from an internet browser

are described using WSDL – Web Service Description Language

contributing to reducing the need for specialized technical knowledge of database structures and query mechanisms by the end-user

ultimately WDS are

a system used to EXPLORE WDS servicesavailable via Internet

URL : http://www.osl.gc.ca/wds-browser/

SOA & Interoperability WDS browser

Symposium on Using Metadata Standards to Achieve Data Interoperability..

WDS browser is

Main objectives:

to provide access to the most recent water temperature data for the St. Lawrence using SOAP Web Data Services developed for various distributed data sets

to allow users to explore archives by selecting

time period

depth interval

SOA & Interoperability client application

Symposium on Using Metadata Standards to Achieve Data Interoperability..

Example of end-user application using WDS - prototype

more Web data services (WDS) including more complex data sources(national, other regions)a system allowing for WDS cascading (aggregation)a system for producing Web Map Services (WMS) from WDSWDS browser improvements: profile graphs, map view, WMS exportWDS cataloguing approachother applications that exploit WDS

Symposium on Using Metadata Standards to Achieve Data Interoperability..

SOA & Interoperability further development

future development plans include

St. Lawrence Observatory (OSL)OSL Internet Portal: overview, products, services, clients

Service-Oriented Architecture (SOA) & InteroperabilityDFO national pilot project results, Web data services, data accessibility

St. Lawrence Global Observatory (SLGO)• Inter-jurisdictional cooperation• Joint initiative bringing together DFO & its external partners involved in data collection,

management and dissemination

Symposium on Using Metadata Standards to Achieve Data Interoperability..

To offer an integrated Web access to the most accurate and complete data and information about the St. Lawrence ecosystem by:

fostering the clustering and networking of various organizationsresponsible for the collection and dissemination of data and information, while respecting their orientations and obligations;

optimising access, dissemination and analysis of data and information for the various client groups using an infrastructure allowing for an efficient use of data, information, products and services offered by the community of member organizations.

integrated access ● distributed data ● networking ● quality ● efficiency

SLGO mission & objectives

Symposium on Using Metadata Standards to Achieve Data Interoperability..

• systems interoperability

• common standards (data exchange protocols, metadata, security, etc...)

producers systems users

• discovery services, directories, catalogues

• increased accessibility to data and information assets

• distributed architecture

• quality products and services

• more efficient access by users

data services

databasesinformationsystems

producers

user

systems

• secure architecture

SLGO components of a common solution

Symposium on Using Metadata Standards to Achieve Data Interoperability..

non-profit organization ● board of directors ● business plan ● membership agreement

SLGO community of prospective membersuniversities ● research & development ● governments ● community groups

Institut des sciences de la mer

GRÉA - UQTRGroupe de recherche surles écosystèmes aquatiques

RDDCValcartier

ASCAgenceSpatialeCanadienne

Symposium on Using Metadata Standards to Achieve Data Interoperability..

…Question Period--

Symposium on Using Metadata Standards to Achieve Data Interoperability..

summary of key elements discussed

…accessibility of DFO data & products

…national approach to implementing SOA

…interoperability within DFO & with external partners

…use of common recognized standards (data exchange protocols, metadata, security, etc.)

…information supplement…-

Symposium on Using Metadata Standards to Achieve Data Interoperability..

OSL Internet Portal usage & clienteles

Symposium on Using Metadata Standards to Achieve Data Interoperability..

Client groups/sectors of activity: governments, research organisations,

universities & colleges, industry (navigation, ecotourism, coastal zone management,

fisheries, consultants, etc.),interest groups, communities

and general public.

OSL Portal launched January 2000

Most popular themes and data types:

1. Ocean Forecasts (sea ice, surface currents) 2. Ecosystem Modelling3. Remote Sensing (sea surface temperature) 4. Real-Time/On-Line Buoy Data 5. Marine Mammal Research 6. Sentinel Fisheries 7. Tides & Water Levels 8. Oceanographic Data Management Ssystem9. Georeferenced Images

10. - Lobster AND

- Marine Species Identification Guide.

Multiplatform accessibility to reflect the diversity of client environments:

Internet Explorer, Firefox, Opera, Netscape...

Windows 95, 98, NT, 2000, XP...

Macintosh, Linux, SunOS, UNIX...

SOA & Interoperability components

Symposium on Using Metadata Standards to Achieve Data Interoperability..

SOA : collection of self-contained services communicating with each other using standard description language and protocols and working within a distributed systems architecture

WSDL : Web Service Description Language

SOAP : protocol for exchanging XML-based messages over a network (initially = Simple Object Access Protocol)

UDDI: Universal Discovery, Description and Integration

Based on recognized standards

Source: http://www.service-architecture.com/index.html

World Wide Web Consortiumworking on the foundation of Web Services since 1999

• SOAP 1.2 : W3C Recommendation (2003)

• WSDL 2.0 : W3C Candidate Recommendation (2006)

• XML 1.1 : W3C Recommendation (2004)

● are connectors that define a series of access methods (or functions) and their behaviour

● allow systems to EXPLORE various heterogeneous data setsdo not require uniformity of formats, data models and technologies on the systems side

● use a set of specifications defined in the context of the pilot project

● use SOAP technology for data transport

Web Data Services (WDS)

● are a solution to most conventional data access needs, easy to develop:

11 functions

SOA & Interoperability Web data services

Symposium on Using Metadata Standards to Achieve Data Interoperability..

accessible using most programming languages : .Net, Java, Python, etc. using SOAP client interface (API)accessible directly from an internet browserdescribed using WSDL – Web Service Description Language

ex : http://www.osl.gc.ca/wds/services/climate?wsdland their functions are accessible via a URL

ex : http://www.osl.gc.ca/wds/services/climate?method=getStatus

Symposium on Using Metadata Standards to Achieve Data Interoperability..

server and client application languages & platforms do not need to matchanything coded once by a single programmer is reusable by all for other purposes WDS can become building blocks for assembling powerful applications

SOA & Interoperability Web data services

WDS are

also of interest for developers & programmers

reducing the need for specialized technical knowledge of database structures and query mechanisms by the end-user

ultimately WDS are

Symposium on Using Metadata Standards to Achieve Data Interoperability..

SLGO governance & functions

direction

operations

OGSL-BDBoard of Directors

OGSL-ECExecutive Committee

OGSL-ACAdvisory Committee• Strategic Planning• Project Prioritization

St. Lawrence Global Observatory (SLGO)

Administrative Assistant Coordinator• Liaison/consultation +members/clients• Needs Assessment• Promotion

Coordinator• Web Development Project Management• Team Management• Processes, validation, quality, standards

INTERNET DEVELOPMENT

ProgrammerDevelopment/Maintenance

Senior Programmer/Analyst Webmaster

Web Designer

Web IntegratorProgrammerDevelopment/Maintenance

ADMINISTRATION PARTNERSHIPS

active member

cooperativeprojects

access

Membership Agreement

Member - SLGOSenior managementManagers of agreement

DIRECTION

Producers / providers /Data managers• collection• validation• structure/models• archiving• quality control

DATA MANAGEMENT

• Strategic Planning• Prioritization of needs• Project Identification

WEB DIFFUSIONSTEERING COMMITTEE• Strategic Planning• Prioritization of needs• Project Identification

WEB DIFFUSIONSTEERING COMMITTEE

Corporate Information services• accessibility• security• technologies

INFORMATIONMANAGEMENT& TECHNICAL

SERVICES

Internet portal sources data & information

OGSL-DGDirector General

Service Level Agreement Service Level Agreement

clients & users

diffusion

Collaborators & experts from SLGO& member organizationsParticipating in:• Web projects• Definition of

products & services

• Needs Studies

PROJECTTEAMS

Collaborators & experts from SLGO& member organizationsParticipating in:• Web projects• Definition of

products & services

• Needs Studies

PROJECTTEAMS

gateway

membership

membership

temporarytemporary temporarytemporary temporarytemporary temporarytemporary