towards inter-jurisdictional interoperability for a
DESCRIPTION
TRANSCRIPT
Towards Inter-jurisdictional Interoperability for a
Sustainable Management of theSt. Lawrence Ecosystem
J. HamelSt. Lawrence Observatory
Fisheries and Oceans Canada
Symposium on Using Metadata Standards to Achieve Data Interoperability Bedford Institute of Oceanography
Dartmouth, NS
June 13-14, 2006
Presentation outline
St. Lawrence Observatory (OSL)OSL Internet Portal: overview, products, services, clients
Service-Oriented Architecture (SOA) & InteroperabilityDFO national pilot project results, Web data services, data accessibility
St. Lawrence Global Observatory (SLGO)Inter-jurisdictional cooperation
Symposium on Using Metadata Standards to Achieve Data Interoperability..
OSL Internet Portal products & services
Symposium on Using Metadata Standards to Achieve Data Interoperability..
St. Lawrence Observatoryhttp://www.osl.gc.ca
Data Access: real-time data,
data bases, information systems;
Dynamic products: forecasts, SST maps, modelling, georeferenced photographs, …;
Thematic Web sites;
Collaborative projects: governments, universities, industry;
On-line resources: reports, glossary, search engine, …;
Multiplatform accessibility: to reflect diversity of client environments
remote sensing - SST
Marine species identification guideEcosystem modelling
sea ice forecasts
On-line since January 2000
St. Lawrence Observatory (OSL)OSL Internet Portal: overview, products, services, clients
Service-Oriented Architecture (SOA) & InteroperabilityDFO national pilot project results, Web data services, data accessibility
St. Lawrence Global Observatory (SLGO)Inter-jurisdictional cooperation
Symposium on Using Metadata Standards to Achieve Data Interoperability..
Service-Oriented Architecture
• not a new concept, an approach about sharing and decoupling business processes from technology to increase operational efficiency and provide the ability to adapt and change quickly
reduces technological dependency
• enables flexible access to information across platforms and languages through standard protocols which treat all platforms equally in a distributed infrastructure
respects existing technological choices and areas of expertise at the data management level
• involves the use of recognized standards & technologies
SOAP, XML, WSDL…SOA is part of OGC Geospatial Portal Reference Architecture (OGC 04-039, Open Geospatial Consortium, 2004)
SOA & Interoperability concept
Symposium on Using Metadata Standards to Achieve Data Interoperability..
WSDL : Web Service Description Language SOAP : protocol for exchanging XML-based messages over a network
Deliverables included:a common framework (specifications, guidelines)development of data services (physical oceanography) from the following sources:
• On-line Scientific Buoy Network: real-time data• CHS SINECO Water Level Information Network: real-time data• BIO TS Climate Database: archives, 33 million records• ODMS – Oceanographic Data Management System: archives 22 million records
a Web data service browsera client data access interfacea national workshop (held March 28-30, 2006 @ IML)
To develop a strategy for the implementation of a service-oriented architecture (SOA) to enhance accessibility of DFO scientific data assets by taking existing systems to a level of interoperability that will result in a more efficientmanagement of DFO data holdings and an improved capacity to deliver our mandate and serve our clients.
SOA & Interoperability DFO national pilot project
Symposium on Using Metadata Standards to Achieve Data Interoperability..
Objectives:
IML: DFO's Maurice Lamontagne Institute, Mont-Joli, Quebec
allow systems to EXPLORE various heterogeneous data setsdo not require uniformity of formats, data models and technologies on the systems side
use a set of specifications defined in the context of the pilot project
use SOAP technology for data transport
Web Data Services (WDS)
SOA & Interoperability Web data services
Symposium on Using Metadata Standards to Achieve Data Interoperability..
accessible using most programming languages : .Net, Java, Python, etc. using SOAP client interface (API)
accessible directly from an internet browser
are described using WSDL – Web Service Description Language
contributing to reducing the need for specialized technical knowledge of database structures and query mechanisms by the end-user
ultimately WDS are
a system used to EXPLORE WDS servicesavailable via Internet
URL : http://www.osl.gc.ca/wds-browser/
SOA & Interoperability WDS browser
Symposium on Using Metadata Standards to Achieve Data Interoperability..
WDS browser is
Main objectives:
to provide access to the most recent water temperature data for the St. Lawrence using SOAP Web Data Services developed for various distributed data sets
to allow users to explore archives by selecting
time period
depth interval
SOA & Interoperability client application
Symposium on Using Metadata Standards to Achieve Data Interoperability..
Example of end-user application using WDS - prototype
more Web data services (WDS) including more complex data sources(national, other regions)a system allowing for WDS cascading (aggregation)a system for producing Web Map Services (WMS) from WDSWDS browser improvements: profile graphs, map view, WMS exportWDS cataloguing approachother applications that exploit WDS
Symposium on Using Metadata Standards to Achieve Data Interoperability..
SOA & Interoperability further development
future development plans include
St. Lawrence Observatory (OSL)OSL Internet Portal: overview, products, services, clients
Service-Oriented Architecture (SOA) & InteroperabilityDFO national pilot project results, Web data services, data accessibility
St. Lawrence Global Observatory (SLGO)• Inter-jurisdictional cooperation• Joint initiative bringing together DFO & its external partners involved in data collection,
management and dissemination
Symposium on Using Metadata Standards to Achieve Data Interoperability..
To offer an integrated Web access to the most accurate and complete data and information about the St. Lawrence ecosystem by:
fostering the clustering and networking of various organizationsresponsible for the collection and dissemination of data and information, while respecting their orientations and obligations;
optimising access, dissemination and analysis of data and information for the various client groups using an infrastructure allowing for an efficient use of data, information, products and services offered by the community of member organizations.
integrated access ● distributed data ● networking ● quality ● efficiency
SLGO mission & objectives
Symposium on Using Metadata Standards to Achieve Data Interoperability..
• systems interoperability
• common standards (data exchange protocols, metadata, security, etc...)
producers systems users
• discovery services, directories, catalogues
• increased accessibility to data and information assets
• distributed architecture
• quality products and services
• more efficient access by users
data services
databasesinformationsystems
producers
user
systems
• secure architecture
SLGO components of a common solution
Symposium on Using Metadata Standards to Achieve Data Interoperability..
non-profit organization ● board of directors ● business plan ● membership agreement
SLGO community of prospective membersuniversities ● research & development ● governments ● community groups
Institut des sciences de la mer
GRÉA - UQTRGroupe de recherche surles écosystèmes aquatiques
RDDCValcartier
ASCAgenceSpatialeCanadienne
Symposium on Using Metadata Standards to Achieve Data Interoperability..
…Question Period--
Symposium on Using Metadata Standards to Achieve Data Interoperability..
summary of key elements discussed
…accessibility of DFO data & products
…national approach to implementing SOA
…interoperability within DFO & with external partners
…use of common recognized standards (data exchange protocols, metadata, security, etc.)
…information supplement…-
Symposium on Using Metadata Standards to Achieve Data Interoperability..
OSL Internet Portal usage & clienteles
Symposium on Using Metadata Standards to Achieve Data Interoperability..
Client groups/sectors of activity: governments, research organisations,
universities & colleges, industry (navigation, ecotourism, coastal zone management,
fisheries, consultants, etc.),interest groups, communities
and general public.
OSL Portal launched January 2000
Most popular themes and data types:
1. Ocean Forecasts (sea ice, surface currents) 2. Ecosystem Modelling3. Remote Sensing (sea surface temperature) 4. Real-Time/On-Line Buoy Data 5. Marine Mammal Research 6. Sentinel Fisheries 7. Tides & Water Levels 8. Oceanographic Data Management Ssystem9. Georeferenced Images
10. - Lobster AND
- Marine Species Identification Guide.
Multiplatform accessibility to reflect the diversity of client environments:
Internet Explorer, Firefox, Opera, Netscape...
Windows 95, 98, NT, 2000, XP...
Macintosh, Linux, SunOS, UNIX...
SOA & Interoperability components
Symposium on Using Metadata Standards to Achieve Data Interoperability..
SOA : collection of self-contained services communicating with each other using standard description language and protocols and working within a distributed systems architecture
WSDL : Web Service Description Language
SOAP : protocol for exchanging XML-based messages over a network (initially = Simple Object Access Protocol)
UDDI: Universal Discovery, Description and Integration
Based on recognized standards
Source: http://www.service-architecture.com/index.html
World Wide Web Consortiumworking on the foundation of Web Services since 1999
• SOAP 1.2 : W3C Recommendation (2003)
• WSDL 2.0 : W3C Candidate Recommendation (2006)
• XML 1.1 : W3C Recommendation (2004)
● are connectors that define a series of access methods (or functions) and their behaviour
● allow systems to EXPLORE various heterogeneous data setsdo not require uniformity of formats, data models and technologies on the systems side
● use a set of specifications defined in the context of the pilot project
● use SOAP technology for data transport
Web Data Services (WDS)
● are a solution to most conventional data access needs, easy to develop:
11 functions
SOA & Interoperability Web data services
Symposium on Using Metadata Standards to Achieve Data Interoperability..
accessible using most programming languages : .Net, Java, Python, etc. using SOAP client interface (API)accessible directly from an internet browserdescribed using WSDL – Web Service Description Language
ex : http://www.osl.gc.ca/wds/services/climate?wsdland their functions are accessible via a URL
ex : http://www.osl.gc.ca/wds/services/climate?method=getStatus
Symposium on Using Metadata Standards to Achieve Data Interoperability..
server and client application languages & platforms do not need to matchanything coded once by a single programmer is reusable by all for other purposes WDS can become building blocks for assembling powerful applications
SOA & Interoperability Web data services
WDS are
also of interest for developers & programmers
reducing the need for specialized technical knowledge of database structures and query mechanisms by the end-user
ultimately WDS are
Symposium on Using Metadata Standards to Achieve Data Interoperability..
SLGO governance & functions
direction
operations
OGSL-BDBoard of Directors
OGSL-ECExecutive Committee
OGSL-ACAdvisory Committee• Strategic Planning• Project Prioritization
St. Lawrence Global Observatory (SLGO)
Administrative Assistant Coordinator• Liaison/consultation +members/clients• Needs Assessment• Promotion
Coordinator• Web Development Project Management• Team Management• Processes, validation, quality, standards
INTERNET DEVELOPMENT
ProgrammerDevelopment/Maintenance
Senior Programmer/Analyst Webmaster
Web Designer
Web IntegratorProgrammerDevelopment/Maintenance
ADMINISTRATION PARTNERSHIPS
active member
cooperativeprojects
access
Membership Agreement
Member - SLGOSenior managementManagers of agreement
DIRECTION
Producers / providers /Data managers• collection• validation• structure/models• archiving• quality control
DATA MANAGEMENT
• Strategic Planning• Prioritization of needs• Project Identification
WEB DIFFUSIONSTEERING COMMITTEE• Strategic Planning• Prioritization of needs• Project Identification
WEB DIFFUSIONSTEERING COMMITTEE
Corporate Information services• accessibility• security• technologies
INFORMATIONMANAGEMENT& TECHNICAL
SERVICES
Internet portal sources data & information
OGSL-DGDirector General
Service Level Agreement Service Level Agreement
clients & users
diffusion
Collaborators & experts from SLGO& member organizationsParticipating in:• Web projects• Definition of
products & services
• Needs Studies
PROJECTTEAMS
Collaborators & experts from SLGO& member organizationsParticipating in:• Web projects• Definition of
products & services
• Needs Studies
PROJECTTEAMS
gateway
membership
membership
temporarytemporary temporarytemporary temporarytemporary temporarytemporary