ooi ci lca review august 2010 ocean observatories initiative ooi cyberinfrastructure architecture...
TRANSCRIPT
OOI CI LCA REVIEW August 2010
Ocean Observatories Initiative
OOI Cyberinfrastructure Architecture Overview
Michael Meisinger
Life Cycle Architecture ReviewLa Jolla, CA
OOI CI LCA REVIEW August 2010
Goals for this Presentation•To set the stage…
•What is … the OOI Integrated Observatory?•What is … the CI (Cyberinfrastructure)?•What is … Release 1? •What is … the role of the architecture in
Construction?•Where … can I find information about the CI design?
•What … were the main accomplishments in Elaboration?
•What … are the core implementation choices?
•… for detailed subsystem presentations
OOI CI LCA REVIEW August 2010
Overview
•Architecture in the System Engineering Process
•Architectural Overview
•The OOI Integrated Observatory
•CI Capabilities in Release 1
•Subsystems and Interfaces
• Implementation of the Architecture
•Current Status
•Main Choices
•Key Concepts
•Capability Integration Strategy
•Deployment: Plan and Strategy
OOI CI LCA REVIEW August 2010
Role of the Architecture• Blueprint for software construction
• Defines long term intent
• Defines the core structure of the system: interfaces, services, startup,
data flow
• Defines the fundamental principles
• Starting point for developers during task definition
• Daily reference for developers when making implementation decisions
• Place to document consolidated understanding and design refinement
• Ensure that the developed system meets the requirements:
• Functional capabilities, performance, security
• Maintainability, manageability, extensibility
• Supporting OOI-wide SE processes
• Requirements and interface management
• Configuration control
• Integration, test, validation
OOI CI LCA REVIEW August 2010
Architecture Products
•Architecture Documentation• Story, background, context (Living, consistent
documentation)
• Located on Confluence, exported to PDF
•Architecture Model• Drawings, Definitions, Tracing
• Authored in Enterprise Architect, clickable export
• Searchable PDF document of all drawings
•Technology List• Candidate technologies for integration, interfacing, reference
• Living spreadsheet and reference catalog
OOI CI LCA REVIEW August 2010
Enterprise ArchitectUsed to:• Define• Draw• Connect• Identify• Check• Document• Browse• Export
Examples:• Drawing
repository• Requirements
Tracing• Interface
identification
HTML Export: http://ooici.net/eaexport/
OOI CI LCA REVIEW August 2010
OOI Integrated Observatory
OOI CI LCA REVIEW August 2010
Integrated ObservatorySensor
PlatformsPhysicalInterface
MarineOperations
Shore SideOperations
End UserOperations
MobileCore
FixedCore
ResearchPlatforms
AdministratorCyber OperatorMarine Operator
User
Marine
Cyber
Operational Authority
ObservatoryOperations
Science Teams & Educators
ObservatoryManagement
MarineManagement
User EnvironmentManagement
Marine Net Observatory Net
OOI CI LCA REVIEW August 2010
OOI Integrated Observatory
Out of scope
for release 1
Out of scope
for release 1
Out of scope
for release 1
Out of scope
for release 1
Out of scope
for release 1
OOI CI LCA REVIEW August 2010
OOI Release 1
External Data
Sources (Observatorie
s, such as IOOS with GTS/IDD, individual
data producers)
Data Analysts, Numerical Modelers
OOI CI LCA REVIEW August 2010
Scope: Product Definition•Release 1: Data Distribution Network (May 2011)•“Ingest” data (products) from external data
sources•Characterize data sources with their metadata
attributes (format, structure) •Transform data into internal OOI data formats, for
stream-based distribution and persistence•Distribute data via streaming and DAP servers to
data analysts and numerical modelers•Provide a platform for initial instrument
integration, control and sensor data acquisition•Provide a distributed service integration and
execution platform
OOI CI LCA REVIEW August 2010
Release Schedule
Y 1 Y 2 Y 3 Y 4 Y 5
4 4 6 2
Release Cycle
R-1
R-2
R-3
R-4
R-5
Project Year
R-1
R-2
R-3
R-4
R-5
Data Distribution Network
Managed Instrument Network
OnDemand Measurement Processing
Integrated Modeling Network
Interactive Ocean Observatory
Kick-Off 9/09
OOI CI LCA REVIEW August 2010
Subsystems
2650-00008 OV2 CI
Sensing & Acquisition
DataManagement
CommonOperating
Infrastructure
CommonExecution
Infrastructure
OOI CI LCA REVIEW August 2010
The Capability Container
• Ingredients:
• Capability: function, service, process
• Plumbing: Messaging, security
• Container: drop it all in as needed
• Packaging: label it, tape it shut… done!
OOI CI LCA REVIEW August 2010
Secure Reliable Messaging
CapabilityContainer
CapabilityContainer
CapabilityContainer
CapabilityContainer
CapabilityContainer
Capability(Service)
Capability(Service)
Capability(Service)
Capability(Service)
Capability(Service)
OOI CI LCA REVIEW August 2010
COI Infrastructure Services
The Common Operating Infrastructure (COI) is the integration & communication environment for all the
other subsystem services
Common Operating Infrastructure
Sensing & Acquisition
Data Management
Analysis & Synthesis
Identity Management
State Management
GovernanceFramework
Resource Management
Planning & Prosecution
Exchange
Service Framework
Presentation Framework
Common Execution
Infrastructure
OOI CI LCA REVIEW August 2010
Integration Strategy
•Capability Container
•Secure reliable messaging via the “Exchange”
•Service-oriented architecture
•Non-central governance
•COI Infrastructure Services
OOI CI LCA REVIEW August 2010
CI Interfaces and Subsystems
OOI CI LCA REVIEW August 2010
Deployment Plan and Strategy
•Deployment of capability containers in OOI clusters
and in the Amazon cloud by leveraging
virtualization
•CyberPoP (Cyberinfrastructure Point of Presence):
physical deployment of one or multiple capability
containers
•Network connectivity
•Storage and computation (redundant)
OOI CI LCA REVIEW August 2010
Network Architecture
OOI CI LCA REVIEW August 2010
Network Deployment
OOI CI LCA REVIEW August 2010
Goals of Spiral Phases in Development
• Inception
• Define the objectives with stakeholders
• Perform isolated prototyping in high risk areas
• Get the development team trained in technologies and dependencies
• Define the architecture and integration plan
• Elaboration
• Build out the core interfaces and architectural components (services and message
interactions)
• Integrate services by defining end-to-end scenarios
• Refine and consolidate the architecture and design specs
• Make a realistic construction plan based on measured team performance
• Construction
• Refactor core interfaces and components based on lessons learned
• Implement services and components according to construction plan
• Continuous integration
• Successively add to the test suite in order to prove satisfaction of release use cases
OOI CI LCA REVIEW August 2010
Progress in Elaboration
•One primary code base “LCAarch”
•Python as primary technology for architectural
prototyping
•More than 25K lines of code
• Integration basically across all subsystems
(some exceptions)
•Presentation Platform: Web UI
• Interoperability with prototypical Java platform
OOI CI LCA REVIEW August 2010
LCAarch
•TBD
OOI CI LCA REVIEW August 2010
Goals check: Questions?
Thanks !
OOI CI LCA REVIEW August 2010
Scenario Walk Through
•Detailed use case message scenario:
•External entities (user/system/device)
•services with operations and events
•deployment locations
•message format
• interaction sequence
OOI CI LCA REVIEW August 2010
Agenda
•Subsystem Purpose
•Release 1 Product Description Use Case Overview
•Architectural Overview
•Status of Progress
•Use Cases Address, Use Cases Demonstrated
•Technology Challenges and Achievements
•Plan for Construction
•Significant Risks
OOI CI LCA REVIEW August 2010
Agenda
•Subsystem Purpose
•Release 1 Product Description Use Case Overview
•Architectural Overview
•Status of Progress
•Use Cases Address, Use Cases Demonstrated
•Technology Challenges and Achievements
•Plan for Construction
•Significant Risks
OOI CI LCA REVIEW August 2010
{name} Subsystem: Purpose
OOI CI LCA REVIEW August 2010
Release 1 Product Description Use Case Overview
OOI CI LCA REVIEW August 2010
Architectural Overview
OOI CI LCA REVIEW August 2010
Status of Progress
•Use Cases Address
•Use Cases Demonstrated
OOI CI LCA REVIEW August 2010
Technology Challenges and Achievements
OOI CI LCA REVIEW August 2010
Plan for Construction
OOI CI LCA REVIEW August 2010
Significant Risks
OOI CI LCA REVIEW August 2010
Architecture Overview
OOI CI LCA REVIEW August 2010
Thanks !
Questions ?
OOI CI LCA REVIEW August 2010
Scope of Future Releases•Release 2: Managed Instrument Network (2012)
• Fully managed instrument activation and control; ready for deployment on OOI moorings and cable infrastructure
• Qualified data products based on automated data processing•Release 3: On-Demand Measurement Processing
(2013)• Observatory management and resource scheduling• On demand and event driven measurements• Data processing workflows
•Release 4: Integrated Modeling Network (2014)• Interactive analysis and synthesis• Numerical model integration
•Release 5: Interactive Ocean Observatory (2015)• Full control of data, processes, models, instruments• Closed loop, adaptive sensing and platform control
Out of scope
for release 1
OOI CI LCA REVIEW August 2010
Preparing Services for Deployment
InstrumentPoint
AcquisitionPoint
IngestPoint
ApplicationPoint
StoragePoint
AccessPortal
OOI CI LCA REVIEW August 2010
Deployment Scenario
Out of scope
for release 1
Out of scope
for release 1
Out of scope
for release 1
OOI CI LCA REVIEW August 2010
External Interfaces
1604-00001 SV1 OOI
OOI CI LCA REVIEW August 2010
External Interfaces
Terrestrial CyberPoP
Cloud Execution
Point
Marine Management
CI Station
CI Instanceon platform
User CIInstanceOut of scope
for release 1
Out of scope
for release 1
Out of scope
for release 1
OOI CI LCA REVIEW August 2010
System Deployments
2660-00014 SV1 CI