introducing open xdx technology for open data api development
DESCRIPTION
Introduction to the concepts of Open-XDX for building Open Data APIs using the CAMeditor toolkit. See also http://www.verifyXML.org for working online demonstration site. For online demonstration site please see: http://www.verifyxml.orgTRANSCRIPT
<Insert Picture Here>
Open Data API delivery “Open-XDX”
David Webber, Information Architect, Oracle Public Sector
Open
Data
Exchange
The following is intended to outline Oracle general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.
The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Disclaimer Notice
Slide 2
Background
"Open Data is the new default…
anywhere, anytime on any device,
and everything should be APIs"
Steven VanRoekel
Federal CIO – Whitehouse Digital Strategy Architect
© 2012 Oracle Corporation – Proprietary and Confidential 4
Decoding the Digital Strategy
•What exactly are Open Data APIs?
•How can Oracle solutions support them?
•What does a solution architecture look like?
© 2012 Oracle Corporation – Proprietary and Confidential 5
Open Data APIs explained
•A way, via the internet, to securely deliver
information between entities and systems
•API – Application Programming Interface
•Security is supported along with roles and
permissions for requestors, e.g.
– Public information – such as road works, health services, voting
– Private information – patient data, student data, company data
© 2012 Oracle Corporation – Proprietary and Confidential 6
Oracle Solutions for Open Data
•Introducing Open-XDX
•How Oracle Solutions work with Open-XDX
•Open Data APIs – unleashed data
•Cross-platform and device delivery
© 2012 Oracle Corporation – Proprietary and Confidential 7
Oracle Open Data Solution – Open-XDX
•Open-XDX is an all new component designed
to deliver rapid Open Data APIs
•Integrates into Oracle Fusion Middleware
foundation and Database products
•Uses XML configuration templates and code-
less methods and open source NIEM tools
•Allows plug-and-play delivery for Oracle
customers and applications
Integration Conceptual ViewOpen XDX deployment
• Visual Editor
• SQL Browser
• Dictionaries
• Drag and Drop
• Generate Data
• Validate Data
• Send Data
• Open XDX
• Web Services
• FMW / BPM
Design Test Deploy
DB
Web
Open XDX
CAMV
CAM Editor
Open XDX
• Device
• Browser
• Server
Data Delivery
SQL
XML
XML
SQL
FMW
Data Exchange
Open XDX - Conceptual Overview
Existing Information Databases
SQL
Open Data XML
Open-XDX
Send
SQL
Rapid
Deploy
JDBC connection
Control template contains information of the exchange structure design and DB mapping rules of data tables and columns
Template
Structure
Rules
DB Mappings
Parameters
Configuration
Data Exchange Mapping
Option #1 – Visual Mapping Mode
Control template contains information of the exchange structure design and DB mapping rules of data tables and columns
Template
Structure
Rules
DB Mappings
Parameters
Store Configuration
• Individual column assignments made as DB mapping rules to existing XML structure layout;
• Original XML layout imported from industry schema (such as NIEM PMIX shown here)
Drag and Drop Mappings
Database schema viewer
XML structure viewer
Existing application SQL tables; e.g.
Oracle Healthcare, E-Business Suite,
custom system, etc.
Data store connection wizard
Data Exchange Design
Option #2 – Visual Designer Mode
• Start with new empty XML structure;
• Toggle database viewer to designer mode.
Drag and Drop Designer
Database schema viewer
XML structure viewer
EMPTY (Patient Report)
Data Exchange Design
Visual Designer Mode
Control template contains information of the exchange structure design and DB mapping rules of data tables and columns
Template
Structure
Rules
DB Mappings
Parameters
Store Configuration
• Drag and Drop table into XML structure
• Complete XML structure components automatically inserted (with DBMappings);
• All component names / definitions conform to NIEM NDR (smart rename wizard converts SQL to XML)
Drag and Drop Designer
Database schema viewer
XML structure viewer
Drag and Drop of Table
Data Exchange
Demonstration – Open-XDX Data Generation
Existing Information
Open Data XML
Open-XDX
Send
SQL
Live Data Demo
Oracle Tools
MySQL Workbench
XML Designer
Generate
Application Data Tables
1
2
3
© 2012 Oracle Corporation – Proprietary and Confidential 14
SQL DB Mapping Quick Guide
•Tables and Views mappable– Direct access only, use of synonyms not supported– Foreign keys for relationships between tables
•Primary keys and Foreign keys automatically mapped– Indexes not mapped automatically – must be referenced – Views – no index definitions – so must be referenced
•Data - by default all records are retrieved from all tables referenced– Filtering – parameters must be used on all tables to produce
subset of matching records as needed – e.g. date range, customerID
– Master & Parent / Child table hierarchy automatically deduced from DBMapping rules and XPath to XML structure
•Access control via normal account admin and user rights•Tested with Oracle DB and MySQL
© 2012 Oracle Corporation – Proprietary and Confidential 15
XML Structure Usage
•Repeatable parent element for matching SQL table– Rows of data inserted as child elements of parent
•Table joins provided by parameter select statements– Select statements reference key fields (primary or foreign keys)
•Optional and Choice elements– If not used for extracted data, then exclude or use default value– Ensure components needed for data are not part of choice or
optional
•Map to existing elements or add new elements– Attributes also supported
•Data hinting value mechanism can be used in tandem with SQL data inputs for fixed values (company name, company address, exchange version #, etc)
© 2012 Oracle Corporation – Proprietary and Confidential 16
Tools Check List
•SQL Database– Oracle SQL database– MySQL database– JDBC connector for target SQL database
•SQL Development tool– MySQL Workbench– SQL Developer
•Open-XDX solution– CAM Editor XML visual developer– Open-XDX JAR for XML generation batch component
•Secure message delivery– Oracle Weblogic / SOA Suite– Open-XDX integration (JAX-WS)
© 2012 Oracle Corporation – Proprietary and Confidential 17
Deployment Usage Scenarios
• Rapid prototyping of information exchange packages
• Developing NIEM conformant exchange structures / dictionaries
• Query / Response interfaces with filter parameters
• Publish / Subscribe Daily or Hourly reporting
• XML information structures conform to SQL database model
• Limited number of SQL tables involved
• SQL data model well behaved with primary indexes and foreign keys
• Out of Scope
– Highly complex reporting and data manipulation
– Huge data volumes / massively high query rates per minute
– Multiple sets of tables and relationships
© 2012 Oracle Corporation – Proprietary and Confidential 18
Key Technology Capabilities
• Delivering on the Open Data Digital Strategy Vision for government
• Open Standards and Open Source based
• Plug and play with code-free templates and rapid development
• Supports NIEM and Open XML exchanges
• Leverages deployed technology today
• Workflow integration
• Secure messaging delivery and partner management
• Delivered across-platform and device
• End-to-end security & governance
CAMeditor.ORG Project Statistics
‹#›
SNAPSHOT OF PROJECT
ACTIVITIES
50,000+ CAMeditor.org page
visits in one year
130+ countries have downloaded tools; 30% of visitors are
from U.S.;400+ downloads
weekly
5 to 10 students use online video training
resource weekly
6 languages now available
www.cameditor.org
©2012 Oracle Corporation 20