National Information Exchange Model (NIEM) October 24, 2006 Jeremy Warren Deputy Chief Technology Officer U.S. Dept. of Justice 2 Web Site (www.niem.gov) Activitywww.niem.gov Average hits / day 1,842 pre-beta 10,923 currently Average downloads / day 11 pre-beta ~100 currently Web site activity for the period from June 1, 2006 to August 31, 2006 3 What is NIEM? NIEM was launched on February 28, 2005, through a partnership agreement between the U.S. Department of Justice (DOJ) and the U.S. Department of Homeland Security (DHS) NIEM brings Communities of Interest (COIs) together to: Develop (and harmonize) (reusable) data exchange components Leverage (NIEM and external) data exchange components to build information exchanges Publish and discover reusable information exchanges Provide public domain standards and technical tools to support the above Provide training, technical assistance and implementation support services for enterprise-wide information exchange 4 NIEM Use Cases To effectively exchange information, there must be a common semantic understanding of data among participants, and the data must be formatted in a consistent manner. NIEM provides reusable components and IEPDs for exchanges Between NIEM domains (inter-domain). Within NIEM domains (intra-domain) (where multiple sub communities exist within a single NIEM domain, e.g. justice). 5 Built on the Global JXDM NIEM is deeply rooted in the GJXDM and Global Justice Community, and committed to maintaining and growing that relationship The Global Justice XML Data Model (Global JXDM) has A robust, mature framework that is rich, flexible, and extensible An effective governance mechanism Widespread recognition and use, especially among state and local agencies NIEM builds on the demonstrated success of the GJXDM NIEM 0.1 is based upon GJXDM The Global JXDM will form the justice domain of NIEM (the jxdm namespace) The GXSTF will continue to represent the Global JXDM within NIEM 6 Built on the Global JXDM, continued NIEM = GJXDM + Expanded Scope + Lessons Learned Incremental changes to GJXDM to address specific issues and expanded scope A few examples: Expanded Domains (Intel, International Trade, Emergency Mgt, Infrastructure Protection, etc.) Better Modularity Improve Reusability - Leveraging work of others Discovery of IEPDs and components Capturing Business Context Incorporating feedback into the model - Model Refinement through use Support for components from external standards IEPD consistency 7 NIEM Federated Domain Architecture Data component - fundamental building block of NIEM. Data components are either Universal, Common, or Domain- specific. Universal components - data components commonly understood and reused among all domains; subject to NIEM governance. Common components - data components understood and potentially reused between two or more domains; subject to NIEM governance. Domain-Specific - components managed by a specific Community of Interest (may be reused with COI, available for reuse by others). 8 NIEM Domains NIEM Core Universal Common Structures ZNZN ZNZN NIEM J J Sc EM Im IP IT Intel NIEM Domains: Represent a subset of components expected to be used in NIEM for inter-domain, intra-domain exchanges or both Are governed by a cohesive group of data stewards who are domain experts, have some level of authority over the domain and harmonize semantic conflicts Govern their own content under guidelines established by NIEM PMO Are wrapped in a namespace to facilitate governance and to serve as the primary taxonomy. 9 External Domains NIEM Domains NIEM Core Universal Common Structures ZNZN ZNZN NIEM J J Sc EM Im IP IT Intel External Domains: Represent a data standardization initiative outside of NIEM Do NOT fall under NIEM NDR or governance Can be leveraged to create a new NIEM domain May participate in NIEM in the following ways: Total migration (the special case of GJXDM) Wrap / refer (how an external standard is used) Translate / map (NIEM set maps to original data set) Extract / use (translate and move original data set) Adopt (becomes a candidate for a new NIEM domain) External Domain 10 IEPD Development vs the Model IEPD Library (virtual) NIEM The Model NIEM reusable components IEPD Development National priorities (e.g. NDEx, TWPDES) Authoritative sources (e.g. Rap Sheet) Local requirements NIEM NDR reuse / revise add / replace reuse add / replace 11 IEPD Subset Extension NIEM External 2 External 3 External 1 External External domains or standards 1, 5 create 2, 4 wrap / refer 3 translate / map 6 adopt IEPDs and Data Components 12 Organization Model: External View 13 NIEM IEPD Life Cycle 0 Scenarios, BRM Taxonomy 2 Map + model 3 Build + validate 4 Assemble to IEPD spec 1 Info exchange requirements 5 Publish + implement Executive orders, mission statements, business requirements, business context, policies/procedures Specific information exchange, high-level business requirements, existing IEPDs Submission of candidate NIEM components, component business context IEPD artifacts to share/reuse, metadata for discovery IEPD artifacts to share/reuse, metadata for discovery Existing IEPD artifacts Gap analysis, specs for new components Valid IEPD schemas, example instances, documentation, metadata Data requirements, business context, exchange model Data requirements, business context, exchange model IEPD for reuse library NIEM NDR NIEM NDR NIEM Complete IEPD IEPD Lifecycle 14 IEPD Life Cycle Feeds the Data Model Maturity Life Cycle NIEM Staging Area NIEM Governance NBAC / NTAC: vet, harmonize, conformance Groups with common data interests Early Awareness & coordination IEPDs New component candidates & business context NIEM IEPD Life Cycle 0 Scenarios, BRM taxonomies 4 Assemble to IEPD spec 1 Info exchg requirements 5 Publish + implement 3 Build + validate 2 Map + model Top down Bottom up 15 Deliverables Documentation Introduction to NIEM Concept of Operations User Guide NIEM Naming and Design Rules Standards NIEM 1.0 IEPD requirements specs Training and Technical NIEM website Training materials Help desk Tools Component Mapping Template Schema Subset Generation Tool Graphical Browser IEPD Repository Governance and Processes The structure to manage and maintain NIEM and the processes and procedures behind its operations. 16 NIEM Pilots Based on Business Scenarios Content Contributor Pilots DHS Immigration and Customs Enforcement ICE Enterprise Data Model mapping to NIEM DHS Customs and Border Protection United Nations Trade Data Elements Directory (UNTDED) DHS Emergency Management Adding Disaster Management, Resource Message contents Geospatial Community of Interest Adding Geospatial contents DHS Team 5 Pilot People Screening data elements from five DHS components DHS Infrastructure Protection (NADB) Adding infrastructure protection contents Early Adopter Pilots Intelligence Community Watchlist Message Pilot Terrorist Watchlist Person Data Exchange Standard (TWPDES) Working group, OCIO Watchlist and NCTC actively participating National Capital Region Data Exchange Hub Pilot Virginia, DC, and Maryland representatives leading the pilot In partnership with the Disaster Management eGov initiative Initial target: First responder resource request messages OCIO ITEP Pilots (kickoff in August 2006) Data model validation using semantic web techniques JIEM Tool for business stakeholder facilitation 17 Status NIEM 1.0 Release Candidate 2 later this week Scaling up and implementing Governance structures Pilot projects underway GJXDM convergence plan promulgated Cross Federal alignment discussions underway 18 Web site 19 Training and Technical 20 Tools 21 Tools: Graphical Browser 22 Tools: Schema Subset Generation Tool 23 Tools: IEPD Tool 24 Tools: IEPD Tool 25 Lessons Learned GJXDM Usage Base and Governance Structure Enables NIEM Governance and policy are the critical path, not technology They are both also really hard Process cannot replace relationships and trust Balance between: inside / outside the beltway; architectural / operational We are making progress lots more to do State and local involvement as first rank partners As practitioners, stakeholders, thought leaders Role of industry, academic partners Success = adoption and use Never forget that the best way to get this is the simplest listen! 26 Conclusion For more information visit the NIEM web site (http://www.niem.gov)http://www.niem.gov Contact NIEM byat Questions and Discussion