rwdg webinar: align data modeling with data governance
TRANSCRIPT
1
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
Real World Data Governance
Align Data Modeling with Data Governance
Monthly Webinar Series Hosted by DATAVERSITYRobert S. Seiner – KIK Consulting / TDAN.comOctober 19, 2017 – 2:00 p.m. EST
2
2
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Real-World Data Governance – Monthly Webinar SeriesNovember 16, 2017 - Data Governance Best Practices and Lessons LearnedDecember 21, 2017 - Governing Big Data, Smart Data, Data Lakes, and the IOTThird Thurs @ 2pm EST – Register at TDAN.com, KIKconsulting.com, DATAVERSITY.net
• Non-Invasive Data Governance BookISBN 9781935504856 / Technics Publishing / Amazon.com
• Speaking EventsData Governance Winter Conference 2017 – Delray Beach, Florida – December 4-8
• Online Learning PlanNon-Invasive Data Governance - DATAVERSITY Training CenterSeven Online Courses with Evaluations
• The Data Administration Newsletter (TDAN.com)Twice Monthly – Articles, Columns, Blogs and FeatureProduced by DATAVERSITY – Subscribe for emails
Real-World Data GovernanceCurrent Events
3
3
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• During this webinar Bob will discuss:– Data Modeling as a Data Governance Discipline– Using Data Modeling to Improve the Business Understanding of Data– Why the Data Model is a Key Data Governance Artifact– How to Use the Data Model as an Effective Communications Tool– Including Modeling as a Core Service Associated with Data Governance
Align Data Modeling with Data GovernanceAgenda for Today’s Webinar
4
4
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Governance– Data Governance is the Execution and Enforcement of Authority
Over the Management of Data and Data-Related Resources.
• Data Stewardship– Data Stewardship is the Formalization of Accountability
Over the Management of Data and Data-Related Resources.
Align Data Modeling with Data GovernanceDefinitions
5
5
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Non-Invasive Data Governance™– The practice of:
• applying formal accountability & behavior • through non-invasive roles & responsibilities• to existing and / or new processes• to assure that the definition, production & usage of data• assures regulatory compliance, security, privacy, protection & quality.
– Non-Invasive describes how governance is applied to assurenon-threatening management of valuable data assets.
– The goal is to be» Transparent» Supportive» Collaborative.
Align Data Modeling with Data GovernanceDefinitions
6
6
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Modeling– Data modeling is a process used to define and analyze data
requirements needed to support the business processes within thescope of corresponding information systems in organizations.
Align Data Modeling with Data GovernanceDefinitions
7
7
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Modeling– The process of data modeling involves professional data modelers
working closely with business stakeholders, as well as potential usersof the information system.
• Data Modeling is the process of learning about the data and the datamodel is the result of data modeling.
Adapted from a definition from Steve Hoberman
Align Data Modeling with Data GovernanceDefinitions
8
8
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
Align Data Modeling with Data GovernanceTypes of Data Models
9
9
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• All of the models require:– Definition of Data– Collection of Data Definition Metadata– Representation of Data– Discipline around Data
Align Data Modeling with Data GovernanceWhat is Consistent Across Models?
10
10
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• “To deliver appropriate models requires that the person responsible for themodel involve the appropriate people at the appropriate time …”
• Data Governance Bill of “Rights”– Getting the “right” people– Involved in the “right” way– At the “right” time– Using the “right” data– To come to the “right” decision– At least most of the time.
●
Align Data Modeling with Data GovernanceWhat is Consistent Across Models?
11
11
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
Align Data Modeling with Data GovernanceIs Data Modeling Data Governance?
●
12
12
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Yes– Data Modeling definitions & structures are the “stuff” being governed.– Data Modeling requires business stakeholder involvement– Data Modeling as part of a data management plan …
• No– Data Modeling is about quality data definition, while
• Data Governance is about the quality of data recorded.– Data Modeling is a discipline apart from governance– Data Modeling does not directly lead to governed data
Align Data Modeling with Data GovernanceIs Data Modeling Data Governance?
●
13
13
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• What are the Data Governance Disciplines?– Three Actions of Governing Data
• Governing the Action of Defining Data• Governing the Action of Producing Data• Governing the Action of Using Data
Align Data Modeling with Data GovernanceData Modeling as a Data Governance Discipline
14
14
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Governing the Action of Defining Data– Answer a few simple questions …
• Does your organization define data by modeling?• Is there a process to be followed to define data?• Do the steps include validation with customers?• Are the steps being followed?
Align Data Modeling with Data GovernanceData Modeling as a Data Governance Discipline
15
15
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Relating Data Definition to Data Modeling– Data definition best practices include:
• Getting the “right” people involved.• Recording the appropriate data attributes.• Resolving differences of opinion and understanding.
Align Data Modeling with Data GovernanceData Modeling as a Data Governance Discipline
16
16
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Governing the Action of Producing Data– Data can only be produced as well as data is defined.– Data Definition provides data production requirements.– Include derived, calculated, matched, sorted, rolled up …– Assure data producers know data requirements.
Align Data Modeling with Data GovernanceData Modeling as a Data Governance Discipline
17
17
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Relating Data Production to Data Modeling– Governed modeled data leads to improved data quality.– Quality definition leads to knowledgeable data production.– Data production can be an __________ function.
• Internal – Complete control – Impose influence.• External – Influence data definition when you can.
Align Data Modeling with Data GovernanceData Modeling as a Data Governance Discipline
18
18
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Governing the Action of Using Data– Reduce Risk and Manage
• Protecting sensitive data – PII, PHI, IP, …• Following compliance and reporting rules
– Improve Data Value• Decision making b/on trusted definition/production.• Improved interpretation of data analysis.
Align Data Modeling with Data GovernanceData Modeling as a Data Governance Discipline
19
19
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Relating Data Usage to Data Modeling– Improve people’s knowledge of data to use.– Improve people’s understanding of the data itself.– Improve people’s knowledge of quality requirements.– These improvements require governed processes.
Align Data Modeling with Data GovernanceData Modeling as a Data Governance Discipline
20
20
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Everybody is a Data Steward! Get over it!– Accountability based on relationships to data.– Hold people formally accountable for relationship quality.– Stewardship based on:
• Relationships• Rules
– Data Definers, Producers and Users are Data Stewards.
Align Data Modeling with Data GovernanceModeling to Improve Business Understanding of Data
21
21
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Definition Stewards– Goal: To improve Data Definition through Data Modeling– Examples of Data Definition Stewards
• Data Architects / Data Modelers• Data Owners• Data Integrators• Project Managers• Business Analysts … who else?
– Requires guidelines/rules & supervision for how data is defined.
Align Data Modeling with Data GovernanceModeling to Improve Business Understanding of Data
22
22
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Production Stewards– Goal: To improve Data Production through Data Modeling– Examples of Data Production Stewards
• Data Integrators• System Integrators• People that acquire data• Super Users / Power Users• Data manipulators … who else?
– Requires guidelines/rules & supervision for how data is produced.
Align Data Modeling with Data GovernanceModeling to Improve Business Understanding of Data
23
23
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Usage Stewards– Goal: To improve Data Usage through Data Modeling– Examples of Data Usage Stewards
• Report Writers• Report Analysts• Super Users / Power Users• Data Scientists• Anybody that uses data in their job … who else?
– Requires guidelines/rules & supervision for how data is used.
Align Data Modeling with Data GovernanceModeling to Improve Business Understanding of Data
24
24
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Modeling is the process of learning about the data and the data modelis the result of data modeling.
Steve HobermanThe Data Modeling Addict – TDAN.comThe Book Look – TDAN.comPublisher – My book on NIDG
• Steve is clearly differentiating modeling as a process …
• And the model as the tangible artifact.
• Is it the metadata in the data model that is the tangible artifact?
Align Data Modeling with Data GovernanceWhy the Data Model is a Key DG Artifact
25
25
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• The Data Models become:– The system of record for the data definition.– Forward engineered into database design.– Key data source of metadata for the:
• data dictionary• business glossary• metadata repository tool• data governance tool
Align Data Modeling with Data GovernanceWhy the Data Model is a Key DG Artifact
26
26
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• To share [data models] or not to share; That is the question.
• No seriously … That IS the question for webinar participants.
• How do YOU use your data models?
• Is data modeling a lost art?– With the advent of agile development …– With the expansion of big data …
Align Data Modeling with Data GovernanceUsing Data Models as Communications Tool
27
27
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• To share [data models] or not to share; That is the question.
• Reason TO show the data model:– Contains valuable definitional metadata– Contains valuable relationship metadata– Contains reference and valid value metadata
• Reasons NOT TO show the data model:– Business community not interested– Models are too large to understand;
and overwhelming.– Really interested in the metadata;
not the model itself.
Align Data Modeling with Data GovernanceUsing Data Models as Communications Tool
28
28
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Reason TO compromise:– Use the model and modeling process to collect metadata– Share valuable definitional metadata– Share valuable relationship metadata– Share valuable business rule metadata– Share reference and valid value metadata
Align Data Modeling with Data GovernanceUsing Data Models as Communications Tool
29
29
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Leveraging the Model as a Governance Artifact– Artifact
• An object produced by human craft• A tool of historical interest• By-product of specific discipline
– Definition and Design of the Data• Conceptual Description• Logical Description• Physical Description
●
Align Data Modeling with Data GovernanceUsing Data Models as Communications Tool
30
30
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• DGAAS – Data Governance as a Services
• What capabilities can the Data Governance Office provide to the organization?– Data Definition Services– Data Production Services– Data Usage Services
Align Data Modeling with Data GovernanceIncluding Modeling as a Core DG Service
31
31
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• What capabilities can the Data Governance Office provide to the organization?– Data Definition Services
• Instill discipline in how the organization defines data• Providing business requirements for data definition• Providing data definition development skills• Provide data definition tools:
– Data Model– Data Dictionary– Business Glossary– Metadata Repository
Align Data Modeling with Data GovernanceIncluding Modeling as a Core DG Service
32
32
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• What capabilities can the Data Governance Office provide to the organization?– Data Production Services
• Instill discipline in how the organization produces data• Providing business requirements for data production• Providing data production development skills• Provide data production tools:
– Data Model– Data Dictionary– Business Glossary– Metadata Repository– Data Movement Tools
Align Data Modeling with Data GovernanceIncluding Modeling as a Core DG Service
33
33
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• What capabilities can the Data Governance Office provide to the organization?– Data Usage Services
• Instill discipline in how the organization uses data• Providing business requirements for data usage• Providing data usage development skills• Provide data usage tools:
– Data Model– Data Dictionary– Business Glossary– Metadata Repository– Data Classification and Handling Rules
Align Data Modeling with Data GovernanceIncluding Modeling as a Core DG Service
34
34
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Modeling as Art– Well prepared data models are more or less intelligible to end users who
must use them.– Aesthetics are important (but usually ignored)
• Data Modeling as Science– Both semantic and essential data models are kinds of “ontologies”.
• “Ontology” was the branch of Greek philosophy concerned with “what exists”
• Semantic and Essential models describe rigorously what exists in an organization.
– Think of the data modeler as a “data archeologist”.
●
Align Data Modeling with Data GovernanceIncluding Modeling as a Core DG Service
35
35
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Modeler– In the Facilitator Role– As a Business Role– As a Technician
• Data Stewards– Data Definers– Data Domain Stewards– Subject Matter Experts
Align Data Modeling with Data GovernanceIncluding Modeling as a Core DG Service
36
36
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Modeler Skills– Facilitator– Business Liaison– Skilled in Modeling
• Governance Skills– Facilitator / Decision Point– Aligns Business & Data– Skilled in Enforcing Accountability
●
Align Data Modeling with Data GovernanceIncluding Modeling as a Core DG Service
37
37
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Data Governance Best Practice– Senior Leadership Supports, Sponsors & Understands– Resource(s) Responsible for Data Governance– Goals, Objectives, Roles, Metrics … Defined and Approved
• Data Modeling Best Practice– Listen to business community– Understand the underlying meaning of terms– Provide a clear picture for all to understand– Teach the underlying nature of things.
●
Align Data Modeling with Data GovernanceIncluding Modeling as a Core DG Service
38
38
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• During this webinar Bob discussed:– Data Modeling as a Data Governance Discipline– Using Data Modeling to Improve the Business Understanding of Data– Why the Data Model is a Key Data Governance Artifact– How to Use the Data Model as an Effective Communications Tool– Including Modeling as a Core Service Associated with Data Governance
Align Data Modeling with Data GovernanceSummary
39
39
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Questions and Answers
Align Data Modeling with Data GovernanceSummary
40
40
Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner
• Robert S. SeinerKIK Consulting & Educational Services – KIKconsulting.comThe Data Administration Newsletter – TDAN.comPost Office Box 112571, Upper St. Clair, Pennsylvania 15241412.220.9643, [email protected]@RSeiner @TDAN_com
Align Data Modeling with Data GovernanceContact Information