real-world data governance: navigating the ocean of data governance tools

Copyright © 2014 – Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com1

1Twitter at #RWDGTwitter at #RWDG

Real World Data GovernanceNavigating the Ocean of Data Governance Tools

Monthly Webinar Series Hosted by DataversityRobert S. Seiner – KIK Consulting / TDAN.com

August 21, 2014 – 2:00 p.m. EST

Robert S. SeinerKIK Consulting & Educational Services, LLC - KIKconsulting.com

The Data Administration Newsletter, LLC - TDAN.com

Twitter at #RWDGTwitter at #RWDGTwitter at #RWDGTwitter at #RWDG


2Twitter at #RWDG

• Real-World Data Governance – Monthly Webinar Series – Third Thursday @ 2pm– September 18, 2014 – Data Governance and Metadata Best Practice– October 16, 2014 – Governance Risk and Compliance *– November 20, 2014 – Selecting the Right Data Governance Approach– December 18, 2014 – Big Data Governance: What it is and why it is necessary– Register On-Line at DATAVERSITY.net * with special guest

Real-World Data GovernanceUpcoming Webinars


3Twitter at #RWDG

• Non-Invasive Data Governance:The Path of Least Resistance and Greatest Success– ISBN 9781935504856 / Technics Publishing – September 1

• KIKConsulting.comNew Home of Non-Invasive Data Governance™– Jeremy Seiner (Nephew) Designer – Live June 1

• Data Governance Financial Services Conference– DATAVERSITY & DEBTECH International– Jersey City, New Jersey – September 29-30

• Enterprise Dataversity– DATAVERSITY– Chicago, Illinois – October 6-8

Real-World Data GovernanceWhat’s New?


4Twitter at #RWDG

• What exactly is a Data Governance tool? Is it what the software companiessay it is? Is it something we can develop internally? Is it the traditional datadictionary or business glossary? The answers to these questions are in reverseYes, Yes, Yes and whatever you say it is. This needs to be explained.

• This month’s Real-World Data Governance webinar with Bob Seiner will lookat the types of Data Governance Tools on the market and the types of toolsthat can be delivered internally while evaluating the pros, cons andconsiderations for selecting the combination that will enhance the capabilityof your Data Governance program.

Real-World Data GovernanceData Governance Tools


5Twitter at #RWDG


• This session will cover:‒ Data Governance Tool Requirements‒ Tools Available on the Market‒ Tools that can be Delivered Internally‒ How to Leverage Tools You Already Own‒ How to Justify the Purchase of Available Software


6Twitter at #RWDG

• Data Governance– Data Governance is the Execution and Enforcement of Authority

Over the Management of Data and Data-Related Resources.Robert S. Seiner

• Data Stewardship– Data Stewardship is the Formalization of Accountability

Over the Management of Data and Data-Related Resources.Robert S. Seiner

Recent Client Definitions

Formalization of behavior around the definition, production andusage of data to manage risk and improve quality and usability ofselected data.

Formalization and guidance for behavior over the definition,production and use of information and information related assets.

Data Governance ToolsDefinitions


7Twitter at #RWDG

• Non-Invasive Data Governance™– The practice of:

• applying formal accountability & behavior • through non-invasive roles & responsibilities• to existing and / or new processes• to assure that the definition, production & usage of data• assures regulatory compliance, security, privacy, protection & quality.

– Non-Invasive describes how governance is applied to assurenon-threatening management of valuable data assets.

– The goal is to be transparent, supportive, collaborative.



8Twitter at #RWDG

• Questions to Ask Ourselves:– Is the Purchase of a Data Governance Tool “Invasive”?– What Expectations Come w/the Purchase of a Data Governance Tool?– Is it Data That is Governed or People’s Behavior That is Governed?– Can a Tool (or Use of a Tool) Govern Behavior?



9Twitter at #RWDG

• Forrester Research, Inc.

• Forrester Wave – Smart Data for Smart Decisions

• 2014 Analysis of Data Governance Tools on the market.

Data Governance ToolsWhat’s going on in the market?


10Twitter at #RWDG



11Twitter at #RWDG

• Data Governance: No Single Solution– The problem isn't a shortage of products. It's a shortage of clarity & vision.– Conversation about data governance moved from the why to how stage.– Budgeting data governance activities are as routine as those for marketing

campaigns and technology purchases.– Suites of data quality, data analysis, MDM tools– Data governance software looks more like a business semantics and metadata

management tool.

Rajan Chandrasinformationweek.com/software/information-management/data-governance-no-single-solution/d/d-id/1107215



12Twitter at #RWDG

• Evaluation Criteria for Data Governance Tools– Usability of Business Glossary– Custom Attributes– Custom Relationships– Data Stewardship– Custom Roles– Approval Workflows– Data Policies, Standards and Processes– Master Data Rules– Allowable Values for Business Terms

(Reference Data)

Sunil Soares / Information Managementinformation-management.com/gallery/evaluation-criteria-for-data-governance-tools-10025067-1.html


– Data Lineage– Impact Analysis– Hierarchy of Data Artifacts– Profiling of Diverse Data Sources– Data Quality Scorecard– Data Issues Log– Data Issue Resolution Process– Support for Internal Audit– Data Governance Metrics


13Twitter at #RWDG

• Are Data Governance Tools Ready for Data Governance?– Vendors are still married to the legacy of data management owning and running

with data governance focusing capabilities toward tactical data governance– No single data governance tool manages across all five data governance pillars

(MDM, data quality, ILM, metadata, security) - although some vendors (IBM,Informatica, SAP) can with significant integration between products.

– Only two vendors (Trillium Software, SAP) provided data governance metricsthat linked data conditions with actual business outcomes (regulatory risk, totalcost of ownership, etc.)

– Only one vendor (Collibra) has an in market tool that provides a data governance2.0 environment specifically for strategic data stewardship and operations

Michele Goetz / Forresterblogs.forrester.com/michele_goetz/14-06-25-are_data_governance_tools_ready_for_data_governance



14Twitter at #RWDG

• What you should know when considering data governance tools?– There is no single solution, but data quality, MDM and metadata management

often are tightly connected to governance.– Identify tools that enforce best practices for administrative aspects of data

governance - the end user is the business; may not be a "data geek".– Look carefully at what it takes to connect data conditions and processes to

business outcomes as this effort may be a BI or Data project.– Understand the vendor roadmap - choose those that have solid strategies and

prototypes/early releases geared toward the strategy, process, andadministrative aspects of governance, not just data management and dataprocessing.

Michele Goetz / Forresterblogs.forrester.com/michele_goetz/14-06-25-are_data_governance_tools_ready_for_data_governance



15Twitter at #RWDG

• Data Quality does not Equal Data Governance– Business users tend, if you are lucky, to accept that they “own” process, but few

accept that they do, or should, own data. Conclusion – get over it, and starttalking of “stewardship” instead

– When someone talks of “governance”, without any context, its tantamount totalking about fools gold. Conclusion – governance, out of context, is dangerous;add context in order to make it meaningful

– “Governance of data/information” needs to start, or be applied first, with afocus on data/information that is meaningful to the business: Conclusion – starta governance focus on “enterprise information” (that is, stuff that’s importantlike master data or reference data).

Andrew White / Gartnerblogs.gartner.com/andrew_white/2010/01/27/data-quality-does-not-equal-data-governance/



16Twitter at #RWDG

Data Governance Tools

Tool Requirements


17Twitter at #RWDG

• Evaluation Criteria for Data Governance Tools – Usability of Business Glossary– Custom Attributes– Custom Relationships– Data Stewardship– Custom Roles– Approval Workflows– Data Policies, Standards and Processes– Master Data Rules– Allowable Values for Business Terms

(Reference Data)

Sunil Soares

– Data Lineage– Impact Analysis– Hierarchy of Data Artifacts– Profiling of Diverse Data Sources– Data Quality Scorecard– Data Issues Log– Data Issue Resolution Process– Support for Internal Audit– Data Governance Metrics

Data Governance ToolsTool Requirements


18Twitter at #RWDG

• The cost of poor data governance (DG) is hidden in:– Inefficient Business Processes– Excessive Data Management Activities– Inability to Use Information for Strategic Business Advantage

How Technology Enables Data GovernanceOracle and First San Francisco Partners White Paper – December 2009http://www.oracle.com/us/products/applications/master-data-management/042941.pdf

What are the types of tools that are availablefor purchase that will assist us

Lower These Costs?



19Twitter at #RWDG

• Data Governance specifically:– Helps Establish Strategy, Objectives and Policy– To Effectively Manage Corporate Data– By Specifying Accountability– By Executing Decision Rights


What are the types of tools that are availablefor purchase that will assist us inImplementing This Functionality?



20Twitter at #RWDG

• By:– Creating and Enforcing Policies on Data Security and Data Access Rights– Monitoring and Measuring Quality, Movement, Availability and Accuracy– Providing the Benefits of having Implemented MDM– Leveraging Technology to Manage Data as an Asset


What are the types of tools that are availablefor purchase that will assist us inImplementing This Functionality?



21Twitter at #RWDG

• Tools to Assist in “Formalizing Accountability”– Linking Steward(s) to the Data, Processes– Triggering Communications to the Accountable Parties (Stewards)– Formalizing Decision Making Through Work Flow



22Twitter at #RWDG

• Tools to Assist in Governing Workflow– To Assist in Formalizing Processes and Workflows– To Record and Cross Reference of Process Steps and Governance Roles– To Formally Identify Accountability for Steps of the Process– To Specify RASCI – Responsible, Accountable, Supportive, Consulted, Informed– To Cross Reference for Methodology, Project, Risk Management, Requests– To Specify and Communicate Outcomes, Deliverables, Milestones, Timelines, …



23Twitter at #RWDG

• Tools to Assist in Communications– To Assist in Formalizing Communications & Awareness Required Content– To Record Cross Reference of Content and Governance Roles– To Formally Identify Communications Topics & Awareness Checklist – To Identify Audience, Content, Message, Media, Timing, …– To Specify When / If Refreshes are Necessary



24Twitter at #RWDG


TOOLS ON THEMARKET


25Twitter at #RWDG

Data Governance ToolsTools on the Market

Data Governance

Tools, Forrester

2014


26Twitter at #RWDG

• What kind of tools are on the market to assist with Data Governance?– Adaptive – Business Glossary – Metadata, EA & IT Portfolio Manager

Adaptive.com– ASG – Cloud, Content & Systems Metadata

ASG.com– Collibra – Data Governance Center

Collibra.com– Global Ids – Manage, Integrate, Govern Business Information

Globalids.com– IBM – Data Governance Unified Process

IBM.com– Informatica – Data Integration, Masking, Quality, Replication, MDM, …

Informatica.com



27Twitter at #RWDG

• What kind of tools are on the market to assist with Data Governance?– Information Builders – Intelligence, Integration & Integrity

IBI.com– Innovative Systems – Data Management, Cleanse, MDM, Change Management

InnovativeSystems.com– SAS Institute / DataFlux – Data Management, Quality, Governance & MDM

SAS.com– SAP – Business Applications, Database & Technologies

SAP.com– Trillium – Business Solution & Data Quality Products

TrilliumSoftware.com

– The WHO’s WHO of Data Management Tool Vendors !!!



28Twitter at #RWDG


TOOLS DEVELOPEDINTERNALLY


29Twitter at #RWDG

• “Picture Worth a Thousand Words” Tool – Policy / Principles / Dimensions

Data Governance ToolsTools Developed Internally


30Twitter at #RWDG

• Operating Model of Roles & Responsibilities Tool:

– Definition of Roles, Basis for the Program

– Used to Formalize Roles & Responsibilities, Engage, Communicate

– Data Governance (on some level) is Already Taking Place!

– Be Non-Invasive in Your Approach to Identifying People into Roles

– Covers Executive, Strategic, Tactical, Operational & Support

– Pyramid Structure Has Meaning

– Arrows Have Meaning



31Twitter at #RWDG

Operational LevelOperational Data Stewards (existing)

Data Definers, Producers, UsersThese people are presently defining,producing and using data as part of theirjobs. Recording of the Operational DataStewards will be an important enabler of improved communications, coordinationand cooperation among stewards.

Tactical LevelData Domain Stewards

Per assigned Subject AreasData Steward Coordinators

One per Business Unit

Strategic LevelData Governance CouncilData Governance Sponsors Groupor Group of similar participation. One person, plusalternate, for each Business Unit represented & IT.Consider financial services & human resources.

Executive LevelData Steering CommitteeSenior-most level knowledge of the program.Leverage existing business structure as possible.If no structure exists, utilize an IT Steering Committeeor an executive founded board or council.

Operational Level - Business Unit Specific

Strategic -Enterprise

Tactical Level - Cross Business Unit

Executive

Non-Invasive Data Governance™ Operating Modelof Roles & Responsibilities

Escalation / Approval Path

Data G

over

nanc

e Pro

gram

Team

(DGPT

)

IT Su

bject

Resou

rce E

xper

ts

Data Governance Program TeamData Governance Team ManagerResponsible for Administering the Program,facilitating use of the Data Governance Council,communicating program components and value to the Organization.Advisory assistance from other levels.

IT Subject Resource ExpertsSystem/Data Resource ExpertsIT Staff including ApplicationDevelopment, Data Design,Security, and other DataResource Management.

Communication

EX

IS

TS

EX

IS

TS

EX

IS

TS

NE

W LE

VE

RA

GEN

EW



32Twitter at #RWDG

• Common Data Matrix Tool:

– Assists in Inventory of Data, Data Stores, Systems, System of Record, …

– Assists in Identifying, Recognizing and Recording Stakeholders of Data

– Assists in Formalizing Accountability for Data and Information

– Record Cross Reference of Domains (Subject Areas) and Potential Stakeholders

– Formally Manage Master Data Categories into Domains & Sub-Domains

– Identify Strategic, Tactical and Operational Stakeholders

– Formally Identify and Engage the Knowledgeable IT Resources



33Twitter at #RWDG



34Twitter at #RWDG



35Twitter at #RWDG

• Work Flow Templates Tools:

– Assists in Formalizing Processes and Workflows

– Record Cross Reference of Process Steps and Governance Roles

– Formally Identify Accountability for Steps of the Process

– Specify RASCI – Responsible, Accountable, Supportive, Consulted, Informed

– Cross Reference for Methodology, Project, Risk Management, Requests

– Specify Outcomes, Deliverables, Milestones, Timelines, …



36Twitter at #RWDG

• Issue Resolution Templates Tools:

– Assists in Formalizing Processes and Workflows

– Record Cross Reference of Issue Resolution Steps and Governance Roles

– Formally Identify Accountability for Steps of the Process

– Specify RASCI – Responsible, Accountable, Supportive, Consulted, Informed

– Cross Reference for Specific Activities to Resolve Data Issues

– Specify Outcomes, Deliverables, Milestones, Timelines, to Resolve Issue



37Twitter at #RWDG



38Twitter at #RWDG



39Twitter at #RWDG

• Communications Matrix Tool:

– Assists in Formalizing Communications & Awareness Required Content

– Formally Identify Communications & Awareness Checklist

– Identify Audience, Content, Message, Media, Timing, …

– Message and Delivery May / Will be Different Depending on Audience

– Specify When / If Refreshes are Necessary



40Twitter at #RWDG



41Twitter at #RWDG

• Tools Can Be Internally Developed

– Formalize Roles & Responsibilities

– Formalize Accountability for Data and Information

– Formalize Processes Associated with Governing Data

– Formalize Awareness of Data Governance Activities

– Use Tools as a Component of a Successful Governance Program

– Formalize How This Meta-Data is Recorded and Made Available

– Tools Become the “Face” of Your Data Governance Program



42Twitter at #RWDG


TOOLS YOUALREADY OWN


43Twitter at #RWDG

• Data Definition Tools – Governing Data Definition– Data Modeling Tool (s)– Business Glossary / Data Dictionary

• Data Production Tools – Governing Data Production– Extraction Transformation Load (ETL) Tool (s)– Data Entry Forms / Labels / Constraints

• Data Usage Tools – Governing Data Usage– Report Writer Tool (s)– Analytical Tool (s)

Data Governance ToolsTools You Already Own


44Twitter at #RWDG

Data Governance ToolsTools You Already Own

• Data Administration Tools – Governing Data Administration– Metadata Repository Tool (s)– Change Management Tool (s)

• Data Quality Tools – Governing Data Quality– Data Profiling Tool (s)– Data Issue Log / Process

• Data Process Tools – Governing Data Process– Workflow Management Tool (s)– Decision Making Process Tool (s)


45Twitter at #RWDG


JUSTIFYING THE

PURCHASE


46Twitter at #RWDG

• How does the tool differ from what we already own?

• What efficiency and effectiveness will be gained by using the tool?

• What is the TCO (Total Cost of Ownership) of the tool?– License– Maintenance– Human Resources– Training

• What is the value / benefit we will get from the tool?

• How will the tool help us to do things we cannot presently do?

Data Governance ToolsJustifying the Purchase of Tools


47Twitter at #RWDG

• How does it impact the … of Data Governance?– Goals– Objectives– Scope– Best Practice– Policy / Guidelines– Roles & Responsibilities– Process– Communications

Data Governance ToolsJustifying the Purchase of Tools


48Twitter at #RWDG


• Summary‒ What’s Happening in the Marketplace?‒ Data Governance Tool Requirements‒ Tools that are Available on the Market‒ Tools that can be Delivered Internally‒ Leveraging Tools You Already Own‒ Justifying the Purchase of Software

• Question and Answers


49Twitter at #RWDG

• Real-World Data Governance – Monthly Webinar Series – Third Thursday @ 2pm– September 18, 2014 – Data Governance and Metadata Best Practice– October 16, 2014 – Governance Risk and Compliance *– November 20, 2014 – Selecting the Right Data Governance Approach– December 18, 2014 – Big Data Governance: What it is and why it is necessary– Register On-Line at DATAVERSITY.net * with special guest

Real-World Data GovernanceUpcoming Webinars


50Twitter at #RWDG

Robert S. SeinerKIK Consulting & Educational Services – KIKconsulting.comThe Data Administration Newsletter - TDAN.comPost Office Box 112571, Pittsburgh, Pennsylvania 15241412.220.9643, 412.220.9644 (Fax)[email protected], [email protected]

Wrap Up& Discussion

real-world data governance: navigating the ocean of data governance tools

Technology

seiner kik consulting

big data governance

llc tdan

governance risk

llc kikconsulting

purchase of available

metadata best practiceoctober