real-world data governance webinar: big data governance - what is it and why is it necessary

1

Copyright © 2014 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com

Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting Twitter About This Webinar at #RWDG

Robert S. SeinerKIK Consulting & Educational Services – KIKconsulting.com

The Data Administration Newsletter – TDAN.com

Real-World Data GovernanceBig Data Governance

What is it and why is it necessary?Monthly Webinar Series Hosted by DATAVERSITY

Robert S. Seiner – KIK Consulting / TDAN.comDecember 18, 2014 – 2:00 p.m. EST

Presenter

Presentation Notes

Robert S. Seiner KIK Consulting & Educational Services, LLC The Data Administration Newsletter, LLC Post Office Box 112571 Upper St. Clair, Pennsylvania, USA 15241 412.220.9643 Office 412.220.9644 Fax

2



• Real-World Data Governance – Monthly Webinar Series

– January 22, 2015 – Agile and Data Governance: Bridging the Gap – 2pm EST

– February 19, 2015 – Data Governance Roles & Responsibilities – 2pm EST

– March 19, 2015 – Data Governance Best Practice Criteria – 2pm EST

– Register On-Line at DATAVERSITY.net

Real-World Data GovernanceUpcoming Webinars

3



• Non-Invasive Data Governance:The Path of Least Resistance and Greatest Success– ISBN 9781935504856 / Technics Publishing – September 1

• KIKConsulting.comNew Home of Non-Invasive Data Governance™– Jeremy Seiner (Nephew) Designer – Live June 1

• Enterprise Data World 2015– DATAVERSITY & DAMA International– Washington, DC – March 29 – April 3, 2015– Half-Day Tutorial– Progressive Topics in Data Governance: Big Data, Agile and IoT

Real-World Data GovernanceWhat’s New?

http://www.enterprisedataworld.com/

http://www.enterprisedataworld.com/

4



• Big Data is all the rage. Everybody is asking about Big Data, researching BigData, considering Big Data, some are even doing Big Data. Certainly manypeople are asking questions about Big Data Governance. We have someanswers for them.

• This Real-World Data Governance webinar with Bob Seiner will focus onthe strength of Big Data Governance as a concept and a practice and willhighlight how the concepts of each, Big Data and Data Governance, bothbenefit and hurt each other.

Big Data GovernanceAbstract

5



• This session will include:

– Defining Big Data Governance

– Ways to Govern Big Data

– Making the Connection for IT and Business People

– Determining the Vitality of Big Data Governance

– Considerations for Big Data Governance

Big Data GovernanceAbstract

6



• T Gregorius

Big Data GovernanceHumorous Side of Big Data

7



Big Data GovernanceHumorous Side of Big Data

8



• Budget Questions for Big Data

– Are companies budgeting for big data?

– What are exactly are they budgeting for?

– How are exactly are they spending their money?

Big Data GovernanceBudget

9



• What do companies need to budget for?

– Scaling Up / Scaling Out Storage

– Development of (Non) Production Environments

– Staff Training on Big Data Tools

– Operational Systems to Handle Big Data

– Purge / Archive / Disaster Recovery for Big Data

– Big Data Governance

– Big Data Metadata

– Big Data Risk Management

Big Data GovernanceBudget

10



• Examples of How Big Data is being Talked About

– “I Love It When You Call Me Big Data” – Pittsburgh Technology Council

– “You may not be doing Big Data, but Big Data is doing you.” – proposed presentation

Big Data GovernanceBig Data – All the Rage

http://www.pghtech.org/

http://www.pghtech.org/

11



Big Data GovernanceWhat is Big Data?

• Big Data is …

– High volume, variety, velocity … data.

– Terabytes, petabytes, and exabytes of data in all sorts of formats, gettingtransferred into many new and different software packages -- many of whichtreat security as a secondary or tertiary requirement.

– Unstructured data -- which includes everything from the text found in email andon social media sites to machine-generated logs.

• How does your organization define Big Data?

12



• Big Data– “Big Data” is a term applied to data sets whose size is beyond the ability

of commonly used software tools to capture, manage, and process thedata within a tolerable elapsed time. Big data sizes are a constantlymoving target currently ranging from a few dozen terabytes to manypetabytes of data in a single data set.

Big Data GovernanceWhat is Big Data?

From Wikipedia.com

www.allanalytics.comBig Data Quick Poll Results

13



Big Data GovernanceWhat is Data Governance?

• Data Governance is:

– Execution and enforcement of authority over the management of data.

– Orchestration / Harmonization of people, process and data.

– Formality of decision rights associated with data.

• How does your organization define Data Governance?

14



Big Data GovernanceWhat is Big Data Governance?

• Execution and enforcement of authority over the management of

– High volume, variety, velocity … data.

– Terabytes, petabytes, and exabytes of data in all sorts of formats, gettingtransferred into many new and different software packages -- many of whichtreat security as a secondary or tertiary requirement.

– Unstructured data -- which includes everything from the text found in email andon social media sites to machine-generated logs.

• Is your organization considering …

– Big Data Governance – or the

– Governance of Big Data Why do the semantics matter?

15




• What are some the things Big Data Governance needs to be concerned with?

– Big Data as an Asset

– Formalized Accountability

– Following the Rules

– Consistency in Application

– Metadata to Improve Value

– Management of Data Definition

– Management of Data Production

– Management of Data Usage

16




• Where Does Metadata Fit in the Picture

– Metadata in the past was limited to names, definitions and labels.

– Big Data Metadata encompasses information about the relationships betweenthe data, the people, the processes and the use of this information.

– Metadata Continues to Evolve• From a Data Management Asset• To a Business Intelligence / Data Warehousing Asset• To a Data Governance Asset• To a Privacy and Confidentiality Asset

• To a Big Data Asset

17



• Do we need a data governance strategy for each type of data?

– Structured data

– Unstructured data

– Content

– Record

– Logs

– Social Media

• Or can one Data Governance program be used for all data types?


18



• Do we need a data governance strategy for each type of data?

– Customer

– Product

– Supplier

– Facility

– Employee

• Or can one Data Governance program be used for all data types?


19



Big Data GovernanceWays to Govern Big Data

• Do we / Will we Govern Big Data differently then other data?

– From an Accountability Perspective

– From a Process Perspective

– From a Rules Perspective

– From an Inventory Perspective

– From a Decision Making Perspective

20



• From an Accountability Perspective


21



• From a Process Perspective


22



• From a Rules Perspective


23



• From an Inventory Perspective


24



• From a Decision Making Perspective


25




• Govern the Definition of Big Data

– What Big Data is available

– What Big Data can be used for

– What Infrastructure is required

– How that Big Data is defined

– Including the definition of the format of the Big Data

– Who has the accountability for defining the Big Data

– Storing the definition of the Big Data

26




• Govern the Production of Big Data

– How Big Data is produced

– Where Big Data comes from

– The quality of the Big Data production

– Accountability for producing the Big Data

– Storing information about the production of Big Data

27




• Govern the Usage of Big Data

– How Big Data is used

– Accountable for using the Big Data

– Storing information about how the Big Data can be used

28



• What does it mean to Govern Big Data?v. gov·erned, gov·ern·ing, gov·erns

– To make and administer the public policy and affairs [of big data]– To exercise sovereign authority [over big data]– To control the speed or magnitude [of big data]– To regulate [big data] – To control the actions or behavior [of big data] – To keep under control [big data]; to restrain [big data] – To exercise a deciding or determining influence [on big data] – To exercise political authority [over big data] – To have or exercise a determining influence [over big data]

FreeDictionary.com [Bob Seiner]

Big Data GovernanceConnecting Governance & Big Data

29



Big Data GovernanceConnecting Governance & Big Data

30



Big Data GovernanceVitality of Big Data Governance

• Questions surrounding the need for Big Data Governance

– Do we require a separate discipline called Big Data Governance?

– How would Big Data Governance differ from any other Data Governance?

– Would the same roles / rules apply?

– Should we stop using the term Big Data Governance and just call it Data Governance?

– Can we use Big Data to sell the need for Data Governance?

31





– Do we require a separate discipline called Big Data Governance?

• In my opinion NO – It is not necessary!

• What’s your opinion? – Separate Discipline for Big Data Governance?

32





– How would Big Data Governance differ from any other Data Governance?

• Different Best Practices

• Different Roles

• Different Action Plan

• Different Communication Plan

33






• Executive Roles

• Strategic Roles

• Tactical Roles

• Operational Roles

• Support Roles

34






• Protection Rules

• Classification Rules

• Compliance Rules

• Business Rules

35





– Should we stop using the term Big Data Governance?

• Is Big Data Governance even a thing?

36





– Can we use Big Data to sell the need for Data Governance?

• If your company embraces the idea of Big Data – Yes!

• If your company has not yet embraced Big Data – Probably Not!

• Stress the need to – Execute and Enforce Authority– Formalize Accountability

37



Big Data GovernanceBig Data Governance Considerations

• What are considerations for the Governance of Big Data?

– Accountability for identifying, vetting and approving data requirements

– Accountability associated with assessing the quality of the data

– Accountability associated with accessing the data / granting access to the data

– Accountability for managing and supporting the infrastructure

– Accountability for managing stakeholder expectations

38



• IBM’s Five Ways to Take Advantage of Big Data1. Build a corporate culture that’s savvy about big data. 2. Make security, privacy and governance a requirement. 3. Invest in a big data platform. 4. Appoint a Chief Data Officer. 5. Infuse intellectual intelligence into a new generation of apps.

http://www.forbes.com/sites/ibm/2014/04/14/five-ways-companies-can-compete-using-big-data-and-analytics/


39



• Companies should consider that they will need to

– Govern parallel issues

– Govern the selection of internal and external data to be integrated

– Govern the selection of analytical models / tools that support business goals

– Govern the capabilities of the organization to exploit this potential


40



• The payoff from joining the big-data and advanced-analytics managementrevolution is no longer in doubt. The tally of successful case studiescontinues to build, reinforcing broader research suggesting that whencompanies inject data and analytics deep into their operations, they candeliver productivity and profit gains that are 5 to 6 percent higher thanthose of the competition.

Harvard Business Review, October 2012


41



• Applications of Big Data in Healthcare– Aggregating years of research and development data into medical databases– Digitizing their patient records– Opening their vast stores of health-care knowledge– Managing data from clinical trials and information on patients– Collecting and analyzing information from multiple sources


42



• Applications of Big Data in Retail– Growing, cross-channel data volumes– Increasing investment in technology– Solving the behavior puzzle with data– Improving personalization– Segmenting the most valuable customers


43



• Applications of Big Data in Education– Improved feedback and application processes– Personalization of courses of study– Efficiency by saving time and effort to realize goals – Tracking and understanding patterns of learners– Understanding the learning process


44



• This session included:– Defining Big Data Governance– Ways to Govern Big Data– Making the Connection for IT and Business People– Determining the Vitality of Big Data Governance– Considerations for Big Data Governance

Real-World Data GovernanceWrap Up

45



• Real-World Data Governance – Monthly Webinar Series

– January 22, 2015 – Agile and Data Governance: Bridging the Gap – 2pm EST

– February 19, 2015 – Data Governance Roles & Responsibilities – 2pm EST

– March 19, 2015 – Data Governance Best Practice Criteria – 2pm EST

– Register On-Line at DATAVERSITY.net

Real-World Data GovernanceComing Up

46



• Robert S. SeinerKIK Consulting & Educational Services – KIKconsulting.comThe Data Administration Newsletter – TDAN.comPost Office Box 112571, Upper St. Clair, Pennsylvania 15241412.220.9643, 412.220.9644 (Fax)[email protected]@tdan.com

Real-World Data GovernanceContact Information

real-world data governance webinar: big data governance - what is it and why is it necessary

Business

rwdg big data

big data governance

enterprise data world

seiner kik consulting

seiner kik consulting

trademark of robert

bob seiner

pm est register