fasten your seatbelt and listen to the (data) steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Fasten your seatbelt and

listen to the (Data) StewardJean-Pierre Riehl

Florian Eidenhttp://blog.djeepy1.net | @djeepy1

http://fleid.net | @fleid_BI

@Djeepy1 | @Fleid_bi | @GUSS_France

Jean-Pierre RiehlPractice Manager Data & BI – AZEO

MVP SQL ServerPresident at GUSS

Florian EidenManaging Consultant, Data & Analytics - CellenzaMVP SQL ServerBoard Member at GUSS

Who are we ?

@Djeepy1 | @Fleid_bi | @GUSS_France

GUSS : PASS France chapterWebcasts, Conferences, Afterworks

.Pro

Next event : SQLSaturday Paris 2014September 13thTour Montparnasse, ParisEnglish-speaking track

@Djeepy1 | @Fleid_bi | @GUSS_France

THE CONTEXT

@Djeepy1 | @Fleid_bi | @GUSS_France

Self-Service BI

Corporate BI• Managed• DatawareHouse• Company-wide

Team BI• Shared• Models• Department-wide

Self-Service BI• Quick & Easy• Personal data• Document-centric

@Djeepy1 | @Fleid_bi | @GUSS_France

Empower UsersRelease Data, Release usages

@Djeepy1 | @Fleid_bi | @GUSS_France

Governance noun.« Leading the conduct of things or persons »

@Djeepy1 | @Fleid_bi | @GUSS_France

THE ISSUES

@Djeepy1 | @Fleid_bi | @GUSS_France

Writer’s blockalso known as

White Worksheet Syndrom

Issue #1

?

@Djeepy1 | @Fleid_bi | @GUSS_France

Too much Data !« I want the Employee’s List »

– Duplicates– Wrong sources– Bad Data– Poor or Bad description– Etc.

Issue #2

@Djeepy1 | @Fleid_bi | @GUSS_France

Compliance– Security– Encryption– Anonymization

Issue #3

@Djeepy1 | @Fleid_bi | @GUSS_France

How does it scale ?

@Djeepy1 | @Fleid_bi | @GUSS_France

POWER BIThe Microsoft Way

@Djeepy1 | @Fleid_bi | @GUSS_France

Features and toolsCollaborate in Office 365

Insights in Excel

Analyze

Visualize

Share

Question

Q&A

Mobility

Discover Search, access, and transform public and internal data sources with Power Query

Share datasets and workbooks refreshable from on-premises and cloud based data sources, with Power BI Sites

Easy data modeling and lightning fast in-memory analytics with Power Pivot

Bold new interactive data visualizations with Power View and Power Map

Ask questions and get immediate answers with natural language query

Mobile access through HTML5 and touch optimized apps

Scalable | Manageable | Trusted

@Djeepy1 | @Fleid_bi | @GUSS_France

Power BI - Big Picture

Power BI O365 Tenant

Power BI Admin Center

SQL

Data Catalog

External Data

Q&A

Cloud On-Prem

Oracle …

Excel

Power BI Sites Power Query Power Pivot

Power View Power Map

Cloud

Power Query

Data Refresh

IndexSearch Data

Management Gateway

@Djeepy1 | @Fleid_bi | @GUSS_France

Ideas of costsAcquire Data

Modelize0€ Geo-

Reporting

Excel 2010* (with limitations)Excel 2013Sharing in SharePoint On-Prem

Visualize

360€by user / year

Mobility

NaturalLangageQ&A

ShareCollaborate

Search

Base on SharePoint Online (O365 Tenant)Possible de ne partager que les métadonnéesRendre

opérationnel

Data Refresh : ouverture de flux

450€by user / year

All Inclusive (ie. including Office 2013 ProPlus Licences)

@Djeepy1 | @Fleid_bi | @GUSS_France

Power BI* On-PremData Sources Gateways & Data Sources Shared Data Sources (SSRS)

Office Data Connection

Datasets Queries Shared Datasets (SSRS)Power Pivot for SharePoint

Models Power PivotData Management Gateway Power Pivot for SharePoint

Dashboards Power View Power View (BISM)

SSRS over Power Pivot

There was some SSBI before Power BI

Power BI vs. On-Prem

* Many more features to come

@Djeepy1 | @Fleid_bi | @GUSS_France

demo

@Djeepy1 | @Fleid_bi | @GUSS_France

• Tools are only a part of the solution

• Good formula : People + Processes + Tools– « Data governance is between 80 and 95%

communication » - Dec 2006 Data Governance Conference

• We have the tools, let’s talk about the rest…

If all you have is hammer…

@Djeepy1 | @Fleid_bi | @GUSS_France

THE DATA STEWARD

@Djeepy1 | @Fleid_bi | @GUSS_France

• Wikipedia: Stewardship is an ethic that embodies the responsible planning and management of resources.

A Steward?

Data Steward of Gondor…Not our idea, see Matthew Roche for complaints

@Djeepy1 | @Fleid_bi | @GUSS_France

IT : Information Technology

My pretty typical organization

Piercing items

Slashing items

Bludgeoning items

Armors & ShieldBusiness Divisions Functional Units

Finance HR Legal

@Djeepy1 | @Fleid_bi | @GUSS_France

Where are stewards needed in the org?

Piercing items

Slashing items

Bludgeoning items

Armors & ShieldBusiness Divisions Functional Units

Finance HR Legal

IT : Information Technology

@Djeepy1 | @Fleid_bi | @GUSS_France

My organization : actual perception

Piercing items

Slashing items

Bludgeoning items

Armors & ShieldBusiness Divisions Functional Units

Finance HR Legal

IT

@Djeepy1 | @Fleid_bi | @GUSS_France

Well, let’s be honest about what it looks like

Piercing items

Slashing items

Bludgeoning items

Armors & ShieldBusiness Divisions Functional Units

Finance HR Legal

IT

@Djeepy1 | @Fleid_bi | @GUSS_France

For maximum results: local initiatives

Piercing items

Slashing items

Bludgeoning items

Armors & ShieldBusiness Divisions Functional Units

Finance HR Legal

IT

@Djeepy1 | @Fleid_bi | @GUSS_France

• Why : – Specific to your company, to be defined in your master plan

• How : – “Responsible planning and management of resources”

• What :– Elect data stewards that will enable, teach, police

Let’s get back to our stewardSlashing items

@Djeepy1 | @Fleid_bi | @GUSS_France

• Skills– Interpersonal skills– Good personal organization– Data-awareness

• Data lifecycle specific to the company• General understanding of BI/data technologies• Data merging, cleaning, metadata maintenance

– Training in tools used in the company

• A chosen career path– It’s an actual job, usually part time– But not just an additional task in the schedule!

Required skills

@Djeepy1 | @Fleid_bi | @GUSS_France

The Journey of a Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

The Journey of a Data Steward• Help to find data

– Manage the Data Lake– Create Data Sources– Facilitate exploration– Manage metadata

@Djeepy1 | @Fleid_bi | @GUSS_France

The Journey of a Data Steward• Manage new data

– Find new Data Sources– Find new Datasets

• Verify new datasets– Check for Accuracy– Check for duplicates– Fix sources and queries

• Use of Workflows

@Djeepy1 | @Fleid_bi | @GUSS_France

The Journey of a Data Steward• Certify

– Ensure Corporate Policies

• Train & Teach – Help for modeling– Help for analysis

@Djeepy1 | @Fleid_bi | @GUSS_France

demo

@Djeepy1 | @Fleid_bi | @GUSS_France

Information Management Platform

ITDevelopers

Data Stewar

d

Importance of relations

Business Users

Tools Tools Tools

@Djeepy1 | @Fleid_bi | @GUSS_France

Information Management Platform

SalesIT

And reality is more complex

Mktg Production

@Djeepy1 | @Fleid_bi | @GUSS_France

DATA(source) LIFECYCLE MANAGEMENT

@Djeepy1 | @Fleid_bi | @GUSS_France

Data Lifecycle Management

@Djeepy1 | @Fleid_bi | @GUSS_France

Data Lifecycle Management

@Djeepy1 | @Fleid_bi | @GUSS_France

Data Lifecycle Management

@Djeepy1 | @Fleid_bi | @GUSS_France

Data Lifecycle Management

@Djeepy1 | @Fleid_bi | @GUSS_France

Data Source Lifecycle Management

Manage, enable

Teach, assist

Analyse, mergeDataSteward

@Djeepy1 | @Fleid_bi | @GUSS_France

• Data asset administration– Create, Delete– Update, Maintain– Give/revoke access– Refresh schedule– Monitor– …

• Business metadata understanding

• Data manipulation• Applied to : data artifacts– Data sets

• Files: CSV, XLSX– Metadata

• Data Models• Documentation

– Data sources– Queries– …

Data Source Lifecycle Management

@Djeepy1 | @Fleid_bi | @GUSS_France

CONCLUSION

@Djeepy1 | @Fleid_bi | @GUSS_France

• Tools are nothing without people and processes

• Governance is different in every company– Decided and sponsored by the executives,

inscribed in a global strategy– Adapted to your organization– The Data Steward as the local implementation of it

A matter of governance

@Djeepy1 | @Fleid_bi | @GUSS_France

1. Build an Information Management Platform2. Identify your processes & Org Chart3. Write the Data Steward « Job Profile »4. Identify the right people for the job5. Leverage Self-Service BI

• Ask your local experts

How to start tomorrow ?

@Djeepy1 | @Fleid_bi | @GUSS_France

• A Data Culture– See Satya Nadella April 15th 2015 presentation in SF

• To at last step up in the knowledge pyramid!– Machine learning \o/

All this for what?

@Djeepy1 | @Fleid_bi | @GUSS_France

Any questions ?Thank You !