In a cube in the office there lived an

information worker…

November 13, 2013@PNWSQL

Power BI Self-Service Information ManagementPower Query and Data Stewardship

Matthew Roche @SQLAllFatherMicrosoft Corporation

Dark Data

Information

Worker

Range-erEmailrond

steward

IT-dalf

IT-dalf

Power BI Review

Microsoft Power BI for Office 365Self-service BI with the familiarity of Office and the power of the cloud

Collaborate in Office 3651 in 4 enterprise customers on Office 365

Insights in Excel1 Billion Office Users

Analyze Visualize Share Find

Q&A

MobileDiscover

Scalable | Manageable | Trusted

DemoSSIM in Power BI

6

Challenges and Target Audiences

• Information Workers spend too much time searching for data, and preparing it for use instead of focusing on actually analyzing the data

• IT spends too much time and resources servicing data requests from the business while trying to secure and govern data access and use

• The lack of trust in information continues as a significant inhibitor to businesses

Informatio

n Workers (supported by )

IT Pros

Data

Stewards

(in midsize to very large organizations)

“…only business users close to the content can evaluate information in its business context” -- Gartner

Power BI SSIM Main Modules

For IT Administrators:• To setup, monitor and govern the

cloud solution and data integration layer

Admin CenterFor Information Workers:• to discover and access relevant data• to filter and re-shape dataFor query authors and Data Stewards• to define repeatable data queries that

acquire and transform data consistently

• to publish/share and annotate queries for other IWs to find

Power Query in Excel

Data Catalogue• Stores and processes metadata about data sources, users and their relationships • Provides data & metadata search functionality across multiple sources• Connects to corporate data through data integration layer

For Data Stewards and query authors: • to manage metadata, shared

queries, and published data sources • to see data telemetry (usages,

search etc.)• to gain insight on data lineage

Data Management Portal

Data Catalogue of corporate data

Publish via Power Query Publish via Admin Center

IW (query author) Data Steward IT Admin

Corporate Data Data Management Gateway

Public data published by Microsoft

Catalog of Public data

Legend: PublishFederated (automatically)Refer to data sourceUse tool

SSIM in Power BI – Hybrid Data Publishing

Enabling the Information Management Ecosystem

Fostering a collaborative virtuous cycle for the Data Value Chain

The organization’s data

• Discover• Connect

Web data Curated Public data

The world’s data • Refine• Combine• Annotate • Share

IT ADMIN

• Certify• Categorize• View usage analytics and feedback

• Secure • Monitor• Operationalize

DATA STEWARDS

DATA ANALYSTS(PRODUCERS)

INFORMATION WORKERS

(CONSUMERS)

• Provision• Configure

• Discover • Combine• Clean• Annotate• Publish/Share

Public tenant

Corporate

tenant

Arrows Legend: Provision/configure service

Publish/Share data Metadata/Data flow Discover data /Get data search results Access data directlyGet telemetry

Delivering Tangible Benefits for Customers

A self-service and collaborative way to:• Seamlessly find and access relevant data • Easily enrich and reshape data to make it

useable

• Balance self-service data discovery for the business with IT need for visibility and control

• Reduce human and infrastructure resources required for data discovery and enrichment

Information Workers

Data Stewards

• Improve quality, usefulness and discoverability of data

• Promote the correct usage of trusted data• Foster a community of productive data users

IT Professionals

Defining the Data Stewardship ExperienceThe Data Steward RoleThe Virtuous Cycle of Data StewardshipQuery sharing, management and telemetry

StewartData Steward

Provisions & distributes high quality data

I’m a business subject matter expert, sitting in IT or LOB as a liaison between the two. Depending on the size and type of the business, I may do part of someone else’s job (e.g. Anna or Vicki).

“

”

• Making data useful to the business

• Consistent use of data across the

business

• Promoting and achieving high data

quality standards

• Resolving data integrity issues across

stakeholders

Accountabilities• 5+ years of industry experience

• Proficient with Office (Excel, Word,

PowerPoint). Can learn to use Power

Pivot

• Understands data relationships, data

process flows. May know SQL.

Skills

• Analyzes data for quality (particularly

as part of BI work), reconciles data

issues

• Identifies and acquires new data

sources

• Actively analyzes data for ‘semantic’

quality

• Drives resolution of data integrity

issues across business and technical

stakeholders. Leads and / or

participates in MDM / EIM / DQ

initiatives

• Creates and maintains business

metadata, references data values and

meanings, and / or master data values

and meanings

Work Activities• Process and detail oriented with great

organizational skills

• Prides himself on his creative

resourcefulness, passion for quality

and great interpersonal skills

• A ‘de facto’ steward because of deep

industry expertise and understanding

of his organization’s data sources

Perspectives

The Data Steward

Data Stewardship Experience Overview

Stewart Identifies Data

Curation Needs Stewart

Creates and Annotates Queries

Stewart Shares Queries

Anna Searches for Data

Anna Consumes Annotated

Query

Anna Creates Power Pivot / View / Map /

Query Artifacts

Stewart Analyzes

Usage KPIs

Patrick Provisions

Tenant

Patrick Assigns Role Membership

The Data Stewardship Experience represents a virtuous cycle of data augmentation, quality, awareness and availability. The

more value the steward puts into the

system, the more value the customer receives from the

system.

Patrick Configures Data

Management Gateways

Patrick Monitors, Manages and

Reacts

DemoStewart managing shared queries and analyzing usage telemetry data

ReviewOne does not simply walk into data discovery…

Three Workbooks for the Analysts under the sky,Seven for the Report Writers in their halls of stone,

Nine for Information Workers doomed to die, One for the Executive on his dark throne

In the Land of Corporate where the Shadows lie.

One Query to rule them all, One Query to find them,One Query to bring them all and in the meeting bind

them In the Land of Corporate where the Shadows lie.

18

Sometimes you don’t need a king.

Sometimes aSteward is exactlywhat you need.

Thank youfor attending this session and supporting the MNW SQL User Group

19