1 1 the analyst's perspective: advanced bi with powerpivot dax, sharepoint dashboards, and sql...

11

The Analyst's Perspective: Advanced BI with PowerPivot DAX, SharePoint Dashboards, and SQL Data MiningRafal LukawieckiStrategic Consultant, Project Botticelli Ltdrafal@projectbotticelli.com

22

Objectives

Introduce more advanced BI analytics from MicrosoftDiscuss using SharePoint 2010 as a BI Dashboard environment

The information herein is for informational purposes only and represents the opinions and views of Project Botticelli and/or Rafal Lukawiecki. The material presented is not certain and may vary based on several factors. Microsoft makes no warranties, express, implied or statutory, as to the information in this presentation.

Portions © 2010 Project Botticelli Ltd & entire material © 2010 Microsoft Corp. Some slides contain quotations from copyrighted materials by other authors, as individually attributed or as already covered by Microsoft Copyright ownerships. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Project Botticelli Ltd as of the date of this presentation. Because Project Botticelli & Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft and Project Botticelli cannot guarantee the accuracy of any information provided after the date of this presentation. Project Botticelli makes no warranties, express, implied or statutory, as to the information in this presentation. E&OE.

This seminar is based on a number of sources including a few dozen of Microsoft-owned presentations, used with permission. Thank you to Chris Dial, Tara Seppa, Aydin Gencler, Ivan Kosyakov, Bryan Bredehoeft, Marin Bezic, and Donald Farmer with his entire team for all the support.

3

PowerPivot on SharePoint 2010Manageability

44

PowerPivot for SharePoint 2010Managed Self-Service Business Intelligence

Collaborative, shared gallery of PowerPivots

IT Pro managementLifecycle & WorkflowServer Resource Management

55

Share Insights Common view of organizational performance

Publish and share rich workbooks to SharePoint

PowerPivot capabilities grant access to unlimited data secured in SharePoint

Workbook data can be refreshed manually or automatically

Same rich fidelity with web browser including Ribbon and Excel functions

6

1. PowerPivot for SharePoint: Uploading Documents to Server

2. Galleries

demos

77

Managing the BI Environment

User driven application administration and monitoring

Simplify management of BI content using IT Operations Dashboard

for SharePoint

Manage and facilitate access to secure organizational data

8

1. PowerPivot Management Dashboard2. Anticipating a self-created BI that can

become an organisational concern

demos

99

PowerPivot Client Architecture

1010

PowerPivot – Part of SharePoint

13

PowerPivot DAX

1414

Data Analysis Expressions (DAX)

Simple Excel-style formulas Define new fields in the PivotTable field list Enable Excel users to perform powerful data analysis using the skills they already have

Has elements of MDX but does not replace MDX

1515

Data Analysis Expressions (DAX)

No notion of addressing individual cells or rangesDAX functions refer to columns in the data

Sample DAX expression Means:= [First Name] &“ ”& [Last Name] String concatenation just like Excel

=SUM(Sales[Amount])SUM function takes a column name instead of a range of cells

=RELATED (Product[Cost])new RELATED function follows relationship between tables

1717

More than 80 Excel Functions in DAXDate and Time Information Math and Trig Statistical TextDATE ISBLANK ABS AVERAGE CONCATENATEDATEVALUE ISERROR CEILING, ISO.CEILING AVERAGEA EXACTDAY ISLOGICAL EXP COUNT FINDEDATE ISNONTEXT FACT COUNTA FIXEDEOMONTH ISNUMBER FLOOR COUNTBLANK LEFTHOUR ISTEXT INT MAX LENMINUTE LN MAXA LOWERMONTH Logical LOG MIN MIDNOW AND LOG10 MINA REPLACESECOND IF MOD REPTTIME IFERROR MROUND RIGHTTIMEVALUE NOT PI SEARCHTODAY OR POWER SUBSTITUTEWEEKDAY FALSE QUOTIENT TRIMWEEKNUM TRUE RAND UPPERYEAR RANDBETWEEN VALUEYEARFRAC ROUND

ROUNDDOWNROUNDUPSIGNSQRTSUMSUMSQTRUNC

1818

Example: Functions over a Time Period

TotalMTD (Expression, Date_Column [, SetFilter])TotalQTD (Expression, Date_Column [, SetFilter])TotalYTD (Expression, Date_Column [, SetFilter] [,YE_Date])

OpeningBalanceMonth (Expression, Date_Column [,SetFilter])OpeningBalanceQuarter (Expression, Date_Column [,SetFilter])OpeningBalanceYear (Expression, Date_Column [,SetFilter] [,YE_Date])

ClosingBalanceMonth (Expression, Date_Column [,SetFilter])ClosingBalanceQuarter (Expression, Date_Column [,SetFilter]) ClosingBalanceYear (Expression, Date_Column [,SetFilter] [,YE_Date])

19

1. DAX for Creating Calculated Measures2. DAX for Creating New Columns

demos

20

SharePoint 2010 BI Dashboards:PerformancePoint Services

2121

PPS in SharePoint 2010

PerformancePoint Services in SharePoint 2010 improve over PerformancePoint Server 2007:

SharePoint does all security, management, backup, respository of dashboardDecomposition TreeKPI DetailsScorecard drilldown, dynamic hierarchies, calculated KPIsDynamic, up-to-date filters for time intelligenceSharePoint Dashboard Designer is smootherBetter accessibilityAnalytic charts with value filtering and server-based conditional formatting

2222

Monitoring with PPS

Business users can build performance dashboards easily

2323

Analytics with PPS

Integration of KPIs and analyticsMultidimensional slice and dice, drill-across, drill-to-detail, root-cause analysis, prediction and centralized business logic definitionsNo coding

2424

Reporting and Consolidation in PPS

Combine operational and financial data into one report

No need to reconsolidate manually

Dynamic and standard reportsConsistent live reports published from Excel to Reporting Services and SharePoint

27

1. Building a Dashboard, Scorecard, and a KPI Using SharePoint Server PerformancePoint Services

demos

28

Visualising BI with Microsoft Visio and SharePoint 2010

29

Two Trends that Lead to…The Messy Diagram

30

Data VisualizationFault Analysis Tree

Status Indicators

Color By Value

Text Callouts

Data Bars

31

Data VisualizationManufacturing

Specialized Shapes

3232

Strategy Maps VisualizePPS Scorecard data in context

33

Data Mining with SQL Server

3434

What does Data Mining Do?

Explores Your Data

Finds Patterns

Performs Predictions

3838

Data Mining TechniquesAlgorithm Description

Decision Trees Finds the odds of an outcome based on values in a training set

Association Rules Identifies relationships between cases

Clustering Classifies cases into distinctive groups based on any attribute sets

Naïve Bayes Clearly shows the differences in a particular variable for various data elements

Sequence Clustering

Groups or clusters data based on a sequence of previous events

Time Series Analyzes and forecasts time-based data combining the powerof ARTXP (developed by Microsoft Research) for short-term predictionswith ARIMA (in SQL 2008) for long-term accuracy.

Neural Nets Seeks to uncover non-intuitive relationships in data

Linear Regression Determines the relationship between columns in order to predict an outcome

Logistic Regression

Determines the relationship between columns in order to evaluate the probability that a column will contain a specific state

40

1. Association Rules for Market Basket Analysis

2. Automatic recommendation engine using DMX queries

demos

4242

Summary

Rafal LukawieckiStrategic Consultant, Project Botticelli Ltdrafal@projectbotticelli.com

4343

Want Powerful BI Applications?

You should have a Data Warehouse

Want BI Apps quickly?PowerPivot

Want great self-service BI?Ensure good dimensional design:

Easy to understand for a knowledge workerFlexibleCorrect and aligned

4444

Complementary BI Contexts

Personal BI

Self-Service Ad-hoc Analysis

Team BIShared,

Collaborative Insight

Organizational BIPre-designed,

aligned, approved

4545

Business User Experience

Microsoft Business IntelligenceEnd-to-End BI for Everyone

Business Collaboration Platform

Data Infrastructure & BI Platform

4646

ResourcesProject Botticelli at your service!

Training, mentoring, “do-it-with-you” on-the-job assistance with all BI and SQL needsEmail me at rafal@projectbotticelli.com

Home: www.microsoft.com/biIDV Visual Fusion: Mark.Morrison@idvsolutions.com

Demos on www.powerpivot.com, www.powerpivotgeek.com, www.sqlserveranalysisservices.com, www.sqlserverdatamining.com, www.codeplex.com

More demos and sessions at www.microsoft.com/technetspotlight

4747

© 2010 Microsoft Corporation & Project Botticelli Ltd. All rights reserved.

The information herein is for informational purposes only and represents the opinions and views of Project Botticelli and/or Rafal Lukawiecki. The material presented is not certain and may vary based on several factors. Microsoft makes no warranties, express, implied or statutory, as to the information in this presentation.

Portions © 2010 Project Botticelli Ltd & entire material © 2010 Microsoft Corp. Some slides contain quotations from copyrighted materials by other authors, as individually attributed or as already covered by Microsoft Copyright ownerships. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Project Botticelli Ltd as of the date of this presentation. Because Project Botticelli & Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft and Project Botticelli cannot guarantee the accuracy of any information provided after the date of this presentation. Project Botticelli makes no warranties, express, implied or statutory, as to the information in this presentation. E&OE.