getting to know the bi semantic model
DESCRIPTION
Getting to Know the BI Semantic Model - Visual Studio Live! March 2013TRANSCRIPT
![Page 1: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/1.jpg)
Getting to Know the BI Semantic Model
Level: Intermediate
March 28, 2013
Andrew BrustCEO and Founder
Blue Badge Insights
![Page 2: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/2.jpg)
• CEO and Founder, Blue Badge Insights• Big Data blogger for ZDNet• Microsoft Regional Director, MVP• Co-chair VSLive! and 17 years as a speaker• Founder, Microsoft BI User Group of NYC
– http://www.msbinyc.com
• Co-moderator, NYC .NET Developers Group– http://www.nycdotnetdev.com
• “Redmond Review” columnist for Visual Studio Magazine and Redmond Developer News
• brustblog.com, Twitter: @andrewbrust
Meet Andrew
![Page 4: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/4.jpg)
Read all about it!
![Page 5: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/5.jpg)
What is the BI Semantic Model
• It’s a relational model for analytical data• Similar to an OLAP cube
– Because it facilitates dimensional/drill-down analysis– (Some people would even consider BISM a cube)
• Similar to a data warehouse– Because it accommodates a star schema– Because it uses columnar technology used in many data
warehouse appliances
• But it’s different– Data is not stored dimensionally– Star schema not required– Can function as a model layer only, storing no physical
data
![Page 6: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/6.jpg)
Agenda
• BISM Overview• BISM in Excel 2013• PowerPivot• SSAS Tabular• Power View
![Page 7: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/7.jpg)
BISM OVERVIEW
![Page 8: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/8.jpg)
Genesis
BISM
Competing
products (BO, TM1)
Report Builder
1.0 report models
Analysis Services
cubes
![Page 9: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/9.jpg)
BISM CompanionsxVelocity in-memory technologies
• Manifested in storage engines for PowerPivot and SSAS Tabular mode
Data Access eXpressions (DAX)
• Analytical function library with Excel-like syntax• Successor to MultiDimensional Expressions (MDX)
PowerPivot
• For designing, storing and querying models
Power View
• For reporting on and visualizing BISM data
Excel 2013
• Which creates BISM models implictly
![Page 10: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/10.jpg)
Motivations
• Self Service• In-memory performance• Agility• More business-friendly• More relational-friendly
![Page 11: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/11.jpg)
Column-Oriented Stores• Imagine, instead of:
• You have:
• Perf: values you wish to aggregate are adjacent• Efficiency: great compression from identical or nearly-identical
values in proximity• Fast aggregation and high compression means huge volumes
of data can be stored and processed, in RAM
Employee ID Age Income
1 43 90000
2 38 100000
3 35 100000
Employee ID 1 2 3
Age 43 38 35
Income 90000 100000 100000
![Page 12: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/12.jpg)
BISM IN EXCEL 2013
![Page 13: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/13.jpg)
BISM Embedded in Excel 2013
• Importation of data into a sheet implicitly adds it to a columnar, in-memory BISM model– The model can then be queried via PivotTabes, charts
and Power View– “Import millions of rows from multiple data sources”– “Create relationships between data from different
sources, and between multiple tables in a PivotTable”– “Create implicit calculated fields”– “Manage data connections”
• This means most “spreadmarts” are now BISM models. This is huge.
![Page 14: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/14.jpg)
Rules for Model Building
• Sometimes data is not immediately added– But building a PivotTable or Power View report on it
will cause it to be added
• Even a manually created Excel table may be added
• “Add to Data Model” button in PowerPivot tab of ribbon allows adding explicitly
• Using PowerPivot window unnecessary, but still required for more advanced modeling.– As long as you have Office ProPlus
![Page 15: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/15.jpg)
Data Explorer
• Beta Excel add-in for importation of structured and unstructured data– Facebook– Hadoop/HDFS– Active Directory– SharePoint– Files in folder, XML– Improved Web/HTML
• Because of implicit model and linked tables, Data Explorer effectively opens up new data sources for the BISM
![Page 16: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/16.jpg)
Embedded Models
![Page 17: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/17.jpg)
POWERPIVOT
![Page 18: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/18.jpg)
What is PowerPivot?
• Excel + Analysis Services + SharePoint• Mitigates many spreadmart pitfalls:
– Use Analysis Services (AS) as a hidden engineInstead of no engine
– Share via SharePoint, accessible by all AS clientsInstead of “deploying” via email
– Formal data refresh on serverSo data doesn’t get stale, and users don’t have to make effort at updating
– Allow IT to monitorSo it’s not all rogue
– Provide path to more rigorous implementationsCan be upsized to Analysis Services
![Page 19: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/19.jpg)
How do you get PowerPivot?
• For Excel 2010:– Download the add-in from www.powerpivot.com– Get 32-bit or 64-bit version, depending on your
version of Office (not Windows)– Run the installer
• For Excel 2013:– Included in product, but only with:
Office Pro Plus retail product (under volume licensing)Office 365 Pro Plus or Enterprise E3/E4 subscriptions
– It’s still an add-in, installed but not activated by defaultSame goes for Excel version of Power View
![Page 20: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/20.jpg)
Data Import
• Relational databases– SQL Server (including SQL Azure!), Access– Oracle, DB2, Sybase, Informix– Teradata– “Others” (OLE DB, including OLE DB provider for ODBC)
• OData feeds, incl. R2/2012 Reporting Services, Azure DataMarket, WCF Data Services (Astoria), SharePoint 2010+ lists, Visual Studio LightSwitch
• Excel via clipboard, linked tables• Filter, preview, friendly names for tables/columns
![Page 21: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/21.jpg)
Calculated Columns and DAX• Formula-based columns may be created• Formula syntax is called DAX (Data Analysis
eXpressions).– Not to be confused with MDX or DMX. Or DACs.
• DAX expressions are similar to Excel formulas– Work with tables and columns; similar to, but distinct from, worksheets
and their columns (and rows)
• =FUNC('table name'[column name])• =FUNCX('table name', <filter expression>)• FILTER(Resellers,[ProductLine] = "Mountain")• RELATED(Products[EnglishProductName])• DAX expressions can be heavily nested
![Page 22: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/22.jpg)
PowerPivot Guidebook
Table tabs
View data in Excel
DAX formula bar
Relationship indicator
Import data fromalmost anywhere
Sort and filter
Calculatedcolumnentry
![Page 23: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/23.jpg)
Modeling the Data KPIs
Calculations
Data and Diagram views
Calculationarea
Calculationformula
Sort one column by another
![Page 24: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/24.jpg)
Diagram ViewDefault Aggregations Special Advanced Mode
Reporting
properties
Hierarchies
Hide specific
columns andtables
Createrelationshipsvisually
KPIs
Perspectives
Calculations
![Page 25: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/25.jpg)
PowerPivot Client
![Page 26: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/26.jpg)
Excel Services
• A component of SharePoint Server 2007+; requires Enterprise CAL
• Allows export of workbook, worksheet, or individual items to SharePoint report library– Works great for PivotTables and Charts!– Also for sheets with CUBExxx formulas or conditional
formatting-driven “scorecards”
• Content can be viewed in browser– Excel client not required– Drilldown interactivity maintained– Rendered in pure HTML and JavaScript– Parameterization supported
![Page 27: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/27.jpg)
PowerPivot Server
• Publish to Excel Services• Viewing and interacting• Data Refresh• Treating as SSAS cube
– 2008 R2 version: URL to .xlsx as server name– 2012 version: use POWERPIVOT named instance and treat
just like SSASDb name is GUID-based; best to discover it
– Use Excel, Reporting Services as clientsAnd now Power View too…more later
![Page 28: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/28.jpg)
The IT Dashboard
Increase IT efficiency:Familiar Technologies for Authoring, Sharing, Security, and ComplianceCustomizable IT DashboardVisualize usage with animated charts
Simplify management of SSBI content usingIT Operations Dashboard for SharePoint
![Page 29: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/29.jpg)
PowerPivot Server
![Page 30: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/30.jpg)
SSAS Tabular
![Page 31: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/31.jpg)
Analysis Services Tabular Mode
• SSAS Tabular Mode is the enterprise/server implementation of PowerPivot
• You must have a dedicated Tabular mode SSAS instance
• Tabular SSAS projects: Anlaysis Services project tools gone PowerPivot– Implements equivalent tooling to PowerPivot Window– Can create an SSAS Tabular database project by
importing an Excel workbook with PowerPivot model
• SSAS Tabular models support partitions and roles
![Page 32: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/32.jpg)
SSAS Tabular Project in SSDT-BI(i.e. Visual Studio)
SSAS Tabular projectmenus and toolbar
Calculations area and formula bar
Reporting properties in Properties window
![Page 33: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/33.jpg)
DirectQuery Mode
• In DQ mode, model defines schema, but is not used for data
• Queries issued directly against source
• Similar to ROLAP storage for conventional cubes
• Combine with xVelocity Columnstore indexes for fast, real-time querying
![Page 34: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/34.jpg)
SSAS Tabular Mode
![Page 35: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/35.jpg)
POWER VIEW
![Page 36: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/36.jpg)
What is Power View?
• Ad hoc reporting. Really!• Analysis, data exploration• Data Visualization• In Silverlight, in the browser, in SharePoint• And now in Excel 2013, too
– ProPlus edition required– Still Silverlight
• Is actually based on SSRS– Power View makes a special RDL file
• Competitive response– To QlikView, Tableau, Tibco Spotfire
![Page 37: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/37.jpg)
Power View Data Sources
• Power View works only against BISM• DirectQuery mode supported, however• Support for SSAS Multidimensional cubes
coming• Gist is this: Power View emits DAX
expressions– PowerPivot and SSAS Tabular support DAX– SSAS Multidimensional will support DAX soon
![Page 38: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/38.jpg)
Create a Power View Report
• In Excel 2013, click Power View button on Insert tab of ribbon– Make sure add-in is activated
• In SharePoint, click “Create Power View Report” button or option on workbook in PowerPivot Gallery
• For SSAS tabular model, create BISM data source, then click its “Create Power View Report” button or option– BISM data sources can point to PowerPivot workbooks
too, if you want.
• Can export to PowerPoint and view there
![Page 39: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/39.jpg)
Power View!
Variety of visualizationsand data formats
Field list, as with PivotTables
Data regions pane,as with PivotTables
![Page 40: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/40.jpg)
Maximize, Filter
Maximize chart
Filter area
![Page 41: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/41.jpg)
Power View Basics
![Page 42: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/42.jpg)
Scatter/Bubble Charts
• Allow for several measures• Features a “play” axis which can be
manipulated through a slider or animated• Excellent way to visualize trends over time
![Page 43: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/43.jpg)
Advanced Properties
• Setting the representative column and image tells Power View how to summarize your data, and show stored images
• Other properties tell it about key attributes, default aggregations and more
• These are all BISM features; they are merely being exposed by PowerPivot and SSAS Tabular– They are the justification for the term “semantic”
![Page 44: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/44.jpg)
Advanced Power View
![Page 45: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/45.jpg)
Vocabulary--Multidimensional--
MOLAP
UDM
Cube
--BISM--
xVelocity Columnstore Technology
VertiPaq
BISM
IMBI
Tabular
![Page 46: Getting to Know the BI Semantic Model](https://reader035.vdocuments.site/reader035/viewer/2022062319/55510b51b4c9057b478b558a/html5/thumbnails/46.jpg)
Thank You!
• Email• [email protected]
• Blog:• http://www.zdnet.com/blog/big-data
• Twitter• @andrewbrust on twitter