your automation decision: automation matrix 2014

© 2014 Genesee Academy, LLC

Data Modeling Data Vault Modeling Big Data Agile DW Ensemble Modeling Certification

Your Automation Decision:

Automation Matrix 2014

© 2014 Genesee Academy, LLC USA +1 303 526 0340 Sweden +46 70 250 2102 [email protected]

gohansgo

Keynote by Hans Hultgren, May 22 2014

Automation in BI & Analytics Conference 2014

http://www.geneseeacademy.com/



http://www.twitter.com/gohansgo


About this Session

• The promise of automation is compelling. As a key contributor to improved agility, automation can be an integral component of the agile data warehouse program.

• But automation theories, methods, tools and techniques vary greatly. So

which approach will work best for you in your organization? • This presentation introduces a current framework for classifying

automation capabilities. This framework presents a set of classification criteria and automation categories that together help us to define the scope of our automation requirements.

2

Automation Matrix


• Using the updated Automation Matrix you will be able to capture, describe and communicate your specific needs for automation (capture requirements). And the Matrix is also used to classify, evaluate and rank various automation tools and techniques (comparative tools assessment).

• The Automation Matrix is a form of decision support framework for your automation decisions. Specifically: the Automation Matrix helps people to identify the categories of automation and create a matrix of features and capabilities. This matrix is used for two purposes:

1) Identify and understand specific automation requirements and 2) Map the features of various automation tools against this Matrix

so that people can make informed and knowledgeable decisions on which automation tools to consider.

3

Automation Matrix


• Why do you want to Automate? • What are your primary Automation Requirements? • What are your Automation Critical Success Factors? • What components of the DWBI Architecture are in Scope?

4

Automation Decision Process


• Agility and Automation • The Automation Matrix • Classification Criteria • Automation Categories • Applying the Matrix

Welcome


DWBI Agility

• Agility – Overall performance in adapting to change.

• Data Warehosue Agility = constantly adapting to change – New and Changing Sources – New Attributes and Mappings – New and Changing Transformations – New and Changing Requirements – New and Changing Business Rules – New Forms of Data (n-structured, etc.) – New and Changing Deliveries – Expanding Subject Areas

• Enterprise Data Warehouse = adapting to change

Data Warehousing = Agility


• Automation in the operations of the business means automating some business process. Production, sales, manufacturing, and shipping for example.

7

About Automation

Process Automation

Operational

Sales/POS Logistics Manufacturing Campaigns CRM Accounting

What did we do before

Automation?


• What are we Automating in the Data Warehouse & Data Marts?

8

About Automation

Process Automation

D/W

Integration Historization Managing Data

Operational

Sales/POS Logistics Manufacturing Campaigns CRM Accounting

Data Marts

Analysis Decisions Reporting

© 2014 Genesee Academy, LLC 9

About Process Automation

D/W • Combing Data &

Keeping History. • Integration,

Historization, and maintain auditability

• Move, coordinate, manage and integrate Data

• Data is the Asset

Operational • Sell Products • Ship Products • Invoice Customers • Create, deploy &

manage campaigns • Contact Customers

• Move, coordinate,

manage Products & Stores for Customers

• Data is Artifact

Data Marts • Analyzing data to

make decisions or discover correlations

• Specify, formulate and make decisions.

• Provide metrics & feedback to business

• Data is the raw material & the product

What does Agility Mean for these Automation areas?


• Process Needs to be Specified in order to be Automated (Modeling Pattern Consistency required for Automation)

• In DWBI areas we are

Automating processes that Automates Processes Automating processes that are constantly Changing

Data Warehousing = Agility

Data Warehouse Automation = Agility Automation

10

Data Warehouse Automation


Facts about Agile DWBI programs

• An Automation Tool does not make you agile. • A Modeling Approach does not make you agile. • An Agile Aware & Trained Team does not make you agile. • A Project Management Approach does not make you agile. • All of the above combined does not make you agile. • Basically, you can’t be agile.

Until you have an Agile Organization

11


Facts about Agile DWBI programs

People Process

Tools Techniques

12

Agile Organization

AGILE DWBI = +


• Analyze and Quantify your Automation Requirements • Match against available Tools and Approaches

13

Automation Matrix


• Header Section

• Main Matrix

• Profile

The Automation Matrix


• Header Section


• Capture name, note and date

• Categorize based on – Tool - Software tool,

application. – Method –

Methodology, PM, framework

• Scope of Automation – What part of the

program supported.


Source ETL in RAW BDW ETL out Marts

Scope of Automation

17

CBC


Scope of Automation

• The Header Section: Scope of Automation


• Main Matrix Section


• Plot the Functions and Features of

a) Requirements b) Capabilities


• Consider the following classification criteria: Templates for ETL Manage Data Modeling Generation of Mappings Automation of Testing

• For each one, consider them in the context of some of the tools and techniques presented earlier today.

This process of contemplating criteria in the context of particular tools and techniques is the purpose of the automation matrix

Classification Criteria


• There are two parts to each classification criteria… Templates for ETL Managing the Data Modeling Generation of Mappings Automation of Testing

• The LEFT side items are tool or technique Features

• The RIGHT side items are DWBI Functions

Classification Criteria


• Manage Assists in the management of this function • Structure Provides structure and structural components • Automate Automates components of the function • Generate Actual generation of artifacts related to the function • Templates Templates to provide consistency & to expedite • Document Creates or provides documentation related to function • Speeds up Enables agility and performance improvements

Features


• Analysis • Design • Data Modeling • Build ETL / Deploy DB • Run ETL / Load DB

Functions

• Mapping • Transformations • Testing • Metadata • Documentation


Automation Matrix Functions/Features


• Combinations of these Classification Criteria help us to form sets of Automation Categories

• While there are some obvious ones to consider (ETL code generators, etc.) we are also able to assemble a custom set of criteria for our own automation category.

• Note that these capabilities will often require a set of tools versus a single tool.

Automation Categories


• Profile Section


• Establish the scope, architecture, approach and general theories and methodologies concerning the Automation.


Profile Section


Architectural Layers & Processes


Profile Section

Customize this Matrix to meet your specific needs. For example if you have SOA, Big Data, MDM, Industry Reference Models and other connected requirements then these should also be included for your Matrix Analysis.


Data Vault EXAMPLE

30


About Data Vault Ensemble

31

Estimated 800 + Data Vault based Data Warehouses around the world


CDVDM ReConnect Event


Links and Information

CDVDM Data Vault Certification

www.GeneseeAcademy.com [email protected]

gohansgo

Book DataVaultBook.blogspot.com

HansHultgren.WordPress.com

HansHultgren

34

Online video-lesson training

DataVaultAcademy.com

DataVaultAcademy

http://gacdvdm.blogspot.com/








mailto:[email protected]

http://datavaultacademy.com/main/home




http://datavaultbook.blogspot.com/





http://www.youtube.com/user/DataVaultAcademy

http://www.twitter.com/gohansgo

http://datavaultbook.blogspot.com/

http://hanshultgren.wordpress.com/

http://www.linkedin.com/in/hanshultgren

http://www.youtube.com/user/DataVaultAcademy

your automation decision: automation matrix 2014

Documents