building scalable bi solutions that truly scale in enterprise

Welcome#BIBoss

Schedule for this evening:

6.00pm – Networking

6.25pm – Welcome and Introduction: Dan Mills, Corecom Consulting

6.30pm – Presentation: Chris Ward, Head of Technical Design at MooD International

Topic: “Building scalable BI solutions that truly scale in Enterprise”

7.10pm – Buffet and Refreshments

7.30pm - Lightning Discussions


www.corecomconsulting.co.uk

http://www.corecomconsulting.co.uk/

Building scalable BI solutions

that truly scale in EnterpriseChris Ward


Design for scale

Planning for the unknown

Investing in data quality

Winning business confidence

Automation

Business focused

Agenda


Design for scale

Modular components

Technology agnostic

Libraries

Use of Frameworks

Database Partitioning

Always On availability groups

Parallel loading and Queuing of jobs

Abstraction and Isolation in the different layers


Planning for the unknown

Modular design to allow swappable components

Unstructured and Structured data

Diverse data sources

Database stored configuration (no hard coding)

Cloud integration



Garbage in = Garbage out

Cleansing invalid data

Only highlight and report data quality issues

Fix data quality issues in the source system and not in the BI/ETL solution



Engage the business users

Should not be IT driven but Business driven

Gain a executive/board level sponsor

Business users can be reluctant to change

Start small and win small

Agile BI only after a waterfall well defined project to solidify; data source access,

development standards, deployment process, security model, operational handover


Automation

Management meta

No hard-coding

Configuration stored in the database

Self-generating ETL

SP’s that generate deployable SP’s

BIML

Modular design

Upgradable components

Swappable components


Business focused

Business landscape and Outcomes

What is a business landscape

What is a business outcome

What MooD do

Solutions

Cisco, HP, Aragon, Bank of America

Business Landscape

Simpson’s Paradox

Causal modelling

Data Service


Summary

Design for scale

Modular, agnostic, isolation

Plan for the unknown

Modular, unstructured data, diverse data sources, database configuration


GIGO, Report data quality issues, fix at source


Business driven, Executive level sponsor, start small and win small

Automation

Management meta, self-generating ETL, upgradable and swappable components

Business focussed

Business landscape and outcomes, what MooD do


Questions


Schedule for this evening:


6.25pm – Welcome and Introduction: Dan Mills, Corecom Consulting

6.30pm – Presentation: Chris Ward, Head of Technical Design at MooD International

Topic: “Building scalable BI solutions that truly scale in Enterprise”

7.10pm – Buffet and Refreshments

7.30pm - Lightning Discussions




Buffet & Refreshments

#BIBoss



Lightning Discussions

#BIBoss



Phillip Pearson – Senior MI Manager

at Swinton Insurance

Question:

“How do people manage the understanding of data

within the business to ensure one version of the

truth and the analysis completed using the data is

done correctly?”



Neil Dunlop – Principal Consultant at

Infinity Works

Question:

“What actions or ways of working are your

organisations taking to maintain data quality?”



Alexis Ridler – Principal Data Analyst at

BAE Systems Applied Intelligence

Question:

“Open source ETL tools - other than Talend what

other tools have people used?”



Thank you

Thank You#BIBoss

