rapid data integration: tools & methodology
DESCRIPTION
TRANSCRIPT
1 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
Rapid Data IntegrationTools and Methodology
2 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
Agenda
What is Data Science?
Why Data Integration matters
Why Iterative Methodology is critical
How do we get there?
What is the payoff?
3 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
What Is Data Science?
Data Science is about analytics– Different from Business
Intelligence– Looks forward– Statistical analysis, predictive
analysis, trending, etc.
4 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
Data Science
Analytical tools– Slicing and dicing, not
reporting
Requirements– By definition, you don’t know
what you need up front– Traditional data
management tools fall short Data profiling, modeling,
ETL, etc., all depend upon defined requirements
5 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
Why Data Integration Matters
To be successful, data scientists need good data– Key question is “why?”– Are we seeing a trend, or is
the data bad?
One question will lead to another
Experimentation
New requirements, more data, new subject areas
How to keep up?
6 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
The Importance Of Iterative Methodology
Change– Market driven change – quarterly– Business driven change – monthly– Analysis driven change – daily
To deal with change, iterative methodologies succeed– Absorb – Implement– Deploy– Test– Repeat
7 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
Iterative Data Integration
Integration model– Map sources to analytical model– Revise physical schema as model evolves– Automation
Reduce error, speed deployment and track changes
Usability– Make the data available – now!
8 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
Business Focused Model
Start with a model– Design logically, deploy physically– Support iterations
9 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
Automation Using Best Practices
Master Data Governance and Stewardship
Schema Management
Model and Metadata Management
Hierarchy Management Workflow and SecurityData Profiling and Validation Data Authoring
Controlled PublicationIdentity Management
Auto-generated Application
Browse and Search Full History and Audit TrailsAuto Match and Merge
OperationsData Integration
Data Validation
Suspense and Exception Handling
Data Sourcing and Field Mapping
Delta Detection
Surrogate Key Management
Code Management and Lookup
Currency and UoM
Graphical Modeling
Model FederationMulti-GranularitySub-typing and Inheritance
Composite EntitiesRagged Hierarchies Change ManagementKPI Management
Business Metadata Classification Hierarchies
Star and Snowflake Schema
Physical Schema Management
Slowly Changing Dimensions
Data Mart and Aggregates
Data Load and Index Management
Rollup Path Awareness
Incremental Summary Generation
Process Automation
Task Execution and Monitoring
Deployment and Migration
Archiving
Restore for Model and Data
Undo Loads
Audit and Logging
Presentation
Metadata Management for BOBJ
Native XLS Pivot Table Generation
Native QlikView Generation
Metadata Management for MSAS
Metadata Management for COGN
MDM Consumer Interface
Report-Time Formula Management
Automated
10 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
What Is The Payoff?
Better quality data– Better analysis– Better decisions– Better business results
More timely data– Reduce guesswork and
estimations– Act with confidence
More efficient– Conserve your resources– Keep pace with change
11 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
Summary
Data Science offers new insights into business
Data Science demands current accurate data
Requirements difficult to pre-determine
Flexible, agile data platform is a must
Kalido Information Engine supports…– Business focused modeling– Rapid integration– Process automation– Accurate data – fast!
12 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
What Are Your Next Steps?
Attend the next how-to webinar on how to use the Business Information Model for rapid data integration
Schedule a 1:1 Discovery Session with one of our experts and get hands on time with the tool
Schedule a more in depth session on rapid data integration for you and your colleagues
13 April 8, 2023© Kalido I Kalido Confidential I April 8, 2023
Polling
I have a clear understanding of how data integration affects my ability to improve insights
I would like to attend a “how-to” webinar on the Business Information Modeler and how it is used
I would like to schedule a Discovery Session with a Kalido Expert and get some experience with the tool
I am unsure as to how rapid data integration affects my ability to improve insights
14 April 8, 2023© Kalido I Kalido Confidential I April 8, 202314
Thank you