litespeed etl conversion and migration
DESCRIPTION
ALC allows clients to easily move from their current ETL Platform to an new ETL platform. Our automated process uses the power of AnalytiX Mapping Manager to reverse engineer out of any platform, and forward engineer into the ETL tool of choice! Eliminating the costly barrier to ETL platform migration! ALC 4.5 and higher is compatible with the following DI ETL tool platforms: · IBM Info Sphere Data Stage 7.5 and greater · Informatica 9.0 and greater · Microsoft SQL Server SSIS 2008 and greater · Talend 7.1 and greater · Oracle Data Integrator (ODI) 11 · Convert SQL Procedures (coming soon) **If your ETL tool platform is not listed – please contact [email protected] and find out where it is on the technology roadmap.TRANSCRIPT
www.analytixds.com 1
© Copyright 2014 – AnalytiX DS
CONFIDENTIAL – DISCLOSURE WITH NDA
Dare to dream… Do the math…
AnalytiX™ DS ETL conversion
AnalytiX™ DS ETL conversion
www.analytixds.com 2
© Copyright 2014 – AnalytiX DS
Company Overview
Source: <___>
• Nearly 50% of Fortune 1000
• Global customer base
• Global government install base
Founded 2006 :
Headquarters Chantilly, VA :
Employees 200 :
Offices USA, India (Hyderabad) :
Leadership >30 years in Data integration :
>1000 Customers
Market Leader Enterprise Data Mapping :
• Relation with Top 5 System Integrators and
Off-shore Integrators
• 20+ resellers globally (HP Global Reseller)
Partners/Resellers
2010 Winner ; Innovation award
2012 Nominated; Technology innovation award
2012; Most valuable partner
AnalytiX reduces costs & accelerate project delivery by automating the data mapping process to make it
Faster, More Manageable & Collaborative while Auto-Generating ETL Jobs for leading ETL Tool Providers
www.analytixds.com 3
© Copyright 2014 – AnalytiX DS
AnalytiX DS Product Leadership Team
www.analytixds.com 4
© Copyright 2014 – AnalytiX DS
Revolutionary products
ETL Platform Conversion
AnalytiX LiteSpeed Conversion (ALC) The industry’s first customizable ETL Conversion Software (SaaS)
• Ease of conversion from legacy ETL platform to New ETL Tool
• Automated process to reverse engineer and forward engineer; driven by
the power and customization of AnalytiX DS!
• Eliminating the costly barrier to ETL migration!
AnalytiX Mapping Manager (AMM) The industry’s first Pre-ETL Source to Target Mapping Software
• Create mapping designs using scanned meta data and group
• Categorize and auto-generate your ETL jobs
• Maintain version control and auditability, Impact Analysis & Lineage
AnalytiX Data Services (ADS) Global Delivery
• Low cost and tool specific expertise
• No job is too big – vast pool of highly talented data experts
• We do it right the first time, and at the right price!
SaaS
available
www.analytixds.com 5
© Copyright 2014 – AnalytiX DS
MappingManager® | Add-on Modules
AnalytiX DS
add-ons
Agile
Third Party
add-ons
Free and
Customizable
add-ons
XLS ETL Code-Gen
Customizable
ETL integration
App Plug-In
Create Custom
applications
Document
Standards API’s
DataVault
Testing Automation Agile BI Code-Gen and Training Services
CSM | RDM
Reference
Data Manager
RM
Release
Manager
LiteSpeed
Conversion™
XConnect
AMM X-Connect
Metadata
Manager
BI Discovery
BI reporting
SAP X-Connect
SAP integration
The Add-On modules are intended to extend the Mapping Manager’s capabilities beyond the core “out the box” capabilities.
www.analytixds.com 6
© Copyright 2014 – AnalytiX DS
Technology board of advisors
Distinguished Panel of Subject Matter Experts
AnalytiX invites select customers with exception standards in data
integration and key members of customer integration teams to represent
our customer advisory board and contribute to our technology roadmap.
Dr. John R. Talburt is Professor of Information Science Program and
heads the Data Quality Program with MIT. He is also the Executive
Director of the UALR Laboratory for Advanced Research in Entity
Resolution and Information Quality (ERIQ LAB).
Hewlett-Packard (HP) Enterprise Information Solutions Group Software is
a Software & Solutions Reseller & Technology Contributor
Complimentary
technology
partners
www.analytixds.com 7
© Copyright 2014 – AnalytiX DS
Customers
Over 1000+ enterprises & 50% of the FORTUNE 1000 enterprises rely on AnalytiX
Mapping Manager to manage and govern the data mapping process of data integration
projects. Some of our featured customers include:
www.analytixds.com 8
© Copyright 2014 – AnalytiX DS
Awards
2012 – Marketplace MVP contest
2010 – Marketplace innovation drive
2012 – Informatica innovation award
Technology categories : 8
Technology solutions : 1000+
Grand Prize Winner :
AnalytiX MappingManager
Solution Automates Pre-ETL Mappings &
Generates ETL Jobs
The Informatica Marketplace connects buyers and sellers to share data integration solutions
within an open and comprehensive ecosystem of more than 100,000 active users :
https://community.informatica.com/solutions/1077?cid=ADS
www.analytixds.com 9
© Copyright 2014 – AnalytiX DS
LiteSpeed Conversion® | What it means?
Consistency | Time Savings | Costs Savings
Auto documentation means consistency, better quality outcomes, and lowered cost per job
Custom code generation using proprietary AnalytiX LiteSpeed conversion® code takes the
cost-per-job from an average of nearly $2000, to just $200 – Saving Millions and creating
better quality output!
Estimated savings on this conversion - $3.5M – Not including the maintenance you will no
longer pay for your prior ETL Platform Maintenance!
2000 jobs
$3.5 m
savings
‘AnalytiX LiteSpeed Conversion defines
“Working Smarter, not Harder”
- the math makes it a clear choice.’
www.analytixds.com 10
© Copyright 2014 – AnalytiX DS
LiteSpeed Conversion® (ALC)
Software as a
service: get to
where you need
to be!
AMM keeps you in
the driver’s seat
• ALC State-of-the-Art Software that auto-
mates the conversion of ETL Tool platforms
• Enabling fast and AUTOMATED conversion
between one ETL platform and another
• Built in features
− Job documentation
− Profiling measures
− Status reports
− Lineage impact and analysis
• ETL logic delivered in the instance of AMM
Manage ahead with
efficiency and
additional ROI
• Reverse and forward engineered jobs are
NOT delivered in spreadsheets
• Comes in a purpose-built mapping repository
• Enables the use of custom templates in auto-
generation of code going forward!
• Save additional time and Money!
“There is no magic here –
Just really great code
generation, created by
great developers with really
great experience… making
ETL Platform Conversion
possible, at a really
great price”
LiteSpeed Conversion + MappingManager Bundled offering
www.analytixds.com 11
© Copyright 2014 – AnalytiX DS
LiteSpeed Conversion®
Software as a Service – Cloud
Platform
ETL Tool
Customizable Code-
Gen Templates
Import
In
LiteSpeed Conversion®
1 2 3 4
DBMS sync to local Converted
ET XML
ETL
Mapping
Custom
SQL Query
Distributed environment
AnalytiX DS MappingManager (Enterprise Edition)
License Key
1
AMM
License Key
2
AMM
License Key
3
AMM
License Key
4
AMM Application Layer
(Customername.war)
Database Layer
(Customername.dbms)
www.analytixds.com 12
© Copyright 2014 – AnalytiX DS
Parallel ETL Conversion Plan
The swim-lanes below details which tool the work will be preformed in
ETL Job Conversion
Convert Repository
DS AMM INFA
Validate/rework
AMM INFA
Unit test ETL Job
INFA
Approve converted ETL
Logic
Approval (AMM)
Custom: Dictionary
Repository Update
AMM
Custom: Teradata
Code-Gen template
AMM
Assemble Job
Workflows
AMM INFA
Validate/rework Job
Workflows
AMM INFA
Unit test Job Workflows
INFA
Schedule using
scheduler
Autosys / Control-M
other
Workflows , Job Sequencing and scheduling
Custom: Workflow
TemplateAMM
Unit test ETL Job
INFA
System test Job
Workflows
AMM INFA
System Test Scheduler
Auto-Sys
Testing
www.analytixds.com 13
© Copyright 2014 – AnalytiX DS
AnalytiX DS – Screenshots
MappingManager® Data Mapping & ETL Conversion Tool
Converted ETL Logic: All ETL Conversion logic is stored, organized and presented in the mapping manager repository.
Customizable Code-Gen templates: Conversion is 1-1 or customizable code-gen templates be created to “augment” converted Jobs.
All ETL Jobs are organized by Project
& reverse engineered as mappings
ETL Logic is represented in easy to
read source to target mapping format
Data Glossaries are organized with
Lineage & Impact Analysis Views
Project & Mapping Browser ETL Mapping Data Grid Data Glossaries & Discovery
www.analytixds.com 14
© Copyright 2014 – AnalytiX DS
AnalytiX DS – Screenshots
ETL Integration Library: Customizable Code Generation
ETL Conversion
• Once the mappings have been reversed engineered from Legacy ETL Tools, they can be quickly and easily exported to Informatica
to auto-generate ETL Jobs.
Generate ETL Jobs from Source to Target Mappings
• Creating “Pre-ETL Source to target Mappings is easy, fast and versioned using Mapping Manager.
• Once these pre-ETL mappings are created , just like Converted DS Jobs, they can quickly be exported to Informatica using the
“customizable” ETL Integration Library to auto-generate the ETL Jobs
www.analytixds.com 15
© Copyright 2014 – AnalytiX DS
ETL Conversion Assessment
Scope & Assessment Worksheet
Part A – Define the ETL Architecture
Sources
No. SRC
Systems
(XX)
Stage
No. ETL
Jobs
(XX)
ODS EDW
No. ETL
Jobs
(XX)
Data Mart(s)
No. ETL
Jobs
(XX)
Outbound files
No. ETL
Jobs
(XX)
No. ETL
Jobs
(XX)
Complexity
Part B – Assessment Matrix
Mappings Percentage
Low
Medium
High
Custom reverse
engineer templates
Custom forward
engineer templates
2430
131
31
TBD
Y
93.8
5.0
1.2
1 Code gen template to convert from Oracle to Teradata Target
www.analytixds.com 16
© Copyright 2014 – AnalytiX DS
DRAFT WBS & Accountability Plan
Conversion Scope and Accountability
Job Conversion
Unit test
Job approval
Job sequence conversion
Sequence approval
Create custom forms
Others?
Test Jobs
Job sequences
Test Scheduler
Test reports
Test data
Test Add-ons
Pre-UAT
UAT
End-to-end integration test
AnalytiX DS
ETL Conversion
AnalytiX DS
Add-ons
AnalytiX DS
Add-ons
Functional/
Pre-UAT Test
Program
Management
Note: This is a starting point for
project planning purposes
• The following resource plan is
recommended for proper audit,
balance and control of the
conversion initiative
• Team based knowledge transfer
and training will be conducted
using MATRIX RESOURCES
where key resources work
integrated across different work-
streams
STAGE ODS EDW Data Mart
Phase
1 2 3 4
www.analytixds.com 17
© Copyright 2014 – AnalytiX DS
LiteSpeed Conversion®
| Deliverables
Automated conversion deliverables enable…Acceleration across all SDLC Phases.
Here are some of the tangible deliverables from LiteSpeed Conversion®…
Legacy ETL Jobs
• Automated Profile Assessment of Legacy ETL Jobs
• Automated Documentation of Legacy ETL Jobs
Converted ETL Jobs (New To Be ETL Tool)
• Auto-Documentation of Converted ETL Jobs
• Deliver fully Converted ETL Jobs from old platform to new ETL Platform
Mapping Manager – Enterprise Edition
• Create, Maintain and Version Source to Target Mappings
Project Management
• Conversion Project Plan
Testing
• Documented Conversion requirements to accelerate testing
www.analytixds.com 18
© Copyright 2014 – AnalytiX DS
LiteSpeed Conversion®
| Deliverables
** The above proposal is based on the mapping complexity information received by ADS and assumptions listed
Sample Opportunity
• Converting 2,592 ETL jobs
• Legacy ETL Tool TALEND/DataStage/SSIS/Abinitio/Other Informatica
Delivery Phased Approach
• Convert one Data Mart/Subject Area at a time using a phased iterative delivery approach
Auto-Document Existing Job Auto-Convert Legacy ETL Jobs to New ETL Platform
• Customization of Converted Jobs are supported through “customizing the conversion and
code-generation templates (Included in the SaaS offering)
FULL Test and Cutover to Production Plan
• Turning up of new systems involves running in parallel for a period of time and running
continuous validation testing on “SOURCE” and Informatica platforms
Our Proposal for conversion support:
• Time to completion : XX months (Most completed within 4-6months)
• Cost Estimate : $ xxx,xxx
Month 1 Month 2 Month 3 Month 4 Month 5 Month 6
Onsite resources
(Avg. FTE)
Global delivery
resources (Avg.FTE)
TBD TBD TBD TBD TBD TBD
TBD TBD TBD TBD TBD TBD
www.analytixds.com 19
© Copyright 2014 – AnalytiX DS
LiteSpeed Conversion®
Agile delivery methodology
Phase 1
4 weeks
• Analyze
• Design
• Build & Test
• Release 1
Phase 2
4 weeks
• Analyze
• Design
• Build & Test
• Release 2
Phase 3
4 weeks
• Analyze
• Design
• Build & Test
• Release 3
Phase 4
4 weeks
• Analyze
• Design
• Build & Test
• Release 4
…
Each 4 week sprint is organized into phases and usually associated with your ETL Architecture
www.analytixds.com 20
© Copyright 2014 – AnalytiX DS
Distributed Environment Option
Offsite and Distributed team environments Repository exports can be exported from CLOUD environments
at predetermined milestones of each phase and “Sync” the onsite production instance.
STAGE ODS EDW Data Mart
Phase
1 2 3 4
Application Layer
(Customername.war)
Database Layer
(Customername.dbms)
License Key
AMM
Customer 1
Dev
License Key
AMM
Customer 2
Test
License Key
AMM
Customer 3
Pre-prod
License Key
AMM
Customer n
Prod
www.analytixds.com 21
© Copyright 2014 – AnalytiX DS
LiteSpeed Conversion®
Service delivery options
Appendix A: Interested in support services from AnalytiX DS? Flexible support models are below.
Pros Options
Dedicated Team
• Fixed resources onsite/ offsite/ Global Delivery Center (offshore)
• Ability to ramp up/down as needed
• SLA based services / Development Team
Committed hours
• Fixed fee
• Flexibility in fixed time
• Ability to ramp up/down as needed
• SLA based services
Global Delivery
Center
• Flexible cost effective services model.
• High value / low costs solutions for resource intensive projects
• Reduced Risk
• Fixed Scope
• Fixed Fee
• Note: requires diligence and understanding of job complexity and scope Fixed Fee
www.analytixds.com 22
© Copyright 2014 – AnalytiX DS
LiteSpeed Conversion®
Key assumptions
• Estimate based on complexity and no. of ETL jobs provided by client
• Estimate covers ETL mapping conversion only
• A client Business Analyst and or SME will be available to impart knowledge on current mappings in
legacy system
• Low complexity mapping consists one source, one target and one transformer
• Medium complexity mapping consists multiple homogeneous sources , multiple targets and
less than 3 transformers
• High complexity mapping consists multiple sources, multiple targets and multiple transformers
• Conversion will be done using client environment
• All admin activities such as Database management, configuration management and server
management will be handled by client
• Any material change in no. of mappings to be converted, direction, strategy, or deliverables will need to
be assessed for impacts on the initial time line though we strive to accommodate within the timeline.
www.analytixds.com 23
© Copyright 2014 – AnalytiX DS
Contact us
Corporate Headquarters Sales Team Product Support
14175 Sullyfield Circle, Suite #
400 Chantilly, VA 20151 USA
Tel: (800) 656-9860
Email: [email protected]
Tel: (800) 656-9860
(800) 603-4790
Email: [email protected]
Tel: (800) 656-9860
(800) 617-9620
Email: [email protected]