informatica cloud test data management€¦ · development, release, and timing of any informatica...
TRANSCRIPT
![Page 1: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/1.jpg)
`
April 28th 2020
Informatica Cloud Test Data ManagementRagavendra KinneraPrincipal Customer Success Technologist
![Page 2: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/2.jpg)
2 © Informatica. Proprietary and Confidential.
Housekeeping Tips
Today’s Webinar is scheduled for 1 hour
The session will include a webcast and then your questions will be answered live at the end of the presentation
All dial-in participants will be muted to enable the speakers to present without interruption
Questions can be submitted to “All Panelists" via the Q&A option and we will respond at the end of the presentation
The webinar is being recorded and will be available to view on our INFASupport YouTube channel and Success Portal. The link will be emailed as well.
Please take time to complete the post-webinar survey and provide your feedback and suggestions for upcoming topics.
![Page 3: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/3.jpg)
Success Portal https://success.informatica.com
Learn. Adopt. Succeed.
© Informatica. Proprietary and Confidential.
FREE Product Learning Paths
and weekly Expert sessions
Bootstrap product trial experience
InformaticaConcierge with
Chatbot integrations
Enriched Onboarding experience
Tailored training and content
recommendations
![Page 4: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/4.jpg)
4 © Informatica. Proprietary and Confidential.
Safe Harbor
The information being provided today is for informational purposes only. The
development, release, and timing of any Informatica product or functionality
described today remain at the sole discretion of Informatica and should not be
relied upon in making a purchasing decision.
Statements made today are based on currently available information, which is
subject to change. Such statements should not be relied upon as a
representation, warranty or commitment to deliver specific products or
functionality in the future.
![Page 5: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/5.jpg)
5 © Informatica. Proprietary and Confidential.
Agenda
• Overview of the current approaches
• IICS Cloud Test Data Management• Data Masking
• Data Sub-setting
• Consistency Data Masking
• Schedule Options
• Bonus: Data Masking Transformation for CDI
• Q&A
![Page 6: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/6.jpg)
6 © Informatica. Proprietary and Confidential.
Salesforce use cases
In-place masking Subset and in-stream masking
ProductionOrg
FullSandbox
PartialSandbox
Dev ProSandbox
DevSandbox
Unlimited Edition 1 0 5 15
Performance Edition 1 1 5 30
Refresh Interval 29 days 5 days 1 day 1 day
Max size / data Same as production Org 5 GB 1 GB 200 MB
What is copied by Salesforce Metadata and all data Metadata and sample
data Metadata only Metadata only
![Page 7: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/7.jpg)
7 © Informatica. Proprietary and Confidential.
Cloud masking offerings at a glance
Cloud Test Data Management and Cloud Masking Data Masking for Data Integration
Designed for provisioning of secure non-production environments
Designed for masking sensitive data in Data Integration
Purpose built wizard Transformation in Cloud Mapping Designer
For Salesforce only
Salesforce: Subset and in-place masking
For all sources supported by Cloud Mapping Designer
SaaS, Oracle, MSSQL, Flat files…
Consistent masking achieved using same set of masking techniques
![Page 8: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/8.jpg)
8 © Informatica. Proprietary and Confidential.
Data Masking and Subset for salesforce.comSecure and Populate Sandbox Copies
• Masks existing sandboxes • Ensures data privacy
• Out of the box PII, PHI, PCI data masking rules
• Create test data sets for dev sandboxes• Populate empty sandboxes with referentially
intact data sets
• Rationalize existing SFDC investment• Saves cost of additional full sandbox copies
![Page 9: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/9.jpg)
9 © Informatica. Proprietary and Confidential.
Cloud-based Test Data ManagementHigh Level Architecture
Cloud Test Data Management
Informatica Cloud
Runtime Environment
(On premises)
Production
Sandbox
SOAP/Bulk API
SOAP/Bulk API
SSL
![Page 10: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/10.jpg)
10 © Informatica. Proprietary and Confidential.
Masking techniques available
Credit card
IP Address
Phone
Random
SSN/SIN
SubstitutionMale/Female
Names
URL
Substitution Position
SubstitutionLast Name
SubstitutionUS ZIP
SubstitutionUS State
SubstitutionCity
SubstitutionCountry
SubstitutionStreet
Custom substitution
(bring your own dictionary)
Expression(build your own masking using expressions)
Mapplet
Regulations: PII, PHI, PCI
![Page 11: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/11.jpg)
11 © Informatica. Proprietary and Confidential.
Source ObjectsSingle or Multiple related Objects
• Single object that doesn’t contain any related objects
• Multiple objects that have an explicit relationship defined in Salesforce
• Schema Graph – Graphical representation of the relationships• Multiple Source Objects
• Relationships
• Assignments
![Page 12: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/12.jpg)
12 © Informatica. Proprietary and Confidential.
Target Task OperationsSingle or Multiple related Objects
• Partial Sandbox – Insert, Update, Upsert operations are possible
• Inplace Masking – target is same as source; only update
• Refresh Fields – when there’s a change in metadata
• Validation Reports - lists mandatory relationships, fields, and field and relationship mismatch between source and target
![Page 13: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/13.jpg)
13 © Informatica. Proprietary and Confidential.
Refresh Metadata
• Refresh metadata without editing task – Explorer Page• Refresh runs a separate job
• Cannot run an instance of masking task and a refresh job at the same time
• Refresh metadata from within a task• Refresh source and/or target fields from within a masking task when you
create or update a masking task
• Best Practice: If you need to update many objects then you refresh metadata without editing the task
Obsolete metadata
![Page 14: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/14.jpg)
14 © Informatica. Proprietary and Confidential.
Staging Database
• H2 Database• Stage record ID’s
• Data subset for simple entities
• Entities with junction objects
• Multipath & Lookup based relationships
• Masking fields
• H2 Staging Database Installer• Packaged along with Secure Agent; run the installer to install the staging connection
• Either start the database connection from Schedule page of the masking task wizard or manually run the H2 startup script
H2
![Page 15: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/15.jpg)
15 © Informatica. Proprietary and Confidential.
Data Subset & Masking Rules
• Masking Task maintains primary-foreign key relationships and reconciles the object relationships in the subset data• Data Filter – Simple or Advanced data filter
• Relationship Behavior (Schema Graph)
• Subset Statistics – Helps in estimating/evaluating target size for the data subset
• Masking Rules – You can apply masking rules to fields which are not read-only• Masking Rule Assignments – Masking Rules by field data type
• Add Mapplets – Use Passive mapplets to mask target fields
• Target Fields – Common & Missing Mandatory fields
![Page 16: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/16.jpg)
Data Masking for Data Integration
![Page 17: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/17.jpg)
17 © Informatica. Proprietary and Confidential.
Data Masking TransformationAvailable on Cloud Mapping Designer
• Designed to mask sensitive data in data integration use cases
• Supports all sources and targets supported by Cloud Mapping Designer
• Embeds several masking techniques: SSN, credit card, substitution, random and others
• Not designed for creation of new test environment systems
![Page 18: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/18.jpg)
18 © Informatica. Proprietary and Confidential.
Consistent masking between TDM and CTDM
• Cloud TDM, on premise TDM, Data Masking Transformation in Cloud Mapping Designer and PowerCenter can mask consistently
• Repeatable: same masked result for the same input
• Seed value: point for generating masked values. If the same seed value and same dictionary (for substitutions) is used, same result will be obtained
Original
John Adams
Nicholas Cage
John Adams
TDM
Tim Jones
Jack Nicholson
Tim Jones
Repeatable ON
Original
John Adams
Nicholas Cage
John Adams
TDM
Tim Jones
Jack Nicholson
Fred Mercury
Repeatable OFF
CTDM
Tim Jones
Jack Nicholson
Tim Jones
CTDM
Calvin Kline
Joanna Wu
Perry Mason
DDM
Jo***
Ni***
Jo***
DDM
Jo***
Ni***
Jo***
![Page 19: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/19.jpg)
19 © Informatica. Proprietary and Confidential.
Consistent masking use cases
• High Level Architecture
Informatica Cloud
Runtime Environment
Relational, Mainframe, CSV, XML
CSV
Masking of Salesforce requires Cloud Test Data
Management
Masking of other sources requires Test Data
Management on premises
Same dictionary flat files are shared for consistent results
Cloud Test Data Management
Test Data Management
![Page 20: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/20.jpg)
20 © Informatica. Proprietary and Confidential.
Test Data Management and Cloud Test Data ManagementMain characteristics and features
Informatica Test Data Management and Cloud Test Data Management are complementary solutions
Test Data Management(on premises solution)
Cloud Test Data Management(Hosted SaaS solution)
Dynamic Data Masking(Masking data on the move)
High Performance and Scalable Subset and Masking • • •Centralized Administration and Management • • •Profiling: discover sensitive data and infer relationships •API for DevOps integration • • Data Validation •Connectivity to Relational, No-SQL, Mainframe • •Masking and Subset for Salesforce Sandboxes • Masking and Subset for Mainframe •Masking No-SQL and Hadoop • •Test Data Warehouse and Self Service Portal •Test Data Generation •Test Data Coverage •
![Page 21: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/21.jpg)
Demo Masking Salesforce Data
![Page 22: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/22.jpg)
Original data in Salesforce
![Page 23: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/23.jpg)
Definition of a Masking Task – Source object
Sandboxes where data
will be masked
Salesforce Objects to be
masked. Standard
objects and custom
objects are supported.
![Page 24: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/24.jpg)
Definition of a Masking Task – Data Filters
Data Filter: Simple &
Advanced
![Page 25: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/25.jpg)
Definition of a Masking Task – Masking configuration
Assign a masking rule to updateable
fields
Pick a Source Object to
apply Masking
Rules
![Page 26: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/26.jpg)
Definition of a Masking Task – Schedule
Enable Primary Key Chunking and use Bulk API for large volumes of source dataImprove data load performance by disabling active triggers and rules on targets and re-enable the same after load completes
![Page 27: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/27.jpg)
Masked data in Salesforce
![Page 28: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/28.jpg)
28 © Informatica. Proprietary and Confidential.
![Page 29: Informatica Cloud Test Data Management€¦ · development, release, and timing of any Informatica product or functionality described today remain at the sole discretion of Informatica](https://reader035.vdocuments.site/reader035/viewer/2022071109/5fe3938b7e66233320191980/html5/thumbnails/29.jpg)
Thank you!