© red clay consulting, inc. all rights reserved. · antony rithin| red clay | director –solution...
TRANSCRIPT
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
PRESENTER
PLACE
CLIENT
DATE
INFORMATION LIFECYCLE MANAGEMENT (ILM) PANEL DISCUSSION
MDM USER GROUP - 2020
Antony Rithin
Mark Polston
Austin TX
OUUG – MDM
March 2020
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
PANEL PRESENTERS
3
Kelley Sanders
IT Manager App. Dev & Meter Data Ops
Ramki Tunuguntla
Lead Analyst
Patrick Sullivan-Wood
MDM Business App. Owner
Chris Cole
MRO Business Analyst
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
Oracle Landscape
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
Implementation
Discussion:
Data Management
Strategy
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
MDM DATA MANAGEMENT STRATEGY
6
Information Lifecycle Management (ILM)
Business Perspective: Retention Requirements Technical Perspective: Data Organization
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
Implementation
Discussion:
Requirements Approach
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
ILM COMPONENTS
8
Application Component: ILM Retention Configurations
• Retention Period >> How long?
• Evaluate Data’s Status >> Confirm data is in a finalized state?
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
ILM COMPONENTS
9
Application Component:
Evaluate Data’s Status
Example: The Initial Measurement Data (IMD) Lifecycle:
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
ILM COMPONENTS
10
Application Component: Eligibility Algorithm
Is the data considered archive-ready?
Evaluates business requirements:• ILM Retention Configuration Options• Evaluates any special data relationships
Sets the ILM Ready for Archive to ‘Y’ on the primary record
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
ILM COMPONENTS
11
Application Component: ILM Crawler Batch Job• Scans the data >> Invokes Eligibility Algorithm
• One ILM Crawler delivered per data object
• ILM Crawlers can be incorporated into existing job streams
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
ILM COMPONENTS
12
Database Component: ILM Specific Columns
• Primary records have ILM Date, Archival columns used, updated by
• ILM Date: Matches Creation Date, used to track retention period
• ILM Archive Switch: Flipped from ‘N’ to ‘Y’once data is ready for archival
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
ILM COMPONENTS
13
Database Component: Partitioning Strategy
Data
Jan
Feb
Data
Jan
Feb
Data
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
ILM COMPONENTS
14
ILM’s Crawler Batch:• References Retention Configuration
• Executes Eligibility Algorithm
• Sets Data as Ready for Archive
DBA’s Role• Manages data partitions, identifies partitions ready for archival
• Moves data to offline storage
• Purges data as necessary
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
Implementation
Discussion:
What’s now &What’s next?
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
DATA COMPRESSION
• Offers the ability to reduce storage & apply efficiencies on the database-level, transparent the application
• Intention is to compress historical partitions where data is more dormant, less read/write occurring
• MDM Use Case: Final Measurements (D1_MSRMT)
16
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
DATA COMPRESSION
17
Method Applies
OLTP Oracle 11g R1+
Advanced Compression Oracle 12c +
Hybrid Columnar Compression (HCC) Oracle Exadata Hardware
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
DATA COMPRESSION: TAKEAWAYS
1818
Generally Recommended
Compliments StrategyFull Volume Testing
Important
Select ApproachProduct, DB Versions
Use Oracle References
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
SUB-RETENTION
19
Enables Multiple Retention Periods in certain data
• Interval & Scalar Data
• Device Event Categories
• Activity Types
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
ADDITIONAL NEW FEATURES
Proactive “Set ILM Archival = Y” Algorithm• Initial Measurement Data (IMD)
• Device Events
• Usage Transactions
Why Important? Determine data eligibility as it is processed vs. at the end of retention period; reduce workload on ILM Crawler
20
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
ADDITIONAL NEW FEATURES
Dropping Historical IMD Records• Product enhanced to no longer depend on IMD!
• Cancel\Re-Bill use only D1_MSRMT Records
Why Important? The IMD record contains the raw interval and scalar data in large CLOB columns, consuming significant storage
21
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d . 22
QUESTIONS?
© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .
CONTACT US
23
Antony Rithin| Red Clay | Director – Solution Delivery
Mark Polston| Red Clay | Managing Consultant
Red Clay Consulting
271 17th Street, Suite 610
Atlanta, GA 30363
(678) 445-3770
www.redclay.com