© red clay consulting, inc. all rights reserved. · antony rithin| red clay | director –solution...

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

PRESENTER

PLACE

CLIENT

DATE

INFORMATION LIFECYCLE MANAGEMENT (ILM) PANEL DISCUSSION

MDM USER GROUP - 2020

Antony Rithin

Mark Polston

Austin TX

OUUG – MDM

March 2020

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

PANEL PRESENTERS

3

Kelley Sanders

IT Manager App. Dev & Meter Data Ops

Ramki Tunuguntla

Lead Analyst

Patrick Sullivan-Wood

MDM Business App. Owner

Chris Cole

MRO Business Analyst

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

Oracle Landscape

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

Implementation

Discussion:

Data Management

Strategy

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

MDM DATA MANAGEMENT STRATEGY

6

Information Lifecycle Management (ILM)

Business Perspective: Retention Requirements Technical Perspective: Data Organization

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

Implementation

Discussion:

Requirements Approach

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

ILM COMPONENTS

8

Application Component: ILM Retention Configurations

• Retention Period >> How long?

• Evaluate Data’s Status >> Confirm data is in a finalized state?

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

ILM COMPONENTS

9

Application Component:

Evaluate Data’s Status

Example: The Initial Measurement Data (IMD) Lifecycle:

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

ILM COMPONENTS

10

Application Component: Eligibility Algorithm

Is the data considered archive-ready?

Evaluates business requirements:• ILM Retention Configuration Options• Evaluates any special data relationships

Sets the ILM Ready for Archive to ‘Y’ on the primary record

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

ILM COMPONENTS

11

Application Component: ILM Crawler Batch Job• Scans the data >> Invokes Eligibility Algorithm

• One ILM Crawler delivered per data object

• ILM Crawlers can be incorporated into existing job streams

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

ILM COMPONENTS

12

Database Component: ILM Specific Columns

• Primary records have ILM Date, Archival columns used, updated by

• ILM Date: Matches Creation Date, used to track retention period

• ILM Archive Switch: Flipped from ‘N’ to ‘Y’once data is ready for archival

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

ILM COMPONENTS

13

Database Component: Partitioning Strategy

Data

Jan

Feb

Data

Jan

Feb

Data

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

ILM COMPONENTS

14

ILM’s Crawler Batch:• References Retention Configuration

• Executes Eligibility Algorithm

• Sets Data as Ready for Archive

DBA’s Role• Manages data partitions, identifies partitions ready for archival

• Moves data to offline storage

• Purges data as necessary

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

Implementation

Discussion:

What’s now &What’s next?

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

DATA COMPRESSION

• Offers the ability to reduce storage & apply efficiencies on the database-level, transparent the application

• Intention is to compress historical partitions where data is more dormant, less read/write occurring

• MDM Use Case: Final Measurements (D1_MSRMT)

16

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

DATA COMPRESSION

17

Method Applies

OLTP Oracle 11g R1+

Advanced Compression Oracle 12c +

Hybrid Columnar Compression (HCC) Oracle Exadata Hardware

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

DATA COMPRESSION: TAKEAWAYS

1818

Generally Recommended

Compliments StrategyFull Volume Testing

Important

Select ApproachProduct, DB Versions

Use Oracle References

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

SUB-RETENTION

19

Enables Multiple Retention Periods in certain data

• Interval & Scalar Data

• Device Event Categories

• Activity Types

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

ADDITIONAL NEW FEATURES

Proactive “Set ILM Archival = Y” Algorithm• Initial Measurement Data (IMD)

• Device Events

• Usage Transactions

Why Important? Determine data eligibility as it is processed vs. at the end of retention period; reduce workload on ILM Crawler

20

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

ADDITIONAL NEW FEATURES

Dropping Historical IMD Records• Product enhanced to no longer depend on IMD!

• Cancel\Re-Bill use only D1_MSRMT Records

Why Important? The IMD record contains the raw interval and scalar data in large CLOB columns, consuming significant storage

21

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d . 22

QUESTIONS?

© R e d C l a y C o n s u l t i n g , I n c . A l l R i g h t s R e s e r v e d .

CONTACT US

23

Antony Rithin| Red Clay | Director – Solution Delivery

Antony.Rithin@redclay.com

Mark Polston| Red Clay | Managing Consultant

Mark.Polston@redclay.com

Red Clay Consulting

271 17th Street, Suite 610

Atlanta, GA 30363

(678) 445-3770

www.redclay.com