the impact of columnar in-memory databases on enterprise ... · pdf filethe impact of columnar...

18
The Impact of Columnar In-Memory Databases on Enterprise Systems Mar$n Lorenz Research Assistant Chair of Prof. Dr. Hasso Pla5ner

Upload: ngodien

Post on 31-Jan-2018

227 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

The Impact of Columnar In-Memory Databases on Enterprise Systems

 Mar$n  Lorenz  

Research  Assistant  Chair  of  Prof.  Dr.  Hasso  Pla5ner  

Page 2: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

Hardware  Development  Enabler  for  a  New  Era  of  Business  Processing  

2  

Page 3: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

A  Common  Database  Approach  For  OLTP  and  OLAP  

3  

Page 4: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

What‘s  in  it  for  the  enterprise?  

Speed!  The  performance  of  the  database  increases  dramaLcally!  

 But,  does  a  faster  system  change  the  game?  

It  might  for  some,  but  there  is  more.  

4  

Page 5: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

What  is  the  impact  of  In-­‐Memory  Technology?  

Speed  is  just  an  enabler  for  Simplifica$on.    

Simplifica$on  allows  to  increase  Flexibility  and  decrease  TCO.    

Flexibility  enables  companies  to  re-­‐think  their  exisLng,  or  approach  new,  Business  Models.  

5  

Page 6: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

A  Textbook  Example:  Wire  Money  from  Account  A  to  Account  B  

6  

Page 7: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

SAP  Financials  –  Invoice  PosLng  Before  SimplificaLon  

7  

Page 8: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

SAP  Financials  –  Invoice  PosLng  SimplificaLon  

8  

Page 9: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

SAP  Financials  –  Invoice  PosLng  A]er  SimplificaLon  with  Database  Views  

9  

Page 10: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

Why  Column  Stores  are  be5er  than    Row  Stores  for  TransacLonal  Processing  

10  

Page 11: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

Enterprise  Workload  Analysis    

11  

*Without  TransacLon-­‐Maintained  Aggregates      

Page 12: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

SimplificaLon  reduces  Data  Footprint  

12  

Page 13: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

Examples  

13  

What  is  the  business  value  generated  from  speed  and  flexibility?    1.  Period  End  Close  SimulaLon  2.  Planning  

Page 14: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

1.  Period  End  Close  SimulaLon  

14  

Closing  Run  

Results  Review  

IdenLfy  Variance  

Reconcile  

CorrecLon  

Business  Report  

Intra  Period   Period  End  

Finance:  0  Visibility  

Business:  0  Support  

Finance  Report  

Simulated  Run  

Results  Review  

IdenLfy  Variance  

Reconcile  

CorrecLon  

Intra  Period   Period  End  

Simulated  Run  

Results  Review  

IdenLfy  Variance  

Reconcile  

CorrecLon  

Simulated  Run  

Results  Review  

IdenLfy  Variance  

Reconcile  

CorrecLon  

Business  Report  

Business  Report  

Business  Report   Period  Close  

Run  

Finance  Report  

Time-­‐consuming,  error  prone  batch  process  involving  100+  tasks    

Process  designed  for  real-­‐Lme  operaLons  to  eliminate  close  bo5lenecks  

Page 15: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

2.  Planning  

15  

1.  Currently,  planning  is  a  staLc  process,  which  operate  on  aggregates.    2.  Planning  informaLon  

-­‐  compeLtors,  -­‐  InflaLon  rate  -­‐  growth  rates,  -­‐  economy,  -­‐  forecasted  pipeline  

applied  on  aggregates  is  dangerous  and  not  very  scienLfic.  Its  like  holding  your  thumb  in  the  air    3.  Plans  are  done  rolling  1,3,5  years.  What  if  your  organizaLonal  structure  changes?  All  plans  are  invalid!  

America   Asia   Europe  

Cars   9   17   6   32  

Bikes   8   8   4   20  

Planes   18   25   5   48  

35   50   15   100%  

Planning  2.0:  You  need  to  abstract  your  revenue  structures  and  apply  planning  rules  to  the  lowest  level  of  granularity,  the  line  item  level!!  

Page 16: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

16  

Thank  You!  

Page 17: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

Read-­‐Only  ReplicaLon  

17  

MIXED WORKLOAD

OLAP, SEARCH AND READ-ONLY APPLICATIONSON TRANSACTIONAL SCHEMA

OLTP

Customers Sales Managers Decision Support

Read-Only Replica

Master Node

Data EntryOperational Reporting& New Applications

Asynchronous,Transactionally ConsistentReplication

Page 18: The Impact of Columnar In-Memory Databases on Enterprise ... · PDF fileThe Impact of Columnar In-Memory Databases on Enterprise Systems! Mar$n&Lorenz& ... SAP!Financials!–Invoice!PosLng!

Transparent  Aggregate  Cache  

18  

MAIN

COLD 1COLD N

DELTA

MAIN

COLD 1COLD N

DELTA

AGGREGATES

ĔJ ��Jĉ�Aggregation

TransparentAggregate Cache

Inserts

Aggregation�Ű

Aggregation�Ű

Inserts