virtualize your data to embrace unified real-time analytics · load data using optimized processing...

26
PUBLIC Virtualize your data to embrace unified real-time analytics Sabrina Bussolotti, Data Architect & Analytics

Upload: others

Post on 13-Jan-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC

Virtualize your data to embraceunified real-time analyticsSabrina Bussolotti, Data Architect & Analytics

Page 2: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 2ǀ

Today’s disruptors are Insight-Driven

Organizations that provide people with the insight they need to make better decisions, and

enable them to act, will disrupt and deliver growth and innovation

DATA INFORMATION INSIGHT ACTION VALUE

© 2017 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Page 3: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 3ǀ

Is your organization Insight-Driven?

Research shows that insight-driven decisions

are crucial to digital transformation.

“A new kind of company, we call them insight-

driven businesses, has formed.

They are growing at an average of 30% annually,

and are on track to earn $1.8 trillion by 2021.”

Forrester Research, 2017

Insight-Driven Businesses set the pace for Global Growth

Page 4: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 4ǀ

What are your users demanding to meet today’s business challenges?

Will the Data Warehouse be able to meet high customer and data demands?

PerformanceValuable real-time results

Scope historical data AND Predictive, agile analytics

Value Improved use of previously unused data

Higher Customer Expectations

Data

New TypesBehavioral data and the Internet of Things

Larger VolumesPetabytes with a two digit annual growth rate

New LocationsCloud and data lakes

Data Warehouse

?

Page 5: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 5ǀ

Move Data Vs. Move Analytics

Require much time.

Datawarehouse store cold data

instead near-real-time analytics

Bring Analytics to Data Instead move Data to Analytics

DATA

APP

APP

APP

APP

APP

Complexity & Effort insead

semplification

Require continues & constant

investment

Page 6: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 6ǀ

Page 7: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 7ǀ

Page 8: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 8ǀ

Connected, intelligent data

#1 Know Your Data #2 Orchestrate Your Data #3 Utilize Your Data

Internet of Things Data LakeCloud Data

WarehouseMachine Learning Applications

On-Premise

Data Warehouse

Use

Cases:

Rela

tio

na

l Pre

dic

tive

Question Answer

Push

Engines

& Queries

Query

ResultsSAP Data HubSAP

BW/4 HANA

SAP

Cloud Platform

Page 9: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 9ǀ

• Run historical comparisons and trend analyses

• Build an harmonization Layer

SAP BW/4HANA is an Harmonization Layer

Extend Embedded Analytics

SAP BW/4HANASAP “ERP"

SAP HANA Platform

SAP Analytics

III Party DataIII Party DB

III Party APP

Machine

Generated Data

• Complement embedded analytics

• Break silos with enterprise data warehousing

Cloud Data

Page 10: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 10ǀ

SAP S/4HANA is about agility and real-time

then the last thing you want is being slowed down by older data

Use SAP BW/4HANA as corporate memory

X

Nodes

SAP S/4HANA SAP BW/4HANA

Distribute Transaction Manager

Harmonized Data Access

SAP BW/4HANA & SAP S/4HANA Together is Better

Virtual Access

Page 11: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 11ǀ

SAP BW/4HANA: Content Overview

• Uses new SAP BW/4HANA

features

• Follows the LSA++ architecture

• Delivered Content offers more

flexibility in data acquisition and

reporting

• Provides higher level of detail

(line items, …)

Quality

Management

Master Data

Business Area

Industries: Utilities

Sales &

Distribution

Sales

Overview

Conditions

Delivery

Service

Supply Chain Management

Procurement

Invoice

Verification

Inventory

Production

Planning and

Controlling

Extended

Warehouse

Management

Master Data

Governance

Finance

Accounts

Receivable

Accounts

Payable

Fixed Asset

Accounting

General

Ledger

incl.

Financial

Statement

Controlling

Cost Center

Accounting

Overhead

Cost Orders

Enterprise

Controlling

Contract

Accounts

Asset

Management

Quality

Management

Overhead

Projects

incl.

Networks

Plant

Maintenance

Customer

Service

Product Cost

Controlling

Master DataSales

Statistics

Energy Data

Management

Real Estate

Page 12: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 12ǀ

SAP BW/4HANA overview

Slow to deliver

insights or deal with

larger/faster data

• Process and

data silos

• Misaligned &

competing KPIs

• Antiquated UI

and applications

• Business drives

Shadow IT

• Time and cost

intensive

• Discord between

Business and IT

Page 13: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 13ǀ

SAP BW/4HANA overview

High Performance

• Reduce data handling

wait time

• Improve decision-

automation

Processing push-down

Fast loading & processing

No aggregates, roll-ups

• Reduce data

integration Cost

• Reduce ETL spend

• Reduce infrastructure

costs

Openness

Mixed scenarios with

HANA native DW

All data types

On-prem and Cloud

• Speed up change requests

• Reduce implementation

time

• Reduce development

spend

Simplicity

Simplified Models

Simplified data flows

Simplified data tiering

Modern Interface

• Improve business user

productivity

• Reduce shadow analytics

• Improve user adoption

Modern analytics

Visual modelling

Modern administration

Page 14: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 14ǀ

Openness: Comprehensive access to all data

SAP BW/4HANA simplifies data integration, offering comprehensive access to external systems

▪ Number of Source System types reduced from 10 to 4

▪ Replicate data in real-time (HANA SDI based replication or via ODP – especially with ODP-SLT)

▪ Access data virtually

▪ Load data using optimizedprocessing

data

load

SAP HANA

HANA Source

System

Extractors

ODQ

direct

access

real-time

replication

RDBMS

/HadoopText

StructuredSocial Media

EmailSLT ABAP

CDS

BW Business

ByDesign

SAP BW/4HANA

HIVE SPARK VORA

Hadoop

ODP Source SystemBig Data Source

SystemFile Source System

SAP EIM

Non-SAP Data SAP Data

File

Big Data File

SAP ERP, ECC, ASE, HANA,

and other SAP applications

Page 15: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 15ǀ

Any DB

Significant performance gain through

push-down of operations/calculations

to SAP HANA

• OLAP Engine, complex query

calculations

(e.g. exception aggregation)

• Planning functions

(e.g. disaggregation)

• Data management

(e.g. transformation logic)

SAP BW/4HANA – Algorithm Push-down

BW on AnyDBSAP BW Server

Data Modelling

Pro

ce

ss O

rch

estr

ation

SAP HANA

OLAP

Planning

Data Management

SAP BW/4HANA Server

Data Modelling

Pro

ce

ss O

rch

estr

ation

OLAP

Data Management

Planning

Pushdown

All processing on application server Most processing on SAP HANA

Page 16: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 16ǀ

SAP BW/4HANA: A simpler, faster, and more agile data warehouse

Built on HANA Engine!

DATABASE MANAGEMENT

Web Server JavaScript

Graphic Modeler

Data Virtualization ELT & Replication

Columnar OLTP+OLAP

Multi-Core & Parallelization

Advanced Compression

Multi-tenancy Multi-Tier Storage

Graph Predictive Search

DataQuality

SeriesData

Business Functions

Hadoop & Spark Integration

Streaming Analytics

Application Lifecycle Management

High Availability &Disaster Recovery

OpennessDataModeling

Admin &Security

Remote Data Sync

Spatial

Text Analytics

Fiori UX

APPLICATION DEVELOPMENT DATA INTEGRATION & QUALITYADVANCED ANALYTICAL PROCESSING*

S A P H A N A + S A P B W / 4 H A N A

DATA WAREHOUSING

Analytic Services

Open Interfaces Business Planning & Consolidation

Services *

Data Modeling Objects & Services

Modeling ToolsData Warehousing

Services

Data Acquisition Services

Page 17: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 17ǀ

Enhance data with Advanced

Analytics using HANA specific

libraries (AFL), R-Script or a

custom HANA procedure

• Predictive

• Text Analysis

• Data Mining

• Machine Learning

SAP BW/4HANA – Advanced Analytics

HAP InfoProvider

SAP HANAR-Script

Procedure

AFL

SAP BW/4HANA

Source Transform Target

InfoProviderInfoProvider

/View

HAP

Page 18: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 18ǀ

SAP BW/4HANA – Simplified Data Structures – Simplified Modeling

Classic SAP BW

• Number of Modelling object types

reduced from 10 to 4 (60% less)

• No complex data structures

(extended star schema)

• Field or InfoObject based modelling

• Greater control of data persistency

and virtualization

• Support for external, structured and

unstructured data

InfoCube6

DataStore Object7

Hybrid Provider8

PSA Table9

InfoObject10

Transient Provider5

Virtual Provider4

CompositeProvider3

InfoSet2

MultiProvider1

CompositeProvider1

Open ODS View2

DataStore Object (advanced)3

InfoObject4

Virtu

aliz

atio

nP

ers

iste

ncy

SAP BW/4HANA

Page 19: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 19ǀ

SAP BW/4HANA – Simplified Data Flows

From Layered Scalable Architecture (LSA) to LSA++

SAP BW/4HANA (LSA++)

Service Level

Classic SAP BW (LSA)

Staging Layer/Corporate Memory

Propagation Layer

Architected Data Marts

Virtualization

mandatorylayers

mandatory layer

top

do

wn

mo

de

llin

g

bo

tto

m u

p m

od

elli

ng

Virtualization/ Virtual Data Marts

Architected Data Marts

Source

Staging Layer/ Corporate Memory

Open ODS Layer/ Raw DWH

Propagation Layer/ Integrated DWH

top

do

wn

mo

de

llin

g

optionallayers depending on business needs and required service level

Source

Page 20: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 20ǀ

SAP BW/4HANA – Native SQL Access

SAP BW/4HANA logic and data can be

exposed to SAP HANA

Automatic generation of SAP HANA views

allows:

• SQL logic on top of generated views

• Combined data from native SAP HANA

• SQL access for front-end tools

Generated SAP HANA views are part of

SAP BW/4HANA lifecycle management and

SAP BW/4HANA security

SAP HANASAP BW/4HANA

DataStore

Object

Query

* SAP BW/4HANA generated HANA view

Calculation

View *

Calculation

View *

Calculation

View *

Composite

Provider

Calculation

View *

InfoObject

Open ODS

View

Calculation

View *

HANA

Tables/ Views

Custom

Calculation

Views

Page 21: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 21ǀ

SAP BW/4HANA – Simplified Data Aging Process

SAP HANA Extension Nodes SAP IQ

Hadoop

Automatic Displacement of Data

Hot Data Warm Data Cold DataSAP HANA in-memory

Extension Node with relaxed

memory requirements

Allocate by aDSO or aDSO

partition

SAP HANA in-memory

Allocate by aDSO or aDSO

partition

SAP IQ / Hadoop storage /

SAP Vora

Allocate by aDSO

partition

▪ Consistent approach for

hot, warm and cold data

▪ Allocate temperature by

partition

▪ Displace data

automatically between hot,

warm and cold storage

▪ Reporting is seamless,

users unaffected

Page 22: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 22ǀ

SAP BW/4HANA – New User Interface for Developers & Administrators

SAP BW/4HANA Modelling Tools

integrated with SAP HANA Studio (Eclipse)

SAP BW/4HANA Cockpit

Page 23: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 23ǀ

Classic SAP BW

on any database

SAP BW/4HANA

Fresh installation

System consolidationBW on AnyDBBW on AnyDBClassic SAP BW

on any database

Easy conversion to SAP BW/4HANA

Classic SAP BW

on any database

Classic SAP BW

on any database

Remote conversion

In-place conversion

SAP BW on

SAP HANA

SAP BW/4HANA

Starter Add-on

Page 24: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 24ǀ

SAP BW/4HANA – In-memory & VIRTUAL Data Warehousing

Query all data at the speed of SAP HANA

No Aggregates or Roll-up Processes

No Performance Specific Modeling Objects

Fewer Database Indexes

Faster Loading and Processing

Page 25: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

Thank you.

Page 26: Virtualize your data to embrace unified real-time analytics · Load data using optimized processing data load SAP HANA HANA Source System Extractors ODQ direct ... n Data Modelling

© 2019 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of

SAP SE or an SAP affiliate company.

The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its

distributors contain proprietary software components of other software vendors. National product specifications may vary.

These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or

warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.

The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty

statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional

warranty.

In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or

any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,

and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and

functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason

without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or

functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ

materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they

should not be relied upon in making purchasing decisions.

SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered

trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names

mentioned are the trademarks of their respective companies.

See www.sap.com/copyright for additional trademark information and notices.

www.sap.com/contactsap

Follow us