webinar - sap azure analytics · 2020. 5. 20. · azure data factory orchestrates and...

31
Estrategia SAP EMBRACE & Azure Analytics Moises Coronado Global Partner Development Manager Microsoft Iberica

Upload: others

Post on 30-Dec-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Estrategia SAP EMBRACE & Azure Analytics

Moises CoronadoGlobal Partner Development ManagerMicrosoft Iberica

Page 2: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Introducing The Embrace Initiative

SimplifyMove with confidence, reducing

complexity and mitigating risk

AccelerateBecome an agile, efficient, digital

enterprise on Microsoft Azure, with

a cloud platform optimized for SAP

solutions

InnovateTransform and evolve your

business with continuous

innovation to create new

opportunities and drive growth

Align

Specialist

Expertise

Create a

Catalyst and

Action Plan

Take a

Comprehensive

Approach

Access

Continuous

Innovation

Leverage

Best Practices

& Experience

A strategic alliance between SAP and Microsoft, to simplify

and accelerate a customer’s journey to SAP S/4HANA on

Microsoft Azure.

Optimized

Platform

Market Approved

Journeys

Reference

Architecture

Embrace

Engagement and

Services

The Embrace Initiative SAP S/4HANA

On Microsoft Azure

Microsoft Azure is SAP’s

preferred cloud

Foundations,

Investments, &

Services

Page 3: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

© Microsoft Corporation

Turn your SAP data into actionable insights

Azure Data Factory Azure Blob storage

Azure Data Lake Store

Azure SQL Server

Open Source DB

Azure Databricks

Azure HDInsight

Azure Data Lake Analytics

Azure Synapse Analytics

Azure Analysis Services

Azure Data Share

Cosmos DB

Page 4: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Common Data Model

Open Data Initiative

https://aka.ms/opendatainitiative

CDM folders

Page 5: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media
Page 6: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

© Microsoft Corporation

YOUR PREFERRED CLOUD PARTNER

Innovación e Integración en la transición a Cloud

José Antonio Hérnandez – Global CTO & Founder myCloudDoor

Page 7: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Introduction: The Cloud Journey

7

Strategic Phase –

Business Case

Testing Phase –

Cloud Adoption

Optimization Phase

– Cloud Migration

Innovation Phase –

Business Models

1

2

3

4

• Time, TCO

• Portfolio

• Business

Drivers

• SaaS

• POC´s

• Dev IaaS

• Hybrid Setup

• Apps: Rationalization

• Apps: Migration

• IT Optimization

• Cloud Governance

• DevOps

• New Services

• New Business Solutions

• Expansion to new markets

• Platform Standardization

Savings 25%

Savings 50%

Business

Agility

Page 8: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Plan Maestro de Adopción y/o Migración a Cloud

8

I. Pre-Migration or

Preparation StageII. Migration Stage III. Optimization Stage

1. Cloud Acknowledgement

2. Define the Business Case

3. Assess Organization

Readiness

4. Technical Cloud Training

5. Cloud Contract and Initial

Setup

6. Cloud Governance:

Develop your initial CRA

7. Discovery

8. Workload Analysis

9. Prepare Service

Management and Cutover

10. Develop Migration

Runbook

11. Design and Deploy

12. Migration Testing and

adjustments

13. Cutover and Live Migration

14. Handover to Operations

15. Workload Optimization

16. Cost Optimization

17. Implement Automation

18. Integrate and Innovate

Page 9: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Cloud Journey Artifacts

9

Upskilling

Infra & Administration

Trainings

Security Trainings

Certifications

Migration

Dedicated Migration

Services Team

Implementation of best

practices

Smart Cloud Migrations

and Microsoft CAF

Migration with quick

Benefits

Re platforming

Open Source first party

supported systems

Windows to Open

Source OS migrations

SQL Server to PaaS OSS

database migrations

Oracle to PostgreSQL

Migration

SAP OS/DB Migrations

Modernization

Assessments

Containerization

Kubernetes / OpenShift

DevOps practices

Open Source DB

Serverless Design

Advanced Analytics

IoT for Manufacturing

Digital Twins

HoloLens

AA & AI

Implementations

Data Lake Architecture

Edge Implementation

Page 10: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Modernization

10

AssessmentsUnderstand application mapping and dependencies.

Understand the application scalability and performance requirements.

Design new architecture and reduce application footprint

ContainerizationDecompose applications into different smaller services to improve modularity and reduce application footprint.

Reduce technical depth. Business owners won’t need to wait longer.

Fully compatible with DevOps principals.

Kubernetes /

OpenShift

No need to train for operating and managing Kubernetes. Focus on innovating and delivering values to the customers.

Application dependency analysis is necessary. Some services need to be transformed first.

Utilize defacto container orchestration systems together with first party support. Red Hat OpenShift or Kubernetes.

DevOps

Practices

Deliver more frequently and seamlessly.

Innovate faster while increasing efficiency and decreasing mean time to recover.

Will be necessary for digital transformation.

Need DevOps assessment for fully automated pipeline.

Open Source DBReduce SQL Server footprint.

Application dependency analysis is necessary.

Eliminate the cons of open source tool management. Prefer PaaS OSS systems to get full value of Azure.

Serverless

Design

Do not pay for idle servers or applications. There is no cost if your serverless applications aren’t running, event they have been provisioned.

Decompose applications into different smaller services to improve modularity and reduce application footprint.

Low-Code/No-Code strategy is growing, serverless design requires low-code strategy.

Page 11: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Advanced Analytics

11

IoT for

Manufacturing

Make disconnected system, connected

Work with Customer companies to start collecting data from manufacturing plants

Develop Minimal Viable Product (MVP) together

Digital TwinsIntroduce Microsoft Azure Digital Twin Program

Identify use cases together

Build initial prototypes

HololensIdentify Hololens use cases

Work on 3D images

Introduce Dynamics Guides & Remote Assist

AA

Implementations

Identify use cases with Customer companies

Develop MVP together with Customer teams, preferably using OSS frameworks

Knowledge transfer on Azure AI/ML & Cognitive Services

Data Lake

Architectures

Support Customer teams on building an end to end Data Lake architecture

Promote open source technologies like Cloudera, Databricks etc.

Edge

Implementation

Bring IoT and AI Scenarios to Edge where it is necessary

Identify use cases together with Customer Teams

Support for Azure Stack Edge Implementation

Page 12: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Wirksamkeitثقة

Команда

Initiative

ΣύνδεσηDigital

Vizyon

vrijednostiqualità

コミットメント

Transformação

Koneksi

samewerking

Responsability

behendigheid

Online

Diversitéprojekt

UX

Objetivos

Information Résultats

Strategien

环境

comunicazione

ثقافة

мотивация

collegamento

Optimisation

Cloud

Thank [email protected]

Page 13: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

© Microsoft Corporation

YOUR PREFERRED CLOUD PARTNER

Azure Data Factory & Azure Data LakeDaniel Andrés del Castillo-Olivares

myCloudDoor Cloud Analytics Manager

Page 14: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Modern Data Warehouse

14

SAP data

Azure Data Factory orchestrates and operationalizes data pipeline workflow

Business / custom apps

(Structured)

Logs, files and media

(unstructured) Azure Data Lake

Storage Gen2

Polybase

Azure SQL Data Warehouse

Data factory

Data factory

Azure Databricks

(Spark)

Analytical dashboards

(PowerBI)

Model & ServePrep & TrainStoreIngest Intelligence

Azure Analysis Services

On Prem, Cloud

Apps & Data

Page 15: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Modern Data Warehouse

15

SAP data

Azure Data Factory orchestrates and operationalizes data pipeline workflow

Business / custom apps

(Structured)

Logs, files and media

(unstructured) Azure Data Lake

Storage Gen2

Polybase

Azure SQL Data Warehouse

Data factory

Data factory

Azure Databricks

(Spark)

Analytical dashboards

(PowerBI)

Model & ServePrep & TrainStoreIngest Intelligence

Azure Analysis Services

On Prem, Cloud

Apps & Data

SAP data integration typical scenarios:

• Ongoing ELT from SAP to data lake

• Historical migration from SAP to data lake

Page 16: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

A fully-managed data integration service

for cloud-scale analytics in Azure

S c a l a b l e &

C o s t - E f f e c t i v e

C o n n e c t e d &

I n t e g r a t e dP r o d u c t i v e

S e c u r e &

C o m p l i a n t

Rich connectivity

Flexible orchestration

Full integration with Azure Data services

Drag & drop UI

Single-pane-of-glass monitoring

CICD model

Serverless scalability without infra mgmt.

Pay for use

Certified compliance

Enterprise grade security

MSI and AKV support

Azure Data Factory

Page 17: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Access All Your Data (80+ connectors)

17

Azure (15) Database & DW (25) File Storage (6) NoSQL (3) Services & Apps (28) Generic (4)

Blob Storage Amazon Redshift Oracle Amazon S3 Cassandra Amazon MWS Oracle Service Cloud HTTP

Cosmos DB – SQL API DB2 Phoenix File System Couchbase CDS for Apps Paypal OData

Cosmos DB – MongoDB API Drill PostgreSQL FTP MongoDB Concur QuickBooks ODBC

ADLS Gen1 Google BigQuery Presto Google Cloud Storage Dynamics 365 Salesforce REST

ADLS Gen2 Greenplum SAP BW Open Hub HDFS Dynamics AX SF Service Cloud

Data Explorer HBase SAP BW MDX SFTP Dynamics CRM SF Marketing Cloud

Database for MariaDB Hive SAP HANA Google AdWords SAP C4C

Database for MySQL Impala SAP Table HubSpot SAP ECC

Database for PostgreSQL Informix Spark Jira ServiceNow

File Storage MariaDB SQL Server Magento Shopify

SQL Database Microsoft Access Sybase Marketo Square

SQL Database MI MySQL Teradata Office 365 Web Table

SQL Data Warehouse Netezza Vertica Oracle Eloqua Xero

Search Index Oracle Responsys Zoho

Table Storage

Page 18: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Access All Your Data (80+ connectors)

18

Connector Source Systems Protocol Integration Runtime Processing Mode

SAP ECCSAP NetWeaver version 7,0 and

later with SAP GatewayOData No Batch

SAP TableSAP NetWeaver version 7,01 and

laterRFC Yes-self-hosted Batch

SAP BW MDX SAP BW version 7,X RFC Yes-self-hosted Batch

SAP BW Open Hub SAP BW version 7,01 and later RFC Yes-self-hosted Batch

SAP HANA Any SAP HANA ODBC Yes-self-hosted Batch

SAP Cloud For Customer Any OData Yes Batch

Page 19: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

SAP Connector – How It Works

19

SAP Driver

SAP Connector

ADF Self-

hosted

Integration

Runtime

Azure Data StoresPipeline

• You can set up to 4 Self-hosted IR nodes to handle more concurrent runs.

• The similar applies to SAP HANA on Azure as source –you can deploy Self-hosted IR + ODBC driver on Azure VM.

Page 20: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

SAP HANA Connector – Incremental Copy

20

C1 C2 … LastModifiedDate

… … … …

… … … 2019/03/18

… … … 2019/03/18

… … … ……

… … … 2019/03/18

… … … 2019/03/19

… … … 2019/03/19

… … … …

… … … 2019/03/19

… … … …

Pattern I: “my data has timestamp column e.g. last modified time”

Solution: tumbling window trigger + dynamic query with system variables. Get started via Copy Data Tool.

Example: scheduled daily incremental copy starting at midnight

SELECT * FROM MyTable

WHERE LastModifiedDate >= @{formatDateTime(pipeline().parameters.windowStartTime, 'yyyy/MM/dd’)

AND LastModifiedDate < @{formatDateTime(pipeline().parameters.windowEndTime, 'yyyy/MM/dd’)

Execution start time: 2019/03/19 00:00:00 (window end time)

Delta extraction: last modified time between 2019/03/18 – 2019/03/19

Execution start time: 2019/03/20 00:00:00 (window end time)

Delta extraction: last modified time between 2019/03/19 – 2019/03/20

Page 21: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

SAP HANA Connector – Incremental Copy

21

Pattern II: “my data has an incremental column e.g. ID”

Solution: control table/file + high watermark. Get started via solution template.

Workflow Pipeline

Page 22: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Use Case: Cloud Analytics with SAP Data(one of the largest NGO)

22

DATA SOURCES INGEST & STORE TRANSFORM MODEL & SERVE REPORTING

ADLS Gen2

SQL DW

Azure

Analytics

ServiceAzure

Function

File

APIs

Power BI

Excel

Azure Data Factory orchestrates and operationalizes data pipeline workflow

Page 23: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Power BI Integration

Daniel Andrés del Castillo-Olivares

myCloudDoor Cloud Analytics Manager

Page 24: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

© Microsoft Corporation

February 2020

*Gartner “Magic Quadrant for Analytics and Business Intelligence Platforms,” by Cindi Howson, James Richardson, Rita Sallam, Austin Kronz, 11 February 2020

The above graphics were published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from Microsoft. Gartner does not endorse any

vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research

organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. GARTNER is a registered trademark and service mark of Gartner, Inc. and/or its affiliates in the U.S. and internationally and is used herein with permission. All rights reserved.

Page 25: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Power BI family

25

Power BI Pro Power BI PremiumPower BI Desktop

Page 26: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Transforming with dataThe Business Analyst role

26

Page 27: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Power BI GovernanceDelivery Approach

27

Page 28: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Power BI ArchitectureBlended Approach

28

Page 29: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Power BI Connector to SAP HANA and BW

29

SAP HANA (Use SAP HANA in Power BI Desktop)

Calcutation views

SAP BW (Use the SAP BW Connector in Power BI Desktop)

BW cubesBEx queriesAdvanced DataStore Objects (ADSO)

SAP HANA (Data sources in Power BI Desktop)

Odata Services

Page 30: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

DemoPower BI – SAP Integration

Page 31: Webinar - SAP Azure Analytics · 2020. 5. 20. · Azure Data Factory orchestrates and operationalizes data pipeline workflow Business / custom apps (Structured) Logs, files and media

Wirksamkeitثقة

Команда

Initiative

ΣύνδεσηDigital

Vizyon

vrijednostiqualità

コミットメント

Transformação

Koneksi

samewerking

Responsability

behendigheid

Online

Diversitéprojekt

UX

Objetivos

Information Résultats

Strategien

环境

comunicazione

ثقافة

мотивация

collegamento

Optimisation

Cloud

Thank [email protected]