webinar - sap azure analytics · 2020. 5. 20. · azure data factory orchestrates and...
TRANSCRIPT
Estrategia SAP EMBRACE & Azure Analytics
Moises CoronadoGlobal Partner Development ManagerMicrosoft Iberica
Introducing The Embrace Initiative
➔
SimplifyMove with confidence, reducing
complexity and mitigating risk
AccelerateBecome an agile, efficient, digital
enterprise on Microsoft Azure, with
a cloud platform optimized for SAP
solutions
InnovateTransform and evolve your
business with continuous
innovation to create new
opportunities and drive growth
Align
Specialist
Expertise
Create a
Catalyst and
Action Plan
Take a
Comprehensive
Approach
Access
Continuous
Innovation
Leverage
Best Practices
& Experience
A strategic alliance between SAP and Microsoft, to simplify
and accelerate a customer’s journey to SAP S/4HANA on
Microsoft Azure.
Optimized
Platform
Market Approved
Journeys
Reference
Architecture
Embrace
Engagement and
Services
The Embrace Initiative SAP S/4HANA
On Microsoft Azure
Microsoft Azure is SAP’s
preferred cloud
Foundations,
Investments, &
Services
© Microsoft Corporation
Turn your SAP data into actionable insights
Azure Data Factory Azure Blob storage
Azure Data Lake Store
Azure SQL Server
Open Source DB
Azure Databricks
Azure HDInsight
Azure Data Lake Analytics
Azure Synapse Analytics
Azure Analysis Services
Azure Data Share
Cosmos DB
Common Data Model
Open Data Initiative
https://aka.ms/opendatainitiative
CDM folders
© Microsoft Corporation
YOUR PREFERRED CLOUD PARTNER
Innovación e Integración en la transición a Cloud
José Antonio Hérnandez – Global CTO & Founder myCloudDoor
Introduction: The Cloud Journey
7
Strategic Phase –
Business Case
Testing Phase –
Cloud Adoption
Optimization Phase
– Cloud Migration
Innovation Phase –
Business Models
1
2
3
4
• Time, TCO
• Portfolio
• Business
Drivers
• SaaS
• POC´s
• Dev IaaS
• Hybrid Setup
• Apps: Rationalization
• Apps: Migration
• IT Optimization
• Cloud Governance
• DevOps
• New Services
• New Business Solutions
• Expansion to new markets
• Platform Standardization
Savings 25%
Savings 50%
Business
Agility
Plan Maestro de Adopción y/o Migración a Cloud
8
I. Pre-Migration or
Preparation StageII. Migration Stage III. Optimization Stage
1. Cloud Acknowledgement
2. Define the Business Case
3. Assess Organization
Readiness
4. Technical Cloud Training
5. Cloud Contract and Initial
Setup
6. Cloud Governance:
Develop your initial CRA
7. Discovery
8. Workload Analysis
9. Prepare Service
Management and Cutover
10. Develop Migration
Runbook
11. Design and Deploy
12. Migration Testing and
adjustments
13. Cutover and Live Migration
14. Handover to Operations
15. Workload Optimization
16. Cost Optimization
17. Implement Automation
18. Integrate and Innovate
Cloud Journey Artifacts
9
Upskilling
Infra & Administration
Trainings
Security Trainings
Certifications
Migration
Dedicated Migration
Services Team
Implementation of best
practices
Smart Cloud Migrations
and Microsoft CAF
Migration with quick
Benefits
Re platforming
Open Source first party
supported systems
Windows to Open
Source OS migrations
SQL Server to PaaS OSS
database migrations
Oracle to PostgreSQL
Migration
SAP OS/DB Migrations
Modernization
Assessments
Containerization
Kubernetes / OpenShift
DevOps practices
Open Source DB
Serverless Design
Advanced Analytics
IoT for Manufacturing
Digital Twins
HoloLens
AA & AI
Implementations
Data Lake Architecture
Edge Implementation
Modernization
10
AssessmentsUnderstand application mapping and dependencies.
Understand the application scalability and performance requirements.
Design new architecture and reduce application footprint
ContainerizationDecompose applications into different smaller services to improve modularity and reduce application footprint.
Reduce technical depth. Business owners won’t need to wait longer.
Fully compatible with DevOps principals.
Kubernetes /
OpenShift
No need to train for operating and managing Kubernetes. Focus on innovating and delivering values to the customers.
Application dependency analysis is necessary. Some services need to be transformed first.
Utilize defacto container orchestration systems together with first party support. Red Hat OpenShift or Kubernetes.
DevOps
Practices
Deliver more frequently and seamlessly.
Innovate faster while increasing efficiency and decreasing mean time to recover.
Will be necessary for digital transformation.
Need DevOps assessment for fully automated pipeline.
Open Source DBReduce SQL Server footprint.
Application dependency analysis is necessary.
Eliminate the cons of open source tool management. Prefer PaaS OSS systems to get full value of Azure.
Serverless
Design
Do not pay for idle servers or applications. There is no cost if your serverless applications aren’t running, event they have been provisioned.
Decompose applications into different smaller services to improve modularity and reduce application footprint.
Low-Code/No-Code strategy is growing, serverless design requires low-code strategy.
Advanced Analytics
11
IoT for
Manufacturing
Make disconnected system, connected
Work with Customer companies to start collecting data from manufacturing plants
Develop Minimal Viable Product (MVP) together
Digital TwinsIntroduce Microsoft Azure Digital Twin Program
Identify use cases together
Build initial prototypes
HololensIdentify Hololens use cases
Work on 3D images
Introduce Dynamics Guides & Remote Assist
AA
Implementations
Identify use cases with Customer companies
Develop MVP together with Customer teams, preferably using OSS frameworks
Knowledge transfer on Azure AI/ML & Cognitive Services
Data Lake
Architectures
Support Customer teams on building an end to end Data Lake architecture
Promote open source technologies like Cloudera, Databricks etc.
Edge
Implementation
Bring IoT and AI Scenarios to Edge where it is necessary
Identify use cases together with Customer Teams
Support for Azure Stack Edge Implementation
Wirksamkeitثقة
Команда
Initiative
ΣύνδεσηDigital
Vizyon
vrijednostiqualità
コミットメント
Transformação
Koneksi
samewerking
Responsability
behendigheid
Online
Diversitéprojekt
UX
Objetivos
Information Résultats
Strategien
环境
comunicazione
ثقافة
мотивация
collegamento
Optimisation
Cloud
Thank [email protected]
© Microsoft Corporation
YOUR PREFERRED CLOUD PARTNER
Azure Data Factory & Azure Data LakeDaniel Andrés del Castillo-Olivares
myCloudDoor Cloud Analytics Manager
Modern Data Warehouse
14
SAP data
Azure Data Factory orchestrates and operationalizes data pipeline workflow
Business / custom apps
(Structured)
Logs, files and media
(unstructured) Azure Data Lake
Storage Gen2
Polybase
Azure SQL Data Warehouse
Data factory
Data factory
Azure Databricks
(Spark)
Analytical dashboards
(PowerBI)
Model & ServePrep & TrainStoreIngest Intelligence
Azure Analysis Services
On Prem, Cloud
Apps & Data
Modern Data Warehouse
15
SAP data
Azure Data Factory orchestrates and operationalizes data pipeline workflow
Business / custom apps
(Structured)
Logs, files and media
(unstructured) Azure Data Lake
Storage Gen2
Polybase
Azure SQL Data Warehouse
Data factory
Data factory
Azure Databricks
(Spark)
Analytical dashboards
(PowerBI)
Model & ServePrep & TrainStoreIngest Intelligence
Azure Analysis Services
On Prem, Cloud
Apps & Data
SAP data integration typical scenarios:
• Ongoing ELT from SAP to data lake
• Historical migration from SAP to data lake
A fully-managed data integration service
for cloud-scale analytics in Azure
S c a l a b l e &
C o s t - E f f e c t i v e
C o n n e c t e d &
I n t e g r a t e dP r o d u c t i v e
S e c u r e &
C o m p l i a n t
Rich connectivity
Flexible orchestration
Full integration with Azure Data services
Drag & drop UI
Single-pane-of-glass monitoring
CICD model
Serverless scalability without infra mgmt.
Pay for use
Certified compliance
Enterprise grade security
MSI and AKV support
Azure Data Factory
Access All Your Data (80+ connectors)
17
Azure (15) Database & DW (25) File Storage (6) NoSQL (3) Services & Apps (28) Generic (4)
Blob Storage Amazon Redshift Oracle Amazon S3 Cassandra Amazon MWS Oracle Service Cloud HTTP
Cosmos DB – SQL API DB2 Phoenix File System Couchbase CDS for Apps Paypal OData
Cosmos DB – MongoDB API Drill PostgreSQL FTP MongoDB Concur QuickBooks ODBC
ADLS Gen1 Google BigQuery Presto Google Cloud Storage Dynamics 365 Salesforce REST
ADLS Gen2 Greenplum SAP BW Open Hub HDFS Dynamics AX SF Service Cloud
Data Explorer HBase SAP BW MDX SFTP Dynamics CRM SF Marketing Cloud
Database for MariaDB Hive SAP HANA Google AdWords SAP C4C
Database for MySQL Impala SAP Table HubSpot SAP ECC
Database for PostgreSQL Informix Spark Jira ServiceNow
File Storage MariaDB SQL Server Magento Shopify
SQL Database Microsoft Access Sybase Marketo Square
SQL Database MI MySQL Teradata Office 365 Web Table
SQL Data Warehouse Netezza Vertica Oracle Eloqua Xero
Search Index Oracle Responsys Zoho
Table Storage
Access All Your Data (80+ connectors)
18
Connector Source Systems Protocol Integration Runtime Processing Mode
SAP ECCSAP NetWeaver version 7,0 and
later with SAP GatewayOData No Batch
SAP TableSAP NetWeaver version 7,01 and
laterRFC Yes-self-hosted Batch
SAP BW MDX SAP BW version 7,X RFC Yes-self-hosted Batch
SAP BW Open Hub SAP BW version 7,01 and later RFC Yes-self-hosted Batch
SAP HANA Any SAP HANA ODBC Yes-self-hosted Batch
SAP Cloud For Customer Any OData Yes Batch
SAP Connector – How It Works
19
SAP Driver
SAP Connector
ADF Self-
hosted
Integration
Runtime
Azure Data StoresPipeline
• You can set up to 4 Self-hosted IR nodes to handle more concurrent runs.
• The similar applies to SAP HANA on Azure as source –you can deploy Self-hosted IR + ODBC driver on Azure VM.
SAP HANA Connector – Incremental Copy
20
C1 C2 … LastModifiedDate
… … … …
… … … 2019/03/18
… … … 2019/03/18
… … … ……
… … … 2019/03/18
… … … 2019/03/19
… … … 2019/03/19
… … … …
… … … 2019/03/19
… … … …
Pattern I: “my data has timestamp column e.g. last modified time”
Solution: tumbling window trigger + dynamic query with system variables. Get started via Copy Data Tool.
Example: scheduled daily incremental copy starting at midnight
SELECT * FROM MyTable
WHERE LastModifiedDate >= @{formatDateTime(pipeline().parameters.windowStartTime, 'yyyy/MM/dd’)
AND LastModifiedDate < @{formatDateTime(pipeline().parameters.windowEndTime, 'yyyy/MM/dd’)
Execution start time: 2019/03/19 00:00:00 (window end time)
Delta extraction: last modified time between 2019/03/18 – 2019/03/19
Execution start time: 2019/03/20 00:00:00 (window end time)
Delta extraction: last modified time between 2019/03/19 – 2019/03/20
SAP HANA Connector – Incremental Copy
21
Pattern II: “my data has an incremental column e.g. ID”
Solution: control table/file + high watermark. Get started via solution template.
Workflow Pipeline
Use Case: Cloud Analytics with SAP Data(one of the largest NGO)
22
DATA SOURCES INGEST & STORE TRANSFORM MODEL & SERVE REPORTING
ADLS Gen2
SQL DW
Azure
Analytics
ServiceAzure
Function
File
APIs
Power BI
Excel
Azure Data Factory orchestrates and operationalizes data pipeline workflow
Power BI Integration
Daniel Andrés del Castillo-Olivares
myCloudDoor Cloud Analytics Manager
© Microsoft Corporation
February 2020
*Gartner “Magic Quadrant for Analytics and Business Intelligence Platforms,” by Cindi Howson, James Richardson, Rita Sallam, Austin Kronz, 11 February 2020
The above graphics were published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from Microsoft. Gartner does not endorse any
vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research
organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. GARTNER is a registered trademark and service mark of Gartner, Inc. and/or its affiliates in the U.S. and internationally and is used herein with permission. All rights reserved.
Power BI family
25
Power BI Pro Power BI PremiumPower BI Desktop
Transforming with dataThe Business Analyst role
26
Power BI GovernanceDelivery Approach
27
Power BI ArchitectureBlended Approach
28
Power BI Connector to SAP HANA and BW
29
SAP HANA (Use SAP HANA in Power BI Desktop)
Calcutation views
SAP BW (Use the SAP BW Connector in Power BI Desktop)
BW cubesBEx queriesAdvanced DataStore Objects (ADSO)
SAP HANA (Data sources in Power BI Desktop)
Odata Services
DemoPower BI – SAP Integration
Wirksamkeitثقة
Команда
Initiative
ΣύνδεσηDigital
Vizyon
vrijednostiqualità
コミットメント
Transformação
Koneksi
samewerking
Responsability
behendigheid
Online
Diversitéprojekt
UX
Objetivos
Information Résultats
Strategien
环境
comunicazione
ثقافة
мотивация
collegamento
Optimisation
Cloud
Thank [email protected]