data to actionable insights with azure - trustmarque · azure data factory azure blob storage azure...

23

Upload: others

Post on 21-May-2020

38 views

Category:

Documents


0 download

TRANSCRIPT

2

@tayganr

linkedin.com/in/taygan

Taygan Rifat

taygan.co

About Me

Digital Disruption and the 4th Industrial Revolution

1780s 1870s 1970s 2015+

The scale and pace of change 2007 $100,000

2013 $700

2007 $40,000

2014 $100

2007 $550,000

2014 $20,000

2000 $2.7bn

2007 $10m

2014 $1,000

1984 $30

2014 $0.16

2009 $30,000

2014 $80

2007 $499

2015 $10

DNA

Solar

Smartphones

Drones

3D Printing

Industrial

Robots

Sensor (3D)

An astonishing pace of change is accelerating transformation.Technology is more affordable and accessible than ever before.

2

2

3

3

4

4

5

6

6

8

20

0 2 4 6 8 10 12 14 16 18 20 22

Xiaomi

Snapchat

Airbnb

CloudFlare

Uber

Average Unicorns

Tesla

Cloudera

Facebook

Google

Typical Fortune 500

years

Time to reach $1B valuation or moreSource: World Economic Forum

DATA163 zettabytes annually by 2025

ANALYTICS$200 billion global market by 2020

CLOUDCloud shift will affect more than

$1 trillion in IT spending by 2020

Driving forces behind

digital transformation

Source: Forbes, Gartner

There are barriers to getting value from data

Complexity of

solutionsPerformance

constraints

Rising costsIncongruent

data types

Data silos

Derive real value from your data

One hub for

all data

Support for diverse

types of dataUnlimited

data scale

Familiar tools

and ecosystem

Lower

TCO

On-premises, hybrid, Azure

Data to Insight

10

| |

| || |

| |

Data-to-Insight

Data-to-Insight

Doc it

Move it

Bring it

Store it

Serve it

Scale it

Stream it

Predict it

See it

Common Patterns

Ingest Store Prep & Train Model & Serve

Modern Data Warehouse

Azure Blob Storage

Logs (unstructured)

Azure Data Factory

Azure Databricks

Microsoft Azure also supports other Big Data services like Azure HDInsight and Azure Data Lake to allow customers to tailor the above architecture to meet their unique needs.

Media (unstructured)

Files (unstructured)

PolyBase

Business/custom apps

(structured)

Azure SQL Data

Warehouse

Azure Analysis

Services

Power BI

Advanced Analytics on Big Data

Ingest Store Prep & Train Model & Serve

Cosmos DB

Azure Blob StorageAzure Data Factory

PolyBase

SparkR

Apps

Azure SQL Data

Warehouse

Azure Analysis

Services

Power BI

Logs (unstructured)

Media (unstructured)

Files (unstructured)

Business/custom apps

(structured)

Azure Databricks

Microsoft Azure also supports other Big Data services like Azure HDInsight and Azure Data Lake to allow customers to tailor the above architecture to meet their unique needs.

Ingest Store Prep & Train Model & Serve

Real Time Analytics

Sensors and IoT

(unstructured)

Apache Kafka for

HDInsight

Cosmos DB

Files (unstructured)

Media (unstructured)

Logs (unstructured)

Azure Blob StorageAzure Data Factory

Azure Databricks

Real-time apps

Business/custom apps

(structured)

Azure SQL Data

Warehouse

Azure Analysis

ServicesPower BI

Microsoft Azure also supports other Big Data services like Azure IoT Hub, Azure Event Hubs, Azure Machine Learning, and Azure Data Lake to allow customers to tailor the above

architecture to meet their unique needs.

PolyBase

Demo

Bring It Stream It See It

Demo 1 - Stream

API Azure Event Hub Stream Analytics Power BI

every 10s

See ItMove It Store It Scale It Serve It

Demo 2 - ELT

Amazon S3 Azure Data Factory Azure Blob Storage Azure Databricks Azure SQL DB Power BI

© Copyright Microsoft Corporation. All rights reserved.