welcome to the era of open analytics

40
Welcome to the Era of Open Analytics Sumit Sarkar, Chief Data Evangelist, Progress [email protected] | @SAsInSumit www.linkedin.com/in/meetsumit

Upload: sumit-sarkar

Post on 22-Jan-2018

191 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Welcome to the Era of Open Analytics

Welcome to the Era

of Open Analytics

Sumit Sarkar, Chief Data Evangelist, Progress

[email protected] | @SAsInSumit

www.linkedin.com/in/meetsumit

Page 2: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.2

The embedded analytics market is

estimated to nearly double to 46 billion

between 2016 and 2021Source: Markets and Markets

Page 3: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.3

The same research firm estimates the

advanced analytics market will be worth

close to 30 billion by 2019

Page 4: Welcome to the Era of Open Analytics

Infographic by DataCamp

Increasing demand for advanced analytics

Page 5: Welcome to the Era of Open Analytics

Infographic by DataCamp

Hiring Data Engineers and Data Scientists

Page 6: Welcome to the Era of Open Analytics

0

20

40

60

80

100

120

140

160

180

200

2012 2013 2014 2015 2016 2017 2018 2019 2020

Cloud Market ($B)

SaaS

BPaaS

IaaS/PaaS

Stir in some clouds

Page 7: Welcome to the Era of Open Analytics

… and a pinch of data

0

1,000

2,000

3,000

4,000

5,000

6,000

7,000

2013 2014 2015 2016 2017 2018 2019 2020 2021

IoT Data (ZettaBytes)

Page 8: Welcome to the Era of Open Analytics

Welcome to the era of Open Analytics

Page 9: Welcome to the Era of Open Analytics

But what is it?

Page 10: Welcome to the Era of Open Analytics

‘Open analytics’ is the integration of an open data access layer into business applications to be directly consumed by external analytics tools and popular programming languages.

Source: https://www.datanami.com/2017/03/29/welcome-open-analytics-era/

Page 11: Welcome to the Era of Open Analytics

Walk through an example

Page 12: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.12

Readmission Application in the Cloud with Embedded Analytics

Page 13: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.13

Need map of regions where readmission rates are higher?

Page 14: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.14

Readmission Application in the Cloud with Embedded Analytics

1. Build a predictive model for

readmission

2. Visualize the data blended with

hospital management system

3. Ingest the detailed medical

conditions and line items into Data

Lake

4. Need report delivered as PDF at

9AM every Monday to CEO staff

5. …

Page 15: Welcome to the Era of Open Analytics

Just give them the data…

Page 16: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.16

But how can Cloud Apps “give” data to every analytics framework?

“BYOA”

Page 17: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.17

State of Cloud and Analytics

Source: BI and Data Management in the Cloud: Issues and Trends:

BARC Research Study January 2017

Page 18: Welcome to the Era of Open Analytics

Open Analytics strategies deliver open interfaces for your

Cloud Apps

Page 19: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.19

Data Access Approaches for Open Analytics

ODBCStandard API for accessing

databases

Standard API for accessing

databases for Java

Industry standard

Interoperable REST API

JDBC

OData

SQL

REST

Business Analytics and Data

Management Tools and

Platforms, R, SAS, Python

Business Analytics and Data

Management Tools and Platforms,

Hadoop, Spark, R, Java

Data Visualization and Cloud

Analytics, Application

Development

FILEStandard file format and

common approachCSV Desktop Tools

Page 20: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.20

Clouds Disrupt Data Access for Analytics

SQL

REST APIs

Page 21: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.21

Data

Preparation /

IntegrationAnalytics

Database

Embedded BI

Server

Operational

Database Open Analytics

via standard

SQL, REST, CSV

2. Open Analytics

democratizes your data

for external Platforms,

Clouds and Tools

1. Embedded

Analytics delivered

in your UI

Closer Look at an Open Analytics Architecture

Page 22: Welcome to the Era of Open Analytics

Our passion for open data standards

Page 23: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.23

Progress’ Rich Heritage with Open Standards and APIs

ODBC

1.0 in 1992

3.8 in 2009

Co-founders of ODBC

JDBC

1.0 in 1997

4.2 in 2014

Key member of JDBC Expert Group

ADO.NET

1.0 in 2002

4.6 in 2015

OData

ISO/IEC standard in February 2017

First to join OData technical committee

Page 24: Welcome to the Era of Open Analytics

How to deliver Open Analytics for your cloud app?

Page 25: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.25

Open Analytics Strategies for Cloud Apps

DATABASE REPLICATIONEXPORT

DATABASE ACCESSREST API

Page 26: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.26

We’re Almost Never Solving for One Problem with Analytics

Reporting Analytics

Summarized

Data

Segmented

Data

Detail

Data

We can’t just aggregate / We can’t not aggregate

Dashboarding

Campaign

Optimization

Customer

Drill-down Attribution, CLTV,

Experience,

Personalization

Targeting

Forecasting

Page 27: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.27

REST API: OData vs Proprietary

Page 28: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.28

Database Access: Cloud Networking and Security

1. Network Based VPN

2. SSH Tunneling

3. Reverse Proxy Servers

Page 29: Welcome to the Era of Open Analytics

Who delivers advanced Open Analytics?

Page 30: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.30

Sample SaaS apps supporting ODBC, JDBC or OData

Page 31: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.31

Data Gravity increasing for Cloud Apps

Select production core database metrics for Oracle Service Cloud

Page 32: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.32

PROGRESS GLOBAL CONNECTED CRM LEADERS

Page 33: Welcome to the Era of Open Analytics

What is an open REST API?

Page 34: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.34

REST is great, BUT from an analytics and data management perspective...

It’s a style – not a standard

Limited querying capabilities

Metadata support?

Page 35: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.35

OData is an open standard REST API for your Cloud Apps

First member to join

OData Technical

Committee

An open protocol to allow the creation and

consumption of queryable and interoperable

RESTful APIs in a simple and standard way.

OASIS Standard REST API (“SQL for the web”)

• Approved for release by ISO/IEC on February, 2017

• Ratified as an OASIS standard February, 2014

• Operations built on REST principles

• Uniform URL conventions

• Surface metadata in standard way

Page 36: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.36

Standard query capabilities

Operations OData GraphQL ORDS

Filtering Yes No Yes

Ordering Yes No Yes

Aggregation No No No

Joining Yes Yes No

Paging Yes No Yes

Page 37: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.37

Surfacing Metadata

Operations OData GraphQL ORDS

Schema Metadata Yes Yes Yes

Object Metadata Yes Yes Yes

Object

Details

Data Types Yes Yes Yes

Scale/Precision Yes No No

Read/Write No No No

Unique No No No

Primary Keys Yes No Yes

Description Yes Yes Yes

Nullability Yes Yes No

Page 38: Welcome to the Era of Open Analytics

Let’s talk

Page 39: Welcome to the Era of Open Analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved.41

Visit Progress DataDirect in Expo Hall to learn more about Open Analytics and our patented Hybrid Data Gateways

www.progress.com/hybrid

Page 40: Welcome to the Era of Open Analytics