data management and analytics update - sas groups/sunz...rdbms ingestion •data prep...

28
Copyright © SAS Institute Inc. All rights reserved. Data Management and Analytics update Wessel de Meyer

Upload: vumien

Post on 01-Apr-2018

231 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Data Management and Analytics updateWessel de Meyer

Page 2: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Extracting Business Value from the data

Page 3: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Data Management

Page 4: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

The challenge to Timely business insight

BUSINESS PROBLEM

BUSINESS DECISION

20%80%Preparing to

solve the problemSolving

the problem

Page 5: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS Data Management – A Unified Data Platform

MQ

XML

Cloud

CONSUMERS

SOURCES

DATA INTEGRATION

DATA ACCESS

EVENT STREAM PROCESSING

DATA VIRTUALIZATION

DATA QUALITY

MASTER DATA MGMT

SAS® DATA MANAGEMENT

DATA GOVERNANCE

RDBMS

Ingestion • Data Prep • Self-Service • Hadoop • Right-Time DI • New Data • Integrated Platform

Page 6: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Hadoop Ecosystem

Page 7: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS Data Loader for Hadoop

Simple UI designed for Self-Service Data

Preparation

Market-Leading Data Integration and Data

Quality

Purpose-Built to run in parallel on Hadoop

Load Data In-Memory for Visualisation and

Advanced Analytics

Page 8: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

20%80%Preparing to

solve the problem

Solving the

problem

BUSINESS

PROBLEM

BUSINESS

DECISIONPreparing to

solve the problem

Solving the

problemInnovate

30%20% 50%

Changing the Equation

Page 9: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

A New Data Management Paradigm

ActivatedData

Automated

Cross-OrganizationAlways-On

Ad Hoc Data

Data Scientist or Analyst

IndividualSelf-Service

in-SAS/CAS · in-Hadoop · in-Memory · in-Database · in-Cloud · in-Stream

Code Generation, Optimization, Process Distribution, & Monitoring

Governance

Governed Data

DataStewards

Cross-DepartmentAdministered Use

Monitored Data

IT Staff

Cross-TeamMeasured Use

Managed Data

ETL Developeror Coder

Team/DepartmentRepeated Use

in-SAS/CAS · in-Hadoop · in-Memory · in-Database · in-Cloud · in-Stream

Code Generation, Optimization, Process Distribution, & Monitoring

Governance

Page 10: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Planned offerings – SAS Viya

Proposed Target Dates (SAS Viya Schedule Dependent) 2017 2018 2018 2018+

SAS Viya Offering“Data Preparation” “Data Discovery” “Data Integration” “Data Management”

Capabilities

Foundation (data prep, data access/load/merge, projects)

Data Quality (DQ, profile, enrichment, more)

Intelligence (suggestions, data discovery, more)

Stewardship (workflow, remediation, biz terms, more)

Integration (process flow design, transforms, more)

Enterprise (MDM, reporting, policies, more)

Page 11: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 12: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Analytics

Page 13: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS® Viya Design Principles for Analytics Product Suite

IntegratedDiscovery &

AnalyticsModernOpen & Scalable

Architecture

InteractiveVisual &

Collaborative ConnectedOutput predictions

& Operationalize

Models

Page 14: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS® Viya™ Based Product offerings

Interfaces

SAS Studio

SAS Visual Analytics

Visualapproach

Programmaticapproach

SAS Visual Analytics

SAS Visual Statistics

SAS Visual Data Mining and

Machine Learning

CAS actions, PROCS related to VA capabilities

Visual Analytics (VA) Interface

CAS actions, PROCS related to VS capabilities

Visual Statistics (VS) add-on to VA Interface

CAS actions, PROCS related to VDMML

capabilities

Visual Data Mining and Machine Learning

(VDMML) add-on to VA Interface

Page 15: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS Visual Analytics

Page 16: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS® Visual Analytics Roadmap

SAS 9 SAS VIYA

Page 17: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Visual Analytics 8.1 Key Themes

Usability

Single HTML5 Interface

Change Visualization Type

Undo/Redo with History

Auto Controls

Self-Service Data Prep

Data Profiling

Column Transformations

Color Coded Visual Joining

CAS Action Oriented

Interface Diversity

Coding via SAS Studio, Python, Lua

or Java

Browser Support: Chrome, Firefox,

Safari, IE

Custom Applications via

REST API

Mobile Access (iOS, Android &

Windows)

Enterprise Readiness

Self Healing

New Data Types

Effective Memory Management

Enhanced Cloud Support

Page 18: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

VA 8.1 Demo – 2-3 minutes

Page 19: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS Visual Statistics

Page 20: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 21: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS® Visual Statistics 8.1Key Features

• Modeling Techniques • Linear Regression

• Logistic Regression

• GLM Regression

• Clustering (k-means)

• Decision Tree

• Common Features• Training-validation partitioning

• Variable Importance / Profile

• Model Assessment

• Score Code

• Model comparison

• Derivation of predictive outputs

• Ability to export model statistics into Excel

Page 22: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS Visual Data Mining and Machine Learning

Page 23: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS® Visual Data Mining and Machine Learning 8.1New Machine Learning Visualizations in Visual Analytics

• Machine Learning Techniques• Factorization Machine

• Random Forest

• Gradient Boosting

• Neural Network

• Support Vector Machine

• Common Features• Training-validation

• Auto-tuning

• Model Assessment

• Score Code or Analytic Store

• Model comparison

• Ability to export model statistics into Excel

Page 24: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

• Logistic Regression• Linear Regression• Generalized Linear Models • Nonlinear Regression • Ordinary Least Squares Regression • Decision Trees• Partial Least Squares Regression• Quantile Regression• K-means and K-modes Clustering• Principal Component Analysis • Random Forest• Gradient Boosting• Neural Networks• Support Vector Machines• Factorization Machines• Network Analytics/Community Detection• Text Mining• Boolean Rules• Auto-tuned Hyper-parameters

Data

DeploymentDiscovery

• Assess Supervised Models• Analytic Item Store

• In-Memory Data Step• Transpose• DS2• SQL• Variable Binning • Variable Cardinality Analysis• Sampling and Partitioning• Missing Value Imputation• Variable Selection

SAS VISUAL DATA MINING AND MACHINE LEARNING

Key:

• Visual Statistics• Visual Data Mining Machine Learning

Page 25: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

SAS® Studio Programmatic Interface

Page 26: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Future Roadmap - Viya

H1 2017 H2 2017 2018SAS Viya 3.2

• SAS Visual Analytics 8.1• SAS Visual Statistics 8.1• SAS Visual Data Mining & Machine Learning 8.1• SAS Visual Forecasting• SAS Econometrics• SAS Optimisation• SAS Visual Investigator 10.2• SAS Visual Scenario Designer 10.2• SAS Event Stream Processing• In-Database Technologies• SAS Studio

SAS Viya 3.3

• SAS Data Preparation(new)• SAS Data Quality• SAS Visual Analytics 8.2• SAS Visual Statistics 8.2• SAS Visual Data Mining & Machine Learning 8.2• SAS Office Analytics• SAS Visual Forecasting• SAS Econometrics• SAS Optimisation• SAS Visual Text Analytics (new)• SAS Model Manager• SAS Visual Investigator 10.3• SAS Visual Scenario Designer 10.3• SAS Event Stream Processing• In-Database Technologies• SAS Studio

SAS Viya 3.4

• SAS Data Preparation• SAS Data Quality• SAS Data Discovery(new)• SAS Data Integration• SAS Visual Analytics 8.3• SAS Visual Statistics 8.3• SAS Visual Data Mining & Machine Learning 8.3• SAS Office Analytics• SAS Visual Forecasting• SAS Econometrics• SAS Optimisation• SAS Visual Text Analytics• SAS Model Manager• SAS Visual Investigator 10.4• SAS Visual Scenario Designer 10.4• SAS Event Stream Processing• In-Database Technologies• SAS Studio

Page 27: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Page 28: Data Management and Analytics update - SAS Groups/sunz...RDBMS Ingestion •Data Prep •Self-Service •Hadoop •Right-Time DI •New Data ... • Model comparison ... • SAS Visual

sas.com

Copyright © SAS Inst itute Inc. A l l r ights reserved.

Thank You