changing business with information

© 2010 IBM Corporation

Changing Business with Information

September 16, 2010

Business Analytics on System zBusiness Analytics on System z

© 2010 IBM Corporation2

Agenda

The Changing Environment and Requirements

The System z Solution Foundation

IBM Smart Analytics System 9600

IBM Smart Analytics Optimizer

Getting Started


The world is changing and becoming more…

The resulting explosion of information

creates a need for a new kind of intelligence

… to help build a Smarter Planet

Instrumented

Interconnected

Intelligent

3


Imagine If Your Decision Makers Could…

Physician Telco Loyalty Manager

Supply Chain Manager

Retail Sales Manager

…predict and treat high-risk patients to proactively intervene

at time of visit?

…apply inferred social relationships of

customers to prevent churn?

…identify inventory levels and order

demands at time of order?

…determine which discounts will drive additional sales if offered at time of

sale?

…optimize every transaction, process and decision at the point of impact, based on the current situation,

without requiring that everyone be an analytical expert


Business Requirements Have Changed… and again require highest Quality of Service

According to Gartner:– Fewer than 15% of data warehouses in 2007 have been

designed to provide high availability, failover, disaster recovery and the remaining components of mission-critical systems.

– The mixed workload performance will become the single most important performance issue in Data Warehousing

– Over 60% of current data warehouses fail when attempting to deliver in-line operational BI and Analytics

• Resulting in lost revenue or increased costs.

System z is again at the forefront– Proven reliability and continuous availability capabilities

– Industry leading availability and workload management capabilities

– Exploiting synergic effects of proximity to the operational data

– Leveraging your investments in the platform


Getting To The Answers Is Not Always EasyThe Pressure is On!

No way I can deploy a new system by next quarter!

What is our consolidated revenue?, I keep getting different answers…

One solution, five vendors, ten support numbers, ..we might as well be system integrators.

Revenue & profits are down,….. only thing that is up is my quota.

Whatever I spend to solve today's problem must be relevant to solve tomorrows as well.

Even if I had the applications I do not trust my information.

No way my infrastructure can support these new requirements.

6


What Clients are Telling Us

• We Need a Single System to Deliver Our Analytics Needs

Simplified planning, purchase, deployment, maintenance, and growth

Designed for Enterprise class analytics and performance

Pay as you grow Modular-based Deployment

• We Need Faster Time To Value

Pre-Built for Rapid Deployment

Pre-tested and Configured to your requirement

Out of the Box Performance

Minimized risk through standards and proven best practices

With Reduced Cost Of Ownership

Reduced integration costs Less Storage, Server and floor

Space required Reduced Labor Reduced Energy Consumption Improved system management Flexibly add user and data capacity

to meet growth requirements

And Greater Access to Information and Analytics

Pre-Configured Business Intelligence Modules with flexibility of functionality and style of delivery

Optimized and integrated OLAP capability gives you performance at the speed of thought

We Need …………………….

7

© 2010 IBM Corporation8 8

IBM System z…the platform for the future

"you cannot think seriously about your longer-term IT architecture without thinking equally seriously about what today's mainframe

environment has to offer“

CIO Magazine: Mainframe computing is set for a rebirth – September 29, 2009


The System z Solution Foundation


WarehouseWarehouse

Present

Acquire

ETLETLData QualityData Quality ELTELT

ReplicationReplicationEAIEAIEIIEII

Data Warehouse/BI Basics - Four stages between Data and Information

Store

CubingCubing

Operational Source SystemsStructured/ Unstructured Data

Operational Applications

Transform/Optimize

IBM SPSS Decision

Management


The IBM Data Warehouse Solution on System z Foundation

z/OS LPAREnterprise Data Warehouse

z/OS LPAREnterprise Data Warehouse

z/OS LPAROperational System (OLTP)

z/OS LPAROperational System (OLTP)

DB2 for z/OSDB2 for z/OS DB2 for z/OS VUEDB2 for z/OS VUE

ELTELT

Solution Edition for Enterprise LinuxSolution Edition for Enterprise Linux

Solution Edition for zDWSolution Edition for zDW

z/ OS

Data Sharing Group

LINUX ON SYSTEM Z – or z/VM LPARLINUX ON SYSTEM Z – or z/VM LPAR

InfoSphere Information

Server

InfoSphere Warehouse

Cognos BI Server

Lin

ux

Consolidation of mission-critical data on System z

Ability to leverage existing environment, high availability, backup and governance procedures as well as skills

Efficient data movement between LPARs and DB2 Subsystems

Performance and TCO improvements through cubing services (data marts) and DB2 enhancements

Complex transformations and data quality driven from Linux on System z with Information Server

Low Latency movement of data with Replication Server

InfoSphere Replication Server


12

The IBM Solution: IBM Information ServerDelivering information you can trust

Understand

Cleanse Transform Deliver

Parallel ProcessingRich Connectivity to Applications, Data, and

Content

IBM Information Server

Discover, model, and govern information

structure and content

Standardize, merge,and correct information

Combine and restructure

information for new uses

Synchronize, virtualize and move information for in-

line delivery

Unified Deployment

Unified Metadata Management


13

InfoSphere Warehouse on System z Provides a highly scalable, resilient, lower cost way to design, populate and optimize a

DB2 for z/OS Data Warehouse

Adds core data warehouse and analytics capability to DB2 for z/OS– Advanced physical database modeling and design– In-database data movement and manipulation capabilities of SQL Warehouse Tool (SQW)– Optimize multidimensional reporting and analysis of data with Cubing Service

13

Cognos

Excel

OLTP DB2 DWH DB2

SQW

MDX Queries

Cubing Services


14

IBM InfoSphere Warehouse Cubing Services

InfosphereWarehouse

Warehouse Modeling

Cubing Services

IBM Business Analytics

Large enterprise IT deploymentsPrimary OLAP Use:

Ideal for:

• Very large data sets with very large dimensions

• Enterprise rollouts requiring near real time data

For IT departmentsFor IT departments

Operational Planning, Financial analytics, business reporting

Because of its unique:• Scalable, low latency OLAP• Standard, Open APIs• Integrated IT tooling


15

Optimized Decision Making

Message Sources

Modern and Legacy Sources

Application Sources

OLAP Sources

Relational Sources

Easy access to a consistent, trusted and relevant view of information where, when and how it is needed

Intuitive and tightly integrated capabilities accommodate decision makers with different needs and skill sets

Common Business Model

Cognos


16

Measure and Monitor to See “How” You’re DoingDashboards

• Provide at-a-glance, high impact views of complex information

• Help quick focus on issues that need attention and action

• Combine information across disparate sources

• Benefit from range of highly visual personalized, managed, or self-assembled dashboards

• Gain personalized views of operations with continuous monitoring

H

Real-time Monitor Business Operations• Continuously monitor and alert when

exceptions occur to take immediate action

• Detect events, anomalies and trends in data streams flowing through transactional and messaging systems

• Aggregate data streams across multiple transactional systems and data sources

• Enable self-service with user-defined dashboards, operational KPIs, and alerts

• Address full operational decision cycle from detection to action

MonitorMonitorMonitorMonitorAlertAlertAlertAlert

AnalyzeAnalyzeAnalyzeAnalyzeRespondRespondRespondRespond

Cognos


17

Start to Understand the “Why” Behind Business Performance

Reporting

• Address full breadth of report needs (personalized, transactional, management, statutory, production…)

• Deliver consistent information across all types of output

• Personalize and target to each department/individual without having to re-author

• Re-use queries, analyses, express author reports in business and collaborate on design with IT

• Easy access to data lineage, definitions of terms, and annotations

Ad-hoc Query

• Intuitive, self-service reporting

• Access to all data; drag and drop query creation

• Easy sorting and filtering

• Corporate templates for consistency

• Share ad-hoc or promote for professional distribution

J


Miami Dade County Success Story – Why Leverage Cognos 8 BI for Linux on System z

Requirements:

Demand for BI has really taken off– New regulatory reporting requirements– Every new system, every new solution, every

new application is having a business intelligence component

Multiple Cognos 8 BI deployments - 6+

Wanted an enterprise BI standardized solution, but

– Needed higher capacity – grow from approx 400 to 1000 users

– Do more with less - less researchers, less software, less hardware, same staff

– Had available IFL’s on System z

Results:

11 days to move from distributed to System z deployment model for Cognos 8 BI

– Quickly and easily meet new requirements

Consolidate multiple BI deployments on to a single platform

Single point for BI administration

Consolidate multiple disparate data sources

Ensure 99.999% availability

Offer a complete disaster recovery plan

Additional green savings

Objective: Using System z to standardize on a single BI solution


IBM Smart Analytics System Offerings Deliver Analytics Value Across PlatformsFaster Time to Value, Faster Business Results

Meeting clients where their information is…

7600Based Power System

9600Based on System z

5600Based System x

20

Consistent value, Right fitted to your needs



What’s new:

– Delivers a complete end-to-end software, hardware, and services solution for deploying business analytics on System z at a compelling price point.

Features / Business Value:

– Provides unprecedented value for an end-to-end analytics solution on System z

– Inherits the unique System z quality of service, for new business analytic workloads

– Delivers continuous availability to a centralized single view of the business to support enterprise- wide business analytics

– Features an advanced Workload Manager that can easily prioritize critical queries within a large pool of queries.

– Leverages customers existing disaster recovery, and backup processes to simplify deployment without requiring additional backup and recovery processes.

Delivers - unprecedented value in deploying new business analytics

Client Benefits:

– To deliver enterprise-wide business analytics to operational users

– Deliver business insights to the right person, at the right time, in the right context



Cubing Cubing ServicesServices

Cognos 8 BI

IBM Smart Analytics System 9600High Value Dynamic Warehousing

ELTELT


Data Data WarehouseWarehouse

System z

Implementation Services

Implementation Services

DB2 for z/OS VUE(option for MLC)

DB2 Utilities SuiteImage Copy, LOAD, UNLOAD, REORG, etc

Powercube Powercube ServicesServices


Choose A Deployment Style

Virtual Upgrade Delivery

Standalone Delivery

Server delivered in “appliance-like” fashion

Capacity delivered as a “bolt-on” to existing server(s) or as new server(s) depending on customer needs in a “virtual appliance-like” fashion


DB2 Base

Amt Usable Disk*Amt

User Data*

240TB 100TB

120TB 50TB

60TB 25TB

24TB 12TB

8TB 4TB

IBM Smart Analytics SystemPre-Set Configurations Sized to Meet Business Requirements

Data Capacity Sizing

*Usable = Disk storage delivered for compressed table data, indexes, work files, MQTs etc.

*User Data = Processing capacity delivered to support this amount of raw, uncompressed, user business data


IBM Smart Analytics SystemPre-Set Configurations Sized to Meet Business Requirements

Cognos Workload

Named Users Max Concurrent Users

10,000 100

50

525

BI Capacity Sizing

*Named User = Licensed Cognos User

*Concurrent User = Users that are doing work (consuming CPU) in the Cognos application, DB2 or both


What exactly is a “User”?

“Named User” “Active User” “Concurrent User” “DB2 ‘In-Use’ Thread User”

This is a licensed Cognos user.

This is a member of the subset of “Named Users” that are currently logged in to the Cognos application

Users that are doing work (consuming CPU) in the Cognos application, DB2 or both

Users that are actively running in DB2 (consuming CPU in DB2)

Best defined as the general user community that may or may not be using the Cognos application at any given point in time

This user community includes users that are:

– Actively doing work in the application (which may or may not also incur work in DB2)

– In “think time”– Have walked away from

their machine

The Cognos work may or may not incur work in DB2


IBM Smart Analytics System Optimizer


IBM Smart Analytics Optimizer

How is it different

Performance: Unprecedented response times to enable 'train of thought' analyses frequently blocked by poor query performance.

Integration: Connects to DB2 through deep integration providing transparency to all applications.

Self-managed workloads: queries are executed in the most efficient way

Transparency: applications connected to DB2, are entirely unaware of the accelerator

Simplified administration: appliance-like hands-free operations, eliminating many database tuning tasks

What is it? The IBM Smart Analytics Optimizer is a workload optimized, appliance-like, add-on, that enables the integration of business insights into operational processes to drive winning strategies. It accelerates select queries, with unprecedented response times.

Breakthrough Technology Enabling New Opportunities


DB2 for z/OS

Optimizer

IBM

SA

O interfa

ceQuery execution run-time for queries that cannot be or

should not be off-loaded to IBM SAO

IBM SAO

.

.

.

Co

ord

ina

tors

Application

ApplicationInterface

Queries executed with IBM SAOQueries executed without IBM SAO

Heartbeat

Heartbeat (IBM SAO availability and performance indicators)

Worker 1

Worker 2

Worker 3

Worker n-1

Worker n

IBM Smart Analytics Optimizer Query Execution Process Flow


Extreme performance for complex queries

Game Changing Performance

Rapidly delivers information to decision makers through breakthrough technologies providing dramatic performance improvement.

The best of row and columnar store technologies

Highly compressed data Compressed data operations In-memory processing Massively parallel architecture

Enables decision makers to submit queries they never dared in the past, that analyze trends, predict outcomes, and produce better business results.


Database Performance Appliance

Appliance-like, add-on device

Application transparent, install and begin reaping the benefits of higher performance

Rapidly add new applications and user requirements driving immediate value to the bottom line

No need for indices, materialized query tables (MQTs), query plans or query hints

Significantly reduces costs and enables quick time to value

Significantly reduces costs and enables quick time to value


Proven Operational Characteristics

Integrated infrastructure that is managed by System z through Hardware Management Console and firmware

Benefits of a System z workload optimized infrastructure

It broadens the System z Qualities of Service of manageability, security, availability to the business intelligence and data warehouse workloads.

It extends the established System z hardware management environment to the workload optimized platform., centralizing and simplifying the deployment and management

Creates New Opportunities for Existing Systems by Using New Technology Approaches


Comparing the Smart Analytics offerings in System z:

IBM Smart Analytics System 9600 IBM Smart Analytics Optimizer

Complete, end-to-end environment for BI workload Processes ALL queries submitted by end-users

Software:

Includes z/OS, DB2 for z/OS, Linux, InfoSphere Warehouse, Cognos, DB2 Connect

Supports:

Data movement / ETLEnd user tools (Cognos) / BI queries/reportsData Storage (Data warehouse)

Runs in z/OS-DB2 LPAR, Linux for System z LPAR for Tooling

Is an all purpose environment to deploy any BI workload

Workload optimized, appliance-like, add-on to a Data Warehouse on System z

MUST connect TO a DB2 for z/OS environment that is running a BI workloadWill enhance a Smart Analytics System 9600Software:

Includes IBM SAO software running on blades and connects to DB2 for z/OS to enable query routing to IBM SAO

Supports: (Subset of) complex and long-running BI queries with access to data in a star or snowflake schemaOrder of magnitude acceleration of a SUBSET of queries that are selected/routed to IBM SAO by DB2 for z/OS

GA June 2010 GA 4Q 2010

For acceleration of multidimensional star schema queries, use IBM Smart Analytics Optimizer as add on option

Uses Features of Accelerator


Getting Started


Websites for Additional Information:

IBM Smart Analytics System 9600 Webpage: http://www.ibm.com/software/data/infosphere/smart-analytics-system/

IBM Smart Analytics System Optimizer Webpage: http://www.ibm.com/software/data/infosphere/smart-analytics-optimizer-z/

Data Warehousing and Analyticshttp://www.ibm.com/software/data/infosphere/data-warehousing/

Data Warehousing and Business Intelligence on System z http://www.ibm.com/software/data/businessintelligence/systemz/

Terabyte Club for System z BI customershttp://www.ibm.com/software/data/businessintelligence/systemz/terabyte-club.html

Data Governance on System zhttp://www.ibm.com/software/data/db2imstools/solutions/compliance.html


Some Key Redbooks

Enterprise Data Warehousing with DB2 9 for z/OS• www.redbooks.ibm.com/abstracts/sg247637.html?Open

50 TB Data Warehouse Benchmark on IBM System z• www.redbooks.ibm.com/abstracts/sg247674.html?Open

DB2 for z/OS: Data Sharing in a Nutshell• www.redbooks.ibm.com/abstracts/sg247322.html?Open

System Programmer’s Guide To: Workload Manager• www.redbooks.ibm.com/abstracts/sg246472.html?Open

Workload Management for DB2 Data Warehouse, REDP-3927• www.redbooks.ibm.com/abstracts/redp3927.html?Open

Cognos on System z,

Data Collocation,

and InfoSphere Warehouse

also in progress!


Global Name Recognition

Global Name Recognition

WarehouseWarehouse

Cognos BI

InfoSphere Information

Server

ETLETL

Data QualityData QualityCommon Meta Data

Common Meta Data

Dynamic Warehouse The Integrated Stack for System z

InfoSphere Industry Models


CubingCubing

InfoSphere MDM Server

Information Services Director

Data Synchronization

Replication Server

Replication Server Classic Event

Publisher

Classic Event PublisherClassic

Federation

Classic FederationFederation

FederationChange Data

Capture

Change Data Capture


Operational Applications

GlobalName

Recognition

Master Master DataData

Smart Analytics Optimizer

Smart Analytics

System 9600

SPSS


Dylan MurphySystem z InfoSphere and Data

Warehousing Technical [email protected]

(914) 766-7248

changing business with information

Documents