wall street technology

36
Informix Bells Wall Street! (Capital Markets) Bharat Gera Session Z99 Michael Pintus IBM Tuesday/24/Time

Upload: bharat-gera

Post on 11-Jul-2015

157 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Wall Street Technology

Informix Bells Wall Street! (Capital Markets)

Bharat Gera Session Z99

Michael Pintus

IBM Tuesday/24/Time

Page 2: Wall Street Technology

Agenda

• Requirements of Capital Markets, Industry Trends

• Informix Technology for Capital Markets

• Financial Market Case Study

• Q&A

6/1/2012 Informix Bells Wall Street - Session Z99 2

Page 3: Wall Street Technology

Requirements of Capital Markets,Industry Trends…

Emerging Technology Themes• Regulation, and then some more regulation

– BASEL II, III, Dodd-Frank, Fraud detection…

• Risk elevated to top of heap– Near real-time impact of global events– Risk as pre-trade input – Enterprise-wide or “Horizontal” Risk

views

6/1/2012 Informix Bells Wall Street- Session Z99 3

Large Scale Data Management Data warehousing Business Intelligence Reporting

Extreme Performance In-memory data grids Real-Time compute

infrastructure

Page 4: Wall Street Technology

6/1/2012 4

Requirements of Capital Markets, Industry Trends…

Emerging Technology Themes• Data is growing insanely

– Needs to be cleansed, manipulated, aggregated, analyzed, stored

– Market data is multiple Million messages/sec

– Unstructured data growing (market sentiment)

• Electronic trading is becoming the norm– 60% of US and 40% of European trading is

Electronic. Rapid growth in APAC

6/1/2012 4

Large Scale Data Management Data warehousing Big Data positioning

Extreme Performance High speed, scalable Warehouse Accelerator

Extreme Performance Deterministic

execution Complex event

processing High speed networks

Informix Bells Wall Street- Session Z99

Page 5: Wall Street Technology

6/1/2012 Informix Bells Wall Street - Session Z99 56/1/2012 5

Requirements of Capital Markets,Industry Trends ...

Emerging Technology Themes

• Banks need new customers and new sources of revenue

– M&A, customer segmentation, mobility

– Real-time view of profitability, product performance

• Reduce operating costs, while improving business agility

– Standardization, Scalability, Elasticity, On Demand

6/1/2012 5

Analytic Support SPSS, Cognos

Integrations

Standardized Infrastructure Automated

provisioning Management

Virtualized network, compute and storage

Page 6: Wall Street Technology

6/1/2012 Informix Bells Wall Street - Session Z99 66/1/2012 6

• Big Board’s (NYSE) Market Capitalization: ~14 Trillion $

• Average Daily Trading: ~150 Billion $

• Millions of Equity Ticks (Time Series Data Point) flow out per day with ExponentialData storage requirements

• Microseconds are the difference between winning and losing in the global financial markets, and access to the lowest latency data is imperative

6/1/2012 6

High Frequency Global Market Equities

Time Series Data

Page 7: Wall Street Technology

Capital Markets Application AreasCharacteristics and Technologies

6/1/2012Informix Bells Wall Street - Session Z99

7

Electronic Trading(Front Office)

Pre-Trade Analytics(Middle Office)

Data Management

(Back & Middle Office)

Characteristics • Low latency messaging

• Real-time eventprocessing

• Single-thread executionperformance

• High performance computation

with high performance IO forshared file systems

• Horizontal scale compute andvertical scale database.

• Reference and trade data

integration and transformationacross asset classes and

trading systems

• Transactional and data

warehouse functions providing

Technologies • Single thread

performance servers

• Optimized executionplatform

• High performancenetworking and TCP/IP

Stack

• In-memory data grids

• SMP systems for database

• Data warehousing for analytics

• Single thread performanceservers for risk and pricing

computations

• High speed Flash or directattach storage for Tick

databases

• High performance networking

• Distributed data grids andcaches

• SMP systems for database

• High-Availability datareplication

• Mixed workload databases

• High throughput messageoriented middleware.

• Horizontal scale Common Technology Themes:

Large Scale Data Management, Extreme Performance the “glue” for the entiresystem

Page 8: Wall Street Technology

Informix Technology for Capital Markets

6/1/2012 Informix Bells Wall Street - Session Z99 8

Page 9: Wall Street Technology

Comprehensive Technology Stack

6/1/2012 Informix Bells Wall Street - Session Z99 9

Informix Business Intelligence Integrations

TimesTen

Informix Flexible Grid

Informix Warehouse &Accelerator

Informix Time Series

Informix 11.70

Informix Genero

• Informix Business Intelligence Integrations– Comprehensive BI and Analytic Integrations

with IBM Cognos and SPSS

• Informix Flexible Grid– Highly Scalable, distributed data access and

flexible deployment

• Informix Genero– Modernized Application Development Stack

• Informix Warehouse Accelerator– Extreme Performance delivered for warehouse

queries: Acceleration up to 100X

• Informix Time Series– Informix Time Series delivers exceptional

performance and storage savings

• Informix 1170– Informix Panther release for Data Management

Page 10: Wall Street Technology

6/1/2012 Template Presentation - Session Z99 10

Large Scale Data Management

Informix in IBM Big Data Platform

InfoSphere BigInsights Hadoop-based low latency

analytics for variety and volume

IBM Netezza High

Capacity ApplianceQueryable Archive

Structured Data

IBM Netezza 1000BI+Ad Hoc

Analytics on Structured Data

IBM Smart Analytics

SystemOperational Analytics on

Structured Data

IBM Informix TimeseriesTime-structured analytics

IBM InfoSphere

WarehouseLarge volume structured

data analytics

InfoSphere StreamsLow Latency Analytics for

streaming data

MPP Data Warehouse

Stream ComputingInformation Integration

Hadoop

InfoSphere Information

ServerHigh volume data integration

and transformation

Page 11: Wall Street Technology

6/1/2012 Template Presentation - Session Z99 1111

Informix Time Series Solution Knocks Out Competition

• Informix Time Series delivers exceptional performance and storage savings– 25-70 times faster than the competition– 66% less storage required

• Handles all aspects of in one product - compliance, billing, customer portal, analytics, etc...

– Combine relational data with time series data in the same SQL query

Based on actual benchmark test run for a large US company

Re

lati

on

al

Sto

rage

Dis

k St

ora

ge R

eq

uir

em

en

t

Competitor

Data

(TimeSeries)

Tim

ese

rie

s

Dat

a ty

pe

Sto

rage

IBM-InformixData Storage Comparison for 1 million meters

Competition

Pro

cess

ing

Tim

e (

In H

ou

rs)

Data Loading ReportsPerformance Comparison for Data Loads and Reports for 1 Million Meters

IBM Informix

INFORMIX Other DB

Time to Load - 1,000,000 Data Points 18 Minutes 7 Hours

Reports Seconds to 11 min 2-7 HOURS

Storage Requirements - 1,000,000 Data Points 350GB 1.3 TB

Page 12: Wall Street Technology

6/1/2012 Informix Bells Wall Street - Session Z99 12

Client connectivity and

application development

Informix

database server

ClientApplication

ClientApplication

Data loading

IBM Data Studio

Informix TimeSeries Plug-in for Data Studio

Administration

IBM OpenAdmin Tool for InformixInformix TimeSeries Plug-in for OAT

TimeSeriesTimeSeriesTimeSeries

TimeSeries

data typesSQL routinesAPI routines

Java classes

Informix Time Series Architecture

Page 13: Wall Street Technology

6/1/2012 Informix Bells Wall Street - Session Z99 1313

Maximize Storage with Deep Compression

• Best in industry

• Minimize storage costs

• Improve performance

• Reduce energy consumption

• Easy to implement

• Customers achieving 70% storage savings

"With millions of financial transactions each day, we rely on IBM Informix to deliver high speed and reliability. With the compression capabilities, we can gain even greater value by reducing our storage requirements by 50%.”

- IT Manager, Large Financial Services Company

81

% Sm

aller

78

% Sm

aller

Sales Table Product Table

Page 14: Wall Street Technology

6/1/2012 Informix Bells Wall Street - Session Z99 14

Introducing Informix Flexible Grid

Redistribute work locally, regionally,

globally

An easy to manage Grid of Informix Servers for High-Availability, Scalability & Workload Balance

Six 9’s of availability –

zero downtime for planned

maintenance

Administer the grid

as if it were a single server

Mix hardware and versions

of OS and Informix

Page 15: Wall Street Technology

Optimize your Availability Always On” Availability with Informix

6/1/2012 Informix Bells Wall Street - Session Z99 1515

Business Continuity Demands:

24 x 7 availability

Downtime = Lost Revenue

Customizable disaster recovery plan

Multiple global backup locations

Worldwide application availability

Global marketplace

$6,450,000/hour is $107,500/minute!

Tim

e Is

Mo

ney

How do I minimize planned/unplanned outages?

If my data is

available ...

Then in 1 year it is

unavailable …

99% 3.6 days

99.9% 8.7 hours

99.99% 52 minutes

99.999% 5.2 minutes

99.9999% 30 seconds

Page 16: Wall Street Technology

Informix Flexible Grid offers measurable cost savings

6/1/2012 Informix Bells Wall Street - Session Z99 16

Scale globally

Manage easily

Balance workloads

Save DBA time

Re-use current hardware

Avoid platform lock-in

Ideal for the Cloud

Page 17: Wall Street Technology

Usage Example - Expanding Beyond a Single Cluster

6/1/2012 Informix Bells Wall Street - Session Z99 1717

Connection Manager for grid

Connection Manager for Cluster

Connection Manager for Cluster

AIX Linux

Flexible Grid

Secondary

HP

Secondary

Windows

Initially one cluster is neededBusiness grows and a new cluster in a new city is needed –new hardware is used

Business grows again and more servers are added

New applications are created that require data from both sites so a grid is created

Secondary

Page 18: Wall Street Technology

Flexible Grid - Simple Setup

6/1/2012 Informix Bells Wall Street - Session Z99 18

18

• Install Informix on your server machines

– Servers may have secondary servers attached such as HDR, RSS, or SDS servers

– Hardware can be from various vendors

• Define a grid to contain your servers:

– Just give your grid a name and tell it the list of servers to use

– You can either use the Open Admin Tool graphical interface or a command line tool to define your grid

– Configure whether you want to replicate just schema changes or schema and data changes

• The grid is ready to use!

Spread your Workload Across different Hardware, Operating systems, and versions of Informix

AIX Linux

Flexible Grid

Secondary

Solaris

Secondary

Windows

Page 19: Wall Street Technology

Informix Flexible Grid is easy to manage

6/1/2012 Informix Bells Wall Street - Session Z99 1919

Easy to Manage

– Manage ANYTHING from ANYWHERE with a single ‘click’

– Set-up takes minutes not days or weeks

– Propagate changes to all servers on the Grid

Reliable

– Continuous availability

– Automated failover

– Automatic storage provisioning on the grid

Hassle

Page 20: Wall Street Technology

New Cluster Replication Features

6/1/2012 Informix Bells Wall Street - Session Z99 2020

• Rolling Upgrade Support• No down time needed to upgrade to 11.70 and beyond

• Support for ER replication of tables without primary keys

• Support DDL changes across ER replicate set and HDR/RSS/SDS servers

• Snapshot clone of an existing server• Resulting server can be an RSS server or ER server

• Transactions on secondaries continue to completion when primary fails over

• Backup to the cloud• Support for ontape to backup/restore to/from a cloud storage manager

Page 21: Wall Street Technology

Informix 11.7 - A Single Platform for OLTP & Data Warehousing

6/1/2012 Informix Bells Wall Street - Session Z99 21

Graphic ETL designer

included in Growth and Ultimate

Editions

Informix for Data Warehousingand Business Intelligence

Integrates XPS warehouse capabilities for

up to 10x fasteranalytic queries

Integrates with IBM Cognos BI, Mashup Center, Data Quant, and

SPSS

On demand scale out for Analytic & OLTP workloads

Page 22: Wall Street Technology

Informix Ultimate Warehouse Edition

6/1/2012 Informix Bells Wall Street - Session Z99 2222

What it is What it does

Benefits

• Informix edition for warehouse

• Packaged as:• Informix Ultimate Edition

• Informix Warehouse

Accelerator (IWA)*

• Compression (Informix)

• Compresses and processes data

mart entirely in memory

•Uses a deep columnar approach for

optimizing performance

•Runs as an add-on to Informix

• Order of magnitude or more

performance gains

• Transparent to BI apps – queries

continue to run against Informix

•No maintenance

•Manage warehouse on Informix

*Informix Warehouse Accelerator requires a Linux Intel system as it is relies on optimizations in that environment

Page 23: Wall Street Technology

Extreme Performance

Informix Warehouse Accelerator

• Informix Warehouse Accelerator

– Accelerates warehouse queries up to 100X

• Leverages deep columnar approach

– On-demand scale-out for Analytic & OLTP workloads

– Lowers data warehouse costs

• No change to business apps

• No database tuning requirements

6/1/2012 Informix Bells Wall Street - Session Z99 23

Page 24: Wall Street Technology

Informix Warehouse Accelerator –Breakthrough Technology for Performance

6/1/2012 Template Presentation - Session Z99 24

1

2

34

5

6

7 1

2

34

5

6

7

Row & Columnar DatabaseRow format within IDS for transactional workloads and columnar data access via accelerator for OLAP queries.

Extreme Compression3 to 1 compression ratio

Massive ParallelismAll cores are used for each query

Predicate evaluation on compressed data

Often scans w/o decompression during evaluation

Frequency PartitioningEnabler for the effective parallel access of the compressed data for scanning. Horizontal and

Vertical Partition Elimination.

In Memory Database3rd generation database technology avoids

I/O. Compression allows huge databases to be completely memory resident

Multi-core and Vector Optimized Algorithms

Avoiding locking or Synchronisation

Comes with Smart Analytics Studio, a GUI tool, for configuring data mart with IWA

Page 25: Wall Street Technology

6/1/2012 Informix Bells Wall Street - Session Z99 2525

Take “No” for an answer!

NO

Application changes

Index maintenance

Storage allocation/data

partitioning

Statistics maintenance

Cube maintenance or

summary tables

New order of Performance!

10s to 100s of times

faster

Predictable response times

No maintenance!!Zero

administration!!

Page 26: Wall Street Technology

Informix Genero: New Generation of Modernized Apps

6/1/2012 Informix Bells Wall Street - Session Z99 2626

• Deploy apps faster with easy, graphical tools

• Deploy in browser-based, GUI, Windows or mobile and cloud environments

– Lower Development Costs

• Improve Developer Productivity

• Develop Apps 5 to 10 times faster

– Modernize existing 4GL Apps

Desktop, Web & Mobile

Page 27: Wall Street Technology

Informix Genero – The Fastest Path To…

6/1/2012 Informix Bells Wall Street - Session Z99 2727

the iPhone or iPad

27

Linux

Web 2.0Cloud

Page 28: Wall Street Technology

Packaging

6/1/2012 Informix Bells Wall Street - Session Z99 282828

Informix Genero Developer Suite Informix Genero Runtime Suite

Genero BDL with Web Services

Genero Application Server

Genero Studio (server and client)

Genero Desktop Client (Linux and Windows)

Genero Report Designer

Informix Client SDK 3.50

Genero BDL with Web Services (runtime)

Genero Application Server

Genero Desktop Client (Linux and Windows)

Genero Report Engine, Designer and Viewer

Informix Connect 3.50

Page 29: Wall Street Technology

Financial Market Case Study

6/1/2012 Informix Bells Wall Street - Session Z99 29

Page 30: Wall Street Technology

Informix in the Financial Market

6/1/2012 Informix Bells Wall Street - Session Z99 30

A Large Financial Solutions Software Company

Deploys the leading suite of Financial Solutions designed anddeveloped to leverage the power and advanced functionality ofInformix RDBMS

Page 31: Wall Street Technology

A Large Financial Solutions Software Company

– Powered By IBM

6/1/2012 Informix Bells Wall Street - Session Z99 31

Discover Informix

Page 32: Wall Street Technology

A Scalable Solution Architecture

6/1/2012 Informix Bells Wall Street - Session Z99 32

Page 33: Wall Street Technology

An IBM Validated Scalable

Architecture

6/1/2012 Template Presentation - Session Z99 33

Discover Informix

Page 34: Wall Street Technology

IKey Technical Highlights

6/1/2012 Informix Bells Wall Street - Session Z99 34

Informix embedded as part of the application

Customer deployments require minimal / no DBA support

Automatic schema upgrades when upgrading applications

Designed to be a financial engine with Informix Backend

Integration via Web API or native database access are fully supported

Software Development Differentiator – IBM Informix Genero

Page 35: Wall Street Technology

Case Studies (APAC)

6/1/2012 Informix Bells Wall Street - Session Z99 35

Large Revenue Board

54 Tax offices, 500+ users

Implemented for internal financialmanagement and payment processing for tax refunds

Application Developed in Genero

Auction House

Informix based Financial Engine fully integrated within

Internationally recognized level 1 global auction

Page 36: Wall Street Technology

Questions?!?

6/1/2012 Informix Bells Wall Street - Session Z99 36