oracle database 11g performance innovations juan loaiza senior vice president, oracle corporation

45
Oracle Database 11g Performance Innovations Juan Loaiza Senior Vice President, Oracle Corporation

Upload: samuel-watts

Post on 28-Dec-2015

224 views

Category:

Documents


0 download

TRANSCRIPT

Oracle Database 11g Performance Innovations

Juan LoaizaSenior Vice President, Oracle Corporation

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Agenda

• High-Performance Today

• Offloading and Caching for High Performance

• High Performance with Large Data Volumes

• End-to-end Performance Architecture

<Insert Picture Here>

High Performance Today

Database Scaling

SMP Scale-Up

• Very mature– 20 years of experience

• Many customers with largest SMPs on the market – 64 to 256 CPUs– Sun M9000, HP Superdome, IBM Regatta

• Single System Image– Easy to manage– Easy to design applications

• Works great, but high cost– Eventually hits a wall

• Need at least two for availability

RAC Scale-Out

• Runs all Oracle database applications• Highly available and scalable• No Idle Resources• Single System Image• Thousands of production customers

HR ERP

Oracle Leads Performance Benchmarks

Benchmark World Record

Leadership

TPC-C Performance Oracle

TPC-C Price/Performance Oracle

TPC-H @ 1,000 GB Oracle

TPC-H @ 3,000 GB Non-Clustered Oracle

TPC-H @ 10,000GB Non-Clustered Oracle

TPC-H @ 30,000 GB Oracle

SAP Sales and Distribution Parallel Oracle

SAP Sales and Distribution 2-tier Oracle

SAP (ATO) Assemble-To-Order

2 and 3 Tier

Oracle

As of October 2, 2009: Source: www.tpc.org & www.sap.com/benchmark.SAP TRBK Standard Application Benchmark: Sun Fire E6900 DB Server (8 1.5 GHz US-IV+ processors, 16 cores, 16 threads, 56 GB memory): 10,012,000 Day posts/hr, 6,664,000 Night bal accs/hr, Solaris 10, Oracle 10g, SAP Account Management 3.0 (64-bit) Cert #2006018.The two-tier SAP Business Information Warehouse 3.5 Standard Application Benchmark suite performed on 2/28/06, by Fujitsu Siemens Computers in Paderborn, Germany, was certified on 3/14/06 with the following data.  The scenario for 32GB main memory which corresponds to 467,200,000 records in fact table was used.  Load Phase - Average throughput total step 1+2 (rows/hour):  53,255,652.   Query Navigation Steps:  377,280.  The software configuration for all steps of the SAP BW Benchmark:  Operating system central server:  SUN Solaris 10.  RDBMS:  Oracle 10g.  Platform Release:  SAP NetWeaver '04.  Configuration: Central server:  Fujitsu Primepower 850, 16 processors/16 Cores/16 threads, SPARC64 V, 2.16 GHz, 128 KB (D) + 128 KB(I) L1 cache, 4 MB L2 cache, and 32 GB main memory, Cert # 2006014.

Best OLTP Performance - TPC-C Record

• 12 node Sun T5440 cluster – Sparc T2+ • First World Record using Flash Technology• 8X less hardware than previous record• 16 times better response time• 4X Less Power

As of 10/10/2009: 12-Node Sun SPARC Enteprise T5440 server cluster 7,717,510 tmpC, $2.34/tpmC, available 12/14/09

150,960

QphH

Oracle

Source: TPC, As of Nov 9, 2007: Oracle Database 10g on HP Superdome Server, 150,960 QphH $46.69/QphH, avail 6/18/07.

Best Data Warehouse Performance- World Record 30 TB TPC-H

Processors 128 Core Superdome

Memory 1 Terabyte

Disk Arrays 256 MSA1000’s

Disk Storage 448 TB

Read Throughput

40 GB/Sec

10,400

35,40039,100

0

5,000

10,000

15,000

20,000

25,000

30,000

35,000

40,000

SD

Use

rs

MSFT DB2 Oracle

These results, as of October 2, 2009, have been certified by SAP AG, www.sap.com/benchmark. Please see notes page for benchmark certification details for the above results.

The results above we achieved with SAP ERP 6.0 (Non-Univode)SAP ERP 200

Best Business Application Performance- World Record SAP SD 2-tier Benchmark

First Benchmark on a 256 Core SMP – Sun M9000

2,035

4,010

15,520

22,416

30,016

37,040

0

5,000

10,000

15,000

20,000

25,000

30,000

35,000

40,000

SD

Us

ers

4 8 12 16 20 24 28 32 36 40 44 48 52 56 60 64 68 72 76 80

# of CPU Cores

Near Perfect Scaling across SMP and Cluster

These results, as of October 2, 2009: have been certified by SAP AG, www.sap.com/benchmark. Please see notes page for benchmark certification details for the above results.

Best Business Application ScalingWorld Record SAP SD Benchmark Results

2 Node RAC

3 Node RAC

4 Node RAC

5 Node Oracle RACIBM P570

Single Node SMP

182,112

320,363

609,349

0

100,000

200,000

300,000

400,000

500,000

600,000

700,000

Qu

ery

Nav

igat

ion

Ste

ps/

Ho

ur

8 8 16# of CPU Cores

These results, as of October 2, 2009: , have been certified by SAP AG, www.sap.com/benchmark. Please see notes page for benchmark certification details for the above results.

Best Business Intelligence PerformanceWorld Record SAP BI Data Mart Benchmark

2 Node RAC Fujitsu RX300

Single Node SMP

IBM DB2 Oracle Oracle

Best OLTP Price-Performance

0.540.60

0.680.73 0.74

0.840.91

0.00

0.10

0.20

0.30

0.40

0.50

0.60

0.70

0.80

0.90

1.00

$/t

pm

C

Oracle Oracle Oracle Oracle Oracle SQLServer

SQLServer

Windows Linux

Value Leadership Over Microsoft

As of 10/2/09::HP ProLiant ML350 G6 server, 232,002 tpmC, $0.54USD/tpmC, available May 21, 2009. Dell PowerEdge 2900 Server, 104,492 tpmC $.60USD/tpmC, available 2/20/2009. Dell PowerEdge 2900 97,083 tpmC, .68/tpmC, available 6/16/08. HP ProLiant ML350G5, 102,454 tpmC, .73/tpmC, available 12/31/07. HP ProLiant ML350G5, 100,926 tpmC, .74/tpmC, available 6/8/07. Microsoft SQL Server on HP ProLiant ML350G5, 82,774, .84/tpmC, available 03/27/07. Dell PowerEdge 2900, 69,564 tpmC, .91/tpmC, available 3/9/07. Source: Transaction Processing Performance Council (TPC), www.tpc.org

Linux

HP Intel

What Oracle Runs

Storage

Example: Oracle Central e-Business DB

• Worldwide Central E-business database for Fortune 200 company

• ERP, HR, and CRM– Payroll, orders, contracts, procurement, expense reports, hiring…

• Consolidated 70 separate Applications databases– Estimated cost savings of over $1B

Data Guard

76 TB Primary 76 TB Standby

Sun E25K 36 CPU 2 Cores/CPU

Total = 288 Cores

Texas Colorado

4 NodeRAC

Oracle Beehive OLTP using Exadata

• Runs Oracle Email, Calendar, Contacts, Chat, Documents, Web Conferencing

• 16-node production system– Remote standby, testing system

• 1 PB of disk per system– 50 SAS cells, 48 SATA cells– 3 PB of total storage

• Complete Oracle Software Stack– RAC, Streams, Active Data Guard,

Secure Backup, RMAN, Flashback Database, ASM, Partitioning

– 2X space saved with compressed SecureFiles

17 Switches

Infiniband

16 Node RAC Cluster 2 quad-core Intel CPUs per Node

98 HP Exadata Storage Cells

1 PB Raw Storage1 PB Raw Storage

Each of 3 Configurations:Each of 3 Configurations:

<Insert Picture Here>Offloading and Caching for High Performance

Database, Client, Remote

Server SQL Results Cache

• Database caches results of queries, sub-queries, or pl/sql function calls

– Cache is shared across statements and sessions on server

– Full consistency and proper semantics• 2x speedup on hit for worst case of trivial query• 100x speedup on hit for complex queries• Statement hints specify caching - /*+ result_cache +*/• Only for very read intensive tables

In-Memory Parallel Execution

• Database release 11.2 introduces parallel query processing on memory cached data

– Queries run from tables in database buffer cache– Harnesses memory capacity of entire database

cluster for queries– Foundation for world record 1TB TPC-H

315,842

1,018,321

1,166,976

ParAccel Exasol Oracle & HPExadata

QphH: 1 TB TPC-H

Faster than specialized in-memory warehouse databases

Memory has 100x more bandwidth than Disk

Source: Transaction Processing Council, as of 9/14/2009: Oracle on HP Bladesystem c-Class 128P RAC, 1,166,976 QphH@1000GB, $5.42/QphH@1000GB, available 12/1/09. Exasol on PRIMERGY RX300 S4, 1,018,321 QphH@1000GB, $1.18/QphH@1000GB, available 08/01/08.ParAccel on SunFire X4100 315,842 QphH@1000GB, $4.57 /QphH@1000GB, available 10/29/07.

Mid-Range StorageFew Shelves

Few I/O’s

Database Smart Flash Cache

• Database Smart Flash Cache transparently extends buffer cache

– 10x Larger– Uses flash disks or cards in

database host– Cache eliminates most I/Os– Available on Solaris and OEL

• Benefits– Fewer disks needed– Less powerful array needed– Better response time– Big jobs run faster– Lower Power– High ROI

Buffer Cache

Enterprise StorageMultiple Cabinets

Buffer Cache

Database Smart

Flash Cache

Many I/O’s

Oracle is the First Flash Optimized Database

OCI Consistent Client Cache

• Caches query results on client• Primarily for caching small (10s or 100s of KB) read-intensive tables

– Queries where network overhead dominates– e.g. lookup tables

• Cache is fully consistent– Coherence messages bundled into responses to DB calls ensure

cache remain consistent – Like Cache Fusion extended out to clients

Application Server

Database

Consistent Caching

Simplest Queries can speedup:• 50x in elapsed time• 20x in CPU time

In-Memory Database Cache Grid – TimesTenScaling with Business Growth Peer-to-peer

communication between grid

nodes

Incremental scalability

High availability

In-MemoryDatabase

Cache

Application

In-MemoryDatabase

Cache

Application

In-MemoryDatabase

Cache

Application

In-MemoryDatabase

Cache

Application

On-demand loading of cached data and redistribution based

on usage

Transactional consistency

In-MemoryDatabase

Cache

Application

0

2

4

6

8

10

12

14

16

Read a Record Update Transaction

millionths of

a second

44

millionths of

a second

1414

Mic

rose

con

ds

Oracle TimesTen In-Memory Database 11g - Intel Xeon 3.0 Ghz 64-bit Oracle Enterprise Linux

Lightning Fast Response Time Runs In-Application

Active Data Guard Query Offload

• Users want to performance protect their production DBs– Active Data Guard offloads high risk reporting & backup from OLTP

• Current approaches -– Physical Copy Reporting DB (e.g. split mirror)

• Solution is simple but data is stale (day old)– Logical Replica Reporting DB (e.g. replication)

• Replication provides real-time updates but is complex

• Active Data Guard enables a unique real-time solution– Reporting using physical standby technology– Real-time, simple, and fast – also provides DR

Real-Time

Simple

ReportingDatabase

Production Database

Real-time Queries

Continuous Redo Shipment and Apply

Concurrent Query

Designated Fast-Start Failover DB

Web Scale Highly Available Reader Farm

• Reader farm implemented using Active Data Guard– Scale-out read queries– Isolate faults to each DB– High performance– Supports all types & DDL

• Automatic, zero loss failover– Readers follow automatically

• RAC can scale-out updater, or centralize storage of readers

PrimaryDatabase

Updates

ReaderDatabases

Redo Shipping

Reporting, web content browsing

Redo Shipping

<Insert Picture Here>High-Performance with Large Data Volumes

Data Growth Challenges

• IT must support exponentially growing amounts of data– With improved performance– With lower cost

• Powerful and efficient compression is key

Advanced OLTP Compression

• Compress large application tables– Transaction processing, data warehousing– Transparent to application

• Compress all data types– Structured and unstructured data types

• Improve query performance– Cascade storage savings throughout data center

Compression4X

Up To

Real World Compression Results- ERP Database 10 Largest Tables

0

500

1000

1500

2000

2500

Storage Utilization

MB

3x Smaller

Table Scan Performance

Tim

e (s

econ

ds)

0

0.1

0.2

0.3

0.4

2.5x Faster

DML Performance

0

10

20

30

40

Tim

e (s

econ

ds)

Less than 3% Overhead

Exadata Hybrid Columnar CompressionTwo Modes

Warehouse Compression• 10x average storage savings• 10x reduction in Scan IO

Archive Compression• 15x average storage savings

– Up to 50x on some data

• Some access overhead • For cold or historical data

Optimized for Speed Optimized for Space

Smaller WarehouseFaster Performance

Reclaim 93% of DisksKeep Data Online

Can mix OLTP and Hybrid Columnar Compression by partition for ILM

10 10 10 1116 19 19 19 20 21

29

43

05

101520253035404550

Siz

e R

edu

ctio

n F

acto

r b

y T

able

OLTP Compression (avg=3.3)

Query Compression (avg=14.6)

Archive Compression (avg=22.6)

© 2009 Oracle Corporationl 31

Real-World Compression RatiosOracle Production E-Business Suite Tables

• Columnar compression ratios• Query = 14.6X• Archive = 22.6X• Vary by application and table

5252

Files in the Database Reinvented

• Best of Both Worlds• File Capabilities

– File System Interface– High Performance– Compression– Encryption– Deduplication– HSM

• Database Capabilities– Transactions– Query Consistency– Advanced Backup

and Recovery– Powerful Security– Flashback– Scale up SMPs– Scale out Clusters

• Files are an integral part of modern database applications– Product images, contracts, XML, ETL files, manuals, etc.

• Applications developers want to store business data files in the database to benefit from transactional consistency, and unify HA and Security

– Poor performance, limited functionality, and lack of access by existing file based tools have held them back

• Oracle Database 11g reinvents files in the database

• SecureFiles provides super fast and powerful file storage – Removes performance barrier to storing files in the database

• DBFS provides a file system interface to files in the DB– Enables existing file based tools to easily access DB files

SecureFiles Performance

File Reads(MB/second)

020406080

100

0.01 0.10 1 10 100

SecureFiles

Linux Files

LOBs

File Size (MB)

File Writes(MB/second)

0

10

20

30

40

50

60

0.01 0.10 1 10 100

SecureFiles

Linux Files

LOBs

File Size (MB)

• Performance compared to Linux FS– Tests run using both SecureFiles and ext3 in metadata

journaling only, no network

Database File System - DBFS

• Shared Linux file system– Shared storage for ETL staging, scripts, reports and other

application files

• Files stored as SecureFiles in database tables– Protected like any DB data – mirroring, DataGuard, Flashback, etc.

• 5 to 7 GB/sec file system I/O throughput on Database Machine

• Example use case:

ETL Files in DBFS

Load into database using External Tables

ETL

More File Throughput than High-End NAS Filer

End-to-end Performance Architecture

Sun Oracle Database Machine

© 2009 Oracle Corporation 36

• Grid is the architecture of the future• Highest performance, lowest cost, fault tolerant, scalable on demand• Database Machine is an engineered, optimized, standardized, and

tested grid for Oracle database – with intelligent storage

Exadata Storage Server Grid

• 14 storage servers

• 100 TB or 336 TB Disk Storage

• 5TB flash storage!

• Offload queries into storage

Oracle Database Server Grid

• 8 compute servers

• 64 Intel Cores

• 576 GB DRAM

InfiniBand Network

• 40 Gb/sec unified server and storage network

• Fault Tolerant

Scale Performance and Capacity

• Scalable– Scales to 8 rack database machine

by just adding wires• More with external

InfiniBand switches– Scales to hundreds of storage servers

• Multi-petabyte databases

• Redundant and Fault Tolerant– Failure of any component

is tolerated– Data is mirrored across

storage servers

© 2009 Oracle Corporation 38

Exadata Database Offload to Storage

• Exadata storage servers implement data intensive processing in storage

– Row filtering based on “where” predicate– Column filtering– Join filtering– Incremental backup filtering– Storage Indexing– Scans on encrypted data– Data Mining model scoring

• 10x reduction in data sent to DB servers is common

• No application changes needed– Processing is automatic and transparent– Even if cell or disk fails during a query

New

Exadata Smart Flash Cache

• Smart Flash Cache holds hot data– Not just simple LRU

• Knows when to avoid caching to avoid flushing cache

– Allows optimization by application table

• Performance of Flash combined with Cost of Disk

Oracle is the First Flash Optimized Database

Flash Cache for Scans

7.510

21

50

0

5

10

15

20

25

30

35

40

45

50

GB

/Se

co

nd

(u

nc

om

pre

ss

ed

)

TERADATA2550

TERADATA2550

NETEZZATwinFin 12

NETEZZATwinFin 12

SUN ORACLEDatabase MachineSUN ORACLEDatabase Machine

DiskDiskDiskDisk

DiskDisk

FlashFlash2x – 5x better

throughput*

* Note: This compares uncompressed data. Oracle’s advantage is much greater than this with compressed data.

* Note: This compares uncompressed data. Oracle’s advantage is much greater than this with compressed data.

• Flash storage more than doubles scan throughput– 50 GB/sec

• Combined with Hybrid Columnar Compression– Up to 50 TB of data fits

in flash– Queries on compressed

data run up to 500 GB/sec

Flash Cache for Random I/O

• Database Machine achieves:• 20x more random I/Os

– Over 1 million per second

• 10x better I/O response time

– Sub-millisecond

• Greatly Reduced Cost– 10x fewer disks needed for I/O– Lower Power

5X More I/Os than 1000 Disk Enterprise

Storage Array

Sun Oracle Database MachineExtreme Performance for all Data Management

• Best for Data Warehousing– Parallel query on memory or Flash at more than 50 GB/sec– 10x compressed tables with storage offload

• Best for OLTP– Only database that scales real-world applications on grid– Smart flash cache provides 1 million I/Os per second– Up to 50x compression for archival data– Secure, fault tolerant

• Best for Database Consolidation– Only database machine that runs and scales all workloads– Predictable response times in multi-database, multi-

application, multi-user environments

Oracle is Ready for the Future

• High-Performance Today

• Offloading and Caching for High Performance

• High Performance with Large Data Volumes

• End-to-end Performance Architecture

Exadata SessionsDate Time Room Session Title

Mon 10/12

5:30 PM

Moscone South 307

S311436 - Implement Best Practices for Extreme Performance with Oracle Data Warehouses.

Tue 10/13

11:30 AM

Moscone South 307

S311385 - Extreme Backup and Recovery on the Oracle Database Machine.

Tue 10/13

1:00 PM

Moscone South 307

S311437 - Achieve Extreme Performance with Oracle Exadata and Oracle Database Machine.

Tue 10/13

1:00 PM

Moscone SouthRoom 102

S311358 - Oracle's Hybrid Columnar Compression: The Next-Generation Compression Technology

Tue 10/13

2:30 PM

Moscone South 102

S311386 - Customer Panel 1: Exadata Storage and Oracle Database Machine Deployments.

Tue 10/13

4:00 PM

Moscone South 102

S311387 - Top 10 Lessons Learned Implementing Oracle and Oracle Database Machine.

Tue 10/13

5:30 PM

Moscone South 102

S307963 - Oracle Database Machine and Exadata Best Practices and Customer Considerations.

Tue 10/13

5:30 PM

Moscone SouthRoom 104

S311239 - The Terabyte Hour with the Real-World Performance Group

Tue 10/13

5:30 PM

Moscone South 252

S310048 - Oracle Beehive and Oracle Exadata: The Perfect Match.

Wed 10/14

4:00 PM

Moscone South 102

S311387 - Top 10 Lessons Learned Implementing Oracle and Oracle Database Machine.

Wed 10/14

5:00 PM

Moscone South 104

S311383 - Next-Generation Oracle Exadata and Oracle Database Machine: The Future Is Now.

Thu 10/15

12:00 PM

Moscone South 307

S311511 - Technical Deep Dive: Next-Generation Oracle Exadata Storage Server and Oracle Database Machine