1530 oracle

7/31/2019 1530 Oracle

1/20

RDS and Oracle 10g RAC

Update

Paul Tsien, Oracle

7/31/2019 1530 Oracle

2/20

2

Agenda

Oracle Database10g RAC

What is RDS (Reliable Datagram

Sockets)?Open Source RDS for Linux

Beta Customer Experience

7/31/2019 1530 Oracle

3/20

3

Oracle Database 10g RAC

Oracle Database 10g Real

Application Clusters (RAC)

provides the ability to build an

application platform from

multiple systems that areclustered together

Allows applications to become

Highly scaleable

Highly available

Chosen to avoid a single nodefailure, causing application

downtime

Eliminates a node as single

point of failure

Shared DatabaseShared Database

OracleOracleInstanceInstance

OracleOracleInstanceInstance

OracleOracle

InstanceInstance

7/31/2019 1530 Oracle

4/20

4


Worlds best Scalability with Cache

Fusion

Cache-to-cache data shipping

Scales off-the-shelf applications

with no changes

Worlds best Availability with Fast-

Start Fault Recovery

Node failure is transparent to

applications

Recovers from node failure in 17seconds - workload independent

Pre-warmed cache speeds restart

Easily add and delete nodes

SharedCache

SharedCache

CacheFusionCache Fusion

Users

The Ultimate Parallel

Architecture

7/31/2019 1530 Oracle

5/20

5


Existing Apps

Financials, MFG, HR

and CRM

Collaboration Suite

In house developed

DSS

ISV Apps

Easy Migration

Improve Utilization

ERP CRM DW

Real Applications in a Real Grid!

7/31/2019 1530 Oracle

6/20

6


RAC IPC

Thousands of processes

200K+ associations (not connections)

64 nodes

Oracle IPC Usage

New database functionality will significantly

increase IPC utilization

Approach database I/O rates

Very large messages (8 MB +)

7/31/2019 1530 Oracle

7/20

7

What is RDS?

Vision

A low overhead, low latency, high

bandwidth, ultra reliable, supportable, IPC

protocol and transport systemWhich matches Oracles existing IPC models for

RAC communication

Optimized for transfers from 200 bytes to 8meg

7/31/2019 1530 Oracle

8/20

8

What is RDS?

Goal and Objective

Support for a reliable datagram IPC in OpenIB

Based on Socket API

Minimal code change / testing for Oracle

Failover inter HCA and intra HCA ports

Runs over IB, Ether, iWARP, etc

2-6 month validation / certification for RAC

7/31/2019 1530 Oracle

9/20

9

What is RDS?

Reliable Datagram IPC

UDP Oracle adds reliable delivery via user

mode wire protocol engine

Two sockets per process, thousands of messages

on wire

Slow sends times (windowing,acks,retrans)

Holds together but degenerates under CPU load

Well tested !

7/31/2019 1530 Oracle

10/20

10

What is RDS?

Available Options

uDAPL / itAPI not supporting

IPOIB high CPU overhead, same unreliable

delivery (UDP)

SDP connection oriented

We want to take our existing well tested UDP

module, shutoff most of it to run over an O/Sprovided RD IPC

7/31/2019 1530 Oracle

11/20

11

What is RDS?

RD Reliable Datagram IPC over IB50% less CPU than IPOIB, UDP

Latency of UDP (no user-mode acks)

Within 5% of uDAPL thru-put using OracleMinimal code change reduced our UDP module by70% - removed windowing, acks, retransmissions, etc.

RDS driver ~ = 1k C lines (b-copy)

Decoupled from user-mode CPU loading

Passes all Oracle regression tests in < 2 wks !!!!

Supports fail-over across and within HCAs

7/31/2019 1530 Oracle

12/20

12

What is RDS?

RDS IPC over IB

Uses IB reliable connection (RC)

Node to Node level connection

User mode sockets share small pool of node to

node RCs.

Formed either dynamically at send or at system

startup

7/31/2019 1530 Oracle

13/20

13

Oracle Block Service Rate

0

0000

00000

00000

00000

00000

0 0 0 0 0 0 00 00 00 00 00 00 00 00

r d s

ip o i

g e

7/31/2019 1530 Oracle

14/20

14

Service Response Time

0

.00

.00

.00

.00

0

.0 0

.0 0

.0 0

.0 0

0

0 0 0 0 0 0 00 00 00 00 00 00 00 00

r d s

ip o i

g e

7/31/2019 1530 Oracle

15/20

15

CPU Cost Per Block Served

0

.0000

.0000

.0000

.0000

.0000

.0000

.0000

.0000

0 0 0 0 0 0 00 00 00 00 00 00 00 00

r d s

ip o i

g e

7/31/2019 1530 Oracle

16/20

16

Open Source RDS for Linux

Open Source RDS

Oracle is building Open Source RDS for Linux

http://oss.oracle.com/projects/rds/

Oracle will support RDS on Linux

Oracle RDS will be pulled into OFED

Oracle RDS will support GigE, simple NICs

and RDMA NICs (IB/iWARP)
http://oss.oracle.com/projects/rds/http://oss.oracle.com/projects/rds/

7/31/2019 1530 Oracle

17/20

17


Status

Oracle is testing Open Source RDS on GigE

RDS on IB is in development

Beta testing with customers using SilverStorm

RDS/IB stack

Very stable

Very good performanceRDS is supported by major tier one system

vendors

7/31/2019 1530 Oracle

18/20

18


Intel Confidential00

OpenFabrics Components and Architecture

RDMA NICR -NIC

Host Channel

Adapter

HCA

User Direct Access

Programming Lib

UDAP

L

Reliable Datagram

Service

RDS

iSCSI RDMA

Protocol (Initiator)

iSER

SCSI RDMA

Protocol (Initiator)

SRP

Sockets Direct

Protocol

SDP

IP over InfiniBandIPoIB

Performance

Manager Agent

PMA

Subnet ManagerAgent

SMA

Management

Datagram

MAD

Subnet

Administrator

SA

Common

InfiniBand

iWARP

Key

InfiniBand HCAInfiniBand HCA iWARP RiWARP R--NICNIC

HardwareHardware

Specific DriverSpecific DriverHardware SpecificHardware Specific

DriverDriver

ConnectionConnection

ManagerManagerMADMAD

InfiniBand Verbs / APIInfiniBand Verbs / API

SASA

ClientClient

ConnectionConnection

ManagerManager

Connection ManagerConnection Manager

Abstraction (CMA)Abstraction (CMA)

User LevelUser Level

Verbs / APIVerbs / API

SDPSDPIPoIBIPoIB SRPSRP iSERiSER RDSRDS

UDAPLUDAPL

SDPSDP

LibraryLibrary

User LevelUser Level

MAD APIMAD API

OpenOpen

SMSM

DiagDiag

ToolsTools

Hardware

Provider

Mid-Layer

Upper

Layer

Protocol

User

APIs

Kernel Space

User

Space

NFSNFS--RDMARDMA

RPCRPCClusterCluster

File SysFile Sys

Application

Level

SMASMA

RR--NIC Driver APINIC Driver API

Clustered

DB Access

(Oracle

00g RAC)

Sockets

Based

Access

(IBM DB0)

Various

MPIs

Access to

File

Systems

Block

Storage

Access

IP Based

App

Access

Apps &

Access

Methods

for using

OF Stack

7/31/2019 1530 Oracle

19/20

19


Customer Requirements

Improve application performance (throughput,

latency, etc.)

Maintain data availabilityLower TCO through commodity hardware without

sacrificing performance or scalability

Want to implement Grid and Utility computing

7/31/2019 1530 Oracle

20/20

20


Results

RDS/IB shows significant real world application

performance gains for certain workloads: DSS and

mixed DSS/OLTP workloadsThroughput and latency

Customers are interested in unified fabric for cost and

manageability reasonsReservation/QoS is a concern

Joint customer Oracle World presentation on RDS

(Session S281216, 10/23/2006 11AM)

1530 oracle

Documents