oracle on linux for zseries an emea customer experienceoraclezsig.org/2005presentations/gerard...

1

EMEA ATS - PSSC

© 2005 IBM Corporation

Oracle on Linux for zSeries

An EMEA Customer Experience

Gerard LAUMAYEMEA ATS PSSC, Montpellier, [email protected]

EMEA ATS - PSSC


Agenda

�EMEA ATS PSSC & JSC introduction

�Recent EMEA customer projects

�A benchmark experience with Oracle 10g on Linux zSeries

2

EMEA ATS - PSSC


EMEA ATS PSSC Activities

Briefings, Seminars, Architecture Design,Technical Support

Education, Training & Hands-on Workshops

Customer Test, Benchmark & Proof of Concept

Loaners & remote platforms

High Performance ComputingDesign Center for On Demand Business

Grid Computing Autonomic Computing

Solutions: SAP, Oracle, Siebel, AmdocsLinux Expertise

Advanced Technology & Solutions

EMEA ATS - PSSC


50 Terabytes FAStT &

1300 fibre channel ports, including FICON

40 ESS, 10 SAN Directors,

10 SAN Switches,

12 SVCs

TotalStorage

Including IA64, AMD Opteron & BladeCenter

technology250 serversxSeries

34 Terabytes85,000 CPW,

15 serversiSeries

55 Terabytes10 TeraflopspSeries

150 Terabytes140,000 MipszSeries

Latest Technologies

Missions � Benchmark and proof of concept activity� Briefing � Education� Technical Support� Porting & Testing Services� Loaners & Remote platforms ‘on demand’

People� A unique IBM investment in EMEA� Skill set: 200 professionals (150 IT Specialists & 30 IT Architects)� eServer & TotalStorage infrastructure:

• ALL Platforms• ALL Models• ALWAYS the latest technology

The environment� 4 machine rooms (2500 sqm)� 10 briefing rooms (from 12 to 150 seats)� 11 education rooms� 18 benchmarking rooms� 1 TotalStorage lab

5,000+ visitors per year� 25% of the top 500 clients each year

EMEA PSSC Strengths

3

EMEA ATS - PSSC


A joint team:

…dedicated to customer projects.

EMEA Oracle/IBM Joint Solutions Center Six years of experience

� How the JSC can help� Perform benchmarks� Demonstrations and customer briefings� Workshops and educational events� Architecture validation and sizing for Oracle solutions on IBM eServers� The JSC is located in the PSSC, the IBM training, benchmarking and support

center in Montpellier (France).� The JSC is permanently staffed by Oracle as well as IBM. Its mission is to assist

the Oracle and IBM sales divisions. If you have an issue related to IBM and Oracle, the center might be able to help you.

� Need to test� The JSC can provide you with IBM hardware (pSeries, zSeries, xSeries, iSeries

clusters) for tests when performance is not the main issue. � Need to validate an architecture

� Make sure your solution will work and its components are compatible with each other.

� Need to benchmark� Need to run a benchmark or proof of concept? The JSC will be your interface to

the IBM Benchmark Center in Montpellier and ensure that the test or prototype will run under optimal conditions.

� Want to demonstrate� Use zSeries, pSeries, xSeries, iSeries and Oracle products to show the latest

technology level of our products to your customers.

EMEA ATS - PSSC


IBM-Oracle JSC contribution in pre-sales project cycle

Aw

aren

ess

Pre-

sales

Educ

ation

Tests

Benc

hmar

k

Post-

Sales

Interface withOracle and IBM Support Teams

Architecture validations,

Sizing,

PoCor

FunctionalTests

Technologies & Solutions Awareness

Hands-ontraining

Performance&

Tuning

Pre-sales Technical Support

4

EMEA ATS - PSSC


zSeries Linux Trial (zLT)

Softwarez/VM Linux Distributions

SuSE, RedHat

Linux Server2 virtual CPs512 MB storageDASD 20 GBGBit Ethernet OSA card

Latest TechnologyVirtual servers 64-bit environmentHiperSockets, Guest LAN

Internet

OPNFirewall

zSeriesESS

EMEA ATS - PSSC


EMEA zSeries Benchmark Center, Montpellier

� Functionality - Scalability - Performance Tests

� Customer and/or ISV benchmarks (MOP Qualification Committee / WW Benchmark Council)

� Build Customer references and publish technical papers on the latest solutions

� Easy access to the latest IBM eServer hardware technology - on site or remote

5

EMEA ATS - PSSC


EMEA Oracle/IBM Joint Solutions CenterMontpellier, France

[email protected] : +33 4 67 34 67 49Fax : +33 4 67 34 64 77

EMEA ATS - PSSC


Agenda




6

EMEA ATS - PSSC


Oracle on zSeries: Recent EMEA customer projects

� Dundee City Council, UK – Scotland (Government)� New zSeries customer in 2004 (no zSeries before)� Consolidation of Oracle databases and Open Source applications on

Linux zSeries (z890)� About 30 Linux guests under z/VM

� Sitec, France (Transportation)� Run WAS and Oracle applications on Linux on a z890 server� Integration with an IMS application on z/OS via Hipersockets� About 100 Linux guests under z/VM

� CNES, France (National Space Agency)� Space experiences data archived on a z/OS and Linux Archiving

application (Satellites, Ariane, ESA projects)� Java-Oracle application linked to DFHSM z/OS environment through

zSeries Hipersockets (z800)� zSeries provides full data integrity, availability and automation

EMEA ATS - PSSC


Agenda




7

EMEA ATS - PSSC


A typical Customer benchmark request

�Customer wanted to deploy a new banking applicationon a robust and reliable platform

�The overall goal of this benchmark was to determine appropriate zSeries hardware configuration

�Oracle 10g on Linux on zSeries was a very new software. There were no reference to determine the resources needed. A real-sizing benchmark was needed

�The ISV was new to zSeries and had no implementation of the application on Linux for zSeries

EMEA ATS - PSSC


DEF3000 Application description

� Banking application for Pensions payment

� DEF3000 application is a centralized, complex IT system ensuring:– Record-accountant service,

– Economic analyses,

– Risk management,

– Evaluation of profitability of bank activity and the whole range of electronic banking.

� DEF3000 is based on an Oracle 9i Database EE

� Certified Hardware and Operating Systems:– IBM AIX, SUN Solaris, and HP-UX

– No Linux implementation before the test

� System ensures high efficiency, durability and scalability.

8

EMEA ATS - PSSC


Customer Application implementation� Oracle Database:

– 5,000,000 accounts– Database size = 229 GB– 5 main Tables (Read/Write)– 18 Tables (Read only)– Need Oracle SGA size > 2GB to reach target performance

� Transactions are executed in batch processes– Oracle Stored Procedures– Read and Write operations– I/O intensive application

� Transactions description: – Data validation– Calculation of amount and account’s balance– Write data into the database

� Batch process started from a Windows 2000 server

EMEA ATS - PSSC


Customer Application Sizing

� Customer objectives: – Run the whole chain of batch processes (End Of Month) within 12

hours

� Needs 400,000 tpmC on UNIX� Targeted UNIX configurations:

– IBM p4-690 / 32 processors / 64 GB : 403,255 tpmC– IBM p5-570 / 8 processors / 64 GB : 429,899 tmpC– HP9000 Superdome PA-RISC 8700 / 64 processors / 64 GB :

423,000 tpmC

� Initial sizing done on Linux zSeries: – IBM zSeries 990 / 16 IFL processors– Oracle 10g, just announced on Linux for zSeries. – No experience with 10g.

9

EMEA ATS - PSSC


Project Steps

� Application porting from Oracle 9i to 10g on Linux for zSeries– Needed to support large SGA size on Linux for zSeries

� Application functional validation on Linux for zSeries� Project objectives validation� Hardware and Software Installation and configuration� Oracle Database load

– Data generation and DB expansion using a customer tool (Epsilio)– AIX workstation (Oracle Clients) used for data generation

� Batch Test cases definition � Batch Runs on different hardware configurations

– Batch processes initiated from a Windows Server

EMEA ATS - PSSC


Application migration to Linux for zSeries� Migration from Oracle 9i to Oracle 10g (64-bit)� First experience with Oracle 10g on Linux zSeries� Migration and functional validation in 1 week

– Easy database migration

� Use of zSeries Linux Trial (zLT) free offering (PSSC Montpellier)– Internet remote connection to a Linux zSeries environment– Secure connectivity (SSH)– Linux virtual servers under z/VM

Softwarez/VM Linux Distributions

SuSE, RedHat

Linux Server2 virtual CPs512 MB storageDASD 20 GBGBit Ethernet OSA card

Latest TechnologyVirtual servers 64-bit environmentHiperSockets, Guest LAN

Internet

OPNFirewall

z800ESS

10

EMEA ATS - PSSC


Overall Batch Tests Objectives

� 1- BATCH processing on DB_A (simple accounts): – Process 1,000,000 simple account transactions on 5,000,000 current

accounts within 7 hours.

� 2- END OF DAY processing on DB_A (simple accounts):– Process Batch application within 7 hours.

� 3- BATCH processing on DB_B (regular accounts): – Process 1,000,000 simple account transactions on 5,000,000 current

accounts within 7 hours.

� 4- END OF DAY processing on DB_B (regular accounts): – Process Batch application within 7 hours

� 5- END OF MONTH processing on DB_B (regular accounts): – Process Batch application within 7 hours

� 6- BATCH + END OF MONTH on DB_B (regular accounts) processing:– Process Batch applications combination within 12 hours

� 7- Determine the optimal Oracle configuration (parameter file)

EMEA ATS - PSSC


The Benchmark Team: 8 specialists

� ISV & Customer Team

– 1 Project Manager

– 1 Linux Specialist

– 1 Application Administrator

� IBM PSSC Team

– 1 Project Manager

– 1 Linux zSeries and Oracle for Linux on zSeries Specialist

� IBM - Oracle JSC Montpellier Team

– 1 Oracle Specialist

� IBM Poland Team

– 1 Linux zSeries and Oracle Specialist

– 1 zSeries Sales Specialist

� IBM WW support

11

EMEA ATS - PSSC


DP Rooms

Benchmark InfrastructurezSeries z990 – S53 ESS 800 – D9A3

pSeriesAIX x335 softapps

Win2000 SP4

Admin network

�Model D32

�128GB Mem

�32 processors �DDS4 Tape driver

�2-way, 4GB mem

WorkstationsInternet

Cam21

ESS 800 – D992

8 FICON channels

to ESS

8 FICON channels to ESS

Private network

Oracle ClientSQL* Plus

EMEA ATS - PSSC


IBM zSeries z990 partitions (3 LPARs)� IBM ESS 800– 6.6TB capacity– 64GB cache– 8 FICON channels– Processor Turbo2– Disks size 73GB– Disks speed 15K RPM

SLES 8 SP3 – 64-bitOracle 10g 10.1.0.3128 DASD defined:3390 mod9, 7GB eachTotal of 870 GB.

9.100.195.228

10.10.1.228

Native Linux LPAR11 to 16 IFLs,

4 to 16GB memory

SLES 8 SP3 – 64-bitOracle 10g 10.1.0.3128 DASD defined:3390 mod9, 7GB eachTotal of 870 GB.

9.100.195.215

10.10.1.215

Native Linux LPAR21 to 16 IFLs,

4 to 16GB memory

Used for admin

purposes ESS

FlashCopy

z/VM LPAR32 IFLs, 32GB

memory

Benchmark Configuration

DB_BDB_A

12

EMEA ATS - PSSC


Linux file system definitions

� Both z990 LPARs had identical definitions:– LPAR1 : DB_A (for Simple accounts runs)– LPAR2 : DB_B (for Regular accounts runs – more calculations)– 128 DASD defined on Linux Servers (3390 mod 9)– Mount points :

• 1 DASD (6.8GB) for /• 1 DASD (6.8GB) for /opt/oracle• 102 DASD (689GB) in LVM for /dba_fs1• 6 DASD (41GB) in LVM for /dba_fs2• 1 DASD (6.8GB) for /dba_fs3• 5 DASD (34GB) in LVM for /dba_fs4• 5 DASD (34GB) in LVM for /dba_fs5

– Logical Volume Manager (LVM): Disks are stripped and split across ESS LCU’s (Logical Control Units)

– Oracle RAC feature not used

EMEA ATS - PSSC


Oracle Database Tables and Size

��

��

��

��

��

��

��

��

��

��

��

��

��

��

��

��

��

��

��

��

��

��

��

�!""#$%&�!""#$��&�'("#$��&�)*"�+,"�-+-./

Database Size:

229 GB

5 major Tables

2 Databases:

DB_A and DB_B

Data Generation

and DB load

in 3 days

13

EMEA ATS - PSSC


Oracle DB server settings (major init.ora parameters)

defa1.__db_cache_size=3271557120

defa1.__large_pool_size=16777216

defa1.__shared_pool_size=771751936

*.db_block_size=8192

*.db_file_multiblock_read_count=16

*.db_writer_processes=8

*.disk_asynch_io=TRUE

*.dispatchers='(PROTOCOL=TCP) (SERVICE=defa1XDB)'

*.filesystemio_options='asynch'

*.job_queue_processes=512

*.log_archive_max_processes=4

*.log_buffer=200000000

*.open_cursors=6000

*.pga_aggregate_target=1512000000

*.processes=2500

*.sessions=1500

*.sga_max_size=4294967296

*.sga_target=4294967296

*.sort_area_size=256000000

*.statistics_level='ALL'

SGA: 4 to 12 GB

EMEA ATS - PSSC


Tested configurations

� Main goal: determine the best configuration to reach performance objectives (maximum Batch Elapsed time)

� Tests were done on 4 different configurations:

– TEST A: 8 processors with 16 GB of RAM, SGA size 12 GB and 16 jobs

– TEST B: 8 processors with 8 GB of RAM, SGA size 4 GB and 16 jobs

– TEST C: 4 processors with 8 GB of RAM , SGA size 4 GB and 12 jobs

– TEST D: 2 processors with 8 GB of RAM , SGA size 4 GB and 6 jobs

14

EMEA ATS - PSSC


Tests Results

02:28:201- Batch processing Simple transactionsD - 2CPU, 8GB RAM, SGA 4GB, 6jobs

01:20:161- Batch processing Simple transactionsC - 4CPU, 8GB RAM, SGA 4GB, 12jobs

02:26:022- Batch processing Regular transactionsC - 4CPU, 8GB RAM, SGA 4GB, 12jobs

01:12:363- Batch END OF DAY C - 4CPU, 8GB RAM, SGA 4GB, 12jobs

00:42:451- Batch processing Simple transactionsB - 8CPU, 8GB RAM, SGA 4GB, 16jobs

01:22:462- Batch processing Regular transactionsB - 8CPU, 8GB RAM, SGA 4GB, 16jobs

02:24:023- Batch END OF DAY D - 2CPU, 8GB RAM, SGA 4GB, 6jobs

05:22:442- Batch processing Regular transactionsD - 2CPU, 8GB RAM, SGA 4GB, 6jobs

00:53:433- Batch END OF DAY B - 8CPU, 8GB RAM, SGA 4GB, 16jobs

01:00:313- Batch END OF DAY A - 8CPU, 16GB RAM, SGA 12GB, 16jobs

01:42:022- Batch processing Regular transactionsA - 8CPU, 16GB RAM, SGA 12GB, 16jobs

00:58:081- Batch processing Simple transactionsA - 8CPU, 16GB RAM, SGA 12GB, 16jobs

Elapsed TimeTest caseConfiguration

Elapsed Time objectives (2+3 EOD): 7h00

EMEA ATS - PSSC


Tests Results

Tests Results (1/2)

00:00:00

01:12:00

02:24:00

03:36:00

04:48:00

06:00:00

SimpleBatch

RegularBatch

End Of Day

Workload Type

Ela

psed

Tim

e

TEST B (8Px8GB)

TEST C (4Px8GB)

TEST D (2Px8GB)

zSeries reached 15,000 SQL queries/second on 4 IFL processorswith around 300,000 buffers/second

1.78

1.35

3.92

2.71

15

EMEA ATS - PSSC


Tests Results

Tests Results (2/2)

00:00:0001:12:0002:24:0003:36:0004:48:0006:00:0007:12:0008:24:00

TEST B(8Px8GB)

TEST C(4Px8GB)

TEST D(2Px8GB)

HW Configuration

Ela

psed

Tim

e

End Of Day

Regular Batch

Elapsed Time objectives (2+3 EOD): 7h00

EMEA ATS - PSSC


Lessons learned and Conclusions (1/2)� Customer objectives:

– Process ‘Batch + End of Day’ within 7 hours

– Process ‘Batch + End of Month’ within 12 hours

� All performance objectives reached using a smaller zSeries server hardware configuration than estimated (initial sizing: 16 IFLs)

– ‘Batch + End of Day’ performed in 3 hours and 38 minutes with 4 IFLs

– ‘Batch + End of Month’ performed in 11 hours and 12 minutes with only 4 IFL processors

� 4 IFL processors and 8 GB memory for an optimal configuration (good price/performance ratio)

� 8 IFL processors and 8 GB memory for best performance

� Need less processors compared to UNIX alternatives (TCO impact)

� zSeries performance is very sensitive to application workload

� Sizing is a difficult exercise. Run sizing test when appropriate

16

EMEA ATS - PSSC


Lessons learned and Conclusions (2/2)

� Oracle 9i to Oracle 10g migration was very easy� Customer Application scalability is good� No specific Linux tuning needed during the test

– SLES 8 Service Pack 3 default caching mode (Normal use vs. Sequential read) improves I/O performance

� Need to carefully manage I/O parallelism for better I/O performance – Use Logical Volume Manager (LVM = data striping)– Don’t see ESS as a black box (spread data over LCUs)

� Asynchronous I/O do not influence performance� Oracle tuning was needed� A too large SGA size can reduce performance

EMEA ATS - PSSC


Thank you for Listening!

oracle on linux for zseries an emea customer experienceoraclezsig.org/2005presentations/gerard...

Documents