Look Before You Leap!Oracle 11g Real Application

Testing

Gavin Soorma,

Senior Oracle DBA, HBOSA

Change Management and its challenges

• Change is mandatory – Legal compliance, security, product support • Change is technology driven to enable business to have a

competitive edge • Significant time, effort and money is spent before system changes

can be successfully deployed in a production environment• Many issues go undetected until production deployment adversely

affecting application availability, user confidence and reputation• Inability of test scripts and simulation tools to test using real

production workloads.• Test workloads not accurate representations of peak production

workloads.

Oracle 11g Real Application Testing

• Two Components – Database Replay

– SQL Performance Analyzer

• Capture live workload on production system• Replay production workload on test system with the same timing,

concurrency, dependency and transactional properties of the original workload

• Testing cycles for complex applications is reduced from months to few days – faster deployment

• Reduce cost of change and risk of change

Database Replay

With Database Replay, DBA’s and System Administrators can test:

• Database upgrades, patches, parameter, schema changes, etc.• Configuration changes such as conversion from a single instance to

RAC,ASM, etc.• Storage, network, interconnect changes• Operating system migrations• Hardware migrations• Patches, upgrades, • Database parameter changes

**Database Upgrades – 10.2.0.4 to 11g is now supported**

SPA – SQL Performance Analyzer

• Predict regression in SQL statements performance before end users are affected.

• Assess impact of change on SQL response time• Unit testing of single SQL or set of SQL statements• Optimizer version changes, access path changes, database

parameter changes, index addition and deletion etc

• Database ReplayReplay real database workloadAssess impact of change on total workload throughput

• SPA ‘What if’ analysis and predicts deviations in SQL performanceAssess impact of change on SQL response time

apex:/u01/oracle/scripts> cat load.shfor i in 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25doecho Running Query $i ...echosqlplus -s sh/sh <<EOFset timing on@query.sqlEOFDone

apex:/u01/oracle/scripts> cat query.sqlselect b.country_id,country_name,sum(quantity_sold),sum(amount_sold)from sales a, customers b,countries cwhere a.cust_id=b.cust_idand b.country_id =c.country_idand a.cust_id=987group by b.country_id,country_name/......select b.country_id,country_name,sum(quantity_sold),sum(amount_sold)from sales a, customers b,countries cwhere a.cust_id=b.cust_idand b.country_id =c.country_idand a.cust_id=1660group by b.country_id,country_name/

SQL> SELECT INDEX_NAME FROM USER_INDEXES WHERE TABLE_NAME='SALES';

INDEX_NAME------------------------------SALES_PROD_BIXSALES_CUST_BIXSALES_TIME_BIXSALES_CHANNEL_BIXSALES_PROMO_BIX

SQL> ALTER INDEX SALES_PROD_BIX INVISIBLE;Index altered.SQL> ALTER INDEX SALES_CUST_BIX INVISIBLE;Index altered.SQL> ALTER INDEX SALES_TIME_BIX INVISIBLE;Index altered.SQL> ALTER INDEX SALES_CHANNEL_BIX INVISIBLE;Index altered.SQL> ALTER INDEX SALES_PROMO_BIX INVISIBLE;Index altered.

SQL> SHOW PARAMETER USE_INVISIBLENAME TYPE VALUE------------------------------------ ----------- ------------------------------optimizer_use_invisible_indexes boolean FALSE

Database Replay Workflow• Workload Capture

External client requests to the database tracked and stored in binary files called capture files

• Workload Processing

Before replay, captured workload files have to be processed. Process once – replay many timesTransforms captured data into replay files

• Workload Replay

Replay Clients will run the captured and processed workload files on the target server

• Analysis and Reporting

Analyze capture and replay and report any errors or divergence in data. Compare AWR reports gathered at both capture and replay and provide comparison reports

apex:/u01/oracle/capture> ls -ltotal 66640-rw-r----- 1 oracle dba 1131 Jul 29 14:02 wcr_4j3pkch00384c.rec-rw-r----- 1 oracle dba 1152 Jul 29 14:02 wcr_4j3pkch003n6y.rec-rw-r----- 1 oracle dba 1078 Jul 29 14:02 wcr_4j3pkch003s46.rec-rw-r----- 1 oracle dba 904 Jul 29 14:02 wcr_4j3pkcs00245s.rec-rw-r----- 1 oracle dba 8648 Jul 29 14:02 wcr_4j3pkcs00284k.rec-rw-r----- 1 oracle dba 904 Jul 29 14:02 wcr_4j3pkd000202y.rec-rw-r----- 1 oracle dba 1133 Jul 29 14:02 wcr_4j3pkd0003s50.rec-rw-r----- 1 oracle dba 1131 Jul 29 14:02 wcr_4j3pkd4003s3h.rec-rw-r----- 1 oracle dba 1460 Jul 29 14:11 wcr_4j3pkd8003h0c.rec-rw-r----- 1 oracle dba 1133 Jul 29 14:02 wcr_4j3pkds002h0w.rec-rw-r----- 1 oracle dba 916 Jul 29 14:02 wcr_4j3pkds003c6q.rec-rw-r----- 1 oracle dba 1132 Jul 29 14:02 wcr_4j3pkf8002c14.rec-rw-r----- 1 oracle dba 1145 Jul 29 14:02 wcr_4j3pkg0003w6k.rec-rw-r----- 1 oracle dba 17104896 Jul 29 14:15 wcr_ca.dmp-rw-r----- 1 oracle dba 26539 Jul 29 14:15 wcr_ca.log-rw-r----- 1 oracle dba 43260 Jul 29 14:11 wcr_cr.html-rw-r----- 1 oracle dba 20826 Jul 29 14:11 wcr_cr.text-rw-r----- 1 oracle dba 306 Jul 29 14:11 wcr_fcapture.wmd-rw-r----- 1 oracle dba 236 Jul 29 14:02 wcr_scapture.wmd

Start The Replay Clients

apex:/u01/oracle/capture> wrc replaydir=/u01/oracle/capture userid=system password=oracle

Workload Replay Client: Release 11.1.0.6.0 - Production on Tue Jul 29 14:41:23 2008

Copyright (c) 1982, 2007, Oracle. All rights reserved.

Wait for the replay to start (14:41:23)

Thanks for attending!!

AQ&Q U E S T I O N SQ U E S T I O N SA N S W E R SA N S W E R S

GAVIN SOORMASenior Oracle DBA SpecialistHBOS Australia

Contact me at : 0417713124or

gavin.soorma@hbosa.com.au