ebs tuning kanda session perf

8/16/2019 EBS Tuning Kanda Session Perf

1/54


2/54

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

The following is intended to otline or general prodct

!t is intended for infor"ation prposes only# and "ay

incorporated into any contract. !t is not a co""it"ent to

"aterial# code# or fnctionality# and shold not $e relied p

prchasing decisions. The develop"ent# release# and ti"

featres or fnctionality descri$ed for Oracle&s prodcts re"

sole discretion of Oracle.

Safe Harbor Statement


3/54


Best Practices In E-Business SuitePerformance Tuning

Kandasamy NainamalaiSenior Principal Software Engineer - Applications Technology Group


4/54


'rogra" Agenda

Applications Architectre

(efining ) !solating isse

*ow to approach a perfor"ance isse

+,- Trace and T'O otpt

A/+tatspac% eport

est 'ractices 3 a5i"i6ing the perfor"ance

!

"

#

$

%


6/54Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Applications Architectre

• 78tier architectre – (ata$ase Tier

– Application/iddle Tier

– (es%top Tier


7/54


78Tier Architectre


8/54



9/54


(efining and !solating the !sse

hat is slow9

1. The entire syste" is slow.2. A s$syste" is slow:

- or"s8ased Applications

- e$8ased Applications

- Concrrent anager

1. A particlar process is slow.


10/54



• hen is it slow9 – onth end/year end | – 'ea% hors | Concrrency# de to -oad ;or< */ is not si6ed.

– All the ti"e |• as it wor%ing fine earlier9

– All of a sdden• -ist ot recent changes

–'atch# =ather +che"a# >ew AC8node/"odles/sers# (ata load# O+# >

– (eteriorated over a period• ho all are affected9

– All sers – +pecific to so"e "odle


11/54



• y this ti"e# we shold $e in a position to isolate which co"

sorce of the perfor"ance isse.• Once we identify the co"ponent# we need to investigate w

the pro$le".

• *ow to go a$ot doing that9


12/54



13/54



14/54


Approaching 'erfor"ance !sse

• &es'top

–Althogh it&s a thin client? $rowser ses @ava for the present – !t reires so"e resorce at the (es%top.

–Chec% if there&s enogh resorce C'B/A

–nsre that no heavy applications are rnning when accessapplications.


15/54



• (oncurrent )anager

– Concrrent Do$s are C'B intensive. – *ence ensre enogh resorce C'B/A is availa$le on the ( tier.

– Chec% AC ) 'C' configration.

– Chec% concrrent "anager definition for +leep ti"e ) Cache are set correct

– Chec% resorce8intensive $atch reests are schedled dring pea% hors. ;"anager for long rnning process with less n"$er of "anagers<

– Chec% there are short rnning reests waiting for a longer ti"e to process +peciali6ed anagers<

– Chec% ndEconcrrentEreests ) 'rocesses are prged ) defrag"ented re

– Avoid ena$ling an e5cessive n"$er of standard or speciali6ed "anagers.

– >ote 10FGH02.1 est 'ractices for 'erfor"ance for Concrrent anagers


16/54



• or"s +erver

–e"ory !ntensive. nsre sfficient A#+wap ) C'B. –Chec% +ar ) top ;loo% for spinning fI0we$"5<

–Chec% O+I0ECATC*T O+ECO(E=OB'E

– Chec% if (e$g/( ena$led.

–Chec% load $alancing ena$led and wor%s effectively.

–-atest or"s 'atch set level with !O patches.

–+ervlet Ls +oc%et ode


17/54



• Applications

–*ow "any concrrent sers are there9 –hat are all the "odles sed9

–Any resorce8intensive "odle is sed.

–hen was gather sche"a statistics reest rn last9

–(iagnostics profiles are ena$led ? this will cons"e lots of r

–+ign on Adit is disa$led if not needed.

–Adit on other ta$les have $een ena$led ;additional overh

–'rging is done periodically.


18/54



• &ata*ase

– ( processes are $asically C'B !ntensive. – Chec% adeate resorce ;C'B/A< is availa$le.

– onitor +ar/v"stat otpt ;first thing to do< – !f io is high then need to chec% !/O setp ) +,- eries

– !f C'B is high then chec% for C'B8intensive eries.

– onitor top O+ process at O+ level –Top ;*'< / prstat ;+n< / ps a5 ;A!J<

– init.ora setp ;efer note 1G4I0F.1 <

– Lersion of the (ata$ase ) perfor"ance patch applied.

– A / +tatspac%


19/54



• +e* Tier ,(#./ Apache 0 .ser12 – Chec% if @L is hanging ;de to Ot of e"ory isse


20/54



21/54


(ifferent Trace -evels

• or possi$le levels:

–-evel 1 : eglar Trace / +,- Trace –-evel 4 : Trace with inds

–-evel H : Trace with aits

–-evel 12 : Trace with inds and aits

• M-evel H& is the preferred for analy6ing perfor"ance isses.


22/54


Create Trace ile 3 or"

• Trace "en availa$ility: 11.F.G or higher

• Trace file na"e contains application Bser >a"e• Trace in 're 11.F.G

– !dentify the +ession/'rocess !d then ena$le trace as $elow.

–OA(B= +TO+'!( ))pid

–OA(B= L>T 1004I TAC >A CO>TJT OL – re" OA(B= L>T 1004I TAC >A CO>TJT off


23/54



24/54


Concrrent eport Tracing

• eport -evel Ls 'rogra" level

1. +et Nna$le Trace flag in the Concrrent 'rogra" (efinit;'rogra" level<

2. na$le trace for a specific reest ;++ for" 3P (e$g Op;eest level<

–The profile NConcrrent: Allow (e$gging shold $e set to NQ

–eco""ended way to ena$le trace.

na$ling Trace at the 'rogra" -evel


25/54


na$ling Trace at the 'rogra" -evel

na$ling Trace at the eest -evel


26/54


na$ling Trace at the eest -evel


27/54


Create a Trace ile 3 +elf +ervice

• To generate ( trace if we$ pages are slow. There are two

1. +et 'rofile Option N>(: (iagnostics to Qes2. Alternative: 'rofile Option called M!nitiali6ation +,- +tate"

–hat to choose fro" the a$ove two options9

–Choose option 2 # if the we$ page hangs and prevents yo fro"


28/54


l h


29/54


Create a Trace ile 3 Anywhere

• 'rofile Option :!nitiali6ation +,- +tate"ent 8 Csto"

• Can always $e sed# e.g.: – Concrrent 'rogra"s – ac%grond processes li%e or%flow – ...

• +et on Bser level only• +,- code will e5ecte for each new ( session which it initiali6ed for

ser• +,- +tate"ent for a level 12 trace:begin fnd_ctl.fnd_sess_ctl ('','','TRUE','TRUE','LOG'SESSION SET tracefile_identifier=''!TRA"E'' E#ENTS='NAE "ONTET )ORE#ER, LE#EL $*'''+ end


30/54


h ! T'O9


31/54


hat !s T'O9

• or"atted report of +,- Trace file

• !ncldes all +,- state"ents with statistical info• Allows to identify the perfor"ance pro$le" $y sing differ

"ethods

• In1o'e t'prof from &ata*ase Tier ,3g4g2

= tti T'O O t t


32/54


=etting T'O Otpt

• t%prof tracefile.trc otpt.t5t sortRfchela#e5eela#prsela

– !nvo%e t%prof fro" (ata$ase Tier –Bpload raw trace and t%prof otpt

– i.e. otpt.t5t and tracefile.trc


33/54


total

time

&

!dentif C lprit +,- +tate"ent


34/54


!dentify Clprit +,- +tate"ent

• !dentify Clprit +,- state"ent is within T'O files

• ost relevant is T'O 3 +orted $y elapsed ti"e• !n general the first +,- state"ent is the clprit

Tip: Always loo% for Mlarge n"$ers&

=ather nhanced 5plain 'lan


35/54


=ather nhanced 5plain 'lan

• !solate the clprit +,- state"ent in a te5t file• =ather nhanced 5plain 'lan sing +,-TJ'-A!>.+,-: >ote.21F1HG.1

– !solate the e5pensive (-. – Collect statistics for the ta$les involved in the ery.

• exec fnd_stats.gather_table_stats ('APPLSYS','FND_CONCU!N"_!#U!S"S',P!C!N – Any fll ta$le scan is sed. +ee any inde5 can $e sed

• Create new csto" inde5es on csto" ta$les. !ts sggested not to create inde5es on sreco""ended $y s.

– e8write the csto" ery to speed p the ery – nsre Te"p# interface ta$les are prged and defrag"ented.

– Bnselective inde5 is $eing sed. – e$ild the inde5es associated only if necessary. – 'atch ;for *igher version of code < which resolves it.

• -og an + with Oracle +pport


36/54



37/54


(O

• (e"o A eport

– !f yo see any (- is cons"ing "ore elapsed ti"e# get thsing slEid as $elow. Qo can rn the following co""andsrn8ti"e statistics# as well as past plans recorded in A:

–+,-P +-CT S Ota$le;d$"sE5plan.displayEcrsor;)slEid#nll#A--+TAT+


38/54


A/ +tatspac% eport

• Top $ E1ents section

This section shows the Top F ti"ed events that must *e considered to focus the tuning e

Top F ait vents

----------------- ait / T0tal

E1ent aits Ti2e (cs+ t Ti2e

333333333333333333333333333333333333 333333333333 3333333333 333333333333

db file se45ential read $,676,78 $$,*%6,*7$ &*.6

db file scattered read 67*,79: 7,9$,%8* 8.69

b5ffer b5s; Net brea?@reset t0 client $9,&:7,87 &76,%* $.:7

3333333333333333333333333333333333333333333333333333333333333

A / +tatspac% eport


39/54


A / +tatspac% eport

• 5andling 6d* file scattered read7

This wait happens when a session is waiting for a "lti $loc% !O to co"plete. Tdring fll ta$le scans or inde5 fast fll scans.

– Chec% if there are any fll ta$le scans. !n this case ery tning shold $e sed to opti"i

– +ee if partitioning can $e sed to redce the a"ont of data yo need to scan.

– eview +=A (ata$ase ffer Cache

est 'ractices for a5i"i6ing the 'erfor"ance


40/54



• Techstac' upgrade ;for 'erfor"ance ) *igh8Availa$ility<

– Bpgrade (ata$ase to 11.2.0.4 ;>ote 10FHGI7.1 ) (oc !( HH1F0F.

– OracleA+ 10g elease 7 'atch +et F ;10.1.7.F.0< ;>ote 4F4H11.1<

– or"s $ndle patch on10.1.2.7.0 ;(oc !( 47GHGH.1<

• Bpgrade + to -atest version 12.1.7 ;or< 12.2.4 ;>ote 2IU.1

• Apply eco""ended 'erfor"ance 'atches ;(oc !( 244040.1



41/54



• eglar *ealth chec% to $e perfor"ed

• (ata$ase

– +fficient resorce C'B/A availa$le ;20 8 70V free A/C'B is healthy< – +ar ) Top process has to $e e5a"ined ;+tore it ? can $e sed later to co"pare<

– nsre init.ora para"eters are as per standards.

– A/+tatspac% report e5a"ined often.

• or"s +erver

– +fficient resorce A ) +A' availa$le

– +pinning of for"s process

• set O+ECO(E=OB'EAJR10000 ;(oc !( G4FG11.1<

• Cancel ,ery N>(: na$le Cancel ,ery to M>o&

• Twea% O+I0ECATC*T ) O+ECATC*T

– +ervlet Ls +oc%et ode https://$logs.oracle.co"/stevenChan/entry/whichEisE$etterEfor"sEservletE

• >ote 7H4241.1 3 Bsing or"s +oc%et ode with Oracle 8siness +ite elease 12


https://blogs.oracle.com/stevenChan/entry/which_is_better_forms_servlet_or_socket_modehttps://blogs.oracle.com/stevenChan/entry/which_is_better_forms_servlet_or_socket_mode


42/54



• Concrrent anager

– Tne sing est 'ractice Concrrent anager ;>ote 10FGH02.1<

– +fficient resorce C'B/A availa$le

– +leep ti"e ;70 secs< ) Cache si6e ;eal to n"$er of process< – +peciali6ed anger are sed if needed.

– 'rge / de8frag"ent Concrrent ta$les

• Applications

– =ather sche"a statistics collected at reglar interval with 3 8 #3 9

– 11g (ata$ase # Apply Apps 'atch 1I410424 ;12.1.5< 1I410424 ;12.0.5< 14G0GUGF ;11.F.10< to speed to-eave V as nll ;(oc !( 1FHI7G4.1<

– (iagnostics profiles/(/Traces are disa$led if not needed.

– *ardware +i6ing.

– +ign8on Adit ) Adit ta$les are disa$led if not needed.

– 'rge ) (e8frag"ent interface/transaction ta$les periodically. ;>ote GF2722.1<

• 'rge portal is availa$le in OA that can $e sed to prge Apps.



43/54



• Networ'

– Adit >etwor% sage.

– Tool to help identify the sorce of the pro$le"

• Oracle 8siness +ite >etwor% Btilities: est 'ractices W!( FFIG7H.1X

– >ote UIGUU2.1 3 +y""etrical >etwor% Acceleration with Oracle 8siness +ite e

– >ote GHIFH2.1 3 'erfor"ance (egradation in or"s in 12 hen not Bsing +wan C

• e$ Tier ;OC4@# Apache ) @serv<

– nsre heapsi:e is set properly ;(oc !( 7I2HF1.1 <

– Tne sEoacoreEDv"EstartEoption ;12< ;(oc !( 7I2HF1.1<

• Y grep sEoacoreEDv"EstartEoption YCO>TJTE!- ;O+ co""and to chec% it ot

– Tne oacoreEnprocs; 12<

– Tne Ap@+erv=rop OACore=rop in Dserv.properties ;11i <


44/54


Best Practices for ma;imi:ing performance ,!

Configre 2 = @L *eap +pace for oacore.

– This can roghly spport 1F0 to 200 sers depending on sage.

– (efalt is F12 ;roghly spports F0 sers<

Add "ore oacore instance to spport "ore sers.

se "ltiple "anaged instances instead increasing heap si6e.

Note= Qo shold always si6e yor syste"s $ased on tests singrepresentative data and wor%loads for yor own environ"ent.

acore .>) (onfiguration


45/54


Best Practices for ma;imi:ing performanceacore .>) (onfiguration


46/54


+""ary

• onitor esorce ;C'B/ !/O /A< Btili6ation.

• nsre !nit.ora standards are "et ;>ote 1G4I0F.1<• A eport for (ata$ase wide perfor"ance isse

• est 'ractice Concrrent anager ;>ote 10FGH02.1<

• 'rge ) (efrag"ent interface/transaction ta$les. ;>ote GF272

• =ather +che"a +tatistics at reglar !nterval.• Apply >(E+TAT+ patch 1I410424 ;12.1.5< 1I410424 ;12.0.5<

;11.F.10< to speed to =ather sche"a +tats ;relevant for 11g (a

• Bpgrade Applications ) Techstac%.

'erfor"ance Tning

eferences


47/54


• A *olistic Approach to 'erfor"ance Tning Oracle Applications +yste"s ;(oc !(

• est 'ractices for 'erfor"ance for Concrrent anagers in + ;(oc !( 10FGH0

• edcing Qor + (ata ootprint sing Archiving# 'rging# and !- ;(oc !( GF• $deEch%Ec$o.sl 8 + initiali6ation para"eters 8 *ealthchec% ;(oc !( 1G4I0F.

• Collecting (iagnostic (ata for 'erfor"ance !sses in Oracle 8siness +ite ;(1121047.1<

• Oracle 8siness +ite eco""ended 'erfor"ance 'atches ;(oc !( 244040.1

• https://$logs.oracle.co"/stevenChan/entry/whichEisE$etterEfor"sEservletEo

eferences

https://blogs.oracle.com/stevenChan/entry/which_is_better_forms_servlet_or_socket_modehttps://blogs.oracle.com/stevenChan/entry/which_is_better_forms_servlet_or_socket_mode


48/54


• @L: =idelines to setp the @ava Lirtal achine in Apps $11i and 12 ;(oc !( 7I2HF1.1


49/54


?pgrading E-Business Suite<

• hich Oracle 8siness +ite elease +hold Qo Target: 12.1 or 121FU21UG.1<

• Bpgrade Advisor: 8siness +ite ;+< Bpgrade fro" 11.F.10.2 to 12IU.1<

• !nteropera$ility >otes + 12 with (ata$ase 11g2 ;(oc !( 10FHGI

• !nteropera$ility >otes Oracle + 11i with Oracle (ata$ase 11g2 ;1HH1F0F.1<

• Bpgrading to the -atest OracleA+ 10g 10.1.7.5 'atch +et in Oracle 8elease 12 ;(oc !( 4F4H11.1<

• Bpgrading OracleA+ 10g or"s and eports in Oracle 8siness +it;(oc !( 47GHGH.1<

eferences


50/54


?pgrading E-Business Suite<

• These doc"ents provide a starting point for csto"ers "oving to Oracle 8siness +ite elease 12.2.

• hich Oracle 8siness +ite elease +hold Qo Target: 12.1 or 12.29 ;(oc !( 1FU21UG.1<

• +cenarios for =etting +tarted ith Oracle 8siness +ite elease 12.2 ;(oc !( 1FHG1UF.1<

• Oracle 8siness +ite Technical 'lanning =ide# irst dition# elease 12.2 ;(oc !( 1FHFHFG.1<

• Bsefl 12.2 (oc"ents or Csto"ers And AT= +pport ngineers ;(oc !( 1FHFHHU.1<

• (ata$ase 'reparation =idelines for an 8siness +ite elease 12.2 Bpgrade ;(oc !( 174U240.1<

• 12.2: Consolidated -ist of 'atches and Technology g i5es ;(oc !( 1FU42G4.1<

• 12.1 and 12.2 Oracle 8siness +ite 'reinstall 'atches eport WLideoX ;(oc !( 144H102.2<

• Oracle 8siness +ite eco""ended 'erfor"ance 'atches ;(oc !( 244040.1<

• est 'ractices for ini"i6ing Oracle 8siness +ite elease 12 Bpgrade (ownti"e ;(oc !( 1FH1F4U.1<

• 5press (iagnosis of Oracle 8siness +ite elease 12 Bpgrade 'erfor"ance !sses ;(oc !( 1FH7GF2.1<

• Oracle 8siness +ite 'erfor"ance =ide ;(oc !( 1IG21G4.1<

• Oracle 8siness +ite elease 12.2: Bpgrade +i6ing and est 'ractices ;(oc !( 1FUGF71.1<

• http://docs.oracle.co"/cd/2I401E01/inde5.ht"


51/54


Qo can visit s at

https://co""nities.oracle.co"


52/54


, ) A


53/54



54/54

ebs tuning kanda session perf

Documents