performance tuning siebel software on the sun™ platform

8/11/2019 Performance Tuning Siebel Software on the Sun™ Platform

http://slidepdf.com/reader/full/performance-tuning-siebel-software-on-the-sun-platform 1/79

Performance TuningSiebel Software

on the Sun™ Platform

Khader MohiuddinEngineering Lead Sun-Siebel AllianceMarket Development EngineeringSun Microsystems, Inc

!une "##$



Copyright 2006 Sun Microsystems, Inc., 4150 Network Circle, Snt Clr, Cli!orni "5054, #.S.$. $ll rightsreser%e&.

#.S. 'o%ernment (ights ) Commercil so!twre. 'o%ernment users re su*+ect to the Sun Microsystems, Inc. stn&r&license greement n& pplic*le pro%isions o! the $( n& its supplements. #se is su*+ect to license terms.-his &istri*ution my inclu&e mterils &e%elope& *y thir& prties.

rts o! the pro&uct my *e &eri%e& !rom /erkeley /S systems, license& !rom the #ni%ersity o! Cli!orni. #NI is

registere& tr&emrk in the #.S. n& in other countries, eclusi%ely license& through 3pen Compny, t&. X/Openis a registered trademark of X/Open Company, Ltd.

Sun, Sun Microsystems, the Sun logo, Solaris, Sun Fire, Sun Enterprise, StorEdge, a!a, and "#he $et%ork&s #he Computer' re tr&emrks or registere& tr&emrks o! Sun Microsystems, Inc. in the #.S. n& other countries.

$ll S$(C tr&emrks re use& un&er license n& re tr&emrks or registere& tr&emrks o! S$(C Interntionl,Inc. in the #.S. n& other countries. ro&ucts *ering S$(C tr&emrks re *se& upon rchitecture &e%elope& *ySun Microsystems, Inc.

-his pro&uct is co%ere& n& controlle& *y #.S. port Control lws n& my *e su*+ect to the eport or import lws inother countries. Nucler, missile, chemicl *iologicl wepons or nucler mritime en& uses or en& users, whether

&irect or in&irect, re strictly prohi*ite&. port or reeport to countries su*+ect to #.S. em*rgo or to entitiesi&enti!ie& on #.S. eport eclusion lists, inclu&ing, *ut not limite& to, the &enie& persons n& specilly &esignte&ntionls lists is strictly prohi*ite&.

C#MN-$-IN IS (7I 8$S IS8 $N $ (SS ( IMI CNI-INS,((SN-$-INS $N 9$(($N-IS, INC#IN' $N: IMI 9$(($N-: M(C;$N-$/II-:, I-NSS ( $ $(-IC#$( #(S ( NN)IN(IN'MN-, $(ISC$IM, C- - -; -N- -;$- S#C; ISC$IM(S $( ; - / '$:IN7$I.

er!ormnce -uning Sie*el So!twre on the Sun lt!orm



Abstract

%his paper discusses the per&ormance optimi'ation o& a complete Siebel enterprisesolution on the Sun plat&orm %he article covers tuning &or the Solaris%M (peratingSystem, Siebel so&t)are, (racle database server, Sun StorEdge%M products, and Sun

!ava%M

System *eb Server *e also discuss uni+ue &eatures o& the Solaris (S thatreduce risk )hile helping to improve the per&ormance and stability o& Siebel applications

All o& the techni+ues described here are lessons learned &rom a series o& per&ormancetuning studies that )ere conducted under the auspices o& the Siebel lat&orm Si'ing ander&ormance rogram S.




1 Tuning for Price/Performance: Summary...................................................................................7

2 Siebel Application Architecture Overview..................................................................................

! Optimal Sun/Siebel Architecture for "enchmar# $or#loa%.................................................. 11

3.1 Hardware and Software Used ................................................................................................ 13

& $or#loa% 'e(cription................................................................................................................. 1&

4.1 OLTP (Siebel Web Thin Client nd Users!............................................................................14

4.2 "at#h Ser$er Co%&onents...................................................................................................... 14

) 1*+*** ,oncurrent -(er(: Te(t e(ult( Summary.................................................................... 1)

'.1 es&onse Ti%es and Transa#tion Thro)gh&)t ....................................................................... 1''.2 Ser$er eso)r#e Utili*ation ...................................................................................................1+

Siebel Scalability on the Sun Platform.......................................................................................17

7 Performance Tuning....................................................................................................................2*

,.1 T)ning Solaris OS for Siebel Ser$er .......................................................................................21<.1.1 Solris M-mlloc -uning !or Sie*el............................................................................... 21<.1.2 Solris $lternte -hre&s i*rry #sge.........................................................................22<.1.= -he Solris >ernel n& -C3I -uning rmeters !or Sie*el Ser%er ............................ 2=

,.2 T)ning Siebel Ser$er for the Solaris OS .................................................................................23<.2.1 -uning Cll Center, Sles3Ser%ice, n& eChnnel Sie*el Mo&ules................................. 24<.2.2 9ork!low .......................................................................................................................26<.2.= $ssignment Mnger -uning...........................................................................................2<<.2.4 $I)M?series.................................................................................................................. 2@<.2.5 $I);-- $&pter ..........................................................................................................2"

,.3 Siebel Ser$er S#alabilit- Li%itations and Sol)tions.............................................................. 3<.=.1 -he Sie*el M-sks #pper imit ro*lem................................................................... =0<.=.2 /lote& Sie*el rocesses ACommonly Mistken s Memory eksB...............................=4

,.4 T)ning S)n /a$a S-ste% Web Ser$er ......................................................................................3+

,.' T)ning the Siebel Web Ser$er 0tension (SWS!..................................................................3

,.+ T)ning Siebel Standard Ora#le atabase and S)n Storage.................................................. 3<.6.1 ptiml t*se Con!igurtion..................................................................................... ="<.6.2 roperly octing t on the isk !or /est er!ormnce..............................................40<.6.= isk yout n& rcle t rtitioning.......................................................................41<.6.4 Solris MSS -uning !or rcle Ser%er ..........................................................................44<.6.5 ;ot -*le -uning n& t 'rowth................................................................................ 4<




<.6.6 rcle rmeters -uning................................................................................................4<<.6.< Solris >ernel rmeters on rcle t*se Ser%er .................................................... 50<.6.@ S? ?uery -uning...........................................................................................................50<.6." (oll*ck Segment -uning............................................................................................... 5=<.6.10 t*se Connecti%ity #sing ;ost Nmes $&pter ...................................................... 5=

<.6.11 ;igh I3 with rcle Sh&ow rocesses Connecte& to Sie*el......................................54,., Siebel atabase Conne#tion Pooling .....................................................................................''

,. T)ning S)n /a$a S-ste% ire#tor- Ser$er (LP!................................................................'+

0 Performance Twea#( with o ain(..........................................................................................)7

Script(+ Tip(+ an% Tric#( for 'iagno(ing Siebel on the Sun Platform.................................... )

.1 To 5onitor Siebel O&en Session Statisti#s.............................................................................'

.2 To List the Para%eter Settings for a Siebel Ser$er ................................................................ '

.3 To 6ind O)t ll O5s C)rrentl- )nning for a Co%&onent .................................................. '

.4 To 6ind O)t the 7)%ber of #ti$e Ser$ers for a Co%&onent ................................................ +

.' To 6ind O)t the Tas8s for a Co%&onent ................................................................................ +

.+ To Set etailed Tra#e Le$els on the Siebel Ser$er Co%&onents (Siebel O5!.......................+

., To 6ind O)t the 7)%ber of 9UST Logins for a Co%&onent ...............................................+

. To Cal#)late the 5e%or- Usage for an O5 ..........................................................................+1

. To 6ind the Log 6ile sso#iated with a S&e#ifi# O5 .............................................................+1

.1 To Prod)#e a Sta#8 Tra#e for the C)rrent Thread of an O5 .............................................. +2

.11 To Show S-ste%:Wide Lo#8 Contention ;ss)es Using lo#8stat ............................................ +2

.12 To Show the Lo#8 Statisti# of an O5 Using &lo#8stat ........................................................ +4

.13 To <Tr)ss= an O5 ............................................................................................................... +'

.14 How to Tra#e the S>L State%ents for a Parti#)lar Siebel Transa#tion............................. +'

.1' Changing atabase Conne#t String$i ?O"C;7; and diting the field .Ser$er7a%e.......++

.1+ nabling@isabling Siebel Co%&onents...............................................................................++

1* Appen%i3 A: Tran(action e(pon(e Time(............................................................................. 0

11 Appen%i3 ": 'ataba(e Ob4ect( rowth 'uring the Te(t.......................................................7&

12 Appen%i3 ,: Oracle (tat(pac# eport .................................................................................... 77

1! eference(...................................................................................................................................7

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page '



Introduction

%o ensure that the most demanding global enterprise customers can meet theirdeployment re+uirements, engineers &rom Siebel Systems and Sun are )orking /ointly onseveral engineering pro/ects %heir common goal is to &urther enhance Siebel serverper&ormance on Sun0s highly-scalable Solaris (perating System

%his article is an e&&ort to document and spread kno)ledge o& tuning and optimi'ingSiebel 1 e2usiness Applications Suite on the Solaris plat&orm All o& the techni+uesdiscussed here are lessons learned &rom a series o& per&ormance tuning studiesconducted under the auspices o& the Siebel lat&orm Si'ing and er&ormance rogramS. %he tests conducted under this program are based on real-)orld scenariosderived &rom Siebel Systems customers, )hich re&lect some o& the most &re+uently usedand most critical components o& the Siebel e2usiness Applications Suite %his article alsoprovides tips and best practices--based on our e3perience--&or &ield sta&&, benchmark

engineers, system administrators, and customers )ho are interested in achieving optimalper&ormance and scalability )ith their Siebel-on-Sun installations %he &ollo)ing areas areaddressed in this paper4

• *hat are the uni+ue &eatures o& the Solaris (perating System that reduce risk)hile helping to improve the per&ormance and stability o& Siebel applications5

• 6or ma3imum scalability at a lo) cost, )hat is the optimal )ay to con&igure Siebelon the Solaris (S5

• 7o) does Sun0s 8hip Multithreading 8M%. technology based on the 9ltraSA:8I; processor bene&it Siebel solutions5

• 7o) can transaction response times be improved &or end users in large Siebel-on-

Sun deployments5• 7o) can an (racle database running on Sun StorEdge be tuned &or higher

per&ormance &or Siebel so&t)are5

%he per&ormance and scalability testing )as conducted at Sun0s Enterprise %echnology8enter E%8. in Menlo ark, 8ali&ornia, by Sun0s Market Development EngineeringMDE. )ith assistance &rom Siebel Systems %he E%8 is a massive, distributed testing&acility packing more computer po)er than many 6ortune <### corporations A &acility o&this magnitude provides the resources needed to test the limits o& so&t)are on a muchgreater scale than most enterprises )ill ever re+uire

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page +



1 Tuning for Price/Performance: Summary%he Solaris (perating System is the cornerstone so&t)are technology that enables Sunto deliver high per&ormance and scalability &or Siebel applications= and the (S contains anumber o& &eatures that enable customers to tune &or optimal price>per&ormance levels

Among the core &eatures o& the Solaris (S that contributed to the superior resultsachieved in the tests4

Solaris MTmalloc4 A standard &eature )ith the Solaris system )as enabled on theSiebel application servers %his is an alternate memory allocator module that )as builtspeci&ically &or multithreaded applications such as Siebel %he MTmalloc routinesprovide a &aster, concurrent malloc implementation %his &eature resulted in lo)ering89 consumption by ?@ %hough memory consumption doubled as a side e&&ect,overall price>per&ormance bene&its are positive %here have been improvements made onMTmalloc in Solaris <# (S )hich reduce the space-ine&&iciency penalty More details onthis topic are available in Section 1<<

Siebel Process Size4 6or an application process running on the Solaris (S, the de&aultsetting &or stack and data si'e is unlimited *e &ound that Siebel so&t)are running )iththe de&ault Solaris system setting caused bloated stack si'e and runa)ay processes thatcompromised scalability and stability o& Siebel on the Solaris (S Limiting the stack si'eto <M2 and increasing the data si'e limit to BC2 resulted in increased scalability andhigher stability 2oth ad/ustments let a Siebel process use its process address spacemore e&&iciently, &ully utili'ing the total process address space o& BC2 available to a ?"-bitapplication process A signi&icant drop in &ailure rate o& transactions only eight &ailuresout o& <" million total transactions. )as observed as a result o& these t)o changesMore details on this topic are available in Section 1?

Solaris Alternate Threads Library4 Solaris (S provides an alternate threadsimplementation )ith a one-level model <3<. in )hich user-level threads are associatedone-to-one )ith light)eight processes L*s. %his implementation is simpler than thestandard M3F. t)o-level model in )hich user-level threads are multiple3ed overpossibly. &e)er L*s *hen used on Siebel Application Servers, the <3< modelprovided good per&ormance improvements to the Siebel multithreaded applications Moredetails on this topic are available in Section 1<"

Solaris Multile Page Size Suort !MPSS"4 A standard &eature available in Solaris G(S and subse+uent versions, MSS gives applications the ability to run on the same (S)ith more than one page si'e 9se o& this Solaris library allo)s a larger heap si'e to be

set &or certain applications, )hich results in better per&ormance due to reduced %L2miss %his &eature )as enabled on the (racle server and resulted in per&ormancegains More details on this topic are available in Section 1$B

Solaris #esource Manager )as used on all tiers o& the setup to e&&iciently manage 89resources %his resulted in &e)er process migrations and translated to higher cache hits

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page ,



Sun Storage4 (racle database &iles )ere laid out on a Sun StorEdge SE$?"# system $I/O balancing )as implemented on the Siebel )orkload to reduce hot spots Also zonebit recording )as used on disks to provide higher throughput to the Siebel transactionsDirect I>( )as enabled on certain (racle &iles and on the Siebel &ile system More detailson this topic are available in Section 1$"

%onnection Pooling4 Siebel0s database connection pooling )as used, providing goodbene&its &or 89 and memory %)enty end users shared a single connection to thedatabase More details on this topic are available in Section 11

&sage of Aroriate Sun 'ardware4 ilot tests )ere per&ormed to characteri'e theper&ormance o& the )eb, application, and database across the current Sun product line7ard)are )as chosen based on best price>per&ormance rather than pure per&ormanceDetails on this topic are available in Section ?

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page



( Siebel Alication Architecture )*er*iewSiebel server is a &le3ible and scalable application server plat&orm that supports a varietyo& services operating on the middle tier o& the Siebel F-tier architecture, including dataintegration, )ork&lo), data replication, and synchroni'ation service &or mobile clients .

6igure "< provides a high-level vie) o& the Siebel application suite architecture

Figure 2.1

Siebel server includes business logic and in&rastructure &or running the di&&erent 8:Mmodules as )ell as connectivity inter&aces to the back end database It consists o&several multithreaded processes commonly re&erred to as HSiebel (b/ect Managers0

%hese can be con&igured so that several instances o& it can run on a single Solarismachine %he Siebel 13 server makes use o& gate)ay components to track usersessions

Siebel 13 has a thin client architecture &or connected clients %he Siebel 13 thin clientarchitecture is enabled through the Siebel plug-in S*SE Siebel *ebserver E3tension.running on the )eb server ItJs the primary inter&ace bet)een the client and the Siebel

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page



application server 6or more in&ormation on the individual Siebel components please re&erto Siebel product documentation at )))siebelcom

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page 1



+ )timal Sun/Siebel Architecture for ,enchmar- .or-loadSun o&&ers a )ide variety o& products ranging &rom hard)are and net)orks to so&t)areand storage systems %o obtain the best price>per&ormance &rom an application, oneneeds to determine )hich Sun products are appropriate %his selection process can be

achieved by understanding the applicationJs characteristics, picking Sun products suitableto those application characteristics, conducting a series o& tests, and then &inali'ing thechoice o& machines

6or this pro/ect, tests )ere done to characteri'e )eb, application, and databaseper&ormance across the current Sun product line 7ard)are )as selected based on bestprice>per&ormance rather than pure per&ormance criteria 6igure ?< illustrates thehard)are con&iguration used in the Sun E%8 testing Fote4 S6 stands &or Sun 6ireserver.


Web ServersSF V440/SF V880

Siebel Gateway

Sun Java System Directory

ServerSF V440

Siebel App Servers

SF V890

SF E2900

SF V440

SF E2900

SFV480

SF V440

Sun StorEdgeSE 6320

LoadGeneratorsSF V65x

Key:

Figure 3.1

Network tr!!ic *etween lo& genertors n& we* ser%ers

oint)oint '*ic *etween ech pp ser%er n& &t*se ser%er

Network pckets *etween we* ser%ers to pp ser%ers



A&ter collecting detailed kno)ledge o& SiebelJs per&ormance characteristics, thehard)are>net)ork topology depicted in 6igure ?< )as created %he Siebel end user)orkload (L%. )as distributed across three nodes4 Sun 6ire%M ;G#, Sun 6ire E"G##,and Sun 6ire ;BB# servers Each node ran all the Siebel components under test, that is,8all 8enter, eService, eSales, and e8hannel Siebel server component /obs batch testsEAI-7%%, EAI-M, *ork6lo), and 7%%-adapter. )ere distributed across Sun 6ire;BB# and Sun 6ire ;B# servers %he Siebel gate)ay and the Sun !ava SystemDirectory Server LDA. )ere intentionally placed on one physical machine the Sun 6ire;BB# server. because they are very lo) consumers o& 89 and memory resources *iththe Sun Ethernet CIC connectivity, net)ork throughput )as ade+uate Each o& themachines had three net)ork inter&ace cards FI8s., )hich )e used to isolate the maincategories o& net)ork tra&&ic4

< End-user load generator.-to-)eb-server tra&&ic sho)n in green." *eb server-to-gate)ay-to-Siebel-applications-server tra&&ic sho)n in black.? Siebel-applications-server-to-database-server tra&&ic sho)n in red.

%he net)orking )as done using a 8isco router 8atalyst B###. %)o ;LAFs )ere createdto separate net)ork tra&&ic bet)een <. and "., )hile ?. )as &urther optimi'ed )ithindividual point-to-point net)ork inter&aces &rom each application server to the database%his separation )as done to alleviate any possible net)ork bottlenecks at any tier )hichcould have occurred as a result o& simulating thousands o& Siebel users %he loadgenerators )ere all Sun 6ire ;$@ servers running Mercury Load:unner so&t)are %heload )as spread across three )eb server machines by directing di&&erent kinds o& userssuch as 8all 8enter or eService users, and so on. to the three )eb servers

All o& the Siebel application servers belonged to a single Siebel enterprise A singleE"G## server hosted the (racle database= this )as connected to a Sun StorEdge%M

SE$?"# system using a &iber channel




3.1 Hardware and Software Used

ateway Ser*er/L0AP:• < 3 Sun 6ire ;BB#

o < 3 <" C7' 9ltraSA:8 IIIio <$ C2 :AMo Solaris (S ">#B Ceneric<<1?@#-#"o Sun !ava System Directory Server

LDA B< SG

Alication Ser*ers:

• <3 Sun 6ire ;G#o 3 <"C7' 9ltraSA:8 I;

o ?" C2 :AMo Solaris (S ">#B Ceneric<<1?@#-#"o Siebel 1@"

• < 3 Sun 6ire E"G##o <" 3 <" C7' 9ltraSA:8 I;o B C2 :AMo Solaris (S ">#B Ceneric<<1?@#-#"o Siebel 1@"

• " 3 Sun 6ire ;BB#o B 3 <" C7' 9ltraSA:8 IIIio <$ C2 :AMo Solaris (S ">#B Ceneric<<1?@#-#"o Siebel 1@"

• < 3 Sun 6ire ;B#o B 3 <" C7' 9ltraSA:8 IIIiNo <$ C2 :AMo Solaris (S ">#" Ceneric<#@"-"1o Siebel 1@"o I2M M Series @" 6"

0atabase Ser*er:• < 3 Sun 6ire E"G##

o B 3 <" C7' 9ltraSA:8 I;o <$ C2 :AMo Solaris G (S ">#B

Ceneric<<1<@#-#@o (racle G"#" ?"-bito Sun StorEdgeO SE$?"#

Storage Array B trays "N".,B3<B3?$C2 <@Krpm 68-ALdrives

Load #unner 0ri*ers:• @ 3 Sun 6ire ;$@3

o B 3 ?#" C7' Peono ? C2 :AMo *indo)s P S<o Mercury Load:unner 1@<

.eb Ser*ers:

• " 3 Sun 6ire ;BB#o B 3<" C7' 9ltraSA:8 IIIio <$ C2 :AMo Solaris (S ">#B

Ceneric<<1?@#-#"o Sun !ava System *eb Server

$# S"o Siebel 1@" S*SE

• < 3 Sun 6ire ;#o " 3 G## M7' 9ltraSA:8 IIIio <$ C2 :AMo Solaris (S ">#"

Ceneric<#@"-<?o Sun !ava System *eb Server

$# S"o Siebel 1@" S*SE




.or-load 0escrition All o& the tuning discussed in this document is speci&ic to the S )orkload as de&inedby Siebel Systems %he )orkload )as based on scenarios derived &rom large Siebelcustomers to re&lect some o& the most &re+uently used and most critical components o&

the Siebel e2usiness Application Suite At a high level the )orkload &or these tests canbe categori'ed into the t)o categories4 <. (L% and ". batch server components

4.1 OLTP (Siebel Web Thin Client End Users)

(L% simulated the real )orld re+uirements o& a large organi'ation )ith <#,###concurrent users involved in the &ollo)ing tasks and &unctions in a mi3ed ratio.4

• 8all 8enter sales and service representatives. 1### concurrent users

• artner :elationship Management partner organi'ations. e8hannel,<### concurrent users

• *eb sales customers. eSales, <### concurrent users• *eb service customers. eService, <### concurrent users

%he end users )ere simulated using Load:unner version 1@< S< &rom MercuryInteractive, )ith a think time in the range o& @ to @@ seconds or an average o& ?#seconds. bet)een user operations

4. !at"h Ser#er Co$%onents

%he batch component o& the )orkload consisted o&4

< Siebel Assignment Manager " Siebel *ork&lo)

? Siebel EAI M Series Adapter B Siebel EAI-7%% Adapter

%he Siebel 1 Assignment Manager processed assignment transactions &or salesopportunities based on employee positions and territories Siebel 1 *ork&lo) Managere3ecuted )ork&lo) steps based on inserted service re+uests %he Siebel 1 EAI MSeries Adapter read &rom and placed transactions into I2M M Series +ueues %heSiebel 1 EAI-7%% Adapter e3ecuted re+uests bet)een di&&erent )eb in&rastructures

All o& the tests )ere conducted by making sure that both the (L% and batchcomponents )ere run in con/unction &or a one hour period steady state. )ithin the same

Siebel enterprise installation




2 134333 %oncurrent &sers: Test #esults Summary

%he test system demonstrated that Siebel 1 architecture on Sun 6ire servers and (racleGi database easily scales to <#,### concurrent users

● 5ertical scalability$ %he Siebel 1 Server sho)ed e3cellent scalability )ithinan application server

● 'orizontal scalability$ %he benchmark demonstrates scalability acrossmultiple servers )ithout degradation

● Low networ- utilization$ %he Siebel 1 Smart *eb Architecture and SmartFet)ork Architecture e&&iciently managed the net)ork consuming only @@kbps per user

● 6fficient use of the database ser*er$ %he Siebel 1 Smart Database

8onnection ooling and Multiple3ing allo)ed the database to service<#,### concurrent users and the supporting Siebel 1 Server applicationservices )ith B# database connections

%he actual results o& the per&ormance and scalability tests conducted at the Sun E%8 &orthe Siebel )orkload are summari'ed in the &ollo)ing section o& the article 8hapter resents speci&ic per&ormance tuning tips and the methodology used to achieve this levelo& per&ormance.

&.1 'es%onse Ti$es and Transa"tion Throh%t .or-load 7umber of

&sersA*erage)eration

#esonseTime !Sec"

,usinessTransactions

Throughut/'our

.or-load ,usinessTransactions

Throughut/'our

8all 8enter Sales and Service. 1,### <"$ ?B,11 Assignment Manager <<,B"1

artner :elationship Management <,### ?#? <",@B# EAI - 7%% Adapter "1,?@"

eSales<,### "1B $,11@

EAI - M Series Adapter <<,?<G

eService <,### <GG <",1# *ork&lo) Manager @?,B?G

%otals <#,### F>A $$,G$B

Table '.1

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page 1'



&. Ser#er 'esor"e Utili*ation

6ig)re '.2

7ode 8unctional &se 9 %P&&tilization

Memory&tilization !M,"

< 3 Sun 6ire E"G## B89,<$C2. (racle Database Server @< <$G#< 3 Sun 6ire ;B# B89,<$C2. Siebel App Server EAI-7%% N *ork6lo) $@ "#1@

< 3 Sun 6ire ;BB# B89, <$C2. Siebel App Server AM N EAI M series ?1 <1B"

< 3 Sun 6ire ;BB# B89, <$C2. Siebel App Server <$## end users G< <#,$$$

< 3 Sun 6ire E"G## <"89, BC2. Siebel App Server B## end users $$ ?,G@$

<3 Sun 6ire ;G# 89,?"C2. Siebel App Server ?$## end users $ "@,1<

<3 Sun 6ire ;BB# B89, <$C2.Sun !ava System *eb Server 7%% Adapter,*ork6lo)

<"$

< 3 Sun 6ire ;# B89,<$C2. Sun !ava System *eb Server Application re+uests BG <$

< 3 Sun 6ire ;BB# B89, <$C2. Sun !ava System *eb Server Application re+uests @B ""@

< 3 Sun 6ire ;BB# B89, <$C2.Siebel Cate)ay Server>Sun !ava System DirectoryServer

<< <

Table '.2

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page 1+



Siebel Scalability on the Sun Platform

(n the Sun plat&orm the Siebel application scales to high concurrent users e3tremely)ell *ith Siebel0s &le3ible distributed architecture and Sun0s large server product line, an

optimal Siebel-on-Sun deployment can be achieved either )ith several small one to &our89. machines or )ith a single large Sun machine such as a E<@K, E$G##, and so on.%he &ollo)ing graphs depict Siebel scalability on di&&erent Sun machine types All thetuning that )as applied to achieve these results as documented in the ne3t chapter inthis article. can be applied on production systems

Figure 6.1

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page 1,



Figure 6.2

%he ;BB# server uses 9ltraSA:8 III chips )hile the ;G# and E"G## use 9ltraSA:8I; chips 6igure $" sho)s the di&&erence in scalability bet)een the classes o& Sunmachines 8ustomers can this data &or the capacity planning and si'ing o& their real )orlddeployments Keep in mind that the )orkload used &or these results should be identical to

the customer real-)orld deployment or appropriate ad/ustments need to be made to theserver si'ing 6or more )orkload details, please see Section B




%ost er Siebel &ser on Sun Platform

Figure 6.3* Note:$$/user nuber is based !urely on "ard#are cost and does not include enironental %actors&

%acilities& serice& or anageent .

Sun servers provide the best price>per&ormance &or Siebel applications 6igure $?depicts the costs o& the typical Siebel user on various models o& Sun servers tested

Price/Performance Summary Per Tier of the Sun;Siebel 0eloyment

Application tier4 Sun 6ire ;BB#4 BB# users>89 Q<1@1>user. Sun 6ire ;G#4 $$" users>89 Q"?B">user. Sun 6ire E"G##4 $#$ users>89 Q?1@B>user.

Database tier Sun 6ire E"G##.4 BG#" users>89 Q@B$>user.

*eb tier Sun 6ire ;BB#.4 "B@? users>89 Q?<@>user.

Average response time4 &rom #<"$ to #?#? sec component-speci&ic. Success rate4 R GGGGG &ailures out o& <" million transactions.




< Performance Tuning

Many people think solving a per&ormance problem is a mysterious talent, ho)ever thereis a particular methodology at )ork 6igure < sho)s the process &lo) o& approaching a

per&ormance problem or simply tuning the system &or best per&ormance

Figure '

9se o& a methodology like the process sho)n in 6igure 1< can take the black magic outo& per&ormance tuning because there are several books and )hite papers dedicated tothe sub/ect o& per&ormance tuning methodologies, the sub/ect is not being covered indetail in this )hite paper %he scope o& this )hite paper is to provide the reader )ith

speci&ic tuneables &or the Siebel>Sun plat&orm %he current chapter provides speci&icsuggestions &or per&ormance and scalability tuning %hese suggestions are based onlessons learned &rom the tests conducted at the Sun E%8 and through years o&collaborative engineering bet)een Sun and Siebel




+.1 Tnin Solaris OS for Siebel Ser#er

<$1$1 Solaris MTmalloc Tuning for Siebel

%he alternate memory allocator module, )hich is standard to the Solaris (S and )as

built speci&ically &or multithreaded applications such as Siebel, )as enabled on the Siebelapplication servers %he MTmalloc routines provide a &aster, concurrent mallocimplementation %his &eature resulted in lo)ering 89 consumption by ?@ %houghmemory consumption doubled as a side e&&ect, overall price>per&ormance bene&its )erepositive In Solaris <# (S, improvements have been made on MTmalloc to reduce thespace-ine&&iciency cost

6ffect of MTmalloc on %P& ,enefit and Memory %ost

Figure '.1.1

In 6igure1<<, the blue curve sho)s the percentage reduction in 89 usage &or Siebelapplications running on di&&erent Sun 6ire SM machines )ith MTmalloc enabled %he

red curve sho)s the corresponding increase in memory usage due to use o& MTmalloc As is apparent &rom 6igure 1<<, enabling MTmalloc on a B 89 machine )ill not bebene&icial= there is @< increase in memory usage by Siebel )hile 89 utili'ationremains the same er&ormance gains begin to get better )hen MTmalloc is used onSiebel server running on 89 machines and up)ards (n an 89 machine ;G#.one can e3pect " reduction in 89 utili'ation )hen using the MTmalloc &eature%hough memory usage by the Siebel application increases )hen MTmalloc is tuned,




this is not a big disadvantage, as the standard Sun machine con&iguration has amplememory

%he vBB# has B 89s )ith <$Cbytes o& memory A typical Siebel user on the Sunplat&orm uses about BMbytes o& memory )hile the 89 use is much higher incomparison, so the higher memory &ootprint is a bene&icial trade o&&

7o) does one enable MTmalloc5

< Edit the &ile $SIEBEL_ROOT/bin/siebmtshw" Add the line LD_PRELOAD=/usr/lib/libmtmalloc.so? Save the &ile and bounce Siebel servers4. A&ter Siebel restarts, veri&y that MTmalloc is enabled by e3ecuting the

&ollo)ing command4$%pldd -p <pidofsiebmtshmw> | grep -i mtmalloc

<$1$( Solaris Alternate Threads Library &sage

Solaris (S provides an alternate threads implementation )ith a one-level model <3<.9ser-level threads are associated one-to-one )ith light)eight processes L*s. %hisimplementation is simpler than the standard M3F. t)o-level model in )hich user-levelthreads are multiple3ed over possibly &e)er light)eight processes %he <3< model )asused on Siebel Application Servers and provided good per&ormance improvements to theSiebel multithreaded applications because the Siebel 1@" alternate threads library isenabled by de&ault I& you are using a version o& Siebel older than 1@" then the alternatethreads library is not enabled by de&ault

rocedure to enable the alt thread &eature4

< 9pdate the env variable &or the 9FIPT user that runs Siebel server" I& you are using Korn shell, open up the .profile &or the Siebel o)ner

and add this to the bottom o& the &ile? E3port !"LIBRARY"#T&'usr'lib'lwp($!")*++,"#TB Stop Siebel@ E3it &rom shell and log in again so the change in .profile is in e&&ect$ Start Siebel

%o veri&y i& alt thread is indeed being used4

pldd -p <pidofsiebmtshmw> | grep -i lwp

%he preceding command should return the current Solaris lib, )hich is'usr'lib'lwp'




<$1$+ The Solaris =ernel and T%P/>P Tuning Parameters for Siebel Ser*er Parameter Scoe 0efault

5alueTuned 5alue

shmsys:shminfo_shmmax /etc/system #3&&&&&&&&&&&&&&&& shmsys:shminfo_shmmin /etc/system <##shmsys:shminfo_shmseg /etc/system "##semsys:seminfo_semmns /etc/system <"#G"semsys:seminfo_semmsl /etc/system @<"semsys:seminfo_semmni /etc/system B#G$semsys:seminfo_semmap /etc/system B#G$semsys:seminfo_semmnu /etc/system B#G$semsys:seminfo_semopm /etc/system <##semsys:seminfo_semume /etc/system "#B

msgsys:msginfo_msgmni /etc/system "#Bmsgsys:msginfo_msgtql /etc/system "#Bmsgsys:msginfo_msgssz /etc/system $Bmsgsys:msginfo_msgseg /etc/system ?"1$1msgsys:msginfo_msgmax /etc/system <$?Bmsgsys:msginfo_msgmnb /etc/system <$?Bip:dohwcksum (for resonategbic)

/etc/system #

rlim"fd"ma 'etc'sstem <#"B <$?Brlim"fd"cur 'etc'sstem $B <$?Bs/"ma"si0e 'etc'sstem " #tcp"time"wait"interval ndd 'dev'tcp "B#### $####tcp"conn"re/"ma"/ ndd 'dev'tcp <" <#"Btcp"conn"re/"ma"/1 ndd 'dev'tcp <#"B B#G$tcp"ip"abort"interval ndd 'dev'tcp B#### $####tcp"2eepalive"interval ndd 'dev'tcp 1"##### G#####tcp"remit"interval"initial ndd 'dev'tcp ?### ?###tcp"remit"interval"ma ndd 'dev'tcp "B#### <####tcp"remit"interval"min ndd 'dev'tcp "## ?###tcp"smallest"anon"port ndd 'dev'tcp ?"1$ <#"Btcp"slow"start"initial ndd 'dev'tcp < "tcp"mit"hiwat ndd 'dev'tcp <"G ?"1$

tcp"fin"wait"3"flush"interval ndd'dev'tcp $1@## $1@###tcp"recv"hiwat ndd 'dev'tcp <"G ?"1$

(able '.1.3

+. Tnin Siebel Ser#er for the Solaris OS

%he key &actor in tuning Siebel server per&ormance is the number o& threads or users perSiebel ob/ect manager (M. process Siebel server architecture consists o& multithreadedserver processes servicing di&&erent business needs 8urrently, Siebel is




designed such that one thread o& a Siebel (M services one user session or task %heratio o& threads or users>process is con&igured using the Siebel parameters4

• MinMT4ervers

• MaMT4ervers

• MaTas2s

6rom several tests conducted it )as &ound that on the Solaris plat&orm )ith Siebel 1@ the&ollo)ing users>(M ratios provided optimal per&ormance4

• %all %enter # users>(M• e%hannel B# users>(M

• eSales @# users>(M• eSer*ice $# users>(M

As you can see, the optimal ratio o& threads>process varies )ith the Siebel (M and the

type o& Siebel )orkload per user MaTas2s divided by MaMT4ervers determines thenumber o& users>process 6or e3ample, &or ?## users the setting )ould beMinMt4ervers&56 MaMT4ervers&56 Matas2s&711 %his )ould direct Siebel todistribute the users across the $ processes evenly, )ith @# users on each %he notion o&anonymous users must also be considered in this calculation, as discussed in the 8all8enter section, the e8hannel section, and so on %he prstat 8v or the top commandsho)s ho) many threads or users or being serviced by a single multithreaded Siebelprocess

#)! 94:+;M: 4): +44 4TT: #+) ;)=: T)M: =#9 #+=:44';?#@AA1 pspp B1CM 3DAM cpu@C 3A 1 1(11.11 @1% siebmtshmw'5D

@A5A pspp C5@M @3BM sleep BA 1 1(11.11 3.B% siebmtshmw'5@ @33E pspp 5AEM B@5M cpu7 33 1 1(11.17 @.5% siebmtshmw'53 @EB@ pspp 571M CCEM sleep BD 1 1(11.1@ @.B% siebmtshmw'BD @EAD pspp BDCM C@1M sleep 7A 1 1(11.13 @.C% siebmtshmw'51 @3C5 pspp 5A@M B1DM cpu31 7A 1 1(11.17 @.3% siebmtshmw'53

A thread count o& more than @# threads per process is due to the &act that the count alsoincludes some admin threads I& the MaTas2s>MTservers ratio is greater than <##,per&ormance degrades in terms o& longer transaction response times %he optimal usersper process setting depends on the )orkload, that is, ho) busy each user is

<$($1 Tuning %all %enter4 Sales/Ser*ice4 and e%hannel Siebel Modules

8all 8enter or sccobFmgr-speci&ic in&ormation is presented here Eighty users>process)as &ound to be the optimal ratio




In the &ile $4):*:"+T'bin'enu'uagent.cfg(

● Set :nable=! & G4: to disable invoking 8DA &unctionality● Set =omm:nable & G4: &or 8all 8enter, to disable do)nloading the 8%I

bar● Set =omm=onfigManager & G4:.

It should be noted that the preceding settings are re+uired to be T+9: &or scenarios)here these &unctions are re+uired %he benchmark setup re+uired these settings to bedisabled

%o decide on the MaTas2s, MTservers, non9ser#ool settings, use the &ollo)inge3ample4

Target No. of Users 4000

AnonUserPool C11

Buffer 311 Maxtasks C511

MaxMTserverM!nMTserver BA

Table ,.2

I& the target number o& users is B###, then non9ser#ool is <# o& B###, or B## Allo)a @ bu&&er, add them all together B###NB##N"##UB$##., and MaTas2s )ould beB$## Since )e )ant to run # users>process, the MaMTserver value )ill beB$##>#U@1@ rounded to @.

%he non9ser#ool value is set in the eapps.cfg &ile on the Siebel *eb Server

Engine I& the load is distributed across multiple )eb server machines or instances,simply divide this number In this e3ample, i& t)o )eb servers )ere being used, setnon9ser#ool to "## in each )eb server0s eapps.cfg &ile 7ere is a snapshot o& the&ile and the setting &or 8all 8enter4

H'callcenterInon4essionTimeout & 751Juest4essionTimeout & 514essionTimeout & 711non9ser#ool & 311=onnect4tring & siebel.tcpip.none.none(''@D.@.@.@A(3731'siebel'4==bFMgr

Set the &ollo)ing env variables in the &ile $4):*:"M:'siebsrvr'siebenv.csh or

siebenv.sh4

eport 4):*:"44:+T"M!:&1eport 4):*:"4!";T= & E Matas2s L @111eport 4):*:"4!"T= & @.3 Matas2s

Set Asserts GG by setting the environment variable 4):*:"44:+T"M!:&1




4! T= )ill need to be set higher based on the number o& users being run %his isthe calculation to be &ollo)ed4

4):*:"4!";T= & E Matas2s L @1114):*:"4!"T= & @.3 Matas2s

:estart Siebel server a&ter setting these environment variables

e%hannel

%he same tuning in&ormation as 8all 8enter applies &or e8hannel, e3cept &or t)oparameters4%he users per process ratio giving the best per&ormance &or this )orkload)as B# %he optimal non9ser#ool setting &ound )as ?#

eSer*ice

%he same tuning in&ormation as 8all 8enter applies &or eService, e3cept &or t)o

parameters %he users per process ratio giving the best per&ormance &or this )orkload)as $# %he optimal non9ser#ool setting &ound )as ?#

eSales

6i&ty users per Siebel ob/ect manager process provided better response times andthroughput %he non9ser#ool setting is "#

<$($( .or-flow

Siebel 1 *ork&lo) Manager e3ecuted )ork&lo) steps based on inserted service re+uests

Siebel *ork&lo) can be run in t)o modes4 asnc or snc :emote asnc mode isdiscussed here %he )ork&lo) test consists o& @## 8all 8enter end users )orking on"#,### service re+uests

8onnection pooling o& "#4< )as implemented )ith <# bene&itModi&y uagent.cfg andeai.cfg under $4):*:"M:'bin o& the 2atch application server to have the&ollo)ing settings4

● 8hange :nable=!&G4:

● 9nder H4?:I add4

:nable4huttle&T+9:

:nable+eportsGromToolbar&T+9:

:nable4)!ataoss?arning&T+9:

:nable#opup)nlineuer&T+9:




<$($+ Assignment Manager Tuning

%he Siebel 1 Assignment Manager AM. processed assignment transactions &or salesopportunities based on employee positions and territories AM )as run in batchassignment mode

6or this component the main tunable is the re/uests parameter

Tuneable arameter: :e+uests0efault *alue: @###5alue used in benchmar-: "#

0escritionMa3imum number o& re+uests read per iteration %his controls the ma3imum number o&re+uests ?or2Mon reads &rom the re+uests +ueue )ithin one iteration

It did not help to change deletesi0e to B## &rom de&ault o& @##. or to add inde3es tothe table 4":4="+:

A&ter reducing the number o& re+uests per iteration &rom @### de&ault value. to "# &orcomponent ?or2Mon, 89 utili'ation )as reduced &rom 1" to @? on the Siebelserver node )here AM and EAI-M tests )ere run together

Through ut !t?ns/sec" 5alue for the #e@uestsarameter

A*erage %P& utilization

1,@<< @### 1"?B#G <# @"G<B$ "# @??<

(able '.2.3




%he procedure to list>change the parameter re+uests &or Siebel server &ollo)s4

< 8onnect to server manager at applications server level" srvrmgr(siebapp3> list param +e/uests for comp ?or2Mon

#")4 #"N9: #"!TT,#: #"4=#: ..

#";M:-------- -------- ----------- -------------------------------+e/uests B111 )nteger =omponent ..+e/uests per iteration

@ row returned.

7. srvrmgr(siebapp3> change param +e/uests&31 for comp ?or2Mon=ommand completed successfull

Fote4 %o see the entire list o& parameters &or comp ?or2Mon, type the &ollo)ing4srvrmgr(siebapp3> list param for comp ?or2Mon

<$($ 6A>;Mseries

%he Siebel 1@ EAI M Series Adapter read &rom and placed transactions into I2M MSeries +ueues %his test is designed to receive B##,### messages &rom I2M M seriesinto the Siebel application Messages are divided into di&&erent categories depending onthe type o& operations they per&orm during receive %his test stresses the &ile system on)hich the +ueues reside by per&orming about <# database inserts and <# updatesersistent +ueues are used As a result, the database tuning and disk layout e3plained inthis document are key &or per&ormance

%o achieve best throughput the &ollo)ing setup )as done4

Minmtservers&mamtservers&@6 Matas2s&CB for component M/4eries4rv+cvr on the 4iebelserver.

Moving the &ollo)ing directories to a di&&erent disk helped to improve per&ormance byalleviating I>( bottlenecks4

'm/m'/mgrs'#:+GMJ+'/ueues'4:;!9:9: - 4end/ueue'm/m'/mgrs'#:+GMJ+'/ueues'+:=:)N:9:9: - +eceive/ueue'm/m'/mgrs'#:+GMJ+'/ueues'JO=T)N:P - ctive ogs




M series parameter tuning4

#:+GMJ+.M#ipe"msg&3111111 Ochanged from defaultPin file 'var'm/m'/mgrs'#:+GMJ+'/mstatus.ini

og*uffer#ages&B@3 Ochanged from default @EPin file 'var'm/m'/mgrs'#:+GMJ+'/m"ini

log#rimar files&@3 Odefault value 3Pog4econdarfiles&3 Odefault value 3Pogfilepages &@13C Ochanged to @57ACOmaPPogtpe&=)+=9+Odefault =)+=9+P

6rom all o& the above t)eaks, a per&ormance improvement o& ?@ in throughput )asmeasured Fote4 It )as discovered during the benchmark that M Series version @<>@"has a $B#,### message limit, )hile @? does not

<$($2 6A>;'TTP Adater

%he Siebel 1 EAI-7%% Adapter e3ecuted re+uests bet)een di&&erent )eb

in&rastructures Siebel EAI-7%% Adapter %ransport 2usiness Service lets one send PMLmessages over 7%% to a target 9:L )eb site. %he Siebel *eb Engine serves as thetransport to receive PML messages sent over the 7%% protocol to Siebel

%he Siebel EAI compgrp is enabled on one appserver and the 7%% driver is run on aSun 6ire v$@>*indo)s P machine

%o achieve the result o& "1,?@" business transactions>hour, B threads )ere runconcurrently, )here each thread )orked on 1#,### records %he optimum values &or thenumber o& Siebel servers o& type :)bFMgr &or this )orkload )ere4

MaMT4ervers&3 minmtservers&3 MaTas2s&@1

%he other Siebel (M parameters &or :)bFMgr are best le&t at de&ault= changing4)4#:+4)44=; to anything &rom de&ault o& "# does not help All o& the (racle databaseoptimi'ations e3plained under that section in this paper helped achieve the throughput o&1G ob/ects>sec

%he 7%% driver machine )as ma3ed out, causing slo) per&ormance %he reason &or this)as I>(, as the 7%% test program )as generating about ?Cbytes o& logs during the test=once this )as turned, o&& as sho)n belo), per&ormance improved

driver.logresponse&falsedriver.printheaders&false

%he non4essionTimeout and 4essionTimeout values in the S*SE )ere set to?##

7%% adapter :)bFMgr"enu. tunable parameters4

● MaTas2s - :ecommended value at the moment4 <#● MaMT4ervers, MinMT4ervers - :ecommended value4 "




● 9pperThreshold - :ecommended value4 "@● oad*alanced - :ecommended value4 true de&ault value, o& course.● !river=ount at client. - :ecommended value4 B

+.3 Siebel Ser#er S"alabilit, Li$itations and Soltions

<$+$1 The Siebel MaxTasks &er Limit Problem

In order to con&igure Siebel server to run over ### concurrent users, the Siebelparameter MaTas2s has to be set to a value o& ## *hen this is done, the Siebelob/ect manager processes that is, the Siebel servers. &ailed to start and logged errormessages %his &ailure )as not due to any resource limitation &rom the Solaris (S, asthere )ere ample amounts o& 89, memory, and s)ap space on the machine %he

&ailure to start )as due to the E"G## )ith <" 89, BCbytes :AM

Siebel enterprise server logged the &ollo)ing error messages and &ailed to start4

Jenericog Jeneric:rror @ 311C-1E-71 3@(C1(1E Osissrvr.cpp CEO35@EPerr&3111135 ss&@EP 4N+-11135( 9nable to allocate shared memorJenericog Jeneric:rror @ 311C-1E-71 3@(C1(1E Oscfsis.cpp BOBEPerr&3111135 ss&1P 4N+-11135( 9nable to allocate shared memorJenericog Jeneric:rror @ 311C-1E-71 3@(C1(1E Olistener.cpp 3@O@BEPerr&3111135 ss&1P 4N+-11135( 9nable to allocate shared memor

6?lanation%o understand )hat occurred, it is necessary to revie) some background on the Siebel

server process siebsvc4

%he siebsvc process runs as a system service that monitors and controls the state o&every Siebel server component operating on that Siebel server Each Siebel server is aninstantiation o& the Siebel Server System Service siebsvc. )ithin the current SiebelEnterprise Server Siebel server runs as a daemon process in a 9FIP environment

During startup, the Siebel Server System Service siebsvc. per&orms the &ollo)ingse+uential steps4

< :etrieve con&iguration in&ormation &rom the Siebel Cate)ay Fame Server

" 8reate a shared memory &ile located in the admin subdirectory o& theSiebel server root directory on 9FIP 2y de&ault, this &ile has the name:nterprise"4erver";ame.4iebel"4erver";ame.shm

%he si'e o& this &ile .shm is directly proportional to the MaTas2 setting %he higher thenumber o& concurrent users the higher the MaTas2

%he Siebel Server System Service deletes this .shm &ile )hen it shuts do)n




>n*estigating the #eason for the 8ailure%he .shm &ile that )as being created during startup )ill be memory-mapped and be parto& the heap si'e o& the siebsvc process %hat means the process si'e o& siebsvcprocess gro)s proportionally )ith the increase in the si'e o& the .shm &ile

*ith G@## MaTas2 con&igured, an .shm &ile o& si'e <<@Cbytes )as created duringserver startup4

siebapp5('tmp'%ls -l 'eport'siebsrvr'admin'siebel.sdcvCA1s113.shm-rw------ @ sunperf other @3@31D5B@3 Qan 3C @@(CC'eport'siebsrvr'admin'siebel.sdcvCA1s113.shm

And the siebsvc had a process si'e o& <<BCbytes )hen the process died abruptly4

#)! 94:+;M: 4): +44 4TT: #+) ;)=: T)M: =#9 #+=:44';?# 3B71D sunperf @@ECM @@5DM sleep 51 1 1(11(15 5.B% siebsvc'@

A truss o& the process reveals that it is trying to mmap a &ile <<@Cbytes in si'e and &ails)ith :;M:M.

7ere is the truss output4

A@B1( br2O1B@D3*GEAP & 1A@B1( openOR'eport'siebsrvr'admin'siebel"siebapp5.shmR6 "+!?+|"=+:T|":S=6 1E11P& DA@B1( writeOD6 R111111111111R..6 @75EE75731P & @75EE75731A@B1( mmapO1111111116 @75EE757316 #+T"+:!|#+T"?+)T:6 M#"4+:!6 D6 1P :rrU@3:;M:M

I& the mmap succeeds, the process may have a process si'e R "Cbytes 2ecause Siebel

is a ?"-bit application, it can have a process si'e up to BCbytes "V?" U BCbytes. on theSolaris (S 2ut in our case, the process &ailed )ith a si'e /ust over "Cbytes




%he &ollo)ing )ere the system resource settings &rom the &ailed machine4

sdcvCA1s113('eport'home'sunperf'@A715'siebsrvr'admin'%ulimit -atimeOsecondsP unlimitedfileObloc2sP unlimiteddataO2btesP unlimitedstac2O2btesP A@D3

coredumpObloc2sP unlimitednofilesOdescriptorsP 3B5vmemorO2btesP unlimited

Even though the ma3imum si'e o& the datasi'e or heap is reported as unlimited by theulimit command above, the ma3 limit is "Cbytes by de&ault on the Solaris (S %heupper limits seen by an application running on Solaris hard)are can be achieved byusing a simple 8 program that calls the getrlimit AI &rom ss'resource.h %he&ollo)ing program prints the system limits &or data, stac2, and vmemor4

Uinclude <stdio.h> Uinclude <stdlib.h> Uinclude <stddef.h>

Uinclude <ss'time.h> Uinclude <ss'resource.h>

static void showlimitOint resource6 char strP V struct rlimit limW if OgetrlimitOresource6 XlimP Y& 1P V OvoidPprintfOR=ouldnZt retrieve %s limitnR6 strPW returnW [ OvoidPprintfOR=urrent'maimum %s limit is t%lu ' %lunR6 str6 lim.rlim"cur6lim.rlim"maPW [

int mainOP V showlimitO+)M)T"!T6 RdataRPW

showlimitO+)M)T"4T=K6 Rstac2RPW showlimitO+)M)T"NM:M6 RvmemRPW

return 1W [

(utput &rom the 8 program on the &ailed machine is as &ollo)s4

sdcvCA1s113('eport'siebsrvr'admin'%showlimits=urrent'maimum data limit is 3@CECA75CE ' 3@CECA75CE=urrent'maimum stac2 limit is A7AA51A ' 3@CECA75CE=urrent'maimum vmem limit is 3@CECA75CE ' 3@CECA75CE

6rom the output sho)n, it is clear that the processes )ere bound to a ma3imum data limito& "Cbytes on an out-o&-the-bo3 Solaris system setup %his limitation is the reason &or the&ailure o& the siebsvc process as it tried to gro) beyond "Cbytes

Solution%he solution is to increase the de&ault system limit &or datasi0e and reduce thestac2si0e An increase in datasi0e creates more room &or process address spaceand reduction o& stac2si0e reduces the reserved stack space 2oth these ad/ustments




let a Siebel process use its process address space more e&&iciently, hence allo)ing thetotal Siebel process si'e to gro) up to BCbytes )hich is the upper limit &or a ?"-bitapplication.

1$ .hat are the recommended *alues for data and stac- sizes on Solaris )S while

running the Siebel alicationB 'ow does one change the limits of "atas!#e andstacks!#eB

Set the datasi0e to BCbytes that is, the ma3imum address space allo)ed &or a ?"-bit process. and set the stac2si0e to any value W<Mbyte, depending on the stackJsusage during high load In general, even )ith very high loads the stack may take up to$BKbytes= setting its value to @<"Kbytes )ouldnJt harm the application

System limits can be changed using ulimit or limit user commands depending onthe shell

%he &ollo)ing commands change the limits42sh(ulimit -s B@3ulimit -d C@DC717

csh(limit -stac2si0e B@3limit -datasi0e C@DC717

($ 'ow does one e?ecute the aforementioned commandsB

%hese commands can be e3ecuted either &rom 2sh or csh directly be&ore runningSiebel %he Siebel processes inherit the limits during the shell &orking

2ut $4):*:"+T'bin'start"server script is the recommended place to put thosecommands4

sdcvCA1s113('eport'home'sunperf'@A715'siebsrvr'bin'%more start"server......94J:&Rusage( start"server H-r <siebel root>I H-e <enterprise>I H- <language code>I H-aI H-fI H-g <gatewa(port>I V <server name> ... | [R

ulimit -d C@DC717ulimit -s B@3

UU set variables used in siebctl command below...

...

+$ 'ow do > chec- the system limits for a running rocessB

The plimit <pid> command prints the system limits as seen by the process, that is4

sdcvCA1s113('tmp'%plimit @@511@@511( siebsvc -s siebsrvr -a -g sdcvCA1s113 -e siebel -s sdcvCA1s113 resource current maimum timeOsecondsP unlimited unlimited




fileObloc2sP unlimited unlimited dataO2btesP C@DC717 C@DC717 stac2O2btesP B@3 B@3 coredumpObloc2sP unlimited unlimited nofilesOdescriptorsP 5BB75 5BB75 vmemorO2btesP unlimited unlimited

%he preceding setting allo)s the siebsvc to mmap the shm &ile and thereby siebsvcsucceeds in &orking the rest o& the processes and Siebel server processes start upsuccess&ully %hus this &inding enables one to con&igure MaTas2s greater than G### onthe Solaris (S %hat means one can get around the scalability limit o& G### users perSiebel server, but ho) much higher can one go5 *e determined the limit to be <,### I&Ma3%asks )as con&igured to R <###, Siebel calculates the .shm &ile si'e to be about"Cbytes siebsvc tries to mmap this &ile and &ails, as it has hit the limit &or a ?"-bitapplication process

%he &ollo)ing listing sho)s the Siebel .shm &ile )ith matas2 set to <,###4

sdcvCA1s113('eport'siebsrvr'admin'%ls -l .shm W ls -lh .shm

-rw------ @ sunperf other 31EC37ADE5 Qan 3B @7(37 siebel.sdcvCA1s113.shm-rw------ @ sunperf other @.DJ Qan 3B @7(37 siebel.sdcvCA1s113.shm

sdcvCA1s113('eport'siebsrvr'admin'%plimit @3B3E@3B3E( siebsvc -s siebsrvr -a -g sdcvCA1s113 -e siebel -s sdcvCA1s113 resource current maimum timeOsecondsP unlimited unlimited fileObloc2sP unlimited unlimited dataO2btesP C@DC717 C@DC717 stac2O2btesP B@3 B@3 coredumpObloc2sP unlimited unlimited nofilesOdescriptorsP 5BB75 5BB75 vmemorO2btesP unlimited unlimited

sdcvCA1s113('eport'siebsrvr'admin'%prstat -s si0e -u sunperf -a #)! 94:+;M: 4): +44 4TT: #+) ;)=: T)M: =#9 #+=:44';?#

@3B3E sunperf 7DEBM 7D55M sleep BD 1 1(11(BB 1.1% siebsvc'7 @3B5B sunperf 3@@@M @@5M sleep BD 1 1(11(1A 1.@% siebmtsh'A @3B55 sunperf 3177M @@BDM sleep BD 1 1(11(1A 7.@% siebmtshmw'@1 @3B5C sunperf 313@M 3EM sleep BD 1 1(11(1@ 1.1% siebmtsh'@3 @3B57 sunperf 3111M @CM sleep BD 1 1(11(11 1.1% siebproc'@ 353EC sunperf @5M @3M sleep BD 1 1(1@(C7 1.1% siebsvc'3

In the rare case there is a need to run more than <,### Siebel users on a single Siebelserver node, the )ay to do it is to install another Siebel server instance on the samenode %his )orks )ell and is a supported con&iguration on Siebel>Sun plat&orm It is notadvisable to con&igure more MaTas2s than needed, as this could a&&ect theper&ormance o& the overall Siebel enterprise

<$+$( ,loated Siebel Processes !%ommonly Mista-en as Memory Lea-s"

SymtomDuring some o& the high concurrent user tests, it )as observed that hundreds o& userssuddenly &ailed




0escrition%he reason &or this symptom )as that some o& the Siebel server processes servicingthese users had either hung or crashed 8lose observation )ith repeated replaysrevealed that the 4iebmtshmw process memory shot up &rom 1##M to "C2

%he 9ltraSA:8 I;-based E"G## server can handle up to ?#,### processes and about1,### L*s threads., so there )as no resource limitation &rom the machine here %heSiebel applications are running into ?"-bit process space limits -- but )hy is the memoryper process going &rom 1##Mbytes to "C2ytes5 6urther debugging lead us to theproblem4 the stack si'e

%he total memory si'e o& a process is made up o& heap si0e L stac2 si0e L dataand anon segments In this case, it )as &ound that the bloating in si'e )as at the stack,)hich gre) &rom $BKbytes to <Cbyte, )hich )as abnormal pmap is a utility on theSolaris system that provides a detailed breakdo)n o& memory si'es per process

7ere is an output o& pmap that sho)s that the stack segment bloated to about <Cbyte4

siebapp5\'eport'pspp> grep stac2 pmap.CA11mied.prob.tt Opmap output unit isin KbtesPGG*:A111 73 73 - 73 read'write'eec H stac2 IGG*:A111 73 73 - 73 read'write'eec H stac2 IGG*:A111 73 73 - 73 read'write'eec H stac2 IGG*:A111 73 73 - 73 read'write'eec H stac2 IGG*:A111 73 73 - 73 read'write'eec H stac2 I=1@3111 @1C733C @1C733C - @1C733C read'write'eec H stac2 I

*e reduced the stack si'e to <"Kbytes and this &i3ed the problem Fo) a single Siebelserver con&igured )ith <#,### MaTas2s started up success&ully It )as &ailing to startupbe&ore breaking at the mmap call %he stack si'e o& Mytes is a de&ault setting on theSolaris system 7o)ever, limiting the stack si'e to <"Kbytes removed a lot o& theinstability in our high load tests and )e )ere able to run @### user tests )ithout errors,pushing up to # to G# 89 usage on the <"-)ay E"G## server

8hanging the mainwin address M?"JM"N!!+&1c1111111 to other values did notseem to make a big di&&erence lease do not vary this parameter

Solution8hange the stack si'e hard limit o& the Siebel process &rom unlimited to @<" bytes

Stack si'e on the Solaris (S has a hard limit and a so&t limit %he de&ault values &or these

t)o limits are unlimited and AMbtes, respectively %his means that an applicationprocess on the Solaris (S can have its stack si'e any)here up to the hard limit Sincethe de&ault hard limit on the Solaris system is unlimited the Siebel applicationprocesses could gro) their stack si'e all the )ay up to "Cbytes *hen this occurs, thetotal memory si'e o& the Siebel process hits the ma3 limit o& memory addressable by a?"-bit process and bad things happen such as a hang or crash. Setting the limit &orstack to <Mbytes or a lo)er value resolved the issue




7o) is this done5

sdcvCA1s113('eport'home'sunperf'@A715'siebsrvr'admin'%limit stac2stac2si0e A@D3 2btes

sdcvCA1s113('eport'siebsrvr'admin'%limit stac2si0e @13C

sdcvCA1s113('eport'siebsrvr'admin'%limit stac2si0estac2si0e B@3 2btes

lease note that a large stack limit can inhibit the gro)th o& the data segment, becausethe total process si'e upper limit is BCbytes &or a ?"-bit application Also even i& theprocess stack hasnJt gro)n to a large e3tent, the virtual memory space )ill be reserved&or it according to the limit value *hile the recommendation to limit stack si'e to @<"bytes )orked )ell &or the )orkload de&ined in this paper, this setting may have to bet)eaked &or di&&erent Siebel deployments and )orkloads %he range could be &rom @<" to<#"B bytes

+.4 Tnin Sn -a#a S,ste$ Web Ser#er

%he three main &iles )here tuning can be done are obF.conf, server.ml andmagnus.conf

6dit magnus.conf:

< Set the +/Throttle&C13A in the magnus.conf &ile under the )eb serverroot directory

" isten @5111? =onnueue4i0e A111B KeepliveuerMeanTime B1

6dit server.xml:

< :eplaced host name )ith ip address in server.ml.

6dit o$%.conf:

< %urned o&& access logging" %urned o&& cgi, /sp, servlet support? :emoved the &ollo)ing lines &rom obF.conf4 UUU#ath=hec2 fn&Rchec2-

aclR acl&RdefaultR and UUU#ath=hec2 fn&uni-uri-clean, sincethese are not being used by Siebel

%uning parameters used &or high user load )ith Sun !ava System *eb Servers arelisted in the &ollo)ing table




Parameter Scoe 0efault5alue

Tuned 5alue

shmss(shminfo"shmma 'etc'sstem 1ffffffffffffffff

shmss(shminfo"shmmin 'etc'sstem @11shmss(shminfo"shmseg 'etc'sstem 311

semss(seminfo"semmns 'etc'sstem @31D3semss(seminfo"semmsl 'etc'sstem B@3semss(seminfo"semmni 'etc'sstem C1D5semss(seminfo"semmap 'etc'sstem C1D5semss(seminfo"semmnu 'etc'sstem C1D5semss(seminfo"semopm 'etc'sstem @11semss(seminfo"semume 'etc'sstem 31CA

msgss(msginfo"msgmni 'etc'sstem 31CAmsgss(msginfo"msgt/l 'etc'sstem 31CAmsgss(msginfo"msgss0 'etc'sstem 5Cmsgss(msginfo"msgseg 'etc'sstem 73E5Emsgss(msginfo"msgma 'etc'sstem @57ACmsgss(msginfo"msgmnb 'etc'sstem @57AC

rlim"fd"ma 'etc'sstem @13C @57ACrlim"fd"cur 'etc'sstem 5C @57ACs/"ma"si0e 'etc'sstem 3 1tcp"time"wait"interval ndd 'dev'tcp 3C1111 51111tcp"conn"re/"ma"/ ndd 'dev'tcp @3A @13Ctcp"conn"re/"ma"/1 ndd 'dev'tcp @13C C1D5tcp"ip"abort"interval ndd 'dev'tcp CA1111 51111tcp"2eepalive"interval ndd 'dev'tcp E31111

1D11111

tcp"remit"interval"initial ndd 'dev'tcp 7111 7111tcp"remit"interval"ma ndd 'dev'tcp 3C1111 @1111tcp"remit"interval"min ndd 'dev'tcp 311 7111tcp"smallest"anon"port ndd 'dev'tcp 73E5A @13Ctcp"slow"start"initial ndd 'dev'tcp @ 3tcp"mit"hiwat ndd 'dev'tcp A@3D 73E5Atcp"fin"wait"3"flush"interv

al

ndd'dev'tcp 5EB11 5EB111

tcp"recv"hiwat ndd 'dev'tcp A@3D 73E5A

(able '.)




+.& Tnin the Siebel Web Ser#er Etension (SWSE)

< In the Siebel *eb lugin installation directory, go to the bin directory Edit the

eapps.cfg &ile and make the &ollo)ing changes4• Set non9ser#ool to <@ o& <target Uusers>

• Set the &ollo)ing settings in the Xde&aultY section45. Juest4essionTimeout to $#= this is re+uired &or scenarios )here the

user is bro)sing )ithout logging in5. non4essionTimeout & 7111 4essionTimeout & 711

• Set appropriate non9ser name>pass)ords 4!M);'4!M); &or e8hannel and 8all 8enter Database login. J9:4T@'J9:4T@ &or eService and eSales LDA login. J9:4T:+M'J9:4T:+M &or E:M Database login.

%he non9ser#ool setting can vary on di&&erent types o& Siebel users call center,sales, and so on.

%he table belo) summari'es the individual eapps.cfg settings &or each type o& Siebelapplication4 8all 8enter, e8hannel, eSales and eService, used in the <#,### users test

Parameter callcenter&enu 'rm'ortal&enu esales&enu eserv!ce&enu

non9ser;ame 4!M); J9:4T=# epps3 epps7

non#assword 4!M); J9:4T=# epps3 epps7

non9ser#ool ==@&C316==3&B3B6==7&7@B6 ==C&3@1

731 @51 751

non4essionTimeout 751 751 751 751

Juest4essionTimeout

51 51 51 51

4essionTimeout 711 711 711 711

Table ,.'

%he S*SE stats )eb page is a very good resource &or tuning Siebel




+./ Tnin Siebel Standard Ora"le 0atabase and Sn Storae

%he si'e o& the database used )as appro3imately <B# Cbytes %he database )as built tosimulate customers )ith large transaction volumes and data distributions thatrepresented the most common customer data shapes %able 1$ sho)s a sampling o&record volumes and si'es in the database &or key business entities o& the standard Siebel

volume database

,usiness 6ntity0atabase Table7ame

7umber of#ecords

Size in =bytes

Accounts (&)R*&+,T 14CD<411 +4124<(C

Acti*ities (&+-T&AT C4<4+32 4(D142

Addresses (&A//R&)R* +432C4 (43D<412(

%ontacts (&)NTAT( +4+4< 4<1C42D(

6mloyees (&+MPL)Y++&ATT (14333 2(

)ortunities (&)PTY +4(+<4<D 41D4+3

)rders (&)R/+R +224(D< <14C2D

Products (&PR)/&INT ((4333 +<4331

uote >tems (&U)T+&IT+M 14DC43DD (4(143

uotes (&U)T+&ATT (2+41 2(

Ser*ice #e@uests (&(R-&R+ 242C142+C 4<1C42D(

Table ,.+

<$$1 )timal 0atabase %onfiguration

8reating a )ell-planned database to begin )ith )ill re+uire less tuning>reorgani'ingduring runtime *hile many resources are available to &acilitate creation o& high-per&ormance (racle databases, most tuning engineers )ould &ind themselves t)eaking adatabase consisting o& thousands o& tables and inde3es, piece by piece %his is both timeconsuming and prone to mistakes Eventually one )ould end up rebuilding the entiredatabase &rom scratch

%he &ollo)ing approach provides an alternative to tuning a pre-e3isting, pre-packageddatabase4

< Measure the e?act sace used by each obEect in the schema$ %hedbms"space packages provide the accurate space used by an inde3 or a table(ther sources like dba"free"space only tell you Xho) much is &reeY &rom thetotal allocated space, )hich is al)ays more Fe3t, run the benchmark test and

again measure the space used %he di&&erence )ill result in an accurate report o&Xho) much each table>inde3 gro)s during the testY (ne can use this data to right-si'e all o& the tables, such as the capacity planned &or gro)th during the test Alsothe data can be used to &igure out and concentrate on only the hot tables used bythe test

" %reate a new database with multile inde? and data tablesaces$ %he idea isto place all e+ui-e3tent-si'ed tables into their o)n tablespace Keeping the dataand inde3 ob/ects in their o)n tablespace reduces contention and &ragmentation,




and also provides &or easier monitoring Keeping tables )ith e+ual e3tent si'es intheir o)n tablespace reduces &ragmentation as old and ne) e3tent allocations areal)ays o& the same si'e )ithin a given tablespace, leaving no room &or empty odd-si'ed pockets in bet)een %his leads to compact data placement )hich reducesthe number o& I>(s done

?,uild a scrit to create all of the tables and inde?es$

%his script should havethe tables being created in their appropriate tablespaces )ith the appropriateparameters like freelists, & reelist"groups, pctfree, pctused, and so on9se this script to place all o& the tables in their tablespaces and then import thedata %his )ill result in a clean, de&ragmented, optimi'ed, and right-si'eddatabase

%he tablespaces should also be built to be locally managed %his allo)s the spacemanagement to be done locally )ithin the tablespace, unlike de&ault dictionarymanaged. tablespaces that )rite to the system tablespace &or every e3tent change %helist o& hot tables &or Siebel is available in Appendi3 2

<$$( Proerly Locating 0ata on the 0is- for ,est Performance

%o achieve the incredible capacity on current disk drives, disk manu&acturers haveimplemented 'one bit recording %his means that the outer edge o& the disk drive hasmore available storage area than the inside edge o& the disk drive= that is, the number o&sectors per track decreases as you move to)ard the center o& the disk Disk drivemanu&actures take advantage o& this situation by recording more data on the outeredges Since the disk drive rotates at a constant speed, the outer tracks have &astertrans&er rates than the inner tracks 6or e3ample, a Seagate ?$ Cbyte 8heetah < drive hasa data trans&er speed range o& @1 M2ytes>sec on the inner tracks to $ Mbytes>sec onthe outer tracks -- a @# improvement in trans&er speed

6or benchmarking purposes, it is desirable to4< lace active large block trans&ers on the outer edges o& the disk to minimi'e data

trans&er time

" lace active random small block trans&ers on the outer edges o& the disk drive onlyi& active large block trans&ers are not in the benchmark

=. lace inactive random small block trans&ers on the inner sections o& disk drive tominimi'e the impact o& the data trans&er speed discrepancies

6urther, i& the benchmark only deals )ith small block I>(s, like S8 2enchmark-<Z" benchmarking, the priority is to put the most active L9Fs on the outer edge and the lessactive L9Fs on the inner edge o& the disk drive

1 %he 8heetah <@ K2 :M disk drive datasheet can be &ound at )))seagatecom2 6urther in&ormation about S8 2enchmark-< %M can be &ound at )))Storageer&ormanceorg


http://www.seagate.com/

http://www.storageperformance.org/

http://www.seagate.com/

http://www.storageperformance.org/



@6 M/3secon&

5< M/3secon&

Figure '.6.2

6igure 1$" sho)s a 'one bit recording e3ample )ith &ive 'ones %he outer edge holdsthe most data and has the &astest trans&er rate

<$$+ 0is- Layout and )racle 0ata Partitioning

An I>( subsystem )ith less contention and high throughput is key &or obtaining highper&ormance )ith (racle A&ter analy'ing the Siebel )orkload an appropriate design )asmade

%he I>( subsystem consisted o& Sun StorEdge SE$?"# connected to the E"G##database server via &iber channel %he SE$?"# has " base N " e3pansion arrays driventhrough t)o controllers Each tray consists o& <B3?$Cbyte disks at <@,### :M %hatmeans there are @$ total disks providing over " %bytes o& total storage Each tray has a

cache o& <Cbyte All o& the trays )ere &ormatted in the :AID # mode and t)o L9Fs pertray )ere created Eight striped volumes o& ?## Cbytes each )ere carved Each volume)as striped across seven physical disks )ith stripe si'es o& $BK2 Eight &ilesystems u&s.)ere built on top o& these striped volumes4 TCdis2@, TCdis23, TCdis27, TCdis2C,TCdis2B, TCdis25, TCdis2E, TCdis2A

%he &ollo)ing e3ample sho)s the tuning done at the disk array level lease note thatcache writebehind )as turned o&& and dis2 scrubber )as turned o&&




arra11('(<@>ss listcontroller ( 3.Bbloc2si0e ( 5C2cache ( automirror ( automp"support ( nonenaca ( offrd"ahead ( offrecon"rate ( medss memsi0e ( 3B5 M*tescache memsi0e ( @13C M*tesfc"topolog ( autofc"speed ( 3Jbdis2"scrubber ( offondg ( befitarra11('(<3

Since (racle )rites every transaction to its redo log &iles, these &iles typically )ill havehigher I>( activity compared to other (racle data &iles Also the )rites to (racle redolog &iles are se+uential %he (racle redo log &iles )ere situated on a dedicated trayusing a dedicated controller Additionally the L9F containing the redo log &iles )asplaced on the outer edge o& the physical disks see 6igure ?4 [one 2it :ecording.

%he &irst &ile system created using a L9F occupies the outer edge o& the physical disks(nce the outer edge reaches capacity, the inner sectors are used %his can be used inper&ormance tuning to place highly-used data on outer edges and rarely used data on theinner edge o& a disk

%he data tablespaces, inde3 tablespaces, rollback segments, temporary tablespaces,and system tablespaces, )ere built using BCbyte data&iles spread across the remainingt)o trays %his ensured that there )ould be no disk hotspotting %he spread made &ore&&ective usage o& the t)o controllers available )ith this setup (ne controller )ith its

<Cyte cache &or the redo log &iles and the other controller>cache &or non-redo data&iles belonging to (racle

%he "@B1 data and <",?G< inde3 ob/ects o& the Siebel schema )ere individually si'ed%heir current space usage and e3pected gro)th during the test )ere accuratelymeasured using the dbms"space procedure %hree data tablespaces )ere created usingthe locally managed bitmapped. &eature in (racle Similarly, three inde3 tablespaces)ere also created %he e3tent si'es o& these tablespace )ere 9;)G+M %his ensuresthat &ragmentation does not occur during the numerous deletes, updates, and inserts%he tables and inde3es )ere distributed evenly across these tablespaces based on theirsi'e= their e3tents )ere pre-created so that no allocation o& e3tents takes place during the

benchmark tests

0ata Partitioning er )racle Tablesace

(/S All rollback segment ob/ects!T"B@3111K 8ontained all o& the large Siebel tables);!S"B@311K %ablespace &or the inde3es on large tables);!S"B@31K %ablespace &or the inde3es on medium tables




!T"B@311K %ablespace to hold the medium Siebel tables);!S"B@3K %ablespace &or all the inde3es on small tables!T"B@31K %ablespace &or the small Siebel tablesT:M# (racle temporary segmentsT4 (racle per&ormance measurement ob/ects

!T"B@3K %ablespace &or Siebel small tablesS\S%EM (racle system tablespace

Tablesace to Logical 5olume Maing/ATA&123000 5t6"!sk35oramst5oramst&"ata&123000.02 't7dis23'oramst'oramst"data"[email protected] 't7dis23'oramst'oramst"data"[email protected] 't7dis23'oramst'oramst"data"B@3111K.@1 't7dis27'oramst'oramst"data"[email protected] 't7dis27'oramst'oramst"data"[email protected] 't7dis27'oramst'oramst"data"[email protected] 't7dis27'oramst'oramst"data"B@3111K.@@ 't7dis2C'oramst'oramst"data"[email protected]

't7dis2C'oramst'oramst"data"[email protected]

!T"B@311K 't7dis23'oramst'oramst"data"[email protected] 't7dis27'oramst'oramst"data"[email protected] 't7dis2C'oramst'oramst"data"[email protected]@ 't7dis2C'oramst'oramst"data"[email protected]

!T"B@31K 't7dis27'oramst'oramst"data"[email protected]@

!T"B@3K 't7dis23'oramst'oramst"data"[email protected]@

);!S"B@311K 't7dis2B'oramst'oramst"ind"[email protected] 't7dis2B'oramst'oramst"ind"[email protected] 't7dis2B'oramst'oramst"ind"[email protected] 't7dis2B'oramst'oramst"ind"B@311K.@@ 't7dis25'oramst'oramst"ind"[email protected]

't7dis25'oramst'oramst"ind"[email protected] 't7dis25'oramst'oramst"ind"[email protected] 't7dis25'oramst'oramst"ind"B@311K.@3 't7dis2E'oramst'oramst"ind"[email protected]@ 't7dis2E'oramst'oramst"ind"[email protected] 't7dis2E'oramst'oramst"ind"[email protected] 't7dis2E'oramst'oramst"ind"B@311K.@1

);!S"B@31K 't7dis2B'oramst'oramst"ind"[email protected] 't7dis25'oramst'oramst"ind"[email protected] 't7dis2E'oramst'oramst"ind"[email protected]@

);!S"B@3K 't7dis2B'oramst'oramst"ind"[email protected]@ 't7dis2B'oramst'oramst"ind"[email protected] 't7dis25'oramst'oramst"ind"[email protected] 't7dis25'oramst'oramst"ind"[email protected]

't7dis2E'oramst'oramst"ind"[email protected]

+*4 't7dis23'oramst'oramst"rbs.1@ 't7dis23'oramst'oramst"rbs.1E 't7dis23'oramst'oramst"rbs.@7 't7dis27'oramst'oramst"rbs.13 't7dis27'oramst'oramst"rbs.1A 't7dis27'oramst'oramst"rbs.@C 't7dis2C'oramst'oramst"rbs.17 't7dis2C'oramst'oramst"rbs.1D 't7dis2C'oramst'oramst"rbs.@B




't7dis2B'oramst'oramst"rbs.1C 't7dis2B'oramst'oramst"rbs.@1 't7dis2B'oramst'oramst"rbs.@5 't7dis25'oramst'oramst"rbs.1B 't7dis25'oramst'oramst"rbs.@@ 't7dis25'oramst'oramst"rbs.@E 't7dis2E'oramst'oramst"rbs.15 't7dis2E'oramst'oramst"rbs.@3

't7dis2E'oramst'oramst"rbs.@A

4,4T:M 't7dis23'oramst'oramst"sstem.1@

T:M# 't7dis2E'oramst'oramst"temp.@3 T4 't7dis23'oramst'oramst"tools.1@ 't7dis27'oramst'oramst"tools.13 't7dis2C'oramst'oramst"tools.17 't7dis2B'oramst'oramst"tools.1C 't7dis25'oramst'oramst"tools.1B 't7dis2E'oramst'oramst"tools.15

*ith the preceding setup o& (racle using the hard)are level stripping, and placing (racleob/ects in di&&erent tablespaces, an optimal setup )as reached )ith no I>( )aits noticedand no single disk being more than "# occupied during the tests ;eritas )as not usedas this setup provided the re+uired I>( throughput

6ollo)ing is the )ostat output4 t)o snapshots at &ive-second intervals, taken duringsteady state o& the test on the database server %here are minimal reads Or'sP, andwrites are balanced across all volumes *ith the e3ception o& cEt@d1, this is thededicated %BN array &or (racle redologs It is +uite normal to see high writes'sec onredologs, this /ust indicates that transactions are getting done rapidly in the database%he reads'sec is abnormal %his volume is at "1 busy, )hich is considered borderlinehigh 6ortunately, service times are very lo)

?ed Qan A @B(3B(31 3117 etended device statistics

r's w's 2r's 2w's wait actv wsvc"t asvc"t %w %b device 1.1 @.1 1.1 B.5 1.1 1.1 1.1 @.1 1 @ c1t7d1 @.1 3E.5 A.1 331.A 1.1 1.1 1.1 @.7 1 3 c3tEd1 1.1 35.1 1.1 31A.1 1.1 1.1 1.1 1.B 1 @ c7t@d1 1.5 7E.C C.A 3DD.3 1.1 1.1 1.1 1.A 1 3 cCtBd1 1.1 37.C 1.1 @AE.3 1.1 1.1 1.1 1.5 1 @ cBt@d1 1.1 @1.3 1.1 [email protected] 1.1 1.1 1.1 1.B 1 1 c5t@d1 7.A 7D7.1 @B7C.7 [email protected] 1.1 1.3 1.1 1.5 1 33 cEt@d1 1.1 3A.3 1.1 33B.5 1.1 1.1 1.1 1.5 1 @ cAt@d1 ?ed Qan A @B(3B(3B 3117 etended device statistics

r's w's 2r's 2w's wait actv wsvc"t asvc"t %w %b device @.C @D.A @@.3 @BA.C 1.1 1.1 1.1 @.1 1 3 c3tEd1 1.1 @A.3 1.1 @CB.5 1.1 1.1 1.1 1.B 1 @ c7t@d1 1.A 7D.1 5.C [email protected] 1.1 1.1 1.1 1.E 1 3 cCtBd1 1.1 @A.A 1.1 @B1.C 1.1 1.1 1.1 1.5 1 @ cBt@d1 1.1 @E.C 1.1 @7D.3 1.1 1.1 1.1 1.B 1 @ c5t@d1 B.3 C57.3 @ACC.A 7E1B.5 1.1 1.7 1.1 1.E 1 3E cEt@d1 1.1 3D.C 1.1 37B.3 1.1 1.1 1.1 1.B 1 @ cAt@d1




<$$ Solaris MPSS Tuning for )racle Ser*er

Available as a standard &eature since Solaris G (S, Multiple age Si'e Support MSS.allo)s a program to use any hard)are-supported page si'es to access portions o& virtualmemory MSS improves virtual memory per&ormance by allo)ing applications to uselarge page si'es, there&ore improving resource e&&iciency and reducing overhead, and

accomplishes this )ithout recompiling or recoding applications

Enable MSS Multiple age Si'e Support. &or (racle Server and shado) processes onSolaris G (S or later versions to reduce the T* miss% rate It is recommended to usethe largest available page si'e i& the T* miss% is high

6nabling MPSS for )racle Processes

< Enable the kernel cage i& the machine is not an E<#K or 6<@K, and reboot thesystem Kernel cage an be enabled by the &ollo)ing setting in 'etc'sstem4

set 2ernel"cage"enable&@

*hy do )e need the kernel cage5 %o address a problem )ith memory&ragmentation Immediately a&ter a system boot, a si'eable pool o& large pages areavailable and the applications can get all o& their mmapOP memory allocated &romlarge pages %his can be veri&ied using pmap -s <pid> I& the machine hasbeen in use &or a )hile, the application may not get the desirable large pages untilthe machine is rebooted %his is mainly due to the &ragmentation o& physicalmemory

*e can vastly minimi'e the &ragmentation by enabling the kernel cage *ith thekernel cage enabled, the kernel )ill be allocated &rom a small contiguous range o&

memory, minimi'ing the &ragmentation o& other pages )ithin the system

" 6ind out all possible hard)are address translation 7A%. si'es supported by thesystem )ith pagesi0e -a

$ pagesi0e -aA@D35BB75B3C3AAC@DC71C

? :un trapstat -T %he value sho)n in the ttl ro) and %time column is thepercentage o& time the processors. spent in virtual-to-physical memory address

translations Depending on %time, make a )ise choice o& a pagesi'e that )ill helpreduce reducing the iT*'dT* miss rate

B 8reate a simple config &ile &or MSS as &ollo)s4oracle(<desirable heap si0e>(<desirable stac2 si0e>

Desirable heap and stac2 si'e must be one o& the supported 7A% si'es 2yde&ault, Kbytes is the page si'e &or heap and stac2 on all Solaris releases




@ Set the environment variables M#44=GJG): and M#44:++G): M#44=GJG):should point to the config &ile that )as created in Step ? MSS )rites any errorsduring runtime to &ile

$ reload MSS interposing library mpssso<, and bring up (racle server It isrecommended to put the MSS86C6ILE, MSSE::6ILE, and LD:EL(ADenvironment variables in the (racle startup script

*ith all the env variables mentioned above, a typical startup script may look likethe &ollo)ing4

echo starting listenerlsnrctl start

echo preloading mpss.so.@ ..M#44=GJG):&'tmp'mpsscfgM#44:++G):&'tmp'mpsserr

!"#+:!&'usr'lib'mpss.so.@($!"#+:!eport M#44=GJG): M#44:++G): !"#+:!

echo starting oracle server processes ..

s/lplus 'nolog <<Yconnect ' as ssdbastartup pfile&'tmp'oracle'admin'oramst'pfile'initoramst.oraY

$ cat 'tmp'mpsscfgoracle(CM(5CK

1 Co back to Step ? again and measure the di&&erence in %time :epeat Steps Bthrough 1 until there is some noticeable per&ormance improvement

Suggested #eadingSee the mpss.so.@ man pageu!!orting +ulti!le ,age izes in t"e olaris O!eratingyste *hite aper. at http4>>)))solarisinternalscom>si>reading><1-@G<1pd&

<$$2 'ot Table Tuning and 0ata rowth

During the &our-hour test o& <#,### usersJ (L% and server component )orkload, thedata in the database gre) by "B Cytes In total, "@$ tables and inde3es had ne) datainserted into them %he &ollo)ing table lists the top "# tables and inde3es, based ongro)th in si'e 6or the complete list o& tables and inde3es that gre), please see

Appendi3 2




Siebel )bEect 7ame Tyerowth in,ytes

4"!=K"TS;"J %A2LE <,<11,$1?,1"

4":NT"=T %A2LE <G#,?B<,<"#

4"!=K"TS;"J"#@ IFDEP G$,<<$,1?$

4"!=K"TS;"J"G@ IFDEP @",$##,?"4"=T":M# %A2LE B$,"#",#

4"4+N"+: %A2LE ?B,#?1,1$#

4"9!)T")T:M %A2LE "G,<,#

4"#T,"#4T; %A2LE ",<#,B#

4"=T":M#"M@ IFDEP "@,$##,###

4":NT"=T"M@ IFDEP "?,@"1,B"B

4":NT"=T"MB IFDEP "",@<G,#

4"=T":M#"9@ IFDEP "<,$"$,#

4"=T"=;T=T %A2LE "<,<?@,?$#

4":NT"=T"9@ IFDEP <,?G<,#B#

4"=T":M#"M7 IFDEP <$,@#,GBB

4":NT"=T"MD IFDEP <$,$1#,1"#4":NT"=T"ME IFDEP <$,@B1,B#

4"9!)T")T:M"M3 IFDEP <$,"11,@#B

4"=T":M#"#@ IFDEP <@,<1,G$

4"9!)T")T:M"M@ IFDEP <B,<?<,"##

(able '.6.-

<$$ )racle Parameters Tuning

7ere are the key (racle init.ora tunables that )ere tuned

db"cache"si0e&71CABE5111

%he preceding parameter determines the si'e &or (racle0s SCA Shared Clobal Area.Database per&ormance is highly dependent on available memory In general, morememory increases caching, )hich reduces physical I>( to the disks (racle0s SCA is amemory region in the application that caches database tables and other data &orprocessing *ith ?"-bit (racle so&t)are on a $B-bit Solaris (S the SCA is limited to BCbytes

(racle comes in t)o basic architectures4 $B-bit and ?"-bit %he number o& address bitsdetermines the ma3imum si'e o& the virtual address space

73-bits & 373 & C J* maimum

5C-bits & 35C & @5EEE3@5 T* maimum

6or the Siebel <#,### concurrent usersJ S )orkload, the BCbyte SCA )as su&&icient As a result, the ?"-bit (racle server version )as used




db"bloc2"ma"dirt"target&1db"writer"processes&CGast"start"io"target&1

%he de&ault value o& db"bloc2"ma"dirt"target )as changed &rom B"GBG$1"GB to# Setting this value to # disables )riting o& bu&&ers &or incremental checkpointingpurposes %his stops de&erred checkpointing and achieves 89 and bus improvements%he de&ault value &or db"writer"processes is < 8hanging db"writer"processesto B starts up &our dbwr processes %hese three parameter changes drastically reduced)ait times in the database and thus improved Siebel overall throughput

/$&$lock&s!#e7 8 de&ault value is "K An K value &or Siebel is optimal /B&BL)&LRU&LAT9+(47 8 Secifies the upper bound o& the number o& L:9latch sets Set this parameter to a value e+ual to the desired number o& L:9 latch sets(racle decides )hether to use this value or reduce it based on a number o& internalchecks I& the parameter is not set, (racle calculates a value &or the number o& setsbased on the number o& 89s %he value calculated by (racle is usually ade+uate=increase this value only i& misses are higher than ? in N$T= 6or Siebel <#,###users run on a &our 89 machine, setting the value to B )as optimal

"!str!$ute"&transact!ons0 8 (ett!ng t:!s value to # disables the (raclebackground process called reco Siebel does not use distributed transactions, meaningthat )e can regain 89 and bus by having one less (racle background process %hede&ault value is GG re'l!cat!on&"e'en"enc;&track!ng<AL(+Siebel does not use replication so it is sa&e to turn this o&& by setting it to &alse

transact!on&au"!t!ng<AL(+ *rites less redo &or every commit It is the nature o& Siebel (L% to do many smalltransactions )ith &re+uent commits Setting transaction"auditing to &alse buysback 89 and bus

7ere is the complete listing o& the init.ora &ile used )ith all the parameters set &or<#,### Siebel users

)racle =.3.0.3 !n!t.ora file

U racle D.3.1.3 init.ora for solaris D6 running up to @1111 4iebel E.B.3 userbenchmar2.

db"bloc2"si0e&A@D3db"cache"si0e&71CABE5111db"domain&RRdb"name&oramstbac2ground"dump"dest&'eport'pspp'oracle'admin'oramst'bdumpcore"dump"dest&'eport'pspp'oracle'admin'oramst'cdumptimed"statistics&G4:user"dump"dest&'eport'pspp'oracle'admin'oramst'udumpcontrol"files&OR'eport'pspp'oracle'admin'oramst'ctl'[email protected]'eport'pspp'oracle'admin'oramst'ctl'control13.ctlR6R'eport'pspp'oracle'admin'oramst'ctl'control17.ctlRP




instance"name&oramstFob"/ueue"processes&1a/"tm"processes&1compatible&D.3.1.1.1hash"Foin"enabled&T+9:/uer"rewrite"enabled&G4:star"transformation"enabled&G4:Fava"pool"si0e&1

large"pool"si0e&A7AA51Ashared"pool"si0e&B177@5CA1processes&3B11pga"aggregate"target&3B@5BA3Crollbac2"segments &Orb"11@6rb"1136rb"1176rb"11C6rb"11B6rb"1156rb"11E6rb"11A6rb"11D6rb"1@16rb"1@@6rb"1@36rb"1@76rb"1@C6rb"1@B6rb"1@56rb"1@E6rb"1@A6rb"1@D6rb"1316rb"13@6rb"1336rb"1376rb"13C6rb"13B6rb"1356rb"13E6rb"13A6rb"13D6rb"1716rb"17@6rb"1736rb"1776rb"17C6rb"17B6rb"1756rb"17E6rb"17A6rb"17D6rb"1C16rb"1C@6rb"1C36rb"1C76rb"1CC6rb"1CB6rb"1C56rb"1CE6rb"1CA6rb"1CD6rb"1B16rb"1B@6rb"1B36rb"1B76rb"1BC6rb"1BB6rb"1B56rb"1BE6rb"1BA6rb"1BD6rb"1516rb"15@6rb"1536rb"1576rb"15C6rb"15B6rb"1556rb"15E6rb"15A6rb"15D6rb"1E16rb"1E@6rb"1E36rb"1E76rb"1EC6rb"1EB6rb"1E56rb"1EE6rb"1EA6rb"1ED6rb"1A16rb"1A@6rb"1A36rb"1A76rb"1AC6rb"1AB6rb"1A56rb"1AE6rb"1AA6rb"1AD6rb"1D16rb"1D@6rb"1D36rb"1D76rb"1DC6rb"1DB6rb"1D56rb"1DE6rb"1DA6rb"1DD6rb"@11Plog"chec2point"timeout&@1111111111111111nls"sort&*);+,

sort"area"si0e & @1CABE51sort"area"retained"si0e & @1CABE51nls"date"format & RMM-!!-,,,,(3C(M)(44Rtransaction"auditing & falsereplication"dependenc"trac2ing & falsesession"cached"cursors & A111open"cursors&C1CAcursor"space"for"time & T+9:db"file"multibloc2"read"count & A U stripe si0e is 5CK and not @Mdb"bloc2"chec2sum&G4:log"buffer & @1CABE51optimi0er"mode&+9:filesstemio"options&setallpre"page"sga&T+9:fast"start"mttr"target&1db"writer"processes&5

distributed"transactions & 1transaction"auditing & G4:replication"dependenc"trac2ing & fals:Utimed"statistics & T+9: U turned offma"rollbac2"segments & @31Fob"/ueue"processes & 1Fava"pool"si0e & 1db"bloc2"lru"latches & CAdb"writer"processes & Csession"cached"cursors & A111G4T"4T+T")"T+J:T & 1!*"*=K"MS"!)+T,"T+J:T & 1pre"page"sga & T+9:

<$$< Solaris =ernel Parameters on )racle 0atabase Ser*er Parameter Scoe 0efault

5alueTuned5alue

shmss(shminfo"shmma 'etc'sstem #3&&&&&&&&&&&&&&&& shmss(shminfo"shmmin 'etc'sstem <##shmss(shminfo"shmseg 'etc'sstem "##semss(seminfo"semmns 'etc'sstem <$?Bsemss(seminfo"semmsl 'etc'sstem B#G$semss(seminfo"semmni 'etc'sstem B#G$semss(seminfo"semmap 'etc'sstem B#G$




semss(seminfo"semmnu 'etc'sstem B#G$semss(seminfo"semopm 'etc'sstem B#G$semss(seminfo"semume 'etc'sstem "#Bsemss(seminfo"semvm 'etc'sstem ?"1$1semss(seminfo"semaem 'etc'sstem <$?B

msgss(msginfo"msgmni 'etc'sstem B#G$msgss(msginfo"msgt/l 'etc'sstem B#G$msgss(msginfo"msgma 'etc'sstem <$?Bmsgss(msginfo"msgmnb 'etc'sstem <$?Brlim"fd"ma 'etc'sstem <#"B <$?Brlim"fd"cur 'etc'sstem $B <$?B

(able '.6.'

<$$C SL uery Tuning

During the course o& the test, the most resource-intensive and long-running +ueries )eretracked In general, the best )ay to tune a +uery is to change the SL statementkeeping the result set the same. %he other method is to add or drop inde3es so thee3ecution plan changes %he latter method is the only option in most benchmark tests*e added &our additional inde3es to the Siebel schema )hich helped per&ormance *ithSiebel 1@ there is no support &or 82( cost-based optimi'ation. )ith (racle database82( support is available in Siebel 11

%he &ollo)ing e3ample sho)s one o& the resource-consuming +ueries

*uffer Jets :ecutions Jets per :ec % Total ash Nalue--------------- ------------ -------------- ------- ------------ 3316C1361EE 7B65D5 [email protected] 77.3 3ED31EC3B@

%his +uery )as responsible &or ?? o& the total bu&&er gets &rom all +ueries during thebenchmark tests

4::=TTC.4T"9#!"*,6TC.+?")!6TC.=;G)=T")!6TC.=+:T:!"*,6TC.=+:T:!6TC.4T"9#!6TC.M!)G)=T);";9M6T@.#+)"4T"49*T,#:"=!6TC.4)#"M:T"=!6T@.#+)"4T";M:6TC.49*T,#:"=!6TC.G+JT"=!6TC.;M:6TC.*9")!6T7.+?")!6T3.;M:6T@.+?")!6TC.=9+=,"=!6T@.*9")!6TC.!:4="T:ST6TC.#,M:;T"T:+M")!

G+M+#:+G.4"#+)"4T"*9 T@6+#:+G.4"#,M:;T"T:+M T36+#:+G.4"#+T, T76




+#:+G.4"#+)"4T TC?:+:

TC.#,M:;T"T:+M")! & T3.+?")! OLP;!

T@.*9")! & (N@;!

TC.+?")! & T@.#+)"4T")!;!

T@.*9")! & T7.+?")!;!

OOT@.#+)"4T"49*T,#:"=! Y& Z=4T )4TZ;!

T@.#+)"4T"49*T,#:"=! Y& Z+T: )4TZP;!

OTC.:GG"4T+T"!T <& T"!T:O(N36ZMM'!!',,,, 3C(M)(44ZP;!

OTC.:GG":;!"!T )4 ;9+

TC.:GG":;!"!T >& T"!T:O(N76ZMM'!!',,,, 3C(M)(44ZPP;!

T@.#+)"4T";M: )K: (NC;!

TC.=9+=,"=! & (NBPP+!:+ *, T@.*9")!6 T@.#+)"4T";M:W

6?ecuting lan and statistics before the new inde? was added:

:ecution #lan---------------------------------------------------------- 1 4::=T 4TT:M:;T ptimi0er&+9: @ 1 ;:4T:! #4 O9T:+P 3 @ ;:4T:! #4 7 3 ;:4T:! #4 C 7 T*: ==:44 O*, );!:S +?)!P G Z4"#+)"4T"*9Z B C );!:S O+;J: 4=;P G Z4"#+)"4T"*9"M@Z O;;-9;)9:P 5 7 T*: ==:44 O*, );!:S +?)!P G Z4"#+)"4TZ E 5 );!:S O9;)9: 4=;P G Z4"#+)"4T"#@Z O9;)9:P A 3 );!:S O9;)9: 4=;P G Z4"#+T,"#@Z O9;)9:P D @ T*: ==:44 O*, );!:S +?)!P G Z4"#,M:;T"T:+MZ @1 D );!:S O9;)9: 4=;P G Z4"#,M:;T"T:+M"#@Z O9;)9:P

4tatistics---------------------------------------------------------- 75C recursive calls @ db bloc2 gets C@EBB consistent gets 1 phsical reads 1 redo si0e EBCBB1 btes sent via 4;et to client 3EA@E btes received via 4;et from client 7C@ 4;et roundtrips to'from client C sorts OmemorP 1 sorts Odis2P B1D7 rows processed

Ne> In"ex create" create inde 4"#+)"4T"S3 on 4"#+)"4TO=9+=,"=!6 :GG":;!"!T6 :GG"4T+T"!TP4T+J:O);)T) B@3K ;:ST B@3KM);:ST:;T4 @ MS:ST:;T4 9;)M)T:! #=T);=+:4: 1 G+::)4T4 E G+::)4TJ+9#4 E *9GG:+"# !:G9TP T*:4#=: );!S ;JJ);J #+: C W

As sho)n &rom the di&&erence in statistics, the ne) inde3 caused consistent reads toreduce by about <##

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page '1



:ecution #lan---------------------------------------------------------- 1 4::=T 4TT:M:;T ptimi0er&+9: @ 1 4+T O+!:+ *,P 3 @ ;:4T:! #4 7 3 ;:4T:! #4 C 7 ;:4T:! #4 O9T:+P B C T*: ==:44 O*, );!:S +?)!P G Z4"#+)"4TZ 5 B );!:S O+;J: 4=;P G Z4"#+)"4T"S3Z O;;-9;)9: E C T*: ==:44 O*, );!:S +?)!P G Z4"#,M:;T"T:+MZ A E );!:S O9;)9: 4=;P G Z4"#,M:;T"T:+M"#@Z O9;)9:P D 7 T*: ==:44 O*, );!:S +?)!P G Z4"#+)"4T"*9Z @1 D );!:S O+;J: 4=;P G Z4"#+)"4T"*9"9@Z O9;)9:P @@ 3 );!:S O9;)9: 4=;P G Z4"#+T,"#@Z O9;)9:P

4tatistics---------------------------------------------------------- 1 recursive calls 1 db bloc2 gets 3E5DA consistent gets 1 phsical reads 1 redo si0e EBCBB1 btes sent via 4;et to client 3EA@E btes received via 4;et from client 7C@ 4;et roundtrips to'from client @ sorts OmemorP 1 sorts Odis2P

B1D7 rows processed

Similarly, the three other ne) inde3es added )ere4

• create inde 4"=TJ"=T"#+!"G@ on +#:+G.4"=TJ"=T"#+! O=TJ"=T")! 4=P #=TG+:: @1);)T+;4 3MST+;4 3BB 4T+J: O);)T) B@31K ;:ST B@31K M);:ST:;T4 3 MS:ST:;T4 9;)M)T:!#=T);=+:4: 1 G+::)4T4 CE G+::)4T J+9#4 CE *9GG:+"# !:G9TP T*:4#=:);!S"B@31K ;JJ);JW

• create inde 4"#+J"!:G;"S@ on +#:+G.4"#+J"!:G; O;M:6 +:#4)T+,")!P4T+J:O);)T) B@3K ;:ST B@3KM);:ST:;T4 @ MS:ST:;T4 9;)M)T:! #=T);=+:4: 1*9GG:+"# !:G9TP T*:4#=: );!S"B@3K ;JJ);JW

• create inde 4":4="*Q:=T"S@ on +#:+G.4":4="*Q:=TO;M:6 +:#4)T+,")!6 );=T)N:"GJP4T+J:O);)T) B@3K ;:ST B@3KM);:ST:;T4 @ MS:ST:;T4 9;)M)T:! #=T);=+:4: 1*9GG:+"# !:G9TP T*:4#=: );!S"B@3K ;JJ);J=

%he last t)o inde3es are &or assignment manager tests Fo inserts occurred on the basetables during these tests

<$$D #ollbac- Segment Tuning

Incorrect number and si'e o& rollback segments )ill cause bad per&ormance %he rightnumber and si'e o& rollback segments depends on the application )orkload Most (L%)orkloads re+uire several small-si'ed rollback segments %he number o& rollbacksegments should be e+ual or more than the number o& concurrent active transactions in




the database during peak load In the Siebel tests this )as about # during a <#,### usertest

%he si'e o& each rollback segment should be appro3imately e+ual to the si'e in bytes o& auser transaction 6or the Siebel )orkload <## rollback segments o& "#Mbytes )ith e3tentsi'e o& <Mbyte )as &ound suitable Fote4 I& the rollback segment si'ing is larger thanre+uired by the application, one )ould end up )asting valuable space in the databasecache

%he ne) &eature &rom oracle 9;! 4egments, )hich can be used instead o& :ollbackSegments, )as not tested during this pro/ect )ith Siebel application

<$$13 0atabase %onnecti*ity &sing 9ost Names A"a'ter

It has been observed that high-end Siebel test runs using (racle as the backend haveper&ormed better )hen client-to-(racle server connectivity is done via the hostnamesadapter &eature %his is an (racle &eature that allo)s &or an alternate method o&connecting to the (racle database server )ithout using the tnsnames.ora &ile

Set the J*"!*;M: to something other than the racle"4)! in theistener.ora &ile on the database server as sho)n belo) 2ounce the (racle listenera&ter making this change

)4T:;:+ & O!:4=+)#T);")4T & O!:4=+)#T); & O!!+:44")4T & O!!+:44 & O#+T= & )#=POK:, & :ST#+=PP P O!!+:44")4T & O!!+:44 & O#+T= & T=#PO4T & dbserverPO#+T & @B3@PP P P O!:4=+)#T); & O#+T="4T=K & O#+:4:;TT); & J)#P O4:44); & +?P P O!!+:44 & O#+T= & T=#PO4T & dbserverPO#+T & 3CA@PP P P4)!")4T")4T:;:+ & O4)!")4T & O4)!"!:4= & O4)!";M: & #4:t#rocP O+=:"M: & 'eport'pspp'oracleP O#+J+M & etprocP P O4)!"!:4= & O*L)BAL&/BNAM+ oramst."$serverP O+=:"M: & 'eport'pspp'oracleP O4)!";M: & oramstP




(n the Siebel applications server, go into the (racle client installation and delete orrename. the tnsnames.ora and s/lnet.ora &iles \ou no longer need these as(racle no) connects to the database by resolving the name &rom the 'etc'hosts &ile

As root edit the &ile 'etc'hosts on the client machine that is, the Siebel applications

server in this case. and add an entry like the &ollo)ing4<ip.address of database server> oramst.dbserver

%he name oramst.dbserver should be )hatever you have provided as theJ*"!*;M: in the listener .ora &ile %his becomes the connect string to connect tothis database &rom any client

<$$11 'igh >/) with )racle Shadow Processes %onnected to Siebel

%he disk on )hich (racle binaries )ere installed )as close to <## occupied during the

peak load o& <### concurrent users %his problem )as diagnosed to be the )ell-kno)noraus.msb problem (n (racle clients that make use o& (8I (racle 8all Inter&ace., the(8I driver makes thousands o& calls to translate messages &rom the oraus.msb &ile%his problem has been documented by (racle under bug ID "<B"$"?

%he Sun )orkaround &or this problem is to cache the oraus.msb &ile in memory andtranslate the &ile access and system calls to user calls and memory operations %hecaching solution is dynamic, and code changes are not needed *ith Siebel this)orkaround helped in reducing the calls %he <## occupied I>( )ent a)ay and a Breduction in 89 )as observed also, the response times &or transactions got a <<boost

%his problem is supposed to have been &i3ed in (racle G"#B Details on ho) toimplement the Sun )orkaround by !"#+:! o& an interpose library are available athttp4>>developerssuncom>solaris>articles>ocicachehtml

+.+ Siebel 0atabase Conne"tion Poolin

%he database connection pooling &eature built into the Siebel server so&t)are providesbetter per&ormance A users4database connection ratio o& "#4< has been proven toprovide good results )ith Siebel1@>(racleG"#" %his reduced about ? 89 at theSiebel server, as &e)er connections )ere made &rom Siebel server to database during a"### user 8all 8enter test Siebel memory>user )as ?? lo)er and (racle memory>user)as 1G lo)er, because "# Siebel users share the same (racle connection

Siebel anonymous users do not use connection pooling I& the anonuser count is settoo high that is, higher than the recommended <# to "#. you )ould end up )asting thetasks, as MaTas2s is a number inclusive o& real users Also the anon sessions do not


http://developers.sun.com/solaris/articles/oci_cache.html

http://developers.sun.com/solaris/articles/oci_cache.html



use connection pooling, so you )ould have lots o& one-to-one connections and useincreased memory and 89 on both the database server and the applications server

'ow to 6nable %onnection PoolingSet the &ollo)ing Siebel parameters at the server level via the Siebel thin client C9I or

svrmgr4 Ma4hared!b=onns integer full <number of connections to be used>Min4hared!b=onns integer full <number of connections to be used>MaTr!b=onns integer full <number of connections to be used>

%hen bounce the Siebel server 6or e3ample, i& you are set up to run <### users, thevalue &or <number of connections to be used> is <###>"#U@# Set all o& threeparameters to the same value @#. to direct Siebel to share a single database connection&or "# Siebel users or tasks

(rvrmgr:S56"S8 change param MaTas2s&@@116 MaMT4ervers&316

MinMT4ervers&316 Min4hared!b=onns&B16 Ma4hared!b=onns&B16MinTr!b=onns&B1 for comp esalesobFmgr"enu

'ow to %hec- if %onnection Pooling is 6nabled During the steady state, log in to dbserver and ps -eaf | grep ; | wc -l%his should return around @# &or this e3ample= i& this action returns <### then connectionpooling is not in e&&ect

+. Tnin Sn -a#a S,ste$ 0ire"tor, Ser#er (L02P)

In order to prevent connections &rom timing out, change the &ollo)ing parameter on theLDA directory server4 idletimeout & @B secs Also increase the cache entriesparameter &or LDA &rom the de&ault to "@,### %o change these parameters4

< Stop the LDA Server

" 8hange the value associated )ith cache entries in slapd.conf

? 8hange the value associated )ith idletimeout in slapd.conf to <@

B :estart the LDA Server

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page ''



C Performance Twea-s with o ains%his section is most important as it sheds light on various myths o& per&ormance tuningSometimes a tunable that you think is sure to result in a per&ormance gain, does not butit ends up being counted as i& it did %hese are tunables that mostly help other

applications in a di&&erent scenario or are de&ault settings already in e&&ect %his sectionlists out some o& the tuning parameters that provided no gain )hen tested

Plea(e note: The(e ob(ervation( are (pecific to the wor#loa%+ architecture+ (oftware ver(ion(+

an% (o on u(e% %uring the pro4ect at S- 6T, lab(. The wor#loa% i( %e(cribe% in ,hapter &.

The outcome of certain tuneable( may vary when implemente% with a %ifferent wor#loa% on

a %ifferent architecture/configuration.

%hanging the ma!n>!n address M?&*MA&-A//R0xc00000008hanging this to other values did not seem to make a big di&&erence to per&ormance %hisvalue is set in the siebenv &ile

Solaris =ernel Parameter stks!#e%he de&ault value &or this is <$k, or #3B### on SunB9 9ltra. architecture machinesbooted in $B bit mode )hich is al)ays the de&ault. Increasing this to "Bk, #3$### by thebelo) settings in 'etc'sstem &ile did not provide any gains in per&ormance during thetests

set rpcmod(svc"default"st2si0e&15111set lwp"default"st2si0e&15111

Siebel Ser*er Parameters< #ecycle 8actor$ Enabling this did not provide any per&ormance gains De&ault is

disabled" S>SSP6#S>SS%)77$ %his is the parameter that changes the multiple3ing ratio

bet)een Siebel server and )eb server= its de&ault value is "# ;arying this valuedid not result in any per&ormance gains &or the speci&ic modules tested in thispro/ect )ith the S standard )orkload de&ined in 8hapter B.

#esonate: %ache size -- +:4"#:+4)4T"*=K"4):%his is an environment variable )hich is set inside the resonate startup script %his)as changed to as high as "B#Kbytes and there )as no di&&erence in behavior

Sun Fa*a System .eb Ser*er max'rocs%his parameter, )hen changed &rom the de&ault o& <, starts up more than one ns-httpd)eb server process. Fo gain )as measured )ith a value greater than < It )as better touse a ne) )eb server instance

0atabase %onnection Pooling with Siebel Ser*er %omonentsEnabling this &or the server component batch )orkload caused per&ormance to degradesuch that server processes could not start Some o& the server component modulesconnect to the database using (D28, )hich does not support connection pooling

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page '+



)racle 0atabase Ser*er < Larger than re@uired s:are"'ools!#e$ 6or a <#,### Siebel user benchmark, a

value o& B##Mbytes )as more than su&&icient %oo large a value &orsharedpoolsi0e )astes valuable database cache memory

" Large SA$ A larger than re+uired SCA si'e is not going to improve per&ormance,

)hereas too small an SCA si'e )ill degrade per&ormance? Large #,S$ 2eing larger than re+uired by an application )ould )aste space in thedatabase cache It is better to make the application commit more o&ten

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page ',



@51 siebelapp3"@ e4alesbFMgr"enu @DDBA +unning@5D siebelapp3"@ e4ervicebFMgr"enu @DAE7 +unning@EB siebelapp3"@ e4ervicebFMgr"enu @DA5A +unning@EA siebelapp3"@ e4ervicebFMgr"enu @DAA7 +unning@ED siebelapp3"@ e4ervicebFMgr"enu @DAEA +unning@ED siebelapp3"@ e4ervicebFMgr"enu @DAAA +unningCB siebelapp3"@ 4==bFMgr"enu @D5D5 +unningCB siebelapp3"@ 4==bFMgr"enu @DE13 +unning

B@ siebelapp3"@ 4==bFMgr"enu @D5DE +unning@1C siebelapp3"@ 4==bFMgr"enu @DE3E +unning

+un 4tates are +unning, nline, 4hutting !own, 4hutdown, and 9navailable+un Tas2s should be evenly distributed across servers and close to MaTas2s.

.4 To 6ind Ot the $ber of 2"ti#e Ser#ers for a Co$%onent

9se the &ollo)ing server command to &ind out the number o& active M%S Servers &or acomponent4

srvrmgr> list comp component for server servername show 4N";M:6 ==")46=#"=TN"MT4"#+=46 =#"MS"MT4"#+=4

%he number o& active M%S servers should be close to the number o& Ma3 M%S ser%ers.

.& To 6ind Ot the Tas7s for a Co$%onent

9se the &ollo)ing server command to &ind the tasks &or a component4

srvrmgr> list tas2 for comp component server servername order b TK"T4K)!

(rdering by task id places the most recently started task at the bottom It is a good signi& the most recently started tasks that is, those started in the past &e) seconds orminutes. are still running (ther)ise, &urther investigation is re+uired

./ To Set 0etailed Tra"e Le#els on the Siebel Ser#er Co$%onents(Siebel O5)

Log in to svrmgr and e3ecute the &ollo)ing commands4=hange evtloglvl tas2counters&C for comp sccobFmgrchange evtloglvl tas2counters&C for comp eserviceobFmgr

change evtloglvl tas2events&7 for comp sccobFmgrchange evtloglvl tas2events&7 for comp eserviceobFmgr

change evtloglvl mtwaring&3 for comp sccobFmgrchange evtloglvl mtwaring&3 for comp eserviceobFmgrchange evtloglvl set mt)nfraTrace & True

.+ To 6ind Ot the $ber of 8UEST Loins for a Co$%onent

9se the &ollo)ing server command to &ind out the number o& C9ES% login &or acomponent4




$ srvrmgr 'g gateway 'e enterprise 's server 'u sadmin 'p sadmin 'c ^list tas2for comp component_ | grep +unning | grep J9:4T | wc -l

. To Cal"late the 5e$or, Usae for an O5

< *e use the &ollo)ing script, pmem"sum.sh, to calculate the memory usage &or an(M4

UY'bin'sh

if H $U -e/ 1 IW then echo R9sage( pmem"sum.sh <pattern>Rfi

?M)&`'usr'ucb'whoami`

#)!4&`'usr'bin'ps -ef | grep $?M)R R | grep $@ | grep -v Rgrep $@R | grep -vpmem"sum | aw2 ZV print $3 [Z`

for pid in $#)!4doecho Zpmem process (Z $pidpmem $pid > `uname -n`.$?M).pmem.$piddone

pmem $#)!4 | grep total | aw2 Z*:J); V G4 & R R [ Vprint $@6$36$76$C6$B6$5[

VtotL&$C[ VsharedL&$B[ VprivateL&$5[ :;! Vprint RTotal memor used(R6 tot'@13C RM b

R;+R procs. Total #rivate mem( Rprivate'@13CR M Total 4hared mem( R shared'@13C RM

ctual used memor(R OOprivate'@13CPLOshared'@13C';+PP RMR[Z

" %o use it, type the &ollo)ing4pmem"sum.sh siebmtshmw

. To 6ind the Lo 6ile 2sso"iated with a S%e"ifi" O5

< 8heck the server log &ile &or the creation o& the multithreaded server process4

4erverog 4tartup @ 3117-17-@D @D(11(C5 4iebel pplication 4erveris read and awaiting re/uests4erverog #rocess=reate @ 3117-17-@D @D(11(C5 =reatedmultithreaded server process O4 pid & 34@=P for =all =enter bFect Manager

O:;9P with tas2 id 33B7B

2. %he log &ile associated )ith the preceding (M is 4==bFMgr"enu"34@=.log

@13@ 3117-17-@D @D(CA(1C 3117-17-@D 33(37(31 -1A11 1111111d 11@ 11@f 111@ 1D4==bFMgr"enu 3CED5 3CDD3 @@@'eport'pspp'siebsrvr'enterprises'siebel3'siebelapp@'log'4==bFMgr"enu"3CED5.logE.B.3.3@1 H@5151I :;9:;9




.19 To Prod"e a Sta"7 Tra"e for the Crrent Thread of an O5

< 6ind out the current thread number that the (M is running assuming the pid is"BG1.4

% > cat 4==bFMgr"enu"[email protected]

@13@ 3117-17-@D @D(B@(71 3117-17-@D 33(@D(C@ -1A11 1111111a 11@ 11@f 111@ 1D4==bFMgr"enu 3CDAE 3CDA3 =6'eport'pspp'siebsrvr'enterprises'siebel3'siebelapp@'log'4==bFMgr"enu"3CDAE.logE.B.3.3@1 H@5151I :;9:;9

2. %he thread number &or the preceding e3ample is D+$

? 9se pstac2 to produce the stack trace4

$ > pstac2 3CDAE | sed 8n 'lwpU D7'6'lwpU DC'p

----------------- lwpU D7 ' threadU D7 --------------------

EdfCCbEc lwp"mute"loc2 Oc11111c1P EdfC1dcC mute"loc2"2ernel OCeaE7a116 16 EdfBA@bA6 EdfB51116 16 c11111c1P L cA EdfC@a5C mute"loc2"internal OCeaE7a116 EdfBA@ac6 16 EdfB51116 @6 1P L CCc Ee7cC71c =loseandle O@@edc6 EeCD77aA6 c1@f1AcA6 Eea117eC6 c@B3A6 CeaE7aDAP L aA EeaD5DBA ""@cK=?inThread3T5M"v" OE3BED316 36 c@B7A6 @d6 16 1P L @C EeaDEE5A ""4)#.!::T:+""* OE3BED316 @6 Eebc7Ec16 Eea113DC6 ddAfA6 Ca@EfA@cP L C EeaD5Bf1 ""@cMf:ndThread5G)i"v" OE3BEabA6 E3BED316 16 @6 @6 1P L BA Eedd3c5c ""@cN4!4olarisThread4tart5Gpv"1" OEabaDd16 @6 c1@f1AcA6 B@ecd6 @6 1P LB1 EfbC@@bc ""@c9?slThread#roc?rapper5Gpv")" OEabaDeA6 EeCD77aA6 c1@f1AcA6c1@f1AcA6 16 ffffffffP L CA EeaD577c ""@c#"fThread:ntr5Gpv")" OB@ecc6 ffffffff6 @6 EeaDEAEc6 C1116Ca@Efe@1P L @@C Ee7ca5BA ""@c)MwThread5Gpv"v" O@6 EeCa5d116 EeCD5C116 c117C5C16 c1@f1CBA6c1@f1AcAP L 3ac

EdfCCDE1 "lwp"start O16 16 16 16 16 1P

----------------- lwpU DC ' threadU DC --------------------

.11 To Show S,ste$:Wide Lo"7 Contention ;sses Usin lockstat

< \ou can use loc2stat to &ind out a lot o& things about lock contentions (neinteresting +uestion is, X*hat is the most contended lock in the system5Y

" %he &ollo)ing sho)s the system locks contention during one o& the B$## user runs)ith large latch values and double ramp up time

U loc2stat sleep B

daptive mute spin( @E5C@ events in C.DDA seconds O7B3D events'secP

=ount indv cuml rcnt spin oc2 =aller------------------------------------------------------------------------------- 7C17 @D% @D% @.11 B@ 1711@Ee@37e1 hmestartL1@cA77A@ @D% 7A% @.11 @71 service"/ueue bac2groundL1@7177@B @D% BE% @.11 @75 service"/ueue bac2groundL1dc3@C3 @3% 5D% @.11 A5 service"/ueue /enable"loc2edL17AAB7 B% EC% @.11 C@ 1711@Ee@37e1 hmeintrL13dc

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page +1



@ 1% @11% @.11 B 171135EbEBf1 lwp"unpar2L151

@ 1% @11% @.11 @A 1711@dDaEDcA bac2groundL1b1----------------------------------------------------------------------------

daptive mute bloc2( @11 events in C.DDA seconds O31 events'secP

=ount indv cuml rcnt nsec oc2 =aller

---------------------------------------------------------------------------- 3B 3B% 3B% @.11 C1@ED 1711@Ee@37e1 hmeintrL13dc

A A% 77% @.11 E5BA11 1711@Ee@37e1 hmestartL1@cA5 5% 7D% @.11 @13335 service"/ueue bac2groundL1dcB B% CC% @.11 D77E5 service"/ueue bac2groundL1@71

@ @% @11% @.11 ECCA1 171111Dab111 callout"eecuteL1DA

----------------------------------------------------------------------------

4pin loc2 spin( @AA@C events in C.DDA seconds O7E5C events'secP

=ount indv cuml rcnt spin oc2 =aller---------------------------------------------------------------------------- 3ADB @B% @B% @.11 3C@5 sleep/"headL1AdA cv"signalL17ABBE 7% @A% @.11 @@AC cpuH@1IL1EA disp"getbestL1cCA5 7% 3@% @.11 @1D7 cpuH3IL1EA disp"getbestL1c

@ 1% @11% @.11 @11@ turnstile"tableL1f5A turnstile"loo2upL1B1

@ 1% @11% @.11 @C75 turnstile"tableL1bfA turnstile"loo2upL1B1@ 1% @11% @.11 @5@A turnstile"tableL1c@A turnstile"loo2upL1B1

----------------------------------------------------------------------------

Thread loc2 spin( 77 events in C.DDA seconds OE events'secP

=ount indv cuml rcnt spin oc2 =aller---------------------------------------------------------------------------- 3 5% 5% @.11 A73 sleep/"headL1AdA setrunL1C

3 5% @3% @.11 @@3 cpuH7IL1bA ts"tic2L1c3 5% @A% @.11 C3@ cpuHAIL1EA ts"tic2L1c

@ 7% DE% @.11 @ cpuH@CIL1EA turnstile"bloc2L131c

@ 7% @11% @.11 D@D sleep/"headL173A ts"tic2L1c

----------------------------------------------------------------------------

+'? writer bloc2ed b writer( E7 events in C.DDA seconds O@B events'secP

=ount indv cuml rcnt nsec oc2 =aller---------------------------------------------------------------------------- A @@% @@% @.11 @11A71 17113ECeB511 segvn"setprotL17C

B E% @A% @.11 AEB31 17113DBEEB1A segvn"setprotL17CC B% 37% @.11 D5131 17113ECCa7AA segvn"setprotL17C

@ @% DD% @.11 @B3D51 1711@e3D55B1 segvn"setprotL17C

@ @% @11% @.11 3C5D51 17113DBE5Ce1 segvn"setprotL17C----------------------------------------------------------------------------

+'? writer bloc2ed b readers( C1 events in C.DDA seconds OA events'secP

=ount indv cuml rcnt nsec oc2 =aller---------------------------------------------------------------------------- C @1% @1% @.11 BCA51 17113ECeB511 segvn"setprotL17C

7 A% @A% @.11 BBE77 17113ECCa7AA segvn"setprotL17C7 A% 3B% @.11 @133C1 1711@cE3D55A segvn"setprotL17C

@ 3% DA% @.11 CAE31 17113EBDbB11 segvn"setprotL17C

@ 3% @11% @.11 C5CA1 17113DBE5Ce1 segvn"setprotL17C----------------------------------------------------------------------------

+'? reader bloc2ed b writer( B3 events in C.DDA seconds O@1 events'secP




=ount indv cuml rcnt nsec oc2 =aller---------------------------------------------------------------------------- B @1% @1% @.11 @7@CAA 17113ECeB511 segvn"faultL17A

7 5% @B% @.11 @@@AC1 1711@a53bDC1 segvn"faultL17A7 5% 3@% @.11 @7D3B7 17113ED3f3a1 segvn"faultL17A

@ 3% DA% @.11 DAC11 1711@e3D55B1 segvn"faultL17A

@ 3% @11% @.11 @115C1 17113DBE5Ce1 segvn"faultL17A----------------------------------------------------------------------------

oc2stat record failure( B events in C.DDA seconds O@ events'secP

=ount indv cuml rcnt oc2 =aller---------------------------------------------------------------------------- B @11% @11% 1.11 loc2stat"loc2 loc2stat"record----------------------------------------------------------------------------

.1 To Show the Lo"7 Statisti" of an O5 Usin plockstat

< %he synta3 is4 ploc2stat H -o outfile I -p pid %he program grabs aprocess and sho)s the lock statistics upon e3it or interrupt

" %he &ollo)ing sho)s the lock statistics o& an (M during one o& the B$## user runs)ith large latch values and double ramp up time4

$> ploc2stat -p C13E=

----------- mute loc2 statistics ----------- loc2 tr"loc2 sleep avg sleep avg hold location( count count fail count time usec time usec name 3@CD 1 1 @ B3@A @C3 siebmtshmw( ""environ"loc2 3555 1 1 1 1 7 HheapI( 1Debd1 DCA 1 1 1 1 @ HheapI( 1DfCD1

7@3 1 1 3 7B@ AA HheapI( 1DfCcA CCE 1 1 1 1 3 HheapI( 1DfA5A 37E 1 1 1 1 @1@ HheapI( 1DfAa1 3C5C 1 1 @ CC5D 3 HheapI( 1a11f1 @ 1 1 1 1 @@ HheapI( 1@ECECbc1 3@D 1 1 1 1 3 libsscassmc( m"cacheoc2L1A C@ C@ 1 1 1 3 1EDa3aA3A @B33DB 1 1 @B @@C1E @ libthread( tdb"hash"loc2 357@ 1 1 @1 3DE517 C5A libc( "time"loc2 @A1EB3B 1 1 @5E53 BDEB3 @C libc( ""malloc"loc2 ----------- condvar statistics ----------- cvwait avg sleep tmwait timout avg sleep signal brcast location( count time usec count count time usec count count name 1 1 C@ C1 CBEB3D1 1 1 HheapI( 13feec71 A @5C@7C57 1 1 1 A 1 HheapI( 171BfceA 31 EB15B7D 1 1 1 31 1 HheapI( 1CfafbeA @5 5ACBA@A 1 1 1 @5 1 HheapI( 1B@1aAdA @3 AD511BB 1 1 1 @3 1 HheapI( 1@@1f5@7A @7 @17EB511 1 1 1 @7 1 HheapI( 1@@@7e1C1 ----------- readers'writer loc2 statistics ----------- rdloc2 tr"loc2 sleep avg sleep wrloc2 tr"loc2 sleep avg sleep avghold location( count count fail count time usec count count fail count time usec timeusec name




7A3 1 1 1 1 1 1 1 1 11 HheapI( 1CABc3c1 @13@11 1 1 1 1 1 1 1 1 11 libsscfdm( g"=Tsharedoc2

.13 To <Trss= an O5

1. Modi&y siebmtshw4

UY'bin'2sh

. $M?M:'setmwruntime

M?94:+"!)+:=T+,&$VM?M:['sstem

!")*++,"#T&'usr'lib'lwp($V!")*++,"#T[

exec s!e$mts:m> CDtruss El Eo 5tm'5CC.s!e$mts:m>.trc s!e$mts:m> CD

2. A&ter you start up the server, this )rapper creates the truss output in a &ile named pid .siebmtshmw.trc in 'tmp.

.14 How to Tra"e the S>L State$ents for a Parti"lar SiebelTransa"tion

I& response times are high, or i& you think that the database is a bottleneck, you cancheck ho) long the SL +ueries are taking to e3ecute by running a SL trace on aoad+unner script %he SL trace is run through Siebel and tracks all o& the databaseactivity and ho) long things take to e3ecute I& e3ecution times are too high, there is aproblem )ith the database con&iguration, )hich most likely is contributing to highresponse times %o run a SL %race on a particular script, &ollo) these instructions4

< 8on&igure the Siebel environment to the de&ault settings that is, the componentshould have only one (M, and so on.

" (pen the oad+unner script in +uestion in the ;irtual 9ser Cenerator? lace a breakpoint at the end o& ction @ and be&ore ction 3 %his )ill stop

the user at the breakpointB :un a user




@ (nce the user has stopped at the breakpoint, enable SL tracing via srvrmgr4

change evtloglvl bFMgr4/log&C for comp <component>

$ ress #la, )hich )ill resume the user1 *ait until the user has &inished 9nder the $4):*:"4:+N:+"M:'enterprises'<enterprise>'<server>

directory, there )ill be a log &or the component that is running %his log containsdetailed in&ormation on the database activity, including ho) long the SL +ueriestook to e3ecute Search &or high e3ecution times greater than ##< seconds.

G (nce you are done, disable SL tracing via srvrmgr4

change evtloglvl bFMgr4/log&1 for comp <component>

.1& Chanin 0atabase Conne"t Strin vi $ODBCINI and Editin the

field .ServerName.@. srvrmgr 'g siebgatewa 'e siebel 'u sadmin 'p sadmin 's <server

name>" At srvrmgr prompt4 ;eri&y and change the value o& !4=onnect4tring

parameter4i List params &or named subsystems serverdatasrcii 8hange param !4=onnect4tring&<new value> &or named subsystemsserverdatasrc.

.1/ Enablin?0isablin Siebel Co$%onents

0isabling a %omonent

< 2ring up srvrmgr console4srvrmgr 'g siebgatewa 'e siebel 'u sadmin 'p sadmin 's <servername>

" Disable the component4disable comp <component name>

? List the components and veri&y their status4list components

6nabling a %omonentDisabling a component may disable the component de&inition *e may need toenable the component de&inition

< 2ring up srvrmgr console at enterprise level /ust do not use 's s)itch.3. srvrmgr 'g siebgatewa 'e siebel 'u sadmin 'p sadmin? Enable the component de&inition4enable compdef <component name>Fote4 %his enables the component de&inition at all active servers= you may need todisable the component at servers )here you donJt need the component.

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page +'



B 2ring up srvrmgr console at server level4srvrmgr 'g siebgatewa 'e siebel 'u sadmin 'p sadmin 's <servername>@ Enable the component de&inition at server level4enable compdef <component name>$ 2ounce gate)ay and all active servers

Fote4 Sometimes the component may not be enabled even a&ter &ollo)ing these steps Insuch cases you may need to enable the component group at enterprise level be&oreenabling the actual component4enable compgrp <component group name>

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page ++



13 Aendi? A: Transaction #esonse Times%hese are the di&&erent transactions e3ecuted by the (L% )orkload o& <#,### Siebelusers %he collection here is an average o& all <#,### users in steady state o& < hour,

e3ecuting multiple iterations )ith ?# second average think time bet)een eachtransaction %he average o& all o& the average transactions )as #<$1 seconds

Transaction 7ame Min A*erage Ma?

e4vc3"uer"*ranch 1.1DC 1.@C 7.E17

e4vc3"Mail"nd"Ga 1.157 1.1AB 7.@B5

e4vc3"ogin"#age 1.317 1.73C C.BEA

e4vc3":mail 1.1EA 1.@D7 B.B57

e4vc3"=ontact"9s"7 1.157 1.@35 7.ABD

e4vc3"=ontact"9s 1.1CE 1.15C C.7@7

e4vc3"*ranch"ocator 1.17@ 1.1C3 7.C33

:service3 vg 1.@7D@C3A5

e4vc@"uer"#roduct 1.17@ 1.1B3 3.5E3

e4vc@"#roduct"*utton 1.1@5 1.177 1.@3B

e4vc@"K"#roduct 1.1@5 1.13B 1.355

e4vc@"M"4+ 1.1CE 1.1AC C.17@

e4vc@"M"ccount 1.157 1.1AA 7.A@7

e4vc@"ogout 1.17@ 1.1D7 7.51D

e4vc@"ogin"#age 1.317 1.7B@ 7.DAC

e4vc@"ogin 1.355 1.CC5 7.EB

e4vc@":nter")nfo"nd"4ubmit 1.1CE 1.1DA 7.CB7

e4vc@"!rilldown"4ubmit"4+ 1.157 1.@5A C.7CC

e4vc@"!rilldown"4+ 1.1EA 1.@@B 3.D5D

e4vc@"=ontinue 1.1CE 1.1A5 7.7BD

e4revice3"=ontact"9s"3 1.17@ 1.15 7.EDE

1.@715D37@

e4ls7"77Aogut 1.157 1.@ 1.B57

e4ls7"77E9ser#rofile 1.17@ 1.1CD 1.@B5

e4ls7"775Mccount 1.1DC 1.@7 @.C7A

e4ls7"77B!!rder 1.@C@ 1.37D 3.D33

e4ls7"77CMrders 1.1DC 1.@3A 1.317

e4ls7"777Mccount 1.1DC 1.@3B 1.ABD

e4ls7"773=onfirmrder 1.B7@ 1.5E5 @.53B

e4ls7"77@=ontinue 1.355 1.C3A 3.CAC

e4ls7"771:dit4hipping!eatils 1.1EA 1.@@7 3.1@5

e4ls7"73D:dit4hipping 1.1EA 1.1DA 1.3B

e4ls7"73A:nter=redit)nfo 1.C15 1.BAD 3.AEB

e4ls7"73E=hec2ut 1.3@D 1.7C@ 3.BEA

e4ls7"735Joto=art 1.317 1.3C7 1.53B

e4ls7"73B=hangeuantddtocart 1.3A@ 1.CB7 7.@E3

e4ls7"73C!!product 1.C15 1.B17 7.73A

e4ls7"737*ac2Gromcompare 1 1 1

e4ls7"733#ic2C#rod=ompare 1.7CC 1.C@7 7.@3B

e4ls7"73@=olor"+ed4i0e"MedManuf"cme 1.B7@ 1.5 1.EDE

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page +,



e4ls7"7314elect#rodGamil 1.@1D 1.@A@ 3.3A@

e4ls7"7@D#aram4earch 1.1EA 1.@1@ 1.73A

e4ls7"7@Aome 1.@AA 1.3B@ 7.317

e4ls7"7@Eddto=art 1.317 1.3A7 7.C7A

e4ls7"7@5!!#rod*abood#olice 1.@3B 1.@CA 1.3@D

e4ls7"7@B;et+ecs 1.1DC 1.1DE 1.@E3

e4ls7"7@C;et+ecs 1.1DC 1.@C@ 3.A3A

e4ls7"7@7!!4ub=ategor@.@ 1.@E3 1.335 7.17@

e4ls7"7@3!!=ategor@ 1.@3B 1.@EA 3.51D

e4ls7"7@@=atalogTab 1.@C@ 1.@E 1.7BD

e4ls7"7@1ddto=art 1.3A@ 1.C13 3.B

e4ls7"71D!!#rod*abood 1.@1D 1.@7C 1.355

e4ls7"71A;et+ecs 1.1EA 1.1DE 1.@AA

e4ls7"71E;et+ecs 1.1DC 1.@ 1.B@5

e4ls7"715!!4ub=ategor@.@ 1.@B5 1.@D5 3.1CE

e4ls7"71B!!=ategor@ 1.@1D 1.@CC 1.7EB

e4ls7"71C=atalogTab 1.@1D 1.@C5 @.AEB

e4ls7"713ogin 1.C15 1.BDB 7.D33

e4ls7"71@=lic2ogin 1.1CE 1.1E7 1.@B5

e4ls7"7114tartpp 1.3B 1.7E7 7.7@7

1.3C7EADCE

e4ls3"33Cogut 1.1CE 1.@@D 3.E7C

e4ls3"337:mpt=art 1.157 1.@3D 3.317

e4ls3"333Joto=art 1.@C@ 1.37E 3.E7C

e4ls3"33@ddto=art 1.@AA 1.7 7.@E3

e4ls3"331!!#rod*abood 1.@1D 1.@CE @.CB7

e4ls3"3@D;et+ecs 1.1DC 1.@@@ 3.E@D

e4ls3"3@A;et+ecs 1.1DC 1.@15 3.7EB

e4ls3"3@[email protected] 1.@B5 1.@AD 7.7D@

e4ls3"3@5!!=ategor@ 1.73A 1.7AE 3.CAC

e4ls3"3@B=atalogTab 1.@1D 1.@AE 7.BCE

e4ls3"3@Cddressboo2 1.17@ 1.1BC 3.17@

e4ls3"3@7Mccount 1.1DC 1.@@@ @.7CC

e4ls3"3@39ser#rofile 1.17@ 1.1B5 3.B57

e4ls3"3@@Mccount 1.1DC 1.@3E 3.D33

e4ls3"3@1Mrders 1.1EA 1.@@D 3.E@D

e4ls3"31DMccount 1.@3B 1.@5B 7.@E3

e4ls3"31Addto=art 1.317 1.C3E 7.3@D

e4ls3"31E!!#rod*ing 1.@3B 1.@E5 7.5E3

e4ls3"315;et+ecs 1.1EA 1.@1C 7.5E3

e4ls3"31B;et+ecs 1.1EA 1.@1B 7.BEA

e4ls3"[email protected] 1.@C@ 1.@BB @.5C@

e4ls3"317!!=ategor@ 1.@1D 1.@BD 7.C33

e4ls3"313ogin 1.7EB 1.B75 7.5C@

e4ls3"31@=lic2ogin 1.1CE 1.1EE 3.@3B

e4ls3"3114tartpp 1.37C 1.77@ C.157

1.@ACB5

e4ls@"@@A!!#rod*ingle 1.@3B 1.@57 7.3DE

e4ls@"@@E;et+ecs 1.1EA 1.1D5 3.D33

e4ls@"@@5;et+ecs 1.1EA 1.@1@ 7.@1D




e4ls@"@@[email protected] 1.@3B 1.@BE 7.C5D

e4ls@"@@C!!=ategor@ 1.@1D 1.@5 7.ACC

e4ls@"@@7=atalogTab 1.@3B 1.@CD 7.355

e4ls@"@@3!!#rod*inge 1.@3B 1.@5@ 7.ABD

e4ls@"@@@;et+ecs 1.1EA 1.1DD 7.C5D

e4ls@"@@1;et+ecs 1.1EA 1.@15 7.C7A

e4ls@"@[email protected] 1.@3B 1.@BB 7.B7@

e4ls@"@1A!!=ategor@ 1.@1D 1.@5 7.E55

e4ls@"@1E=atalogTab 1.@1D 1.@CD 7.1CE

e4ls@"@15!!#rod*ing 1.@3B 1.@BD 7.355

e4ls@"@1B;et+ecs 1.1EA 1.@15 7.3DE

e4ls@"@1C;et+ecs 1.1EA 1.@17 7.317

e4ls@"@[email protected] 1.@C@ 1.@57 7.B

e4ls@"@13!!=ategor@ 1.@1D 1.@5C 7.E17

e4ls@"@1@=atalogTab 1.@1D 1.@7C 7.C5D

e4ls@"@114tartpp 1.3@D 1.7CA 7.BDC

1.@CD@1B35

e=hannel7"+eset4tates 1 1.115 @.D5D

e=hannel7"JoTo4+4olutionNiew 1.1DC 1.@B3 B.E55

e=hannel7"JoTo4erviceTab 1.@B5 1.3C5 5.73A

e=hannel7":ecuteuer*4+;um 1.1EA 1.@B3 C.BCE

e=hannel7":nter!etailsnd4ave 1.3@D 1.7AA 5.5B5

e=hannel7"!rilldown4+ 1.@3B 1.3@A 5.C5D

e=hannel7"=reate;ewctivit 1.1EA 1.@3C C.AEB

e=hannel7"=lic2uer*utton 1.1DC 1.@55 C.7@7

e=hannel7"=hange4tatus4ub4tatusnd4ave 1.@AA 1.3A 5.@AA

1.@D3CCCCC

e=hannel3"@73"4aveuote 1.@B5 1.3D5 A.C33

e=hannel3"@7@";ewuote 1.@3B 1.@AB C.@E3

e=hannel3"@71"pportunituoteNiew 1.@3B 1.3 7.A@7

e=hannel3"@3D"pportunitttachmentNiew 1.@1D 1.@EB C.@3B

e=hannel3"@3A"4avectivit 1.@3B 1.3BE C.3B

e=hannel3"@3E";ewctivit 1.@1D 1.@B 3.@C@

e=hannel3"@35"pportunitctivitNiew 1.@3B 1.@D3 C.3B

e=hannel3"@3B"#ic24alesTeam 1.@C@ 1.3E@ B.A3A

e=hannel3"@3C";ew4alesTeam 1.1CE 1.1AB 7.AEB

e=hannel3"@37"pportunit4alesTeamNiew 1.@1D 1.@D7 7.EA@

e=hannel3"@33"4ave#roduct3 1.317 1.7CB C.5C@

e=hannel3"@3@"#ic2#roduct3 1.1DC 1.@73 3.317

e=hannel3"@31"uerGor#roduct3 1.17@ 1.@@E 3.D5D

e=hannel3"@@D"=lic2n#roductGield3 1.1@5 1.13@ 1.CAC

e=hannel3"@@A";ew#roduct3 1.1DC 1.@B7 C.E17

e=hannel3"@@E"4ave#roduct@ 1.317 1.75C 5.@C@

e=hannel3"@@5"#ic2#roduct@ 1.1DC 1.@7E @.5AA

e=hannel3"@@B"uerGor#roduct@ 1.17@ 1.15@ 3.B

e=hannel3"@@C"=lic2n#roductGield 1.17@ 1.17E @.5B5

e=hannel3"@@7";ew#roduct@ 1.1DC 1.@7D C.@3B

e=hannel3"@@3"ppt#roductNiew 1.@1D 1.@EB 7.DAC

e=hannel3"@@@"4ave=ontact 1.@B5 1.3D7 5.C5D

e=hannel3"@@1";ew=ontact 1.@B5 1.71B B.BEA




e=hannel3"@1D";ew=ontactppt 1.1EA 1.@@A 3.E@D

e=hannel3"@1A"!rilldownnppt 1.@B5 1.35E B.1DC

e=hannel3"@1E"4aveppt 1.@E3 1.7C@ B.AD@

e=hannel3"@15"#ic2ccount 1.@3B 1.33 B.B@5

e=hannel3"@1B"uerGorccount 1.17@ 1.1E@ 3.A@7

e=hannel3"@1C"=lic2nuerGorccount 1.1@5 1.13 1.BEA

e=hannel3"@17"=lic2nccountGield 1.@1D 1.@AD B.CB7

e=hannel3"@13";ewppt 1.7D@ 1.E15 A.7@7

e=hannel3"@1@"pportunit4creen 1.@B5 1.35C B.ACC

e=hannel3"@11"+eset4tates 1 1.1@C 1.7BD

1.@D5EBEBA

e=hannel@"4earchGor=ontact 1.1CE 1.1AE 3.DB7

e=hannel@"4earchGorccount 1.1CE 1.1D C.37C

e=hannel@"4ave4+ 1.1DC 1.@D C.1EA

e=hannel@"4ave=ontact 1.@1D 1.3@5 C.17@

e=hannel@"4aveddress 1.1EA 1.@EC B.37C

e=hannel@"4avectivit 1.@1D 1.3@E C.A3A

e=hannel@"4aveccount 1.@C@ 1.3E5 C.EDE

e=hannel@"+eset4tates 1 1.11B 1.C5D

e=hannel@"oo2)n=ontact 1.1@5 1.13D 1.E17

e=hannel@"oo2)nccount 1.17@ 1.1C3 @.E@D

e=hannel@"Jo=ontacts 1.3@D 1.735 E.7EB

e=hannel@"Joccounts 1.@B5 1.3B 5.BCE

e=hannel@"!rilldownnccount 1.@C@ 1.717 5.@E3

e=hannel@"=reate4+ 1.1DC 1.@B7 C.B57

e=hannel@"=reate=ontact 1.157 1.@@A 7.@B5

e=hannel@"=reateddress 1.157 1.1AB 3.7BD

e=hannel@"=reatectivit 1.1DC 1.@3A 3.E55

e=hannel@"=reateccount 1.1EA 1.@@B B.E7C

e=hannel@"=loseGind 1.1EA 1.@@C 3.73A

e=hannel@"=lic2;ew)n=ontactMNJ 1.@1D 1.375 B.3B

e=hannel@"=lic2Gind 1.@1D 1.@5A C.BEA

e=hannel@"ccountTeamNiew 1.@1D 1.@B 7.@1D

e=hannel@"ccount4+Niew 1.@1D 1.@5D 7.B7@

e=hannel@"ccount+evenueNiew 1.@1D 1.@5D C.BCE

e=hannel@"ccountuoteNiew 1.@1D 1.@A5 C.7D@

e=hannel@"ccountrderNiew 1.@1D 1.@D 7.DB7

e=hannel@"ccountssetNiew 1.1DC 1.@5 C.B

e=hannel@"ccountddressNiew 1.1DC 1.@B3 C.37C

e=hannel@"ccountctivitNiew 1.@1D 1.@5B 7.7EB

1.@51ED7@

==7"3solutionNiew 1.1CE 1.1D3 C.ACC

==7"3solution4+view 1.17@ 1.1BA 3.EA@

==7"3set4tatusnd4ave4+ 1.@B5 1.3AC B.D7A

==7"3set4tatusnd4avectivit 1.1DC 1.@73 C.ACC

==7"3service4creen 1.1EA 1.@37 C.@E3

==7"3save4olution 1.157 1.@75 C.C7A

==7"3+eset4tates 1 1.11B 1.5C@

==7"3related4+view 1.157 1.@@5 B.157

==7"3new4olution)nMNJ 1.1CE 1.@@B B.@B5

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page ,



==7"3new4olution 1.1CE 1.@75 7.3A@

==7"3go4olution 1.1CE 1.1D5 C.51D

==7"3bac2ToctivitiesNiew 1.1CE 1.1EB 7.5AA

==7"3activitiesNiew 1.1EA 1.@3@ C.EA@

1.@@CB7AC5

==3"3service4creen 1.@E3 1.3BD B.7D@

==3"3search4+ 1.1CE 1.1AA C.3B

==3"3save4+ 1.@E3 1.77D 5.B57

==3"3savectivit#lan 1.B57 1.D7@ E.DAC

==3"3+eset4tates 1 1.11C 1.C5D

==3"3/uer=ontact 1.1CE 1.15E 7.C33

==3"3product#ic2list 1.1CE 1.@7C 3.@B5

==3"3pen*inocular 1.17@ 1.17C @.1EA

==3"3o2#roduct 1.1@5 1.17@ 3.ABD

==3"3o2=ontact 1.1CE 1.1DA B.73A

==3"3new4+ 1.17@ 1.15C C.B

==3"3newctivit#lan 1.17@ 1.1BC 7.5AA

==3"3go#roduct 1.157 1.1AA 7.DAC

==3"3go=ontact 1.157 1.@3@ B.7EB

==3"3contactMNJ 1.@1D 1.335 B.E7C

==3"3close*inocular 1 1.113 1.BDC

==3"3activit#lanNiew 1.1CE 1.@ C.B

1.@BB3DC@3

==@"+eset4tates 1 1.11B 1.BDC

==@"@A7";avigate*ac2TopptuoteNiew 1.@C@ 1.3@7 B.CB7

==@"@A3"4ave4alesrder 1.157 1.@7B C.@C@

==@"@A@";ew4alesrder 1.7BD 1.5@E 5.7CC

==@"@A1"uoterderNiew 1.3B 1.7B@ 5.E55

==@"@ED"9pdateppt 1.@C@ 1.3BA 5.7BD

==@"@EA"+eprice 1.17@ 1.1BB 7.37C

==@"@EE"4elect!iscountnd4aveuote 1.@E3 1.3AA B.B@5

==@"@E5"#ic2#riceist 1.17@ 1.15E 7.73A

==@"@EB"JouerGor#riceist 1.157 1.@15 C.@C@

==@"@EC"uerGor#riceist 1.1CE 1.1E5 3.51D

==@"@E7"*ring9p#riceistMNJ 1.3DE 1.C37 C.317

==@"@E3"!rilldownnuote 1.3A@ 1.C17 B.EDE

==@"@E@"4aveuote 1.1DC 1.31A 5.C15

==@"@E1"utouote 1.@C@ 1.3D7 5.7@7

==@"@5D"pptuoteNiew 1.157 1.@3 C.7D@

==@"@5A"4ave#roduct3 1.157 1.@7@ 7.EA@

==@"@5E"#ic2#roduct3 1.1@5 1.177 @.1@5

==@"@55"JouerGor#roduct3 1.157 1.@@3 C.@E3

==@"@5B"uerGor#roduct3 1.17@ 1.@@5 @.3B

==@"@5C";ew#roduct3 1.1@5 1.17B @.3A@

==@"@57"4ave#roduct@ 1.157 1.@7E 7.AEB

==@"@53"#ic2#roduct@ 1.1@5 1.13A 7.C15

==@"@5@"JouerGor#roduct@ 1.157 1.37C B

==@"@51"uerGor#roduct@ 1.1CE 1.@CB 3.355

==@"@BD";ew#roduct@ 1.1@5 1.1C@ 7.@B5

==@"@BA"ppt#roductNiew 1.1CE 1.1D7 7.D5D

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page ,1



==@"@BE"!rilldownnppt 1.@E3 1.3B5 C.EDE

==@"@B5"4aveppt 1.@1D 1.375 C.5B5

==@"@BB"#ic2ccount 1.1CE 1.1A3 7.EDE

==@"@BC"JouerGorccount 1.1EA 1.@7E B.@3B

==@"@B7"uerGorccount 1.3B 1.7A@ B.3B

==@"@B3"*ring9pccountMNJ 1.@1D 1.33D 3.AD@

==@"@B@";ew)npptMNJ 1.7BD 1.BDD E.7EB

==@"@B1";ewppt 1.1EA 1.31D C.157

==@"@CD"=ontactpptNiew 1.157 1.@@B 7.C7A

==@"@CA"4ave=ontact 1.1EA 1.@E5 C.D5D

==@"@CE";ew=ontact 1.1@5 1.17@ C.73A

==@"@C5"=ontact4creen 1.@3B 1.31C B.@C@

==@"@CB"=loseGind 1 1.113 1.BCE

==@"@CC"4earchGor=ontact 1.17@ 1.153 7.EB

==@"@C7"=lic2Gind 1.17@ 1.1C @.73A

cc@ avg 1.@EA@C3A5

total avg 1.@5EEB1DB




11 Aendi? ,: 0atabase )bEects rowth 0uring the Test

(I+B+L )BF+T NAM+ TYP+*R)?T9 INBYT+(

4"!=K"TS;"J T*:@6@EE65E76E3A

4":NT"=T T*: @D167C@6@314"!=K"TS;"J"#@ );!:S D56@@56E75

4"!=K"TS;"J"G@ );!:S B365116A73

4"=T":M# T*: C563136AA1

4"4+N"+: T*: 7C617E6E51

4"9!)T")T:M T*: 3D6A@A6AA1

4"#T,"#4T; T*: 3A6@A16CA1

4"=T":M#"M@ );!:S 3B65116111

4":NT"=T"M@ );!:S 376B3E6C3C

4":NT"=T"MB );!:S 336B@D6A1A

4"=T":M#"9@ );!:S 3@65356AA1

4"=T"=;T=T T*: 3@6@7B6751

4":NT"=T"9@ );!:S @A67D@61C14"=T":M#"M7 );!:S @56AB16DCC

4":NT"=T"MD );!:S @565E16E31

4":NT"=T"ME );!:S @56BCE6AC1

4"9!)T")T:M"M3 );!:S @563EE6B1C

4"=T":M#"#@ );!:S @B6@AE6D5A

4"9!)T")T:M"M@ );!:S @C6@7@6311

4":NT"=T"GD );!:S @76AB365E3

4"=T"=;T=T"9@ );!:S @7675@6@B3

4"+!:+")T:M T*: @7615563C1

4"+:N; T*: @36DC76751

4"=;T=T T*: @36EED6B31

4"4+N"+:"ME );!:S @36CD36A11

4"4+N"+:"M3 );!:S @@6D516731

4"=T":M#"G@ );!:S @@6A1C65E3

4"4+N"+:"93 );!:S @16E7@6B31

4"4+N"+:"9@ );!:S @16CCC6A11

4"!="9T: T*: @1673@6D31

4"9T:")T:M T*: D65556B51

4"4+N"+:"MD );!:S A6DE163C1

4"=T"=;T=T"G3 );!:S A6E@563AA

4"#T, T*: A67D56A11

4"=T"=;T=T"#@ );!:S A6@A76A1A

4"9!)T")T:M"G3 );!:S E6DAE6311

4"+!:+ T*: E6DAE6311

4"4+N"+:"G@7 );!:S E6D1B63A1

4"4+N"+:"#@ );!:S E6AE36B@3

4"4+N"+:"M@1 );!:S E6A376751

4"+:4)T:M T*: E6EDA6EAC

4"9!)T")T:M"#@ );!:S E657C6DCC

4"+:N;"9@ );!:S E6CBC6E31

4"4+N"+:"MA );!:S E677@6AC1




4"4+N"+:"M7 );!:S E631A6D51

4"4+N"+:"G5 );!:S E6@7B6373

4"4+N"+:"G@ );!:S E61A561A1

4"+:N;"M@ );!:S E611C6@51

4"#T,"9@ );!:S 565E56CA1

4"+:N;"93 );!:S 565E56CA1

4":NT"=T"G@@ );!:S 565136EB3

4"#T,"T:++ T*: 56B5D6DAC

4"4+N"+:"M5 );!:S 56CE@65A1

4"4+N"+:"G3 );!:S B65@@6B31

4"!="+!:+ T*: C6DE36BCC

4"4+"+:4)T:M T*: C6DE36BCC

4"+J":ST T*: C6A7763A1

4"==;T"#4T; T*: C67C@6E51

4"#T,"=; T*: C6@756D51

4"!="9T:"*9 T*: C61D56111

4"#+T, T*: C61D56111

4"4+N"+:"MB );!:S C61BB61C1

4"#4T;"=; T*: 76D736@51

4"4+N"+:"GE );!:S 76E5A6731

4"4+N"+:"MC );!:S 76B576B31

4"#T,"*9 T*: 76@DC6AA1

4"+:N;"M7 );!:S 76@536@@3

4"=;T=T"M@7 );!:S 76@B76D31

4"#T,"93 );!:S 761E36111

4"+:N;"97 );!:S 7617@61C1

4"#T,"*9"MD );!:S 36DD161A1

4"#T,"*9"#@ );!:S 36DCD6@31

4"#+T,"M3 );!:S 36DCD6@31

4"+!:+"*9"M3 );!:S 36A5E6311

4"#T,"*9"9@ );!:S 36ECC6731

4"+J":ST"G@ );!:S 3653D6573

4"=;T=T"M@@ );!:S 3653@6CC1

4"=;T=T"M3@ );!:S 3653@6CC1

4"=;T=T"M@C );!:S 3653@6CC1

4"#+T,"M7 );!:S 3653@6CC1

4"=;T=T"G5 );!:S 36BA16CA1

4"#T,"N3 );!:S 36BA16CA1

4"+:4)T:M"MC );!:S 36BCE6E@3

4"+:N;"G5 );!:S 36B7D6B31

4"+!:+"MB );!:S 36CDA6B51

4"#+T,"MC );!:S 36CDA6B51

4"+:N;"M3 );!:S 36CDA6B51

4"#4T;"=;"M@ );!:S 36CDA6B51

4"=;T=T"M@3 );!:S 36C@565C1

4"#T,"*9"M@ );!:S 36C@565C1

4"=;T=T"M33 );!:S 36C@565C1

4"#T,"*9"M3 );!:S 3677C6E31

4"#T,"*9"MB );!:S 3677C6E31

4"#T,"*9"M5 );!:S 3677C6E31




4"#T,"*9"MA );!:S 3677C6E31

4"+!:+"#4T; T*: 3677C6E31

4"#T,"*9"ME );!:S 3677C6E31

4"=;T=T"MD );!:S 363D76E51

4"=;T=T"S T*: 363D76E51

4":NT"=T"MA );!:S 363B36A11

4"#T,"*9"MC );!:S 363@@6AC1

4"+:4)T:M"93 );!:S 36@7A6@@3

4"+:4)T:M"MB );!:S 361DE6@B3

4"+:4)T:M"M5 );!:S 361DE6@B3

4"+!:+"*9 T*: 361AA6D51

4"+:N;"G7 );!:S 361AA6D51

4"!="9T:"9@ );!:S 361CA6111

4"+:4)T:M"9@ );!:S 361376C3C

4"#T,"*9"M7 );!:S @6D5561A1

4"+:N;"#@ );!:S @6D5561A1

4"+:N;"GC );!:S @6D5561A1

4"!="9T:"93 );!:S @6D3B6@31

4"4+"+:4)T:M"9@ );!:S @6AD367B3

4"#4T;"=;"M3 );!:S @6AC76311

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page ,'



1( Aendi? %: )racle stats'ack #eort%his is one o& the (racle statspac2 reports collected during the one-hour steady stateo& the test %his report provides an e&&icient )ay to identi&y )here the time is spent insidethe (racle database during the Siebel tests

4TT4#=K report for

!* ;ame !* )d )nstance )nst ;um +elease =luster ost------------ ----------- ------------ -------- ----------- ------- ------------+M4T 7BDE1B@51D oramst @ D.3.1.3.1 ; siebdb

4nap )d 4nap Time 4essions =urs'4ess =omment ------- ------------------ -------- --------- -------------------*egin 4nap( E @C-ug-1C 11(3D(@1 @61C7 BE.3 B111-and-server-use :nd 4nap( A @C-ug-1C 1@(B3(7@ 57D EE.A B111-and-server-use :lapsed( A7.7B OminsP

=ache 4i0es OendP *uffer =ache( 36D@3M 4td *loc2 4i0e( AK 4hared #ool 4i0e( CA1M og *uffer( @163C1K

oad #rofile #er 4econd #er Transaction --------------- --------------- +edo si0e( AEC6EAC.@E E65C1.@3 ogical reads( DB63EC.BE A73.@1 *loc2 changes( B67CC.73 C5.5A #hsical reads( @6573.3A @C.35 #hsical writes( 573.ED B.B7 9ser calls( 76@[email protected]@ 3E.E1 #arses( @63C7.C7 @1.A5 ard parses( 1.@1 1.11 4orts( 7AB.AB 7.7E ogons( 1.D3 1.1@

:ecutes( @6553.A3 @C.B3 Transactions( @@C.B1

% *loc2s changed per +ead( B.5@ +ecursive =all %( 33.33 +ollbac2 per transaction %( 1.33 +ows per 4ort( @A.5A

)nstance :fficienc #ercentages OTarget @11%P *uffer ;owait %( DD.DD +edo ;o?ait %( @11.11 *uffer it %( DA.5C )n-memor 4ort %( @11.11 ibrar it %( @11.13 4oft #arse %( DD.DD :ecute to #arse %( 3B.33 atch it %( DD.DB#arse =#9 to #arse :lapsd %( DB.E5 % ;on-#arse =#9( DE.71

4hared #ool 4tatistics *egin :nd ------ ------

Memor 9sage %( 5E.5A 5A.7C % 4 with eecutions>@( 7E.1A 77.51 % Memor for 4 w'eec>@( 53.ED BA.51

Top B Timed :vents % Total:vent ?aits Time OsP :la Time-------------------------------------------- ------------ ----------- --------=#9 time @@6BB1 E3.1Clog file snc BE763@1 36@C7 @7.7Edirect path read 3A16DCE 53E 7.D@direct path write @BC6EA@ B77 7.73

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page ,+



log file parallel write BB16@1@ B@B 7.3@ -------------------------------------------------------------?ait :vents for !*( +M4T )nstance( oramst 4naps( E -A-> s - second-> cs - centisecond - @11th of a second-> ms - millisecond - @111th of a second-> us - microsecond - @111111th of a second-> ordered b wait time desc6 waits desc Oidle events lastP

vg Total ?ait wait ?aits:vent ?aits Timeouts Time OsP OmsP 'tn---------------------------- ------------ ---------- ---------- ------ --------log file snc BE763@1 3A7 36@C7 C @.1direct path read 3A16DCE 1 53E 3 1.Bdirect path write @BC6EA@ 1 B77 7 1.7log file parallel write BB16@1@ BC56B5B B@B @ @.1db file se/uential read 56CB@6@1C 1 3DC 1 @@.7db file parallel write 3E61C5 1 @B3 5 1.14;et more data to client 3611563B@ 1 @B3 1 7.Bcontrol file parallel write @657D 1 7A 37 1.1en/ueue A6DE@ 1 @1 @ 1.1buffer bus waits 7E61A7 1 D 1 1.@latch free B6EB7 B65AB 5 @ 1.1

log file switch completion B@ 1 7 BC 1.1db file scattered read 7615C 1 @ 1 1.1J?+ wait for redo cop @763CC 1 @ 1 1.1control file se/uential read EC7 1 1 1 1.14;et brea2'reset to clien 3A 1 1 @ 1.1log file single write C 1 1 @ 1.1buffer deadloc2 3@@ 3@@ 1 1 1.1log file se/uential read C 1 1 1 1.14;et message from client @76@3E61D@ 1 C6DA76B17 7A1 33.D4;et more data from clien 36@DE6A3D 1 3AB 1 7.A4;et message to client @76@3565AB 1 33 1 33.D -------------------------------------------------------------*ac2ground ?ait :vents for !*( +M4T )nstance( oramst 4naps( E -A-> ordered b wait time desc6 waits desc Oidle events lastP

vg

Total ?ait wait ?aits:vent ?aits Timeouts Time OsP OmsP 'tn---------------------------- ------------ ---------- ---------- ------ --------log file parallel write BB16@1B BC56B5D B@B @ @.1db file parallel write 3E61C5 1 @B3 5 1.1control file parallel write @657D 1 7A 37 1.1log file snc A3B 1 3 3 1.1J?+ wait for redo cop @763CC 1 @ 1 1.1db file scattered read @E5 1 1 3 1.14;et more data to client 76731 1 1 1 1.1db file se/uential read DDB 1 1 1 1.1control file se/uential read 5D@ 1 1 1 1.1en/ueue @3 1 1 @ 1.1direct path write BC 1 1 1 1.1log file single write C 1 1 @ 1.1buffer bus waits 3C 1 1 1 1.1direct path read BC 1 1 1 1.1log file se/uential read C 1 1 1 1.1rdbms ipc message @6@A563B5 BBC6@11 3A67B@ 3C 3.@4;et message from client D6DCA 1 C6A5D CAD 1.1smon timer @5 @5 C6B1@ UUUUUU 1.14;et more data from clien 76ACB 1 @ 1 1.14;et message to client D6DCA 1 1 1 1.1

er!ormnce -uning Sie*el So!twre on the Sun lt!orm Page ,,



Ac-nowledgements%hanks to Siebel SystemsJ Mark 6arrier, 6rancisco 8asas, 6arina' 6arsai, ;ikram Kumar,Santosh 7asani, San/ay Agar)al, 7arsha Cadagkar, and others &rom Siebel Systems &or)orking )ith Sun %hanks to Scott Anderson, Ceorge Drapeau, and Lester Dorman &ortheir role as management and sponsors &rom Sun %hanks to Diane Kituara, Sherill Ellis,and Ceorge Drapeau &or their valuable &eedback on content &or this paper %hanks to SunMDE %eam Kesari Mandyam, Ciri Mandalika, and Devika Collapudi &or theircontributions %hanks to the various engineers across Sun Microsystems &or providingsub/ect matter e3pertise4 :avindra %alashikar AE., Stephen !ohnson Fet)orkStorage., and Dileep Kumar Sun !ava System *eb Server.

About the Author Khader Mohiuddin )orks as a Sta&& Engineer in the Market Development Engineeringorgani'ation at Sun Microsystems, Inc 7is role as the engineering lead &or the Sun-Siebel Alliance involves optimi'ing Siebel 8:M applications on the Sun plat&orm, /ointtechnology adoption pro/ects, and so on 7e has been at Sun &or &our years empo)eringIS;s to adopt Sun0s latest technologies rior to that he )orked at (racle as a developer

and Senior er&ormance Engineer &or &ive years, and at A%]% 2ell Labs, Fe) !ersey, &orthree years

About Sun Microsystems4 >nc$Since its inception in <G", a singular vision ^ X%he Fet)ork Is %he 8omputerZY ^ haspropelled Sun Microsystems, Inc Fasda+4 S9F*. to its position as a leading provider o&industrial-strength hard)are, so&t)are, and services that make the Fet )ork Sun can be&ound in more than <1# countries and on the *orld *ide *eb at http4>>suncom>

http://sun.com/

http://sun.com/

performance tuning siebel software on the sun™ platform

Documents