stress testing hd
TRANSCRIPT
8/13/2019 Stress Testing Hd
http://slidepdf.com/reader/full/stress-testing-hd 1/2
BEST PRACTICES FORSTRESS TESTING HYPERION v11
WHY STRESS TEST HYPERION v11?
Whilst Hyperion v11 is a compelling proposition to group nanceteams seeking to shorten nancial close cycles and build betterprocesses, the upgrade entails a signicant number of changesat an IT and business level. It introduces Oracle’s new EPMarchitecture, built on SOA (Service Oriented Architecture), to allowwider integration and the incorporation of additional, new EPMapplications. The target platform for most organisations is basedon new 64-bit servers. The benets may be clear but a strategyfor managing change and minimizing risk needs to be part of thedelivery plan. Comprehensive stress testing and go-live performancemonitoring with diagnostics dramatically reduce the risks -both arerecommended to ensure the environment is sufciently speciedand delivers to the expectation of stakeholders and users.
Some organisations simply ask their user base to test the system.Ironically these tests are unrepresentative, unrepeatable and prone totoo many external factors.
BEST PRACTICES FOR STRESS TESTING
Triometric use a best practice approach to testing of Hyperionsystems, honed over a signicant number of customer engagements.This start-to-nish methodology introduces a structured approachwith representative tests, staged loading with clear outcomes and atgo-live, performance monitoring with diagnostics on the real userperformance just when it matters most.
Simulated user testing just using automated tools does not providesufcient information about the components within the application orinfrastructure that might require optimisation. However this approach,in conjunction with Triometric’s Enterprise Analyzer, does allow eachindividual application request to be captured and analyzed. Thisincludes end-to-end transaction time broken down into the networklatency and server response times, for all key Hyperion components,to accurately predict the remote user’s application experience.
Triometric offers a three-step service when stress testing Hyperion v11upgrades which includes the preparatory phase, testing phase andvalidation phase.
HYPERION v11 EPM ARCHITECTUREINFRASTRUCTURE
WAN USERS
TAP ORSPANPORT
MONITOR MANAGER
REPORTER
TRIOMETRIC ENTERPRISE ANALYZER
INTERNET USERS
TESTAGENT
TESTAGENT
TESTAGENT
TESTAGENT
TESTAGENT
8/13/2019 Stress Testing Hd
http://slidepdf.com/reader/full/stress-testing-hd 2/2
PREPARATORY PHASE
This initial phase involves reviewing the current environment toassess peak user loads, usage of key Hyperion components, formsand reports as well as the geographic distribution of the usercommunity. Triometric’s Enterprise Analyzer is the ideal solution forcapturing this information which then forms the basis for deningtest scenarios and creating realistic test scripts. Decisions are alsomade at this stage on the load levels the test should be performedat and from which locations they should be run. For the testing tobe of any value, these must collectively represent the anticipatedserver workload.
TEST PHASEThis second phase constitutes running the planned tests atincreasing load levels, starting with a baseline test; a ‘single user’simulated from all the test locations. This baseline establishes theunit levels for comparison with the ‘multi-user’ tests, ensures thatthe scripts run as expected and the system is f ree of issues. Thesubsequent tests at various load levels are then executed from thespecied locations.
When all tests have been completed successfully, the results aredocumented in a performance test report which highlights thendings and recommendations for optimising the application andinfrastructure so any issues can be rectied immediately withoutlosing precious project time. Depending on the outcome, a seriesof isolated tests may be conducted to ensure all go-live criteria are
met before going into production.Below are two graphs from a test showing total response andnetwork times, by component and country.
Average End-to-end Response Time (seconds) by Component
Average Network Time (seconds) by Component
VALIDATION PHASE
The remaining step is to validate the system performance at go-live.This is the true testimony of real world performance when actual usersare on the production system - the main objective is to comparethe real trafc with the simulated load test results. This is the criticalperiod in the project lifecycle so monitoring the application closely toprovide visibility of performance and usage is essential to ensure thatany issues can be diagnosed and resolved quickly.
The deliverable from this phase is a performance validation reportwhich documents the health of the system and provides furtherrecommendations to optimise the environment.
Below are two examples of the performance of Web Forms and
Smart View showing comparisons between the test results and theactual performance from a user’s perspective when the system rstgoes live into production.
CONTINUOUS MONITORING
Stress testing is just an initial part of the application lifecycle.Continuous monitoring after go-live is recommended by ITIL.Performance and usage should be tracked in a proactive manneragainst SLAs with alerting for efcient management of theenvironment. The data, collated over time, should be used tobenchmark the improvements in the service and validate investments.Finally, the feedback allows both Finance and IT to manage and meetthe expectations of the stakeholders and users of the system.
TRI/PS/009All information was correct at the time of production.
© Triometric 2011
“TRIOMETRIC’S EXPERTISE AND APPROACH TO STRESSTESTING AND MONITORING v11 HAS DEFINITELY MADETHE UPGRADE JOURNEY SMOOTHER.”
Catriona Harrison, Director,Financial Control Group Reporting Systems, Invensys plc
UK0
1
2
3
4
5
6
7
US India France
Location
A v e r a g e
R e s p o n s e
T i m e
( s e c o n
d s )
Australia China Bazil DataCentre
Data Grid
DocumentManager
HR - DisplayReport
Smart View
Static
Web Form
UK0
1
2
3
4
5
6
7
US India France
Location
A v e r a g e
R e s p o n s e
T i m e
( s e c o n
d s )
Australia China Bazil DataCentre
Data Grid
DocumentManager
HR - DisplayReport
Smart View
Static
Web Form
Web Form Comparative End-to-end Response Time Distributions
150u Load Test 300u Load Test Validation
0
80% 85% 95% 100%90%
50
100
150
200
250
300
350
400
450
500
Percentile
E n
d - t o - e n
d R e s p o n s e
T i m e
( s e c o n
d s )
Smart View Comparative End-to-end Response Time Distributions
150u Load Test 300u Load Test Validation
0
80% 84% 94%82% 92%86% 96% 98% 100%88% 90%
1
2
3
4
5
6
7
Percentile
E n
d - t o - e n
d R e s p o n s e
T i m e
( s e c o n
d s )