© 2008 hewlett-packard development company, l.p. the information contained herein is subject to...
TRANSCRIPT
© 2008 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice
Performance & Availability Lifecycle
Recorded on July 10, 2008
Sanjay Anne
HP Software, Product Marketing
Agenda• Performance & Availability
Lifecycle• Why is it important?• Why is it hard to achieve?• How does it help QA/Test and Ops
teams?• Customer example
April 11, 2023
Performance & Availability Lifecycle (PAL)
• What?−Managing performance and availability in both
pre-production and production
• How?−By integrating testing and monitoring solutions
to drive efficiency, mitigate risk, and reduce costs
• Deployment−Use best practices created by HP Software
Services to deploy
Why is it important?
Run Load Tests
Record Business Processes
Deploy and Monitor
Record Business Processes
Testing Operations
“86% of IT projects experience performance problems when first put in production” Gartner
PerformanceRequirements?
Why is it hard to achieve?
SOA, Shared Services, Web 2.0, Enterprise 2.0
New and Agile Business CapabilitiesBusiness Services?
CRM Operationse-Commerce
Finance
Increasing complexity
Increasing time and cost pressures
CIO
Failure
Distributed and Offshore teams
Integrated business processes
PAL scenarios – attributes of a real-time enterprise
Monitor and Optimize
Reuse Business ProcessScripts
Test and Optimize
Record Business Process Scripts Bidirectional
Asset Reuse
TESTING OPERATIONS
Leverage Real User Information in Pre-Production
Reuse Business Processes Scripts/SLAs from Testing in Production
Unified Diagnostics
New application deployment
Continuous improvement
(Hot packs, fixes etc)
Major upgrades
Leverage operational information
HP Performance and Availability Lifecycle includes:
• HP Performance Center software• HP LoadRunner software• HP Business Availability Center software
−HP End User Management software• HP Business Process Monitor
• HP Real User Monitor
• HP Diagnostics software• HP Performance Center Implementation Service
software
7 04/11/23
Linking pre-production and production teams
Key differences when going live…
QA EnvironmentObjective is to establish the breaking points of the application
•Confined to the QA environment•No access restrictions•Known data sets•Dummy data•All operations are fair game •Clean environment•Consistent network •Not an audited environment
ProductionObjective is to ensure the service doesn’t break
•Global Scope•Location/Time restrictions•Chaotic user defined data•Information security requirements•Some things cannot be touched•Noisy environment•Network varies by time & user•Auditing is common
04/11/23
Performance and Availability Lifecycle Process
MONITORING AND OPTIMIZATION
Build Test Scripts & Scenarios
Plan Capacity
Gather Performance Requirements
Diagnose Root Cause & Optimize
Run Performance Tests
Detect and Isolate Problems
Develop Monitoring Strategy
Diagnose Root Cause & Optimize
Gather Performance Requirements
Monitor App and Infrastructure
Build Monitoring Scripts
TESTING AND OPTIMIZATION
Validate Results
OPTIMIZE BUSINESS OUTCOMES
DevelopmentPerformance EngineerQuality Assurance
OperationsPerformance Engineer
Application Support
Deploy
BidirectionalScript Reuse
GoNo-Go
Reuse Business Processes Scripts/SLAs from Testing in Production
Performance and Availability Lifecycle Process
MONITORING AND OPTIMIZATION
Build Test Scripts & Scenarios
Plan Capacity
Gather Performance Requirements
Diagnose Root Cause & Optimize
Run Performance Tests
Detect and Isolate Problems
Develop Monitoring Strategy
Diagnose Root Cause & Optimize
Gather Performance Requirements
Monitor App and Infrastructure
Build Monitoring Scripts
TESTING AND OPTIMIZATION
Validate Results
OPTIMIZE BUSINESS OUTCOMES
DevelopmentPerformance EngineerQuality Assurance
OperationsPerformance Engineer
Application Support
Deploy
BidirectionalScript Reuse
GoNo-Go
Store and retrieve Test Scripts & Scenarios
04/11/23
Reuse Business Processes Scripts/SLAs from Testing in Production
Define SLA’s to a load test
Generate point & click scripts
With powerful scripting capabilities
14 April 11, 2023
Broadest environment support
PR
OTO
CO
LS
ERP/CRM
• SAP• Oracle• Siebel• PeopleSoft
Web
• SOA• HTTP(S)• Web 2.0• Citrix ICA• WAP
Middleware
• EJBs• CORBA• COM• RMI• MQSeries
Databases• Oracle• MS
SQLServer• DB2• ODBC
Legacy
• 3270• 5250• VT100
Load
BalancerWeb
ServerApplication Servers
DatabaseNetworkController Load
Generators
Vusers
US
Europe
• Windows• Unix• Linux
• SNMP• WAN
Emulation
• MS IIS• iPlanet• Apache
• BEA WebLogic• IBM
WebSphere• ATG Dynamo• iPlanet App
Server
• EJB• JDBC• JSP• Sitraka
JMonitor
• Oracle• MSSQL
Server• DB2
Oracle 11i Siebel SAP J2EE J2EE .NET
Diagnostics
Monitors
Operating Systems Network Web Servers App Servers Java Databases
Performance and Availability Lifecycle Process
MONITORING AND OPTIMIZATION
Build Test Scripts & Scenarios
Plan Capacity
Gather Performance Requirements
Diagnose Root Cause & Optimize
Run Performance Tests
Detect and Isolate Problems
Develop Monitoring Strategy
Diagnose Root Cause & Optimize
Gather Performance Requirements
Monitor App and Infrastructure
Build Monitoring Scripts
TESTING AND OPTIMIZATION
Validate Results
OPTIMIZE BUSINESS OUTCOMES
DevelopmentPerformance EngineerQuality Assurance
OperationsPerformance Engineer
Application Support
Deploy
BidirectionalScript Reuse
GoNo-Go
Store and retrieve Monitoring Scripts
Save time creating monitors
Reuse Test Scripts for Business Process Monitoring
Performance and Availability Lifecycle Process
MONITORING AND OPTIMIZATION
Build Test Scripts & Scenarios
Plan Capacity
Gather Performance Requirements
Diagnose Root Cause & Optimize
Run Performance Tests
Detect and Isolate Problems
Develop Monitoring Strategy
Diagnose Root Cause & Optimize
Gather Performance Requirements
Monitor App and Infrastructure
Build Monitoring Scripts
TESTING AND OPTIMIZATION
Validate Results
OPTIMIZE BUSINESS OUTCOMES
DevelopmentPerformance EngineerQuality Assurance
OperationsPerformance Engineer
Application Support
Deploy
BidirectionalScript Reuse
GoNo-Go
Capture Real User Scripts & Scenarios for reuse
Leverage Real User Information in Pre-Production
What can be learned in production?
Individual behaviorSlow operations
Odd data
Navigation paths
Error creation
Group behaviorUsage loads
Common paths
Abandonment metrics
Under/Unutilized areas
User set/group idiosyncrasies
Infrastructure behaviorUtilization
Topology
Relations to user loads
Shared services
Application logicTopology flows
Slow methods/functions
Bottlenecks
Utilization norms between test and production
Day one monitoring
Understand user experience to ensure service levels
Create SLA definitions based on production data
Performance and Availability Lifecycle Process
MONITORING AND OPTIMIZATION
Build Test Scripts & Scenarios
Plan Capacity
Gather Performance Requirements
Diagnose Root Cause & Optimize
Run Performance Tests
Detect and Isolate Problems
Develop Monitoring Strategy
Diagnose Root Cause & Optimize
Gather Performance Requirements
Monitor App and Infrastructure
Build Monitoring Scripts
TESTING AND OPTIMIZATION
Validate Results
OPTIMIZE BUSINESS OUTCOMES
DevelopmentPerformance EngineerQuality Assurance
OperationsPerformance Engineer
Application Support
Deploy
BidirectionalScript Reuse
GoNo-Go
Capture Real User Scripts & Scenarios for reuse
Leverage Real User Information in Pre-Production
Closed-loop integration with Operations
Identify critical business processes
Specify data for accuracy
Manage what really matters
Deliver actionable information
Manage by actionable information
Create scenarios from production data
Data used to create scenarios:
What are the most used BPs?
How many users per BP?
Generate test scripts from Real-User Monitoring
Create Scripts from Production data:
•What does a user do during session?
Performance and Availability Lifecycle Process
MONITORING AND OPTIMIZATION
Build Test Scripts & Scenarios
Plan Capacity
Gather Performance Requirements
Diagnose Root Cause & Optimize
Run Performance Tests
Detect and Isolate Problems
Develop Monitoring Strategy
Diagnose Root Cause & Optimize
Gather Performance Requirements
Monitor App and Infrastructure
Build Monitoring Scripts
TESTING AND OPTIMIZATION
Validate Results
OPTIMIZE BUSINESS OUTCOMES
DevelopmentPerformance EngineerQuality Assurance
OperationsPerformance Engineer
Application Support
Deploy
BidirectionalScript Reuse
GoNo-Go
Collaboration to decrease Time to Resolution
Unified Diagnostics
Unified Diagnostics in pre-production and production
Performance and Availability Lifecycle Process
MONITORING AND OPTIMIZATION
Build Test Scripts & Scenarios
Plan Capacity
Gather Performance Requirements
Diagnose Root Cause & Optimize
Run Performance Tests
Detect and Isolate Problems
Develop Monitoring Strategy
Diagnose Root Cause & Optimize
Gather Performance Requirements
Monitor App and Infrastructure
Build Monitoring Scripts
TESTING AND OPTIMIZATION
Validate Results
OPTIMIZE BUSINESS OUTCOMES
DevelopmentPerformance EngineerQuality Assurance
OperationsPerformance Engineer
Application Support
Deploy
BidirectionalScript Reuse
GoNo-Go
Capture Real User Scripts & Scenarios for reuseStore and retrieve Test Scripts & Scenarios
Store and retrieve Monitoring Scripts
Collaboration to decrease Time to Resolution
Performance and Availability Lifecycle Process
MONITORING AND OPTIMIZATION
Build Test Scripts & Scenarios
Plan Capacity
Gather Performance Requirements
Diagnose Root Cause & Optimize
Run Performance Tests
Detect and Isolate Problems
Develop Monitoring Strategy
Diagnose Root Cause & Optimize
Gather Performance Requirements
Monitor App and Infrastructure
Build Monitoring Scripts
TESTING AND OPTIMIZATION
Validate Results
OPTIMIZE BUSINESS OUTCOMES
DevelopmentPerformance EngineerQuality Assurance
OperationsPerformance Engineer
Application Support
Deploy
BidirectionalScript Reuse
GoNo-Go
Capture Real User Scripts & Scenarios for reuseStore and retrieve Test Scripts & Scenarios
Store and retrieve Monitoring Scripts
Collaboration to decrease Time to Resolution
Value proposition
• For organizations who:−Want to collaborate across IT silos
−Want to optimize IT efficiency through bi-directional use of requirements, assets, people, and information.
−Responsible for overall delivery of the application and infrastructure to support business processes
−Realize Performance is “not” a one time event but a cyclical process that is held captive by the dynamic nature of applications.
Increase IT efficiency with requirements and script reuse
2Mitigate risk with testing and monitoring
1Increase collaboration to accelerate time to resolution
3Optimize Service Performance
4
Customer example: SAP BW Rollout
• Customer Goals: 300 concurrent users, <20 second reports• Baseline Situation: Scalability to only 90 users
Date Action Result
2/14 Engagement start
2/22-3/3 Set-up Install monitors, script, set-up test accounts
3/3 Calibration run 90 concurrent user baseline
60 second report retrieval
3/4- 4/29 10 iterative tuning cycles Presentation, application and db layers are isolated and tested
Scalability improves to 264 users
Customer trained on best practices
5/31-6/30 Project extended Scalability hits 300 users
Response times for critical reports drop to 15-30 seconds
7/1-10/1 Ongoing monitoring 11 business processes re-used for end-user monitoring and health checks
SAP project: issues identified
1. Presentation Layer: − Spawning would improve performance
(CPU/Memory/Capacity OK)
2. BW Layer: − Change Load Balancing schema
− Update service packs
− Optimize batch scheduling
− Reconfigure memory settings (after upgrade)
3. Oracle DB Layer: − Update for Oracle 9i configurations
− Remove STAR_TRANSFORMATION hint from the BW queries
− Increase Redo Log file
SAP project: response time improvement
Support pack implementation
City of Boston
Bridging the application life-cycle
David Nero, Director of Enterprise Applications
“If we have a performance or availability issue, even if it’s only once a quarter, the perception of the end user is ‘the system doesn’t work.’ We need to be proactive and prevent issues from becoming visible to users.”
Challenge Solution Results
•Need to improve customers perception of application availability
•Lack visibility into IT infrastructure and end users experience
• Improve customer experience
•Need to scale and ensure IT is not the bottleneck
HP Business Availability Center• Business Process Monitor• Service Level Management• Service Availability Management•HP Loadrunner
• Improved end user perceptions of system availability
• Improved business process availability and performance to 10x faster than expected
•Leverage assets between pre and post production
•Foundation in place for driving improved performance and accountability 24x7
April 11, 202337
Why HP?• Complete lifecycle solution
−Bi-directional script reuse
−Unified Diagnostics support for both pre-production and production
• Market leader in key aspects of lifecycle−Pre-deployment testing, monitoring and diagnostics
• Comprehensive and flexible service offerings−Consulting, Education, Support and Managed Services
Mitigate risk
Optimize application performance
1. Lifecycle must start with clear business requirements
2. Testing must be done based on actual production measures
3. An accurate view of service level must be measured and monitored
“If you can’t measure it, you can’t manage it” - Dave Packard
Summary
Without it IT cannot set, test, measure, or deliver on expectations
Without it Quality will suffer
Without it Service degradation is inevitable
More information
• HP Performance and Availability Lifecycle Webinar (recorded 9/19/07) www.hp.com/go/hpswpalwebinar − Learn how you can integrate HP LoadRunner, HP End User
Management and HP diagnostics software to:• Reduce risk to new application rollouts and upgrades
• Streamline the testing cycle so you can run more tests and resolve problems prior to production
• Automate test script and scenario creation
• HP Software-as-a-Service: www.hp.com/go/saas • Register for live or on-demand HP Software Web Events -
www.hp.com/go/HPSoftwarewebevents • Get white papers and more at the HP Software Download
Center - www.hp.com/go/dlc • Get more on HP Software - www.hp.com/software
© 2008 Hewlett-Packard Development Company, L.P.The information contained herein is subject to change without notice