performance is a direct reflection on your company your client does not care about the ‘cause’
DESCRIPTION
Performance is a direct reflection on your company Your client does not care about the ‘cause’. Cause can come from many sources Poor architecture Poor configuration Inadequate hardware Insufficient network bandwidth. Takes time Takes production or production- like environment - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/1.jpg)
Low Cost Load and Performance Testing
![Page 2: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/2.jpg)
Example Test
![Page 3: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/3.jpg)
Why Test?
Performance is a direct reflection on your companyYour client does not care about the ‘cause’
![Page 4: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/4.jpg)
Whose Fault Is It?
Cause can come from many sources◦Poor architecture◦Poor configuration◦ Inadequate hardware◦ Insufficient network bandwidth
![Page 5: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/5.jpg)
Why Isn’t Performance Testing Done
Takes timeTakes production or production- like
environmentTakes a special skill setTakes specialized tools
![Page 6: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/6.jpg)
Why Isn’t Performance Testing Done
Can take lots of $$$$$!◦Proprietary tools – can cost 100’s of
thousands of dollars to buy and maintain
![Page 7: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/7.jpg)
So What Are We Supposed to Do?
Option 1 – Do nothingOption 2 – Keep buying hardwareOption 3 – Buy an expensive load and
performance tool. Hire a tool expert to use it.Option 4 – Allocate in-house personnel to
build a custom solution
![Page 8: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/8.jpg)
So What Are We Supposed to Do?
Option 5 – Pray
![Page 9: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/9.jpg)
Low Cost Options
Big tool… little price◦Utilize an industry recognized best-of-
breed tool at a greatly reduced cost◦Pros
Access to functionality that normally costs lots of $$
Good for client server or web applications
◦Cons Proprietary languages. Need ‘tool guru’ Need hardware, bandwidth to run it
![Page 10: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/10.jpg)
Low Cost Options
Open Source◦40+ options - JMeter, OpenSTA,
WebLoad, Grinder◦Pros
Good price Can extend and adapt to your needs Good for simple tests
◦Cons Not as easy to use. Lacks functionality Only for web based products Need hardware, bandwidth to generate load
![Page 11: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/11.jpg)
Low Cost Options
Cloud Based◦ Rapidly growing offering
BrowserMob, LoadStorm◦ Pros
Low price Can easily scale to thousands of users Can completely eliminate the need for hardware
◦ Cons Early in the development phase Only for web-based products Analysis is slowly coming up to speed
![Page 12: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/12.jpg)
Cost Comparison
![Page 13: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/13.jpg)
How Do I Choose?
How do I know what is best for me?
![Page 14: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/14.jpg)
Understand Your True Needs
Performance, Load, Stress, Reliability◦All unique areas of testing
Performance - not to find functionality bugs , but to eliminate system bottlenecks and establish a baseline for future regression tests Takes a white-box approach. The system is inspected
and monitored "from the inside out" and from a variety of angles. Measurements are taken and analyzed and tuning is done accordingly .
![Page 15: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/15.jpg)
Understand Your True Needs
Load - process of testing the system by feeding it the largest tasks it can operate withGoals
expose bugs such as memory management bugs, memory leaks, buffer overflows, etc
Ensure that the application meets the performance baseline established during performance testing.
![Page 16: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/16.jpg)
Understand Your True Needs
Stress - one primary objective, and that is to determine the load under which a system fails, and how it fails. The main purpose is to make sure that when
the system fails, it recovers gracefully. i.e. – no locked sessions, no corrupted data, if load is
removed does it return to normal working condition
![Page 17: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/17.jpg)
Understand Your True Needs
Reliability – determine application performance over a prolonged period of time. Load can vary between very high and very lowThe main purpose is to make sure that the
system performance does not degrade over time. i.e. – slow memory leaks, stale sessions, other
processes interfering with off hour activities
![Page 18: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/18.jpg)
Understand Your True Needs
Understand your user scenarios◦ Analyze traffic patterns
Google Analytics, application logs◦User types
Administrative, buyer, seller, poster, responder, browser, etc…
◦User activity Downloading, uploading, purchasing, saving cart,
submitting,◦User ‘load’
Mix of user type and activity. How many of each
![Page 19: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/19.jpg)
Don’t Go It Alone
May not do load and performance testing for months/years◦ Difficult for most companies to have SME
Reach out to colleagues, user groups, consultants◦ Can help ‘reduce the noise’◦ Guide you through the process
![Page 20: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/20.jpg)
Keep Customers Happy
Performance is something customers notice when it is poor
Don’t give customers a reason to look at other options
![Page 21: Performance is a direct reflection on your company Your client does not care about the ‘cause’](https://reader035.vdocuments.site/reader035/viewer/2022070422/56816381550346895dd46460/html5/thumbnails/21.jpg)
Questions/Discussion Points
Questions?
Lawrence Nuanez – Senior Consultant – [email protected] – ext 109www.ProtoTest.com