performance and automation testing using apache jmeter for agile environment
DESCRIPTION
Jmeter, a powerful performance testing tool from the Apache Jakarta project, can be used to simulate a heavy load on a server, network or object .This helps to test the strength or to analyze overall performance of the system under different load conditions. It has a Full multithreading framework which allows concurrent sampling by many threads and simultaneous sampling of different functions by separate thread groups. It can test servers eg. Web Server – HTTP, HTTPS, Web Services – SOAP, JUnits, Database via JDBC. Jmeter based tests can be integrated into scheduled builds using build tool like Apache Ant . JMeter and Flex BlazeDS Application Performance Testing can be used in a scenario where the front end is developed using flex, the flex remote objects communicate in the flex AMF format. We can leverage JMeter for such scenario where an AMF message can ride over http and a web application can be tested for performance testing and load testing. Take away for the audience :- Examples which illustrate how to use Jmeter in load testing and automation testing.TRANSCRIPT
![Page 1: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/1.jpg)
![Page 2: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/2.jpg)
Contents
• Performance testing• Agile methodology• Automated testing• JMeter
2/20/2010 First Draft 2
![Page 3: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/3.jpg)
What are the pain points ?
19%
18%
17%
16%
16%
14% Reliability issues: connection drop issuesover a period of time.
Load test at module level.
Scalability in terms of Number of usershandled by the system.
Quick comparison of Performance testresults across OS Platforms.
Load test at the functional level.
PSR testing for Quick POCs. (Based on survey conducted at BMC Software)
![Page 4: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/4.jpg)
PROCESS
• Write code( 1- 6 months)• Compile code• Send it to QA (or Production ?)• Performance Regression• PANIC !
No Performance Testing !
![Page 5: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/5.jpg)
A BETTER WAY
• Write code• CI compiles code and runs test• Send it to QA ( or Production?)• Performance Regression• PANIC !
No Performance Testing !
![Page 6: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/6.jpg)
A BETTER WAY 2.0
• Performance test artifacts as soon as they pass Unit and Functional testing
• Fast feedback for developers
• No Surprises
![Page 7: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/7.jpg)
Warm Up
• Performance testing• Agile methodology• Automated testing
2/20/2010 First Draft 7
![Page 8: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/8.jpg)
It’s your turn
• Performance testing• Agile methodology• Automated testing
2/20/2010 First Draft 8
![Page 9: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/9.jpg)
• To determine how fast some aspect of a system performs under a particular workload .
2/20/2010 First Draft 9
Performance testing
![Page 10: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/10.jpg)
2/20/2010 First Draft 10
“ What cannot be measured, cannot be improved.”
![Page 11: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/11.jpg)
Performance Testing
![Page 12: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/12.jpg)
JMeter
• What is JMeter• Who can use JMeter• Where can we use JMeter• When can we use JMeter• Why to use JMeter• How to use JMeter
2/20/2010 First Draft 12
![Page 13: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/13.jpg)
JMeter
• What is JMeter– Background– History
2/20/2010 First Draft 13
![Page 14: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/14.jpg)
JMeter• Who can use JMeter
– Dev and QA
Using open source tools for performance testing Presenter: Goranka Bjedov
![Page 15: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/15.jpg)
JMeter• Where can we use JMeter
2/20/2010 First Draft 15
![Page 16: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/16.jpg)
JMeter• When can we use JMeter
- Know how the system responds to work load- Pound system with simultaneous requests
- Performance- Scalability- Reliability
– PSR tests on the quick POCs.– Use in AGILE– Use other tools that complement JMeter, e.g.
Perfmon
2/20/2010 First Draft 16
![Page 17: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/17.jpg)
Why JMeter
• Catch performance regressions quickly• Simplify the hunting of bugs• Code with confidence• Know the performance cost of features• Go home on time
![Page 18: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/18.jpg)
It’s Demo Time
• JMeter and JUnit• JMeter and database query testing• JMeter and Web based Flex Performance
testing
2/20/2010 First Draft 18
![Page 19: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/19.jpg)
Performance Testing of Flex Web Application
• AMF - Action Message Format (AMF) binary format used to serialize ActionScript objects
• To performance test flex web app, need to generate required amf file first.
![Page 20: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/20.jpg)
Distributed Testing
![Page 21: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/21.jpg)
It’s your turn
• Performance testing• Agile methodology• Automated testing
2/20/2010 First Draft 21
![Page 22: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/22.jpg)
Automated Testing
1. Integration with CI tools- Ant Target
- HTML Report Generation
![Page 23: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/23.jpg)
Comparisons, Alternatives, Conclusions
• Shortcomings of JMeter• Conclusions
2/20/2010 First Draft 23
![Page 24: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/24.jpg)
Resources
• Apache JMeter Home
– http://jakarta.apache.org/jmeter/
• Google TechTalk- Using open source tools for performance testing
2/20/2010 First Draft 24
![Page 25: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/25.jpg)
Questions
2/20/2010 First Draft 25
![Page 26: Performance and Automation Testing using Apache Jmeter for Agile Environment](https://reader034.vdocuments.site/reader034/viewer/2022052211/554ddb61b4c905cc0e8b502f/html5/thumbnails/26.jpg)
2/20/2010 First Draft 26
Sameer Naik - [email protected]
Prasad Nirantar – [email protected]
Contact Details