running realistic load tests: answers to the most important questions - yours!
DESCRIPTION
Hear two software industry veterans as they discuss the answers to the load testing you asked. Get a better understanding of how to make your load tests more realistic. In this webinar, Lino Tadros, CEO of Falafel Software and Sergei Sokolov, Director of Testing and Performance Products at SmartBear Software team up to lead a dynamic discussion about load testing.TRANSCRIPT
Copyright © 2003 – 2011 Falafel Software Inc.
Running Realistic Load Tests
Lino Tadros, MVPSergei Sokolov
Copyright © 2003 – 2011 Falafel Software Inc.
Sergei Sokolov
Sergei Sokolov is a Director of Product Management for Test and Performance tools at SmartBear Software. In his more than fifteen years in the software industry, Sergei has held positions in every part of the software lifecycle, from QA to engineering and engineering management, to professional services, pre-sales, and product management. His passion in software is to achieve high quality with the least effort.
Copyright © 2003 – 2011 Falafel Software Inc.
Lino Tadros, MVP
Microsoft C# MVP for nine years Chairman & CEO – Falafel Software Former member of the Delphi & C++ development team at
Borland. Microsoft established Technical Speaker worldwide (42
countries) in the last 18 years. Architect of major projects for Morgan Stanley, Johnson &
Johnson, Bank of America, Wells Fargo, State of CA, Shell, Chevron and others…
Permanent member of the VSX team at Microsoft. Expert on Web technologies, HTML5, MVC, WCF, Silverlight,
WPF, ASP.NET, SQL databases, Telerik Products and Testing tools.
Copyright © 2003 – 2011 Falafel Software Inc.
The Goal of Today’s Webinar
Answer YOUR questions about Load Testing Give a realistic explanation of Load Testing Explain the difference between Performance and
Scalability Why should we measure? What should we measure? What tools are involved in measuring
Performance and scalability?
Copyright © 2003 – 2011 Falafel Software Inc.
Web Application Performance
It is about RESPONSIVENESS, THROUGHPUT and RESOURCE utilization under a given workload.
Responsiveness is measured based on a SINGLE Client
Throughput and Resource utilization are measured in terms of the whole systems (All Clients)
Apples to Apples comparision for performance based on workload.
Copyright © 2003 – 2011 Falafel Software Inc.
Web Application Scalability
The ability to handle additional workload WITHOUT negatively affecting performance By adding processor power, memory, storage
(hardware) Scalability comes AFTER the Performance has
been measured and FIXED. The Goal is LINEAR, the more resources the
farther the workload will go.
Copyright © 2003 – 2011 Falafel Software Inc.
Performance Vs. Scalibility
Copyright © 2003 – 2011 Falafel Software Inc.
Benefits of Measuring Assess production readiness
Predict resource requirements Determine capacity of current infrastructure Compare different system configurations Verify application meets desired performance requirements within resource
constraints Assess adequacy of Software
Determine performance impact of specific software changes Compare current and desired performance characteristics
Improve efficiency of performance tuning Analyze application behavior at various load levels Identify bottlenecks Provide information on application speed and scalability prior to release
Copyright © 2003 – 2011 Falafel Software Inc.
What To Measure For Performance?
Time To First Byte (TTFB)Total Page Response Time (TTLB)
or as we say: “Time To Last Byte”
Copyright © 2003 – 2011 Falafel Software Inc.
What To Measure For LOAD Testing?
User LoadRequest / SecErrors/Sec
Copyright © 2003 – 2011 Falafel Software Inc.
What To Measure For Resource Testing?
CPUMemoryDisk / Network
Copyright © 2003 – 2011 Falafel Software Inc.
Kind of Tests
Performance Test Determine and validate speed of application
Load Test How an application performs while load increases
Stress Test What happens to the application if pushed beyond
normal conditions.
Copyright © 2003 – 2011 Falafel Software Inc.
More Test Variants
Smoke TestCapacity TestEndurance Test
Copyright © 2003 – 2011 Falafel Software Inc.
Testing Tools FireBug and YSlow Chrome Speed Tracer IE9 Developer Tools LoadRunner PerfMon LoadComplete from SmartBear Many others…
Copyright © 2003 - 2011 Falafel Software Inc.
Answers to Your Questions
Copyright © 2003 - 2011 Falafel Software Inc.
Answers to Your Questions
Copyright © 2003 - 2011 Falafel Software Inc.
You can start today!
Download your FREE trial today with 50 Virtual Usershttp://smartbear.com/products/qa-tools/load-testing/
Schedule your training and/or consulting session today!https://www.falafel.com/store/trainingstore/loadcomplete.aspx
THANK YOU!