running realistic load tests: answers to the most important questions - yours!

17
Copyright © 2003 – 2011 Falafel Software Inc. Running Realistic Load Tests Lino Tadros, MVP Sergei Sokolov

Upload: smartbear

Post on 15-Nov-2014

1.194 views

Category:

Technology


0 download

DESCRIPTION

Hear two software industry veterans as they discuss the answers to the load testing you asked. Get a better understanding of how to make your load tests more realistic. In this webinar, Lino Tadros, CEO of Falafel Software and Sergei Sokolov, Director of Testing and Performance Products at SmartBear Software team up to lead a dynamic discussion about load testing.

TRANSCRIPT

Page 1: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

Running Realistic Load Tests

Lino Tadros, MVPSergei Sokolov

Page 2: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

Sergei Sokolov

Sergei Sokolov is a Director of Product Management for Test and Performance tools at SmartBear Software. In his more than fifteen years in the software industry, Sergei has held positions in every part of the software lifecycle, from QA to engineering and engineering management, to professional services, pre-sales, and product management. His passion in software is to achieve high quality with the least effort.

Page 3: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

Lino Tadros, MVP

Microsoft C# MVP for nine years Chairman & CEO – Falafel Software Former member of the Delphi & C++ development team at

Borland. Microsoft established Technical Speaker worldwide (42

countries) in the last 18 years. Architect of major projects for Morgan Stanley, Johnson &

Johnson, Bank of America, Wells Fargo, State of CA, Shell, Chevron and others…

Permanent member of the VSX team at Microsoft. Expert on Web technologies, HTML5, MVC, WCF, Silverlight,

WPF, ASP.NET, SQL databases, Telerik Products and Testing tools.

Page 4: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

The Goal of Today’s Webinar

Answer YOUR questions about Load Testing Give a realistic explanation of Load Testing Explain the difference between Performance and

Scalability Why should we measure? What should we measure? What tools are involved in measuring

Performance and scalability?

Page 5: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

Web Application Performance

It is about RESPONSIVENESS, THROUGHPUT and RESOURCE utilization under a given workload.

Responsiveness is measured based on a SINGLE Client

Throughput and Resource utilization are measured in terms of the whole systems (All Clients)

Apples to Apples comparision for performance based on workload.

Page 6: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

Web Application Scalability

The ability to handle additional workload WITHOUT negatively affecting performance By adding processor power, memory, storage

(hardware) Scalability comes AFTER the Performance has

been measured and FIXED. The Goal is LINEAR, the more resources the

farther the workload will go.

Page 7: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

Performance Vs. Scalibility

Page 8: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

Benefits of Measuring Assess production readiness

Predict resource requirements Determine capacity of current infrastructure Compare different system configurations Verify application meets desired performance requirements within resource

constraints Assess adequacy of Software

Determine performance impact of specific software changes Compare current and desired performance characteristics

Improve efficiency of performance tuning Analyze application behavior at various load levels Identify bottlenecks Provide information on application speed and scalability prior to release

Page 9: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

What To Measure For Performance?

Time To First Byte (TTFB)Total Page Response Time (TTLB)

or as we say: “Time To Last Byte”

Page 10: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

What To Measure For LOAD Testing?

User LoadRequest / SecErrors/Sec

Page 11: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

What To Measure For Resource Testing?

CPUMemoryDisk / Network

Page 12: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

Kind of Tests

Performance Test Determine and validate speed of application

Load Test How an application performs while load increases

Stress Test What happens to the application if pushed beyond

normal conditions.

Page 13: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

More Test Variants

Smoke TestCapacity TestEndurance Test

Page 14: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 – 2011 Falafel Software Inc.

Testing Tools FireBug and YSlow Chrome Speed Tracer IE9 Developer Tools LoadRunner PerfMon LoadComplete from SmartBear Many others…

Page 15: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 - 2011 Falafel Software Inc.

Answers to Your Questions

Page 16: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 - 2011 Falafel Software Inc.

Answers to Your Questions

Page 17: Running Realistic Load Tests: Answers to the Most Important Questions - Yours!

Copyright © 2003 - 2011 Falafel Software Inc.

You can start today!

Download your FREE trial today with 50 Virtual Usershttp://smartbear.com/products/qa-tools/load-testing/

Schedule your training and/or consulting session today!https://www.falafel.com/store/trainingstore/loadcomplete.aspx

THANK YOU!