webinar: are you ready for your peak season?

53
©2016 SOASTA, All rights reserved. Tom Chavez @tomchavez Are Your applications Ready for Peak Load Performance?

Upload: jennifer-finney

Post on 06-Apr-2017

217 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed .

Tom Chavez@tomchavez

Are Your applications Ready forPeak Load Performance?

Page 2: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed .

• How fast is your site now?• Measure everything• Too much data? Science!• Prioritize what to fix• Optimize your site• What should I test?• Test early and often – shift left and right

Page 3: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 3

Measure, Optimize, Test – Repeat

Page 4: Webinar: Are you ready for your peak season?

How fast is your site now?

Page 5: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 5

How fast is your site now?

• Google says 1000ms!

• No single right answer

• Not all pages are equalo Some pages should be faster than others

o The slowest pages might not be the ones to fix first

Page 6: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 6

How is your site now?

• mCommerce is globalo US is not the benchmark

• 39% of mobile users

are unhappy with their online experienceso Top reasons: slow pages and site freezes/crashes

• 57% have experienced problems when using mobile

• 3 out of 4 consider mobile slower than desktop

• 46% will not return to a site that performs poorly

• 27% of smartphone users exceed data cap every month

Page 7: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 7

When is your Peak Season?

• Peak is year-roundo Super Bowl Sunday – 110 million viewers

o Bi-weekly or monthly payroll processing

o Valentine’s Day, President’s Day, Mother’s Day, Father’s Day

o Quarterly processing and filing

o US Tax filing

o Spring, Summer, Fall & Winter season sales

o July 4th, Christmas in July

o Back to School

o Halloween

o Singles Day – world’s biggest shopping day, $9B in 12 hours

o Black Friday, Cyber Monday and Holidays

Page 8: Webinar: Are you ready for your peak season?

Measure Everything

Page 9: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 9

Measure Real, Synthetic, and Virtual Users

• Real Users (RUM) provide deep data about your visitorso No other way to know everything about your users on your site

• Synthetic Users tell you how parts of your site are doingo When no real users are visiting, synthetic users are still coming

• Virtual Users tell you how your site will do at scaleo Can’t get a million friends to visit your site at the same time?

• Collect all the data and save it in the cloud!o Storage is cheap in the cloud, plus easier to analyze there

• Add App Performance Management (APM) for a complete picture

The Three Musketeers of Performance

Page 10: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 10

Other Things to Measure

• Session pathso How are your users going through your site

• Mobile App Performanceo How are your mobile apps performing?

o What are users doing in your mobile apps?

• Revenueo How much money are you making from each user and where?

• How fast are your competitors’ pages?o You can’t insert code on their sites but you can measure

Your company may be measuring these already

Page 11: Webinar: Are you ready for your peak season?

Too much data?Science!

Page 12: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 12

Analyze

• Benchmark and baseline your siteo How fast is your site now? How about the competition?

• Correlate performance and outcomeo Is poor performance affecting the business?

• Find root causes for performance issueso Use RUM and APM data

• Fix pages that impact mosto Make a prioritized punch list of the pages to fix

Use the data you’ve collected to gain insights

Page 13: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 13

Baseline Your Performance

How is your site doing? How does it compare to the competition?

Page 14: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 14

Correlate Performance and Outcome

How does Page Load affect Conversion Rate?

Page 15: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 15

Find Root Causes for Poor Performance

Not all problems are from your app or back end systems

Page 16: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 16

Page Visits vs. Performance

Page 17: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 17

Page Visits vs. Performance by Device

Page 18: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 18

Prioritize What to Fix – Greatest Impact

The poorest performing page might not be the most important page

Page 19: Webinar: Are you ready for your peak season?

Fix and Optimize

Page 20: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 20

Page Bloat

The average web page is more than 2MB in size

Page 21: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 21

Page Bloat

Where are all those kilobytes going

Page 22: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 22

Doesn’t Bandwidth Solve the Problem?

Page 23: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 23

Comparing Network Performance

Page 24: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 24

Comparing Network Performance

Page 25: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 25

Doesn’t Bandwidth Solve the Problem?

Page 26: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 26

Doesn’t Bandwidth Solve the Problem?

25x Faster Bandwidth != 25x Faster Load Time

Page 27: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 27

Page Bloat

Image Optimization

• Compress imageso Reduces time to send, increases number stored in cache

• Reformat imageso Photos: JPEG, PNG-24; Low complexity: GIF, PNG-8; Line: SVG

• Spritingo Multiple images in a single image file: just one request

• Load feature images early and quicklyo Defer non-essential images “below the fold”

Page 28: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 28

Front-End vs. Back-End Load Times

What’s slowing down page loads the most?

Page 29: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 29

Prepare for Peak Events

Optimize content for peak load events

• Simplify website contento Keep only the most important content on the page

• Reduce infrastructure requestso Block unnecessary requests, out-of-region visitors

• Leverage historical comparisonso Review past traffic levels to predict future levels

Page 30: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 30

Measure Before and After

Is the new release faster than before?

Page 31: Webinar: Are you ready for your peak season?

What Should I Test?

Page 32: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 32

Creating a Test Plan – Session Analysis

Which paths are the most important to users?

Page 33: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 33

Creating a Test Plan – Session Analysis

Which paths are the most important to users?

Page 34: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 34

Creating a Test Plan – Peak Load

What was the busiest Day, Hour, Minute, Second?

Page 35: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 35

Creating a Test Plan – Page Flows

What were most popular page flows with think times?

Page 36: Webinar: Are you ready for your peak season?

Network Emulation

Page 37: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 37

Network Emulation

• Testing to match realistic situationso Users are not all from one location on a fast network

o Packets get delayed, lost, re-ordered

• Apps perform differently as network conditions worseno Reduced throughput

o Timeouts occur, connections are lost

o Transactions take longer, longer sessions

Adding real network modeling to load and performance testing

Page 38: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 38

Network Emulation Terms

• Bandwidth: the bit-rate of available capacity of the network

• Upload rate: the maximum rate packets are sent from the queue

• Download rate: the maximum rate packets can be received from the queue

• Packet: a unit of data carried over a network

• Latency: the time for the packet to get from one point to another

• Jitter: a variation in the delay of received packets

• Packet loss: the percent of packets dropped from the network queue

• Corruption: the percent of packets arriving with incorrect data

• Duplicate: the percent of packets duplicated during transfer

A short dictionary of terms

Page 39: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 39

Sample Network Emulation Profile

Page 40: Webinar: Are you ready for your peak season?

Test Earlyand Often

Page 41: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 41

Start Testing Yesterday

• How long will it take?o 300 test cases x 2 browsers = 600 cases

o 600 cases x 30-minutes/case = 300 hours

o 300 hours / 6 hours/day = 50 days

o 50 days / 5 people = 10 days

• And for mobile:o 300 text cases x 26 devices = 7800 cases

o 7800 cases x 30 minutes/case = 3900 hours

o 3900 hours / 6 hours/day = 650 days

o 650- days/5 people = 130 days of test – 26 weeks!

And even earlier for Mobile

Page 42: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 42

Don’t Wait Til the Last Minute to Test!

Page 43: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 43

Test Right and Test Left, even into Production

• Performance Testing in developmento Set performance SLAs for new code and test in development,

same as unit and functional tests which code must pass

• Performance Testing in stagingo Higher loads in near-production systems

• Performance Testing in Productiono Full scale load tests to expected load and beyond

o Find weak and stress points and prioritize fixes into project

Performance Testing is Continuous

Page 44: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 44

Test Continuously

Test from Development to Integration to Staging to Production

Page 45: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 45

Test in Production

Some issues will only be found at scale load on production systems

Don’t forget your third party providers: CDNs, external scripts

Page 46: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 46

Measure Mobile App Performance Under Load

All mobile apps perform well when there is no load

Page 47: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 47

Automate Your Testing

Use Continuous Integration tools to automate testing

Page 48: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 48

Now That the Test is Over

• Analyze results for future areas to addresso Weak or stress areas that aren’t likely this time but …

• Identify third parties that were affected by loado Coordinate with suppliers to address issues

o Align schedules or at least be aware of their changes

Even if the test passed, you’re not done

Page 49: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 49

Issues Will Happen

• “I am 100% confident that everything we tested will work

just fine.” – Nordstrom Performance Leadero When loads are different than what you modeled, may have

problems

o E.g. At Nordstrom, during a recent anniversary sale, mobile sign-

ins were 9x greater than anticipated

o Used RUM to get to the root cause of the issue

Realize that Issues Will Happen Where You Can’t Predict Them

Page 50: Webinar: Are you ready for your peak season?

Q & AResourcesNext Steps

Page 51: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 51

Questions, Resources & Next Steps

• The Performance Beacono soasta.com/blogo https://www.soasta.com/blog/2015-popular-posts-web-performance/

• Upcoming Webinarso soasta.com/webinars:

Holiday Readiness: What to test, how to test

o Recordings of past webinars

• CloudTest on-Demando soasta.com/cloudtest: SOASTA will build & run tests for you

Resources

Page 52: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 52

“The leader in performance analytics.”

www.soasta.com

SOASTA

Page 53: Webinar: Are you ready for your peak season?

©2 016 S OA S TA , A l l r i gh t s r es e rv ed . 53

CloudTest

• Load testing from development to productiono Continuous testing at any scale, on-prem or in the cloud

• Real-time analytics with customizable dashboardso Safely test in production with full visibility

• Run tests live or automaticallyo Full hands-on control or hands-off automation

• Full end-to-end viewo Front-end performance to back-end systems

Fast, scalable, affordable load testing for performance optimization