time for a new way to measure user experience

49
1 @kenzenhofer Klaus Enzenhofer - @kenzenhofer Time for a new way to measure user experience!

Upload: klaus-enzenhofer

Post on 13-Apr-2017

403 views

Category:

Small Business & Entrepreneurship


6 download

TRANSCRIPT

Page 1: Time for a new way to measure user experience

1 @kenzenhofer

Klaus Enzenhofer - @kenzenhofer

Time for a new way to measure user experience!

Page 2: Time for a new way to measure user experience

Klaus Enzenhofer@kenzenhofer

Page 3: Time for a new way to measure user experience

3 @kenzenhofer

How to measure User Experience?

Page 4: Time for a new way to measure user experience

4 @kenzenhofer

The Performance Impact

Navigation Timings

This is 2012 style!

Page 5: Time for a new way to measure user experience

5 @kenzenhofer

The Performance Impact

http://apdex.org/

0 2.0s 8.0s(4 x 2.0s)

Satisfied Tolerating Frustrated

Navigation Timings

Page Load Time

Page 6: Time for a new way to measure user experience

6 @kenzenhofer

Single Page Load Apps

W3C Timings Blindspots!

http://blogs.telerik.com/telerikmarketing/posts/14-05-21/everything-you-wanted-to-know-about-native-hybrid-and-web-apps-but-were-afraid-to-ask

Omni Channel Market

Navigation Timings Navigation Timings

User Action Response Time

Page 7: Time for a new way to measure user experience

7 @kenzenhofer

Errors – Have the biggest „social“ impact!

Page 8: Time for a new way to measure user experience

8 @kenzenhofer

User Experience Index

User Action Response Time Errors

Page 9: Time for a new way to measure user experience

9 @kenzenhofer

Learn from a Users Journey

Last Action is the Key Indicator

Page 10: Time for a new way to measure user experience

10 @kenzenhofer

User Experience Index

User BehaviorUser Action

Response Time Errors

Page 11: Time for a new way to measure user experience

11 @kenzenhofer

Is this STILL Enough?

Bandwidth

Page 12: Time for a new way to measure user experience

12 @kenzenhofer

User Behavior User Environment

User Experience Index

User Action Response Time

Errors

Page 13: Time for a new way to measure user experience
Page 14: Time for a new way to measure user experience

User Action Users Mind Result

Customer ABC2010-2015

Customer files2010-2015

Customer files2010-2015

Customer files2010-2015

Customer files2010-2015

Customer files2010-2015

Customer files2010-2015

30 sec Response Time…

Generate Report 10 000 Customer filesOrders from 2010-2015

All customers order overview from 2010-2015

2010 2011 2012 2013 2014

Click on:

…and still smiling

Page 15: Time for a new way to measure user experience

ResultUser’s mindUser Action

2 sec Response Time…

Typing in:

shoSearch:

Pick product list:

…and already frustrated!

Productname

Shoe

Shoe paste

Shoe shine

Socks

shoSearch:ShoeShoe pasteShoe shine

Page 16: Time for a new way to measure user experience

The NEW thresholds!

Page 17: Time for a new way to measure user experience
Page 18: Time for a new way to measure user experience

Why we should not use the word “Response Time”?

Page 19: Time for a new way to measure user experience

Your boss looks at…

Page 20: Time for a new way to measure user experience

Ad-Marketing looks at…

Page 21: Time for a new way to measure user experience

You look at…

Page 22: Time for a new way to measure user experience

SOME MORE RESPONSE TIMES…

DOM-Interactive Database Response Time

IO-Time

Network Time

Time to first ByteDocument Loaded

Web Request Response Time

Web Service Response Time

Wait Time

CPU Time

Third Party Response Time

User Action Response Time

Page 23: Time for a new way to measure user experience

My Favorites

DOM-Interactive Database Response Time

IO-Time

Network Time

Time to first ByteDocument Loaded

Web Request Response Time

Web Service Response Time

Wait Time

CPU Time

Third Party Response Time

User Action Response Time

Page 24: Time for a new way to measure user experience

Third Party Response Time

Page 25: Time for a new way to measure user experience

Page with Third Party Content Page without Third Party Content

Page 26: Time for a new way to measure user experience

Third Party Content

Our Content

Page 27: Time for a new way to measure user experience
Page 28: Time for a new way to measure user experience

Adult Industry

XXX.com

142 TPC Domains

Page 29: Time for a new way to measure user experience

Time to First Byte (TFB)

Page 30: Time for a new way to measure user experience

…or the best reason to look at Performance at all

Page 31: Time for a new way to measure user experience
Page 32: Time for a new way to measure user experience
Page 33: Time for a new way to measure user experience
Page 34: Time for a new way to measure user experience

http://searchengineland.com/google-now-counts-site-speed-as-ranking-factor-39708

2010

Page 35: Time for a new way to measure user experience

2015

http://googlewebmastercentral.blogspot.co.at/2015/02/finding-more-mobile-friendly-search.html

Page 36: Time for a new way to measure user experience

http://searchengineland.com/google-testing-red-slow-label-search-results-slower-sites-215483

Future

Page 37: Time for a new way to measure user experience

Future

Page 38: Time for a new way to measure user experience
Page 39: Time for a new way to measure user experience
Page 40: Time for a new way to measure user experience

We want both to be our friends!

Page 41: Time for a new way to measure user experience

www.bva-auctions.com

Lots to offerAbout BVA Auctions

41

41

We are the largest full-service auction house in Europe.

Started out in 2003 as the first online auction house in the Netherlands. Our clients were requesting more transparency and a process that would fit the compliance rules and regulations. Started the Auctio Group in 2015 with brands in 5 countries.

$ 9,685,836

$ 31,760,532

Page 42: Time for a new way to measure user experience

www.bva-auctions.com

Lots to offer

42

How bots came into my life

Google Bots request > 1 million pages per day: what?

Page 43: Time for a new way to measure user experience

www.bva-auctions.com

Lots to offer

43

Results

Real User33%

Bot67%

Bot Traffic Start

Page 44: Time for a new way to measure user experience

Page with Third Party Content Page without Third Party Content

Your NEW friends will help you with the trimming!

Page 45: Time for a new way to measure user experience

What did we learn today?

Page 46: Time for a new way to measure user experience

Klaus favorite Metrics are…

User Experience IndexUser Action Response TimeThird Party Response Time

Time to First-Byte

Page 47: Time for a new way to measure user experience

…and…

2 sec is NOT the expected Response Time!

We NO longer use the word “Response Time” without a Pre-/Post Fix!

Marketing folks can become your best friends!

Page 48: Time for a new way to measure user experience

Do we have some time left?

Page 49: Time for a new way to measure user experience

Klaus EnzenhoferDynatrace Technology Lead@kenzenhoferhttp://blog.dynatrace.comhttp://bit.ly/DynatraceFree