tests with knock out results - justin rondeau #ab40

31
Tests with Knock Out results ©2014, WhichTestWon.com a division of Anne Holland Ventures Inc. All rights reserved. @Jtrondeau

Upload: online-dialogue

Post on 19-Aug-2015

348 views

Category:

Data & Analytics


1 download

TRANSCRIPT

Page 1: Tests with knock out results - Justin Rondeau #ab40

Tests  with  Knock  Out  results  

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Page 2: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

“Just  who  do  you  think  you  are?”  

Page 3: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Someone  with  a  very  unique    perspecDve  of  the  industry  

Evaluate  Other  People’s  

Tests  

Conduct  My  Own  Tests  

Train  In-­‐House  TesDng  Teams  

Page 4: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

I  see  1000+  tests    per  year  across    virtually  every  industry    verDcal    

Evaluate  Other  People’s  

Tests  

Conduct  My  Own  Tests  

Train  In-­‐House  TesDng  Teams  

Page 5: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Things  You’ll  Hear  Tonight:  •  Using  TesDng  to  Grow  Your  Business  •  How  to  Severely  #$%^  Up  Your  Tests  •  Psychology  Techniques  

Page 6: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

What  You’ll  Hear  From  Me:  High  Impact  Pages  to  Start  On  Example  of  Elements  that  are  Worth  TesDng  

Page 7: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Start  Low,  Aim  Big  

Page 8: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Start  Low  Begin  on  Pages    Closest  to  Your    Long-­‐Term    ConverDng  AcDon  

Think  Checkout,  Cart,  or  Thank-­‐You  Pages  

Page 9: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Why?  Most  qualified  traffic    Easier  to  quanDfy  converDng  acDon  

Page 10: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.       @Jtrondeau

Page 11: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Results:  3.6%  Li^  in  AOV    Brand:  3Suisses    Agency:  AlDma    Tech:  Avenseo  

Page 12: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Aim  Big  Go  for  Pages  with  the    Highest    PotenDal  Li^*  

Page 13: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

The  Infamous  ‘*’  

This  doesn’t  mean  ‘Go  for  your  worst  performing  page’  

Page  A   Page  B  

Conversion  Rate  

.05%   2.5%  

30%  Li^   .065%   3.25%  

Difference   .015%   .75%  

Page 14: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

10%  li^  of  a  badly  performing  page  worth  $100  =  $10  

10%  li^  of  a  well  performing  page  worth  $10,000  =  $1,000  

Page 15: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

You  may  be  able  to  apply  the  learnings  from  tests  on  high-­‐performance  pages  to  li^  lower-­‐performing  pages  later.  

Page 16: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Why?  Higher  Li^s  Require    Smaller  Sample  Sizes    Lowest  Hanging  Fruit  

Page 17: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Page 18: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Results:  282%  Li^  in  Form  CompleDon  (on  this  page)  –  57%  Overall    Brand:  KinderCare    Agency:  ISITE  Design    Tech:  Adobe  Test  &  Target  

Page 19: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

High  Impact  Test    Examples  

Page 20: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Page 21: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.       @Jtrondeau

Results:  7.1%  increase  in  orders,  2.37%  increase  in  AOV,  9.64%  increase  in  RPV    Brand:  Anonymous    Agency:  Exclusive  Concepts    Tech:  SiteSpect  &  ConversionOnDemand  

Page 22: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.       @Jtrondeau

Page 23: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Results:  49%  Li^  in  Unique  Orders  &  51%  Li^  in  RPV    Brand:  Anonymous    Agency:  ConversionIQ    Tech:  Visual  Website  OpDmizer  

Page 24: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Page 25: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Results:  28.2%  Li^  in  Clicks  at  99.9%  Confidence    Brand:  Suzuki  Belgium    Agency:  AG  Consult    Tech:  OpDmizely  

Page 26: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.       @Jtrondeau

Page 27: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Results:  14%  Li^  in  Unique  Purchases    Brand:  KRAS    Agency:  Online  Dialogue    Tech:  In-­‐House  

Page 28: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.       @Jtrondeau

Page 29: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Results:  23.7  Li^  in  Unique  Sales  &  15.99%  Li^  in  RPV  (Both  at  96%  Confidence)    Brand:  Radley    Agency:  Red  Eye,  Inc.    Tech:  OpDmizely  

Page 30: Tests with knock out results - Justin Rondeau #ab40

©2014,  WhichTestWon.com  a  division  of  Anne  Holland  Ventures  Inc.    All  rights  reserved.      @Jtrondeau

Did  you  keep  score?    How’d  You  do?  

Page 31: Tests with knock out results - Justin Rondeau #ab40

Thanks  &  Contact  Info  Justin Rondeau Chief Editor & Testing Evangelist WhichTestWon [email protected] (401) 354-7555 x33

@Jtrondeau