![Page 1: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/1.jpg)
23rd Oct 2013 @OptimiseOrDie
12 things to do before your company
dies
![Page 2: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/2.jpg)
@OptimiseOrDie
Timeline + Tweet me!
- 1998 1999 - 2004
2004-2008 2008-2012
![Page 3: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/3.jpg)
SEO
@OptimiseOrDie
PPC UX Analytics
A/B and Multivariate testing
Customer Satisfaction
Design
QADevelopment
40+ websites, 34 countries, 19 languages, €1bn+ revenue
Performance
8 people
![Page 4: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/4.jpg)
If you’re not a part of the solution, there’s good money to be made in prolonging the
problem
![Page 5: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/5.jpg)
Out of my comfort zone…
@OptimiseOrDie
![Page 6: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/6.jpg)
Behind enemy lines…
@OptimiseOrDie
![Page 7: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/7.jpg)
Nice day at the office, dear?
@OptimiseOrDie
![Page 8: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/8.jpg)
![Page 9: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/9.jpg)
Competition…
@OptimiseOrDie
![Page 10: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/10.jpg)
Traffic is harder!
SEO/PPC
@OptimiseOrDie
![Page 11: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/11.jpg)
Panguin tool…
![Page 12: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/12.jpg)
#1 : Fix your broken Analytics!
@OptimiseOrDie
![Page 13: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/13.jpg)
@OptimiseOrDie
#1 : Fix your broken Analytics!
![Page 14: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/14.jpg)
#1 : Common problems (GA)• Dual purpose goal page
– One page used by two outcomes – and not split
• Cross domain tracking– Where you jump between sites, this borks the data
• Filters not correctly set up– Your office, agencies, developers are skewing data
• Code missing or double code– Causes visit splitting, double pageviews, skews bounce rate
• Campaign, Social, Email tracking etc.– External links you generate are not setup to record properly
• Errors not tracked (404, 5xx, Other)– You are unaware of error volumes, locations and impact
• Dual flow funnels– Flows join in the middle of a funnel or loop internally
• Event tracking skews bounce rate– If an event is set to be ‘interactive’ – it can skew bounce rate
(example)
@OptimiseOrDie
![Page 15: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/15.jpg)
#1 : Solutions• Get a Health Check for your Analytics
– Try @prwd, @danbarker, @peter_oneill or ask me!
• Invest continually in instrumentation– Aim for at least 5% of dev time to fix +
improve• Stop shrugging : plug your insight gaps
– Change ‘I don’t know’ to ‘I’ll find out’• Look at event tracking (Google Analytics)
– If set up correctly, you get wonderful insights• Would you use paper instead of a till?
– You wouldn’t do it in retail so stop doing it online!
• How do you win F1 races?– With the wrong performance data, you won’t
@OptimiseOrDie
![Page 16: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/16.jpg)
Insight - Inputs
#FAILCompetitor copying
Guessing
Dice rolling
An article the CEO read
Competitor change
PanicEgo
OpinionCherished notionsMarketing whimsCosmic raysNot ‘on brand’ enough
IT inflexibility
Internal company needs
Some dumbass consultant
Shiny feature blindness
Knee jerk reactons
#2 : Get the right inputs
@OptimiseOrDie
![Page 17: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/17.jpg)
Insight - Inputs
InsightSegmentation
Surveys
Sales and Call Centre
Session Replay
Social analytics
Customer contactEye tracking
Usability testingForms analyticsSearch analyticsVoice of Customer
Market research
A/B and MVT testing
Big & unstructured data
Web analytics
Competitor evals
Customer services
@OptimiseOrDie
#2 : Get the right inputs
![Page 18: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/18.jpg)
#2 : Solutions• Usability testing and User Centred design
– If you’re not doing this properly, you’re hosed
• Champion UX+ - with added numbers– (Re)designing without inputs + numbers is guessing
• You need one team on this, not silos– Stop handing round the baby (I’ll come back to this)
• Ego, Opinion, Cherished notions – fill gaps– Fill these vacuums with insights and data
• Champion the users– Someone needs to take their side!
• You need multiple tool inputs– Let me show you my shortlist…
@OptimiseOrDie
![Page 19: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/19.jpg)
Insight - Inputs
@OptimiseOrDie
#3 : Get the right tools
![Page 20: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/20.jpg)
3.1 - Session Replay• Vital for optimisers & fills in a ‘missing link’ for insight• Rich source of data on visitor experiences• Segment by browser, visitor type, behaviour, errors• Forms Analytics (when instrumented) are awesome• Can be used to optimise in real time!
Session replay tools• Clicktale (Client) www.clicktale.com• SessionCam (Client) www.sessioncam.com• Mouseflow (Client) www.mouseflow.com• Ghostrec (Client) www.ghostrec.com• Usabilla (Client) www.usabilla.com• Tealeaf (Hybrid) www.tealeaf.com• UserReplay (Server) www.userreplay.com
@OptimiseOrDie
![Page 21: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/21.jpg)
21
![Page 22: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/22.jpg)
22
![Page 23: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/23.jpg)
3.2 - Feedback / VOC tools• Anything that allows immediate realtime onpage feedback• Comments on elements, pages and overall site & service• Can be used for behavioural triggered feedback• Tip! : Take the Call Centre for beers
• Kampylewww.kampyle.com
• Qualaroo www.qualaroo.com
• 4Q4q.iperceptions.com
• Usabillawww.usabilla.com
![Page 24: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/24.jpg)
3.3 - Survey Tools• Surveymonkeywww.surveymonkey.com (1/5)• Zoomerang www.zoomerang.com (3/5)• SurveyGizmo www.surveygizmo.com (5/5)
• For surveys, web forms, checkouts, lead gen – anything with form filling – you have to read these two:Caroline Jarrett (@cjforms)Luke Wroblewski (@lukew)
• With their work and copywriting from @stickycontent, I managed to get a survey with a 35% clickthrough from email and a whopping 94% form completion rate.
• Their awesome insights are the killer app I have when optimising forms and funnel processes for clients.
@OptimiseOrDie
![Page 25: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/25.jpg)
25
Som, feedbackRemote UX tools (P=Panel, S=Site recruited, B=Both)Usertesting (B) www.usertesting.comUserlytics (B) www.userlytics.comUserzoom (S) www.userzoom.comIntuition HQ (S) www.intuitionhq.comMechanical turk (S) www.mechanicalturk.comLoop11 (S) www.loop11.comOpen Hallway (S) www.openhallway.comWhat Users Do (P) www.whatusersdo.comFeedback army (P) www.feedbackarmy.comUser feel (P) www.userfeel.comEthnio (For Recruiting) www.ethnio.com
Feedback on Prototypes / MockupsPidoco www.pidoco.comVerify from Zurb www.verifyapp.comFive second test www.fivesecondtest.comConceptshare www.conceptshare.comUsabilla www.usabilla.com
3.4 - UX Crowd tools
![Page 26: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/26.jpg)
3.5 – Usability Recording / Testing• Some low budget testing tools:
CamStudio (free)www.camstudio.org
Mediacam AV (cheap)www.netu2.co.uk
Silverback (Mac)www.silverbackapp.com
Screenflow (Mac)www.telestream.net
UX Recorder (iOS), Skype Hugging, Reflection www.uxrecorder.com & bit.ly/tesTfm & bit.ly/GZMgxR
@OptimiseOrDie
![Page 27: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/27.jpg)
3.5 – Test or Die!Email testing www.litmus.com
www.returnpath.comwww.lyris.com
Browser testing www.crossbrowsertesting.comwww.cloudtesting.comwww.multibrowserviewer.comwww.saucelabs.com
Mobile devices www.perfectomobile.comwww.deviceanywhere.comwww.mobilexweb.com/emulatorswww.opendevicelab.com
@OptimiseOrDie
![Page 28: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/28.jpg)
3.6 – Collaboration tools
Oh sh*t
@OptimiseOrDie
![Page 29: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/29.jpg)
3.6 – Basecamp (Project management)
@OptimiseOrDie
![Page 30: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/30.jpg)
3.6 – Join.me (free screen sharer)
![Page 31: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/31.jpg)
3.6 – Trello (task & project)
@OptimiseOrDie
![Page 32: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/32.jpg)
3.6 – Pivotal Tracker (Agile, Lean)
@OptimiseOrDie
![Page 33: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/33.jpg)
• LucidChart
3.6 – Cloud Collaboration (charting)
@OptimiseOrDie
![Page 34: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/34.jpg)
• Webnotes & Protonotes
3.6 – Cloud Collaboration (feedback)
@OptimiseOrDie
![Page 35: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/35.jpg)
• Conceptshare
3.6 – Cloud Collaboration (feedback)
@OptimiseOrDie
![Page 36: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/36.jpg)
3.7 – Split testing tools – Cheap!• Google Content Experiments
bit.ly/Ljg7Ds
• Multi Armed Bandit Explanationbit.ly/Xa80O8
• Optimizelywww.optimizely.com
• Visual Website Optimizerwww.visualwebsiteoptimizer.com
@OptimiseOrDie
![Page 37: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/37.jpg)
• Many tests fail due to QA or browser bugs– Always do cross browser QA testing – see resources
• Don’t rely on developers saying ‘yes’– Use your analytics to define the list to test
• Cross instrument your analytics– You need this to check the test software works
• Store the variant(s) seen in analytics– Compare people who saw A/B/A vs. A/B/B
• Segment your data to find variances– Failed tests usually show differences for segments
• Watch the test and analytics CLOSELY– After you go live, religiously check both– Read this article : stanford.io/15UYov0
@OptimiseOrDie
3.7 – Split test funnies
![Page 38: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/38.jpg)
#3 : Summary – the minimum!
• Session replay tools– Clicktale, Tealeaf, Sessioncam and more…
• Cheap / Crowdsourced usability testing– See the list in this deck
• Voice of Customer / Feedback tools– 4Q, Kampyle, Qualaroo, Usabilla and
more… • A/B and Multivariate testing
– Optimizely, Google Content Experiments, VWO
• Email, Browser and Mobile Device Testing– You don’t know if it works unless you check@OptimiseOrD
ie
![Page 39: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/39.jpg)
#4 : Go Agile
@OptimiseOrDie
![Page 40: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/40.jpg)
Methodologies - Lean UX
Positive– Lightweight and very fast methods– Realtime or rapid improvements– Documentation light, value high– Low on wastage and frippery– Fast time to market, then optimise– Allows you to pivot into new areas
Negative– Often needs user test feedback to
steer the development, as data not enough
– Bosses distrust stuff where the outcome isn’t known
“The application of UX design methods into product development, tailored to fit Build-Measure-Learn cycles.”
@OptimiseOrDie
![Page 41: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/41.jpg)
Agile UX / UCD / Collaborative Design
Positive– User centric– Goals met substantially– Rapid time to market (especially when
using Agile iterations)
Negative– Without quant data, user goals can
drive the show – missing the business sweet spot
– Some people find it hard to integrate with siloed teams
– Doesn’t’ work with waterfall IMHO
Wireframe
Prototype
TestAnalyse
Concept
Research
“An integration of User Experience Design and Agile* Software Development Methodologies”
*Sometimes
@OptimiseOrDie
![Page 42: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/42.jpg)
CRO
@OptimiseOrDie
![Page 43: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/43.jpg)
Lean Conversion Optimisation
Positive– A blend of several techniques– Multiple sources of Qual and Quant data aids triangulation– CRO analytics focus drives unearned value inside all
products
Negative– Needs a one team approach with a strong PM who is a
Polymath (Commercial, Analytics, UX, Technical)– Only works if your teams can take the pace – you might be
surprised though!
“A blend of User Experience Design, Agile PM, Rapid Lean UX Build-Measure-Learn cycles, triangulated data sources, triage and prioritisation.”
@OptimiseOrDie
![Page 44: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/44.jpg)
5 - Lean CROInspection
Immersion
Identify
Triage & Triangulate
Outcome Streams
Measure
Learn
Instrument
@OptimiseOrDie
![Page 45: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/45.jpg)
#4 : Solutions – Agile• Design your own methodology
Experiment and optimise with your team• Don’t be a slave
The methodology is the slave, not your master• Ask me later…
Questions – see me on Twitter, G+ or ask by mail• Collaborative working
– Harvard study into teams – it’s an ‘all the time’ thing
@OptimiseOrDie
![Page 46: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/46.jpg)
#5 : Build a volume testing culture
@OptimiseOrDie
![Page 47: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/47.jpg)
#5 : Common issues• How many tests do you complete a month?
– Without volume, you won’t get as much attention or traction
• Vanity testing takes hold– Getting one test done a quarter? Still showing it a year later?
• Not enough resource – You MUST hire, invest and ringfence time and staff for CRO
• Testing has gone to sleep– Some vendors have a ‘rescue’ team for these accounts
• You keep testing without buyin at C-Level– If nobody sees the flower, was it there?
• You haven’t got a process – just a plugin– Insight, Brainstorm, Wireframe, Design, Build, QA test,
Monitor, Analyse. Tools, Process, People, Time -> INVEST
• IT or release barriers slow down work– Circumvent with tagging tools– Develop ways around the innovation barrier
@OptimiseOrDie
![Page 48: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/48.jpg)
#5 : Testing Culture tips• Gamble in the office
– Encourage betting in the office– Get people to make a prediction, get them hooked
• Put BIG pictures on the wall– Make people stop and ask questions– Encourage betting in the office
• Market the results like a pro– Market this stuff internally like a PR agency– Send emails around, put on the intranet, optimise internally
• Offer a company wide prize– Offer a prize for best hypothesis that makes it to a test– Do a monthly or quarterly award – make it visible– A great incentive to come up with provable, winning ideas– Do NOT limit to the testing team– Run a TESTATHON to generate bulk ideas
@OptimiseOrDie
![Page 49: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/49.jpg)
#6 : Execute faster
@OptimiseOrDie
![Page 50: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/50.jpg)
#6 : Execution problems• Silo Mentality means pass the product
– No ‘one team’ approach means no ‘one product’
• The process is badly designed– It’s set up to introduce delays or loops of tweaking
• People mistake hypotheses for finals– Endless argument, tweaking means NO TESTING – let
the test decide, please!
• No clarity : authority or decision making– You need a strong leader to get things decided
• Signoff takes far too long– Signoff by committee is a velocity killer – the CUSTOMER
and the NUMBERS are the signoff
• You set your target too low– Aim for a high target and keep increasing it @OptimiseOrD
ie
![Page 51: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/51.jpg)
#6 : Execution solutions• Agile, One Team approach
– Everyone works on the lifecycle, together
• Hire Polymaths– T-shaped or just multi-skilled, I hire them a lot
• Use Collaborative Tools, not meetings– Speeds up time to decide, iterate, resolve, remove defects
• Smash down silos – a special mission– Involve the worst offenders in the hypothesis team– “Hold your friends close, and your enemies closer”– Work WITH the developers to find solutions– Ask Developers and IT for solutions, not apologies
@OptimiseOrDie
![Page 52: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/52.jpg)
#6 : Product cycles are too long
0 6 12 18
Months
Conversion
@OptimiseOrDie
![Page 53: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/53.jpg)
#6 : Solutions• Give Priority Boarding for opportunities
– The best seats reserved for metric shifters
• Release more often to close the gap– More testing resource helps, analytics ‘hawk eye’
• Kaizen – continuous improvement– Others call it JFDI (just f***ing do it)
• Make changes AS WELL as tests, basically!– These small things add up
• RUSH Hair booking – Over 100 changes– No functional changes at all – 37% improvement
• Inbetween product lifecycles?– The added lift for 10 days work, worth 360k
@OptimiseOrDie
![Page 54: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/54.jpg)
#6 : Make your own cycles“Rather than try and improve one thing by 10% - which would be very, very difficult to do,
We go and find 1,000 things and improve them all by a fraction of a per cent, which is totally do-able.”Chris Boardman
@OptimiseOrDie
![Page 55: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/55.jpg)
#7 – Get Experienced
24 Jan 2012
• Persuasion / Influence / Direction / Explanation
• Helps people process information and stories
• Vital to sell an ‘experience’
• Helps people recognise and discriminate between things
• Supports Scanning Visitors
• Drives emotional response
short.cx/YrBczl
![Page 56: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/56.jpg)
• Very powerful and under-estimated area
• I’ve done over 20M visitor tests with people images for a service industry – some tips:
• The person, pose, eye gaze, facial expressions and body language – cause visceral emotional reactions and big changes in behaviour
• Eye gaze crucial – to engage you or to ‘point’
Photo UX
24 Jan 2012
![Page 57: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/57.jpg)
• Negative body language is a turnoff • Uniforms and branding a positive (ball
cap) • Hands are hard to handle – use a prop to
help• For Ecommerce – tip! test bigger images!• Autoglass and Belron always use real
people• In most countries (out of 33) with strong
female and male images in test, female wins
• Smile and authenticity in these examples is absolutely vital
• So, I have a question for you
Photo UX
@OptimiseOrDie
![Page 58: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/58.jpg)
+13.9%
@OptimiseOrDie
![Page 59: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/59.jpg)
+5.9%
Terrible Stock Photos : headsethotties.com & awkwardstockphotos.comLaughing at Salads : womenlaughingwithsalad.tumblr.com
BBC Fake Smile Test : bbc.in/5rtnv@OptimiseOrD
ie
![Page 60: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/60.jpg)
SPAIN
+22% over control
99% confidence
“It’s not about what you think when you look at the design – it’s about the reaction it causes in the mind of the viewer. Always design for that first.”
@OptimiseOrDie
![Page 61: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/61.jpg)
@OptimiseOrDie
![Page 62: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/62.jpg)
#8 : Get Multichannel
• Not using call tracking– Look at Infinity Tracking (UK)– Get Google keyword level call volumes!
• You don’t measure channel switchers– People who bail a funnel and call– People who use chat, go to store, use ringback, email
etc.
• You ‘forget’ mobile & tablet journeys– Walk the path from search -> ppc/seo -> site– Optimise for all your device mix & journeys
• You’re responsive– Testing may now bleed across device platforms– Changing in one place may impact many others– QA, Device and Browser testing even more vital
@OptimiseOrDie
![Page 63: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/63.jpg)
• One reason conversion is lower is channel jumps• You need to try and glue this together• Don’t rely on amazing analytics promises• If you don’t have a strategy here, you need one• You need to think about identifying the customer• At every touch point and micro or macro interaction• Loyalty, marketing, wifi, incentives, geo, instore = glue• What’s your strategy on post identification?• Do you rewrite the data or just ignore it?
@OptimiseOrDie
#8 : Multichannel – cross device
![Page 64: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/64.jpg)
#9 : Get Segmented on Testing
• Averages lie– What about new vs. returning visitors?– What about different keyword groups?– Landing pages? Routes? Attributes
• Failed tests are just ‘averaged out’– You must look at segment level data– You must integrate the analytics + a/b test software
• The downside?– You’ll need more test data – to segment
• The upside?– Helps figure out why test didn’t perform– Finds value in failed or ‘no difference’ tests– Drives further testing focus
@OptimiseOrDie
![Page 65: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/65.jpg)
#10 : Get stats training
• Many testers & marketing people struggle– How long will it take to run the test?– Is the test ready?– How long should I keep it running for?– It says it’s ready after 3 days – is it?– Can we close it now – the numbers look great!
• A/B testing maths for dummies:– http://bit.ly/15UXLS4
• For more advanced testers:– Read this : http://bit.ly/1a4iJ1H
• A stats course would be handy:– A decent guide for testing or marketing pros– Watch this space…
@OptimiseOrDie
![Page 66: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/66.jpg)
#11 : Hire and retain great analysts…
• Long topic – mail me for killer questions• Pay above market rates – 10k less is
not ROI• Don’t make them into report monkeys• Find a knowledge sharer and trainer!• Let them solve business problems• Invest in the analytics, people, continually• Pay extra for specialist help• Give staff direct outcome connections• Freedom to grow and learn is vital• Help them fix broken stuff!
@OptimiseOrDie
![Page 67: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/67.jpg)
SUMMARY : The best Companies….
• See the Maturity Model in the resource pack• Invest continually in analytics instrumentation, tools, people• Use an Agile, iterative, cross-silo, one team project culture• Prefer collaborative tools to having lots of meetings• Prioritise development based on numbers and insight• Practice real continuous product improvement, not SLED• Source photos and content that support persuasion and utility• Have cross channel, cross device design, testing and QA• Segment their data for valuable insights, every test or change• Continually reduce cycle (iteration) time in their process• Blend ‘long’ design, continuous improvement AND split tests• Make optimisation the engine of change, not the slave of ego
@OptimiseOrDie
![Page 68: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/68.jpg)
So you want examples?
• Belron – Ed Colley• Dell – Nazli Yuzak• Shop Direct – Paul Postance (now with EE)• Expedia – Oliver Paton• Schuh – Stuart McMillan• TSR Group – Pete Taylor• Soundcloud – Eleftherios Diakomichalis &
Ole Bahlmann• Gov.uk – Adam Bailin (now with the BBC)
Read the gov.uk principles : www.gov.uk/designprinciples
And my personal favourites of 2013 – Airbnb and Expensify
#PRWDReveal
![Page 69: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/69.jpg)
• World Economic Forum’s Technology Pioneers 2014• Zero to $3Bn in 5 years – servicing a Wembley every
night• FREE Professional Photography
#12 : Do things that don’t scale
@OptimiseOrDie
![Page 70: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/70.jpg)
70@OptimiseOrD
ie
![Page 71: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/71.jpg)
71@OptimiseOrD
ie
![Page 72: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/72.jpg)
“It’s better to have 100 people love you than 1,000,000 like you”
Brian Chesky, CEO, Airbnb
Do things that don’t scale:
Create the perfect experience however you need to do it and then
scale that experience.
It’s creating an experience. And then its multiplying them. Too many people start with ‘how many you sell’ and then they try to make it better.
Brian Chesky, CEO, Airbnb
@OptimiseOrDie
![Page 73: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/73.jpg)
If it isn’t working, you’re not doing it right
@OptimiseOrDie
![Page 74: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/74.jpg)
• Unless you have a dominant natural or physical advantage, the playing field is open to anyone.
• Unfettered customer ratings and comments are here to stay : Think “Net Promoter Score on Steroids”
• Market leaders like Nokia, Blackberry, Best Buy, Borders, The Washington Post and Blockbuster all got hit – why not you?
• One investor asks new startups : “What if Amazon did your thing?”
• Airbnb, Uber, Lyft, Lovefilm, Spotify and Google (Analytics) are excellent examples of innovation competition.
• You must design and scale an amazing customer experience to win
• If your competitor is doing this stuff, you’ll have to spend MUCH more to beat them.
Optimise Or Die
@OptimiseOrDie
![Page 75: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/75.jpg)
75
Is there a way to fix this then?Conversion Heroes!
@OptimiseOrDie
![Page 76: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/76.jpg)
:@OptimiseOrDie
:linkd.in/pvrg14
Download and freely use slides : slidesha.re/TeKiKr
![Page 77: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/77.jpg)
77
RESOURCE PACK
![Page 78: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/78.jpg)
78
RESOURCE PACK
• Maturity model• Triage and Triangulation• The Bucket outcome methodology• Belron methodology example• CRO and testing resources
![Page 79: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/79.jpg)
79
Ad Hoc
Local HeroesChaotic Good
Level 1Starter Level
GuessingA/B testingBasic tools
AnalyticsSurveys
Contact CentreLow budget
usability
Outline process
Small teamLow hanging
fruit
+ Multi variateSession replayNo segments
+Regular usability
testing/research
PrototypingSession replay
Onsite feedback
_____________________________________________________________________________________________ _
Dedicated team
Volume opportunities
Cross silo teamSystematic
tests
Ninja TeamTesting in the
DNA
Well developed Streamlined Company wide
+Funnel optimisationCall tracking
Some segments Micro testing
Bounce ratesBig volume
landing pages
+ Funnel analysis
Low converting & High loss
pages
+ offline integration
Single channel picture
+ Funnel fixesForms analytics
Channel switches
+Cross channel testing
Integrated CRO and analyticsSegmentation
+Spread tool use
Dynamic adaptive targetingMachine learningRealtime
Multichannel funnels
Cross channel synergy
_______________________________________________________________________________________________
________________________________________________________________________________________________
Testing
focus
Culture
Process
Analytics
focus
Insightmethod
s
+User Centered DesignLayered feedback
Mini product tests
Get buyin
________________________________________________________________________________________________Missio
nProve ROI Scale the
testing Mine valueContinual
improvement
+ Customer sat scores tied to
UXRapid iterative
testing and design
+ All channel view of
customerDriving offline using online
All promotion driven by testing
Level 2Early maturity
Level 3Serious testing
Level 4Core business value
Level 5You rock, awesomely
________________________________________________________________________________________________
![Page 80: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/80.jpg)
80
5 - Triage and Triangulation
• Starts with the analytics data• Then UX and user journey walkthrough from SERPS -> key paths• Then back to analytics data for a whole range of reports:• Segmented reporting, Traffic sources, Device viewport and
browser, Platform (tablet, mobile, desktop) and many more• We use other tools or insight sources to help form hypotheses• We triangulate with other data where possible• We estimate the potential uplift of fixing/improving something
as well as the difficulty (time/resource/complexity/risk)• A simple quadrant shows the value clusters• We then WORK the highest and easiest scores by…• Turning every opportunity spotted into an OUTCOME
“This is where the smarts of CRO are – in identifying the easiest stuff to test or fix that will drive the largest uplift.”
![Page 81: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/81.jpg)
81
5 - The Bucket Methodology“Helps you to stream actions from the insights and prioritisation work. Forces an action for every issue, a counter for every opportunity being lost.”
Test If there is an obvious opportunity to shift behaviour, expose insight or increase conversion – this bucket is where you place stuff for testing. If
you have traffic and leakage, this is the bucket for that issue.
InstrumentIf an issue is placed in this bucket, it means we need to beef up the
analytics reporting. This can involve fixing, adding or improving tag or event handling on the analytics configuration. We instrument both
structurally and for insight in the pain points we’ve found.
Hypothesise This is where we’ve found a page, widget or process that’s just not working well but we don’t see a clear single solution. Since we need to really shift the behaviour at this crux point, we’ll brainstorm hypotheses. Driven by
evidence and data, we’ll create test plans to find the answers to the questions and change the conversion or KPI figure in the desired direction.
Just Do It JFDI (Just Do It) – is a bucket for issues where a fix is easy to identify or the change is a no-brainer. Items marked with this flag can either be deployed in a batch or as part of a controlled test. Stuff in here requires low effort or are micro-opportunities to increase conversion and should be fixed.
Investigate You need to do some testing with particular devices or need more information to triangulate a problem you spotted. If an item is in this
bucket, you need to ask questions or do further digging.
![Page 82: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/82.jpg)
5 - Belron example – Funnel replacementFinal
prototype
Usability issues
left
Final changes
Release build
Legal review kickoff
Cust services review kickoff
Marketing review
Test Plan
Signoff (Legal, Mktng, CCC)
Instrument
analytics
Instrument
Contact Centre
Offline tagging
QA testing
End-End testing
Launch 90/10%
MonitorLaunch 80/20%
Monitor < 1
week
Launch 50/50%
Go live 100%
Analytics review
Washup and
actions
New hypothes
es
New test design
Rinse and
Repeat!
![Page 83: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/83.jpg)
83
6 - CRO and Testing resources• 101 Landing page tips : slidesha.re/8OnBRh • 544 Optimisation tips : bit.ly/8mkWOB• 108 Optimisation tips : bit.ly/3Z6GrP• 32 CRO tips : bit.ly/4BZjcW• 57 CRO books : bit.ly/dDjDRJ• CRO article list : bit.ly/nEUgui• Smashing Mag article : bit.ly/8X2fLk
![Page 84: 12 Things to do Before Your Company Dies : Conversion Conference London - Oct 2013](https://reader033.vdocuments.site/reader033/viewer/2022061106/54168def8d7f722f6c8b4b0e/html5/thumbnails/84.jpg)
84
END SLIDESFeel free to steal, re-use, appropriate or otherwise lift stuff from this deck.
If it was useful to you – email me or tweet me and tell me why – I’d be DELIGHTED to hear!
Cheers,
Craig.