seojocktoberfest - testing for understanding seo - michael briggs
TRANSCRIPT
![Page 1: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/1.jpg)
Testing for Understanding SEO
Michael Briggs
![Page 2: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/2.jpg)
My Mate Nick
![Page 3: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/3.jpg)
My Mate Nick
“We used to Be Mavericks”
![Page 4: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/4.jpg)
Not Like This!!!
![Page 5: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/5.jpg)
We used to Spam at Scale
![Page 6: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/6.jpg)
We used to Spam Creatively
![Page 7: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/7.jpg)
![Page 8: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/8.jpg)
Loser
![Page 9: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/9.jpg)
Liar
![Page 10: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/10.jpg)
Fake
![Page 11: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/11.jpg)
Phoney
![Page 12: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/12.jpg)
How we solve this?
• Scientific Method
• Build -> Measure -> Learn
• The accidental test
![Page 13: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/13.jpg)
Scientific Method
Lets see how accurately I can get to an answer
![Page 14: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/14.jpg)
Is Google Flights Hiving Off Traffic
![Page 15: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/15.jpg)
It Must Be
![Page 16: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/16.jpg)
Problem
• Obviously isn’t good enough
• I work for a billion dollar plus company
• Your clients probably need more as they work in the same way
• Need to get to a definitive answer– Or die trying
![Page 17: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/17.jpg)
The Scientific Method
![Page 18: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/18.jpg)
Google Flights Problems
• I hadn’t chosen to do the test
![Page 19: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/19.jpg)
Google Flights Problems
• I hadn’t chosen to do the test
• Google was running the test
![Page 20: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/20.jpg)
Google Flights Problems
• I hadn’t chosen to do the test
• Google was running the test
• Need to then fill in the blanks
![Page 21: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/21.jpg)
Google Flights Problems
• I hadn’t chosen to do the test
• Google was running the test
• Need to then fill in the blanks
• Was looking backwards
![Page 22: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/22.jpg)
The Real World Hypothesis
Google Flights launched and it’s changed the search landscape and is affecting my CTR
from Organic
![Page 23: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/23.jpg)
My Real Thoughts on the Matter
Google Flights launched and it’s hiving off traffic because Google are a new
technological overlord.
If we don’t stop them they will take over the world.
![Page 24: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/24.jpg)
Meh
• Problem
– Search Volumes are growing (and inaccurate)
–Google Webmaster Tools (I am not ever calling it a “search console”) is awful
– There is a wealth of data
–Where can I find something useful
–Where should I be looking
![Page 25: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/25.jpg)
Hypothesis Development
• New Hypothesis– Google flights launched and it is hiving off traffic. If click through rate changes and
positions stay stable then there is a correlation between the launch of Google flights
![Page 26: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/26.jpg)
Hypothesis Development
• New Hypothesis– Google flights launched and it is hiving off traffic. If click through rate changes and
positions stay stable then there is a correlation between the launch of Google flights
– If I have stable variables I can remove these from analysis
• I know on term set X my positions haven’t changed
– I’m lucky we’ve been number one for a range of things for a while
– And find the variables that change
• Traffic by device
• Search volume by device (error factor)
• Implied variable of CTR
![Page 27: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/27.jpg)
The Graph
![Page 28: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/28.jpg)
Problems
• Not enough data on the keyword set– Longtail
– Google Keyword Tool is crap
– Data gap
• There were multiple changes on the historical data set– Hummingbird
– SEM Changes - Ad extensions
– Listing had go site links added to it
– Site in position two changed
• Positional Data from rank tracking isn’t accurate– Personalisation
![Page 29: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/29.jpg)
Conclusion
![Page 30: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/30.jpg)
Forward Looking Test
I think, therefore I’ll test, so I know
![Page 31: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/31.jpg)
Build Measure Learn
Build
Measure Learn
![Page 32: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/32.jpg)
Forward Looking
• I think this to be true
• I will create a hypothesis
• I will test it
• I will make a conclusion (hopefully)
![Page 33: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/33.jpg)
Accepted Truth
![Page 34: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/34.jpg)
Unique Content
• Hypothesis
–If I add unique content to a page it will make me rank better in Google because Google loves unique content therefore I need unique content.
![Page 35: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/35.jpg)
How do I build this as a significant test
• Take two sets of pages
–Test
–Control
• Change content on the test
• Measure the difference in the normalised traffic
![Page 36: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/36.jpg)
Worlds Most Boring Graph
![Page 37: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/37.jpg)
Test Results
![Page 38: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/38.jpg)
Conclusion
![Page 39: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/39.jpg)
Why
• Content writers weren’t good enough?
• Google is a liar and we’ve been lied to?
• The signal balance had changed in a way we didn’t understand?
• Something else?
![Page 40: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/40.jpg)
Why
• Content writers weren’t good enough?
–Build new hypothesis
• Google is a liar and we’ve been lied to?
• The signal balance had changed in a way we didn’t understand?
• Something else?
![Page 41: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/41.jpg)
We Rebuilt The Content
![Page 42: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/42.jpg)
Test Outcome
Unique Content only helps if someone who knows wtf they are doing actually read the content and makes sure it is in the form it is meant to be in and is properly optimised.
Unique content isn’t enough.
![Page 43: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/43.jpg)
The Accidental Test
Fail Forward
![Page 44: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/44.jpg)
Web Engineering
![Page 45: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/45.jpg)
What it really can look like
![Page 46: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/46.jpg)
Sometimes it looks like this!
![Page 47: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/47.jpg)
SEO’s Regress to This
![Page 48: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/48.jpg)
Because Overnight
![Page 49: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/49.jpg)
What this meant was some days of hell!
![Page 50: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/50.jpg)
Failure is Always an Option
![Page 51: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/51.jpg)
![Page 52: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/52.jpg)
Direct got Similar Hit
90% of Direct Traffic on pages examined was really Organic
![Page 53: Seojocktoberfest - testing for understanding seo - Michael Briggs](https://reader031.vdocuments.site/reader031/viewer/2022030315/587ec9511a28abf37b8b6a99/html5/thumbnails/53.jpg)
• Fail Hard
• Fail Fast
• Fail Frequently
• Learn from every failure
#failForward