ales from the trenches: data disasters and how to avoid them by michele kiss

58
TALES FROM THE TRENCHES: Data Disasters and How to Avoid Them @MicheleJKiss

Upload: martech-conference

Post on 23-Jan-2018

247 views

Category:

Data & Analytics


3 download

TRANSCRIPT

Page 1: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

TALES FROM THE TRENCHES:Data Disasters and How to Avoid Them

@MicheleJKiss

Page 2: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

About Me

@MicheleJKiss

Page 3: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

About Me

@MicheleJKiss

Page 4: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

@MicheleJKiss

Page 5: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

@MicheleJKiss

1. Missing Data / Tracking2. Duplicate Tracking3. Broken Data Capture4. Incorrect Data5. PII6. Spam Data

Page 6: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

1@MicheleJKiss

Missing Tracking

Page 7: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Missing TrackingLots of reasons…

Tracking not implemented

@MicheleJKiss

Page 8: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Ways to spot it

Manual check

@MicheleJKiss

Page 9: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

@MicheleJKiss

Ways to spot it

Page 10: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Missing TrackingLots of reasons…

Tracking removed

@MicheleJKiss

Page 11: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Example

@MicheleJKiss

Tag removed

Page 12: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

@MicheleJKiss

Page 13: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

@MicheleJKiss

Train Your Engineers

Page 14: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

@MicheleJKiss

Alerts

Page 15: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Useful AlertsBig shifts (+/-) in:• Traffic• Conversion (incl. micro)• Revenue / Orders• Direct / Site Self-Referrals• Site Errors

@MicheleJKiss

Page 16: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Alert Dashboards

@MicheleJKiss

Page 17: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

(More Complex)

@MicheleJKiss

Page 18: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

2Duplicate Tags

@MicheleJKiss

Page 19: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Duplicate Tags

@MicheleJKiss

Google Analytics UA-123456-1Google Analytics UA-123456-1

Page 20: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Duplicate Tags

@MicheleJKiss

Google Analytics UA-123456-1Google Analytics UA-137895-1

Page 21: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Ways to spot it

@MicheleJKiss

Page 22: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Ways to spot it

@MicheleJKiss

Page 23: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Ways to spot it

@MicheleJKiss

Page 24: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Ways to spot it

@MicheleJKiss

Page 25: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Ways to spot it

@MicheleJKiss

Page 26: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Ways to spot it

@MicheleJKiss

Page 27: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

How to Fix

@MicheleJKiss

Page 28: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

How to Fix

@MicheleJKiss

Page 29: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

3Broken Data Capture

@MicheleJKiss

Page 30: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Broken Data Capture

@MicheleJKiss

Page 31: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Monitor Alerts / Dashboards

@MicheleJKiss

Page 32: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

4@MicheleJKiss

Page 33: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Incorrect Data

@MicheleJKiss

-$50

$0

$50

$100

$150

$200

$250

$300

$350

$400

$450

4/24/15 5/1/15 5/8/15 5/15/15 5/22/15 5/29/15 6/5/15

Rev

enue

(in

K)

Inflated Revenue

Negative Revenue

Page 34: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Identify OutliersOutlier orders:

@MicheleJKiss

Purchase ID Products Number Orders Revenue9926105027 Sweater 1 1 $121,6047439559051 Sweater 1 1 $120,2774412523165 Sweater 2 1 $61,1169009799484 Sweater 1 1 $49,6554297921230 Sweater 2 1 $49,1229704363543 Sweater 2 1 -$36,0002835153889 Sweater 1 1 -$69,633

Page 35: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

How to FixAdvanced

Calculated Metrics

@MicheleJKiss

Page 36: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Identify OutliersTwo issues:• Outlier orders• Orders triggered prior to

purchase complete

Only affected Sweaters

@MicheleJKiss

Page 37: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Create Segment

@MicheleJKiss

Page 38: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Create New Metric

@MicheleJKiss

Page 39: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Corrected Data

@MicheleJKiss

-$50

$0

$50

$100

$150

$200

$250

$300

$350

$400

$450

4/24/15 5/1/15 5/8/15 5/15/15 5/22/15 5/29/15 6/5/15

Rev

enue

(in

K)

Corrected Revenue

Page 40: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

More Details

mkiss.me/adobe-calc-metrics

@MicheleJKiss

Page 41: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Another Option

@MicheleJKiss

Virtual Report Suite

Page 42: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

What About Google Analytics?

@MicheleJKiss

Page 43: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

5@MicheleJKiss

Page 44: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Google Terms of Service

@MicheleJKiss

Page 45: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Consequences

@MicheleJKiss

Page 46: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Examples

@MicheleJKiss

vendor name / email [email protected]

Page 47: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Doesn’t Matter Whose Fault!

@MicheleJKiss

Page 48: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Filters are not enough

@MicheleJKiss

Page 49: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

How to avoid

@MicheleJKiss

Different Property

Block GA call

Page 50: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

6Spam Data

@MicheleJKiss

Page 51: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Spam Data

@MicheleJKiss

Page 52: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Ways to spot it

@MicheleJKiss

Page 53: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

@MicheleJKiss

Dig DeeperIdentify by:• Browser, OS & Device• Country / City / Region• ISP etc

Exclude where possible…

Page 54: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Examples

@MicheleJKiss

Page 55: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Examples

@MicheleJKiss

Chrome 26.0.872.36(Chrome 27 already released)

Page 56: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Plenty of Spam to Go Around

@MicheleJKiss

Page 57: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Be Vigilant

@MicheleJKiss

Page 58: ales from the Trenches: Data Disasters and How to Avoid Them By Michele Kiss

Questions?

@MicheleJKiss

@[email protected]