oliver keyes research analyst, analytics...measuring mobile sessions mobile is a particular...

49
Measuring Mobile Sessions Oliver Keyes Research Analyst, Analytics

Upload: others

Post on 09-Sep-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Oliver KeyesResearch Analyst, Analytics

Page 2: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

I got asked a question...

Page 3: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

I got asked a question...How long are mobile readers' sessions?

Page 4: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Interesting. Enables:

Page 5: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Interesting. Enables:● Read time analysis

Page 6: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Interesting. Enables:● Read time analysis● View clustering

Page 7: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Interesting. Enables:● Read time analysis● View clustering● Defining new terms

Page 8: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

How long does a Unique Client spend browsing Wikipedia in a single Session?

Page 9: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Identifying “unique clients” (UCs)

Page 10: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Identifying “unique clients” (UCs)● Identifying “sessions”

Page 11: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Mobile is a particular challenge

Page 12: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Mobile is a particular challenge● Readers are a particular challenge

Page 13: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Mobile is a particular challenge● Readers are a particular challenge● Mobile architecture: AOL from the early 2000s

Page 14: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Mobile is a particular challenge● Readers are a particular challenge● Mobile architecture: AOL from the early 2000s● Reader PII: highly limited

Page 15: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Mobile architecture:● On a wireless network? No problem!● Using a data plan? Problem.

Page 16: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Mobile architecture:● On a wireless network? No problem!● Using a data plan? Problem.● Very few externally facing IP addresses

Page 17: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Reader PII:● (deliberately) limited in our request logs

Page 18: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Reader PII:● (deliberately) limited in our request logs● IP address, User Agent and language variant

Page 19: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Reader PII:● (deliberately) limited in our request logs● IP address, User Agent and language variant● No cookies, no links to cookies

Page 20: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Algorithm with the most entropy:● IP + UA + language variant

Page 21: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Identifying sessions:● How do we define a session?

Page 22: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Identifying sessions:● How do we define a session?● Doug Lea: (B M* E)

Page 23: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Identifying sessions:● How do we define a session?● Doug Lea: (B M* E)● look at when UCs stop making actions

Page 24: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Implementation, the first: Referrer tracking

Page 25: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Implementation, the first: Referrer tracking● Some UCs don't have referrers

Page 26: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Implementation, the first: Referrer tracking● Some UCs don't have referrers● Some UCs are mad. Well, all users are mad.

Page 27: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Implementation, the first: Referrer tracking● Some UCs don't have referrers● Some UCs are mad. Well, all users are mad.● Compensating for this requires heavy tech input.

Page 28: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Implementation, the second: inter-time analysis

Page 29: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Implementation, the second: inter-time analysis● Look at the time between requests, for sampled UCs

Page 30: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Implementation, the second: inter-time analysis● Look at the time between requests, for sampled UCs

● When people stop making actions, that's the end of the session.

Page 31: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 32: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 33: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 34: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 35: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 36: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 37: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 38: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 39: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Still preliminary. But: my gut says that this is accurate. Why?

Page 40: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 41: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 42: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Page 43: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Beat on the UC algorithm:

Page 44: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Beat on the UC algorithm:● Work out entropy added by each layer

Page 45: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Beat on the UC algorithm:● Work out entropy added by each layer● Compare to mobile edits, where we have UUIDs

Page 46: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Beat on the UC algorithm:● Work out entropy added by each layer● Compare to mobile edits, where we have UUIDs● Fix session algorithm:● Make it identify all sessions associated with a UC

Page 47: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Explore alternative models:● Breadth-first parser?

Page 48: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

● Explore alternative models:● Breadth-first parser?● Temporarily include mw.session.id?

Page 49: Oliver Keyes Research Analyst, Analytics...Measuring Mobile Sessions Mobile is a particular challenge Readers are a particular challenge Mobile architecture: AOL from the early 2000s

Measuring Mobile Sessions

Code and graphics: github.com/Ironholds/MobileSessions

Questions?