![Page 1: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/1.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
1
DO NOT DISTRIBUTE
Collaborative Filtering and Net PerceptionsNovember 15, 2000
The Darden School
Sam Tutterow JD/MBA ‘99
The Darden School
Agenda
How CF works
Where it works (and doesn’t)
Some results
The privacy issue
A quick history of Net Perceptions
Getting a job in high tech marketing
Q&A throughout
![Page 2: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/2.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
2
DO NOT DISTRIBUTE
The Darden School
How collaborative filtering works
How it works
Mathematically
Philosophically (marketing)
The Darden School
The ratings databaseP1 P2 P3 P4 P5 P6 P7 P8 P9 P10 …
C1 1 0 0 0 1 0 0 0 1 0 …C2 0 0 0 1 0 0 1 0 0 0 …C3 0 1 0 1 0 0 1 0 0 1 …C4 1 0 0 0 0 1 0 0 1 0 …C5 0 0 1 0 0 0 0 0 0 1 …C6 0 1 0 0 0 1 0 0 0 0 …C7 0 1 0 1 1 0 1 0 0 1 …C8 0 0 0 0 0 1 0 0 1 0 …C9 0 1 0 1 1 0 1 0 0 1 …C10 1 0 0 0 1 0 0 0 0 0 …… … … … … … … … … … … …
![Page 3: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/3.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
3
DO NOT DISTRIBUTE
The Darden School
A customer comes to the web siteP1 P2 P3 P4 P5 P6 P7 P8 P9 P10 …
C1 1 0 0 0 1 0 0 0 1 0 …C2 0 0 0 1 0 0 1 0 0 0 …C3 0 1 0 1 0 0 1 0 0 1 …C4 1 0 0 0 0 1 0 0 1 0 …C5 0 0 1 0 0 0 0 0 0 1 …C6 0 1 0 0 0 1 0 0 0 0 …C7 0 1 0 1 1 0 1 0 0 1 …C8 0 0 0 0 0 1 0 0 1 0 …C9 0 1 0 1 1 0 1 0 0 1 …C10 1 0 0 0 1 0 0 0 0 0 …… … … … … … … … … … … …
The Darden School
Then we find their “soul mates” in real-timeP1 P2 P3 P4 P5 P6 P7 P8 P9 P10 …
C1 1 0 0 0 1 0 0 0 1 0 …C2 0 0 0 1 0 0 1 0 0 0 …C3 0 1 0 1 0 0 1 0 0 1 …C4 1 0 0 0 0 1 0 0 1 0 …C5 0 0 1 0 0 0 0 0 0 1 …C6 0 1 0 0 0 1 0 0 0 0 …C7 0 1 0 1 1 0 1 0 0 1 …C8 0 0 0 0 0 1 0 0 1 0 …C9 0 1 0 1 1 0 1 0 0 1 …C10 1 0 0 0 1 0 0 0 0 0 …… … … … … … … … … … … …
![Page 4: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/4.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
4
DO NOT DISTRIBUTE
The Darden School
The soul mates determine the best offerP1 P2 P3 P4 P5 P6 P7 P8 P9 P10 …
C1 1 0 0 0 1 0 0 0 1 0 …C2 0 0 0 1 0 0 1 0 0 0 …C3 0 1 0 1 0 0 1 0 0 1 …C4 1 0 0 0 0 1 0 0 1 0 …C5 0 0 1 0 0 0 0 0 0 1 …C6 0 1 0 0 0 1 0 0 0 0 …C7 0 1 0 1 1 0 1 0 0 1 …C8 0 0 0 0 0 1 0 0 1 0 …C9 0 1 0 1 1 0 1 0 0 1 …C10 1 0 0 0 1 0 0 0 0 0 …… … … … … … … … … … … …
The Darden School
How collaborative filtering works
How it works
Mathematically
Philosophically (marketing)
Key characteristics of CF
Focus is on individuals, not on segments
Learns individual preferences in real-time
An adaptive system that gets smarter with every use
Viewed as a customer benefit, not an ad
![Page 5: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/5.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
5
DO NOT DISTRIBUTE
The Darden School
Business problems CF helps solve
Customer objectives
• Getting the first purchase
• Increasing average transaction sizes
• Getting more profit out of the customer base
Product objectives
• Moving overstock inventory
• Promoting high margin items
• Launching new items effectively
The Darden School
Where it works - on the web site
Seven key applications
1. Home page
2. Product detail page
3. Shopping cart cross-sells
4. Check-out page
5. Recommendation center
6. Product category sorting
7. Search results sorting
![Page 6: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/6.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
6
DO NOT DISTRIBUTE
The Darden School
The Darden School
Where it works - on the web site
Seven key applications of NPEC
• Home page
• Product detail page
• Shopping cart cross-sells
• Check-out page
• Recommendation center
• Product category sorting
• Search results sorting
![Page 7: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/7.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
7
DO NOT DISTRIBUTE
The Darden School
The Darden School
Where it works - on the web site
Seven key applications of NPEC
• Home page
• Product detail page
• Shopping cart cross-sells
• Check-out page
• Recommendation center
• Product category sorting
• Search results sorting
![Page 8: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/8.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
8
DO NOT DISTRIBUTE
The Darden School
The Darden School
Results - on the web site
“The click-through is twice as high as anything we get without the software. It has twice the sales impact, too.”
Jim LaBelleVP Marketing, Wine.com1to1, November 2000
![Page 9: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/9.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
9
DO NOT DISTRIBUTE
The Darden School
Other places where CF works
In the call center
Through email campaigns
Other customer touch points such as cell phones, PDAs, kiosks, POS systems
“walk-talk-click-beep”
The Darden School
* Converted from British Pounds
With Net With traditional Perceptions’
cross-sell realtime methods recommendations
Ave. Cross-Sell Value $19.50* 60%higher
Cross Sell Success Rate 9.8% 50%higher
Results - in the call center
![Page 10: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/10.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
10
DO NOT DISTRIBUTE
The Darden School
Results - through email
Click-throughResponse Rate 10% 19.1% 2X
Purchase Rate 0.25% 2.7% 10X
Industry NETP versusAverage* Delivered Industry
* Forrester Research
The Darden School
Some of our personalization customers
![Page 11: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/11.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
11
DO NOT DISTRIBUTE
The Darden School
Where CF works best
Best environment• Lots of products, lots of customers
• Where preferences are expressed and observable through customer behavior (not a “spec’d” purchase)
• Where customers are uniquely identifiable
Best applications• Retail commerce
• Knowledge management
The Darden School
The knowledge management applicationP1 P2 P3 P4 P5 P6 P7 P8 P9 P10 …
C1 1 0 0 0 1 0 0 0 1 0 …C2 0 0 0 1 0 0 1 0 0 0 …C3 0 1 0 1 0 0 1 0 0 1 …C4 1 0 0 0 0 1 0 0 1 0 …C5 0 0 1 0 0 0 0 0 0 1 …C6 0 1 0 0 0 1 0 0 0 0 …C7 0 1 0 1 1 0 1 0 0 1 …C8 0 0 0 0 0 1 0 0 1 0 …C9 0 1 0 1 1 0 1 0 0 1 …C10 1 0 0 0 1 0 0 0 0 0 …… … … … … … … … … … … …
![Page 12: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/12.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
12
DO NOT DISTRIBUTE
The Darden School
The privacy issue
The Darden School
The privacy issue
![Page 13: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/13.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
13
DO NOT DISTRIBUTE
The Darden School
The privacy issue
• Lots of media coverage over the past year
– But coverage has slowed recently
• Privacy issue lies on a spectrum, not in absolutes1. Type of info tracked (anon clicks, mailing address, personalfinancials?)
2. How I consent (opt in immediately, opt out possible, opt out not honored?)
3. Where the info will be used (today, this site only, sold to others?)
4. Value I receive (great experience, save some time, info used to harm me?)
Pause forQuestions and Answers
![Page 14: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/14.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
14
DO NOT DISTRIBUTE
The Darden School
Agenda
How CF works
Where it works (and doesn’t)
Some results
The privacy issue
A quick history of Net Perceptions
Getting a job in high tech marketing
Q&A throughout
The Darden School
Net Perceptions (A)
“Establishing credibility”
Key events
• Amazon as first customer on the web (pre IPO)
• IPO (4/23/99)
• GUS results demonstrate value of the technology in call center (9/20/99)
-
10
20
30
40
50
60
70
4/23
/99
6/7/
99
7/22
/99
9/5/
99
10/2
0/99
12/4
/99
1/18
/00
3/3/
00
4/17
/00
6/1/
00
7/16
/00
8/30
/00
10/1
4/00
![Page 15: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/15.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
15
DO NOT DISTRIBUTE
The Darden School
Net Perceptions (B)
“Catching the wave”
Key events
• Significant customer, partner, and industry leader recognition (November 99)
• ABC and NBC profile the company (December 99)
• Acquire KD1 analytics company (January 99) -
10
20
30
40
50
60
70
4/23
/99
6/7/
99
7/22
/99
9/5/
99
10/2
0/99
12/4
/99
1/18
/00
3/3/
00
4/17
/00
6/1/
00
7/16
/00
8/30
/00
10/1
4/00
The Darden School
Net Perceptions (C)
“The dot-com collapse”
Key events
• Secondary offering raises over $100 million (3/24/00)
• Dot-com market collapses (early April 2000)
• Miss Q3 revenue and earnings targets (9/28/00)
• Lay off 17% of work force (10/19/00)
-
10
20
30
40
50
60
70
4/23
/99
6/7/
99
7/22
/99
9/5/
99
10/2
0/99
12/4
/99
1/18
/00
3/3/
00
4/17
/00
6/1/
00
7/16
/00
8/30
/00
10/1
4/00
![Page 16: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/16.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
16
DO NOT DISTRIBUTE
The Darden School
Where we are today - markets and competitionMarkets
• Multi-channel retailers
• Fortune 1000 (knowledge management)
Closest competitors in retail
• Analytical CRM (Epiphany, Broadbase, Blue Martini)
• Retail-specific ERP (JDA Software, Retek)
• “Build it in-house”
The Darden School
Where we are today - products
Hosted APPS
Software AdvertisingAdvisor
E-commerceAnalyst
RetailAnalyst E-commerce Marketing
Campaigns Call Centers
CoreTechnology
Business Intelligence Personalization“ P e r s o n a l i z a t i o n M a n a g e r ”
Business Intelligence Engine
Knowledge Discovery Engine - Recommendation Engine
AdvertisingAdvisor
E-commerceAnalyst
RetailAnalyst
*Powered by Angara
![Page 17: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/17.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
17
DO NOT DISTRIBUTE
The Darden School
Business intelligence customers
Hudson’s Bay
Questions and Answers
Discussion: Job hunting in high tech
![Page 18: DO NOT DISTRIBUTE - Faculty Directory...DO NOT DISTRIBUTE The Darden School Where we are today - markets and competition Markets • Multi-channel retailers • Fortune 1000 (knowledge](https://reader034.vdocuments.site/reader034/viewer/2022042321/5f0ba6367e708231d4318aba/html5/thumbnails/18.jpg)
DO NOT DISTRIBUTE
Copyright 2000 Sam Tutterow and NetPerceptions
18
DO NOT DISTRIBUTE