cognitive models in recommender systems

49
1 Christoph Trattner 28.1.2015 Yahoo!, Trondheim Cognitive Models in Recommender Systems Christoph Trattner Know-Center & NTNU [email protected] @Graz University of Technology, Austria

Upload: christoph-trattner

Post on 15-Jul-2015

1.916 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Cognitive Models in Recommender Systems

1

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Cognitive Models in Recommender

Systems

Christoph TrattnerKnow-Center & NTNU

[email protected]

@Graz University of Technology, Austria

Page 2: Cognitive Models in Recommender Systems

2

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Before start in this presentation I will talk a bit about

myself, my background…

Page 3: Cognitive Models in Recommender Systems

3

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Where do I come from (Austria)?

Page 4: Cognitive Models in Recommender Systems

4

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Graz

Page 5: Cognitive Models in Recommender Systems

5

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Academic Back-Ground?

Studied Computer Science at Graz University of

Technology & University of Pittsburgh

Worked since 2009 as scientific researcher at the KMI &

IICM (BSc 2008, MSc 2009)

My PhD thesis was on the Search & Navigation in Social

Tagging Systems (defended 2012)

Since Feb. 2013 @ Know-Center Leading the Social Computing Area

At TUG:

WebScience

Semantic Technologies

Page 6: Cognitive Models in Recommender Systems

6

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

My team

2 Post-Docs, 5 Pre-Docs (2 more to join soon )

2 MSc student

2 BSc student

DI. Dieter

Theiler

DI. Dominik

KowaldDr. Peter

KrakerMag. Sebastian

Dennerlein

Dr. Elisabeth

Lex

Mag. Matthias

Rella

DI. Emanuel

Lacic

DI. Ilire Hasani

Page 7: Cognitive Models in Recommender Systems

7

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Thanks to my Collaborators

Page 8: Cognitive Models in Recommender Systems

8

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

What is my group doing?

… we research on novel methods and tools that exploit

social data to generate a greater value for the

individual, communities, companies and the society as

whole.

Our competences:• Network & Web Science

• Science 2.0

• Predictive Modeling

• Social Network Analysis

• Information Quality Assessment

• User Modeling

• Machine Learning and Data Mining

• Collaborative Systems

Our Services:• Social Analytics: Hub-, Expert -, Community -

, Influencer -, Information Flow-, Trend

(Event) Detection, etc.

• Information Quality Assessment

• Social & Location-based Recommander

Systems

• Customer Segmentation

• Social Systems Design

Page 9: Cognitive Models in Recommender Systems

9

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Some industry partners...

Page 10: Cognitive Models in Recommender Systems

10

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Current projects

BlancNoir - “Towards a Big Data recommender engine for offline

and online marketplaces”

I2F - “Towards a Social Media and Online Marketing Manager

Seminar”

Automation-X - “Towards a scalable Graph-based Visual search

solution”

Styria - “Towards a scalable crowd-based hierarchical cluster

labeling approach for willhaben.at”

TripRebel - “Towards an engaging hybrid hotel recommender

solution for triprebel.com”

CDS - “Towards a scalable Entity & Graph-based Visual search

solution for cds.at”

Exthex - “Towards an efficient viral social media marketing

champagne in Facebook and Twitter”

Page 11: Cognitive Models in Recommender Systems

11

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

The Projects

Project: Tallinn University – Interested in the problem of

recommending tags and items to users in social information

systems.

Page 12: Cognitive Models in Recommender Systems

12

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Ok, let’s start….

Page 13: Cognitive Models in Recommender Systems

13

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Research Question:

To what extent is human cognition theory applicable to

the problem of predicting tags and items to users?

Externals involved:

• PUC - Chile, UFCG – Brazil

Page 14: Cognitive Models in Recommender Systems

14

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

What are social tags?

Where can we find them?

Page 15: Cognitive Models in Recommender Systems

15

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Page 16: Cognitive Models in Recommender Systems

16

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Page 17: Cognitive Models in Recommender Systems

17

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Page 18: Cognitive Models in Recommender Systems

18

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Page 19: Cognitive Models in Recommender Systems

19

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Why are social tags good?

Page 20: Cognitive Models in Recommender Systems

20

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

They help you to classify Web content better [Zubiaga 2012]

They help people to navigate large knowledge repositories better

[Helic et al. 2012]

They help people to search for information faster [Trattner et al. 2012]

However, there is an issue with social tags…

People are typically lazy to apply social tags(!!)

Zubiaga, A. (2012). Harnessing Folksonomies for Resource Classification. arXiv preprint arXiv:1204.6521.

Helic, D., Körner, C., Granitzer, M., Strohmaier, M., & Trattner, C. (2012, June). Navigational efficiency of broad vs.

narrow folksonomies. In Proceedings of the 23rd ACM conference on Hypertext and social media (pp. 63-72). ACM.

Trattner, C., Lin, Y. L., Parra, D., Yue, Z., Real, W., & Brusilovsky, P. (2012, June). Evaluating tag-based information

access in image collections. In Proceedings of the 23rd ACM conference on Hypertext and social media (pp. 113-

122). ACM.

Motivation

Page 21: Cognitive Models in Recommender Systems

21

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

To overcome that issue some smart people started to invent mechanisms that

should help the user in applying tags:

Collaborative Filtering

User based- and item-based CF [Marinho et al. 2008]

Matrix Factorization

FM, PITF [Rendle et al. 2010, 2011, 2012]

Graph Structures

Adapted PageRank and FolkRank [Hotho et al. 2006]

Topic Models

Latent Dirichlet Allocation (LDA) [Krestel et al. 2009, 2010, 2011]

Motivation

Page 22: Cognitive Models in Recommender Systems

22

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Why do we need cognitive models in

recommender systems?

Page 23: Cognitive Models in Recommender Systems

23

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Why do we need cognitive models?

First answer: We do not like data data driven approaches…

Me: OK

Second answer: We can understand things better…

…why is something happening and how…

Page 24: Cognitive Models in Recommender Systems

24

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

ACT-R

Page 25: Cognitive Models in Recommender Systems

25

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Cognitive Models

• In principle, there are several approaches to model

cognitive processes (memory, speech, ...) in the

human brain

• Most popular one: ACT-R (Adaptive

Control of Thought-Rational) theory

by J.R. Anderson (1998)

• American Psychologist (CMU)

J.R. Anderson

CMU

Page 26: Cognitive Models in Recommender Systems

26

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Page 27: Cognitive Models in Recommender Systems

27

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

ACT-R

Page 28: Cognitive Models in Recommender Systems

28

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Interestingly, when looking into the literatur of tagging

systems - temporal processes are typically modeled

with an exponential function...

D. Yin, L. Hong, and B. D. Davison. Exploiting session-like behaviors in tag prediction. In

Proceedings of the 20th international conference companion on World wide web, pages

167–168. ACM, 2011.

L. Zhang, J. Tang, and M. Zhang. Integrating temporal usage pattern into personalized tag

prediction. In Web Technologies and Applications, pages 354–365. Springer, 2012

Page 29: Cognitive Models in Recommender Systems

29

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Empirical Analysis: BibSonomy (1)

29

Linear distribution with log-

scale on Y-axis

exponential function

Linear distribution with log-

scale on X- and Y-axes

power function

Page 30: Cognitive Models in Recommender Systems

30

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Empirical Analysis: BibSonomy (2)

30

Exponential distribution

R² = 31%

Power distribution

R² = 89%

Page 31: Cognitive Models in Recommender Systems

31

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Results:

Decay factor is better modeled as

power-function rather than an ex-

function

Page 32: Cognitive Models in Recommender Systems

32

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Experiment 1: Predicting re-use of tags

Page 33: Cognitive Models in Recommender Systems

33

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Results: Predicting re-use of tags

BLLAC

BLLMPU

GIRP

Page 34: Cognitive Models in Recommender Systems

34

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Results: Recall / Precision

Results:

BLLAC performs fairly well in

predicting the re-use of tags

Page 35: Cognitive Models in Recommender Systems

35

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Experiment 2: Recommending Tags

Page 36: Cognitive Models in Recommender Systems

36

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Results: Recall-Precision plots

36

The time-depended

approaches outperform the

state-of-the-art

BLL+MPr reaches the

highest level of accuracy

CiteULike

Page 37: Cognitive Models in Recommender Systems

37

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Results: Recall/Precision

Results:

BLL approaches outperform current

state-of-the-art tag recommender

approaches.

Page 38: Cognitive Models in Recommender Systems

38

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

...how about runtime?

Page 39: Cognitive Models in Recommender Systems

39

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Results: Runtime

BLL+C needs only around 1s to generate tag-

recommendations for 5,500 users in BibSonomy

Page 40: Cognitive Models in Recommender Systems

40

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Results: Runtime

Page 41: Cognitive Models in Recommender Systems

41

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

...predicting items with ACT-R

Page 42: Cognitive Models in Recommender Systems

42

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Our Approach

= CIRTT 2 main steps

First step:

– User-based Collaborative Filtering (CF) to get

candidate items of similar users

Second step:

– Item-based CF to rank these candidate items using

the BLL equation to integrate tag and time

information:

42

Page 43: Cognitive Models in Recommender Systems

43

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Example

big fruit (t=10d)

small fruit (t=10d)

big fruit (t=2d)

small fruit (t=10d)

Recommendation:

Rank@1 =

Rank@2 =

Page 44: Cognitive Models in Recommender Systems

44

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

What are the results?

44

Page 45: Cognitive Models in Recommender Systems

45

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Results: nDCG plots

45

CIRTT reaches the highest level of accuracy

Page 46: Cognitive Models in Recommender Systems

46

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Results

Results:

CIRTT works quite well compared to

the current state-of-the-art in tag-

based item recommender systems

Page 47: Cognitive Models in Recommender Systems

47

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

... ok that‘s basically it

Page 48: Cognitive Models in Recommender Systems

48

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Code & Framework

https://github.com/learning-layers/TagRec/

Page 49: Cognitive Models in Recommender Systems

49

. Christoph Trattner 28.1.2015 – Yahoo!, Trondheim

Thank you!

Christoph Trattner

Email: [email protected]

Web: christophtrattner.info

Twitter: @ctrattner

Sponsors: