personalized retweet prediction in witterpersonalized retweet prediction in twitter liangjie hong*,...
TRANSCRIPT
![Page 1: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/1.jpg)
PERSONALIZED RETWEET PREDICTION IN TWITTER
Liangjie Hong*, Lehigh University
Aziz Doumith, Lehigh University
Brian D. Davison, Lehigh University 1
![Page 2: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/2.jpg)
OVERVIEW
Motivation
Related Work
Our Method
Experimental Results
2
![Page 3: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/3.jpg)
MOTIVATIONS
Social information platforms
3
![Page 4: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/4.jpg)
MOTIVATIONS
Information overload
4
![Page 5: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/5.jpg)
MOTIVATIONS
Information shortage
5
![Page 6: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/6.jpg)
MOTIVATIONS
6
Photo from: http://www.jenful.com/2011/06/google-1-and-the-filter-bubble/
![Page 7: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/7.jpg)
MOTIVATIONS
7
Photo from: http://graphlab.org/
![Page 8: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/8.jpg)
MOTIVATIONS
8
Photo from: http://kexino.com/
![Page 9: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/9.jpg)
MOTIVATIONS
9
Photo from: http://performancemarketingassociation.com/
![Page 10: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/10.jpg)
TASKS
Given a target user and his/her friends, provide a ranked
list of tweets from these friends such that the tweets that
are potentially retweeted will be ranked higher.
10
Photo from: http://performancemarketingassociation.com/
![Page 11: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/11.jpg)
RELATED WORK
Generic Popular Tweets Analysis/Prediction
[Suh et al., SocialCom 2010]
[Y. Kim and K. Shim, ICDM, 2011]
[Uysal and W. B. Croft, CIKM 2011]
[Hong et al., WWW 2011]
Personalized Tweets Prediction
[Chen et al., SIGIR 2012]
[Peng et al., ICDM Workshop 2011]
11
![Page 12: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/12.jpg)
RELATED WORK
Generic Popular Tweets Analysis/Prediction
[Suh et al., SocialCom 2010]
[Y. Kim and K. Shim, ICDM, 2011]
[Uysal and W. B. Croft, CIKM 2011]
[Hong et al., WWW 2011]
Personalized Tweets Analysis/Prediction
[Chen et al., SIGIR 2012]
[Peng et al., ICDM Workshop 2011]
12
Understanding users’ behaviors & content modeling
![Page 13: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/13.jpg)
OUR METHOD
Design requirements
Utilize users’ historical behaviors
Collaborative filtering
Incorporating a rich-set of features
Coupled modeling with content
Learning a correct objective function
Scalability
13
![Page 14: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/14.jpg)
OUR METHOD
Design requirements
Utilize users’ historical behaviors
Collaborative filtering
Latent factor models
14
![Page 15: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/15.jpg)
OUR METHOD
Design requirements
Utilize users’ historical behaviors
Collaborative filtering
Incorporating a rich-set of features
Latent factor models
Factorization Machines [Rendle, ACM TIST 2012] 15
![Page 16: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/16.jpg)
OUR METHOD
Factorization Machines
Generic enough
matrix factorization
pairwise interaction tensor factorization
SVD++
neighborhood models
…
Technically mature
[Rendle, ICDM 2010]
[Rendle et al., SIGIR 2011]
[Freudenthaler et al., NIPS Workshop 2011]
[Rendle et al., WSDM 2012]
[Rendle, ACM TIST 2012] 16
![Page 17: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/17.jpg)
OUR METHOD
Extending Factorization Machines
Non-negative decomposition of term-tweet matrix
Compatible to standard topic models
Co-Factorization Machines
Multiple aspects of the dataset
Shared feature paradigm
Shared latent space paradigm
Regularized latent space paradigm
17
![Page 18: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/18.jpg)
OUR METHOD
Design requirements
Utilize users’ historical behaviors
Collaborative filtering
Incorporating a rich-set of features
Coupled modeling with content
Learning a correct objective function
Scalability
18
![Page 19: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/19.jpg)
OUR METHOD
Design requirements
Learning objective functions for different aspects
User decisions
Ranking-based loss
Weighted Approximately Rank Pairwise loss (WARP)
Content modeling
Log-Poisson loss
Logistic loss
19
![Page 20: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/20.jpg)
OUR METHOD
WARP loss
Proposed by [Usunier et al., ICML 2009]
Image retrieval tasks and IR tasks [Weston et al., Machine Learning 2010]
[Weston et al., ICML 2012]
[Weston et al., UAI 2012]
[Bordes et al, AISTATS 2012]
Can mimic many ranking measures
NDCG, MAP, Precision@k
Applied to collaborative filtering 20
![Page 21: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/21.jpg)
OUR METHOD
Design requirements
Utilize users’ historical behaviors
Collaborative filtering
Incorporating a rich-set of features
Coupled modeling with content
Learning a correct objective function
Scalability (Stochastic Gradient Descent)
21
![Page 22: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/22.jpg)
EXPERIMENTS
Twitter data
0.7M target users with 11M tweets
4.3M neighbor users with 27M tweets
“Complete” sample for each target user
Mean Average Precision (MAP) as measure
Train/test on consecutive time periods
22
![Page 23: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/23.jpg)
EXPERIMENTS
Comparisons
Matrix factorization (MF)
Matrix factorization with attributes (MFA)
CPTR [Chen et al, SIGIR 2012]
Factorization machines with attributes (FMA)
CoFM with shared features (CoFM-SF)
CoFM with shared latent spaces (CoFM-SL)
CoFM with latent space regularization (CoFM-REG)
23
![Page 24: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/24.jpg)
EXPERIMENTS
Comparisons
Matrix factorization (MF)
Matrix factorization with attributes (MFA)
CPTR [Chen et al, SIGIR 2012]
Factorization machines with attributes (FMA)
CoFM with shared features (CoFM-SF)
CoFM with shared latent spaces (CoFM-SL)
CoFM with latent space regularization (CoFM-REG)
24
![Page 25: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/25.jpg)
EXPERIMENTS
25
![Page 26: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/26.jpg)
EXPERIMENTS
26
![Page 27: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/27.jpg)
EXPERIMENTS
27
![Page 28: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/28.jpg)
EXPERIMENTS
28
Examples of topics are shown. The terms are top ranked terms in
each topic. The topic names in bold are given by the authors.
Entertainment
album music lady artist video listen itunes apple produced movies #bieber bieber new songs
Finance
percent billion bank financial debt banks euro crisis rates greece bailout spain economy
Politics
party election budget tax president million obama money pay bill federal increase cuts
![Page 29: PERSONALIZED RETWEET PREDICTION IN WITTERPERSONALIZED RETWEET PREDICTION IN TWITTER Liangjie Hong*, Lehigh University Aziz Doumith, Lehigh University 1 Brian D. Davison, Lehigh University](https://reader030.vdocuments.site/reader030/viewer/2022040611/5ed750f54afafb48426f9828/html5/thumbnails/29.jpg)
CONCLUSIONS
Main contributions
Propose Co-Factorization Machines (CoFM) to handle
two (multiple) aspects of the dataset.
Apply FM to text data with constraints to mimic topic
models
Introduce WARP loss into collaborative filtering/recsys
models
Explore a wide range of features and demonstrate the
effectiveness of feature sets with significant
improvement over several non-trival baselines.
29