![Page 1: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/1.jpg)
个性化推荐的未来
基于知识的推荐与可解释推荐
谢幸,王希廷
微软亚洲研究院
![Page 2: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/2.jpg)
User Behavioral Data
![Page 3: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/3.jpg)
Personalized News Feed
![Page 4: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/4.jpg)
Online Advertising
![Page 5: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/5.jpg)
Conversational Recommendaton
![Page 6: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/6.jpg)
Data Privacy
![Page 7: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/7.jpg)
User Modeling
User Big DataUser
Representation
![Page 8: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/8.jpg)
Explicit User Representation
Demographic
Age
Gender
Life stage
Marital status
Residence
Education
Vocation
Personality
Openness
Conscientiousness
Extraversion
Agreeableness
Neuroticism
Impulsivity
Novelty-seeking
Indecisiveness
Interests
Food
Book
Movie
Music
Sport
Restaurant
Status
Emotion
Event
Health
Wealth
Device
Social
Friend
Coworker
Spouse
Children
Other relatives
Tie strength
Schedule
Task
Driving route
Metro/bus line
Appointment
Vacation
![Page 9: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/9.jpg)
Explicit vs Implicit
IDs Texts Images Network
ID Embedding Text Embedding Image Embedding Network Embedding
Deep Models
User Embedding
Item Embedding
DNN Model
Implicit User Representation
Feature Engineering
Classification/Regression Models
Explicit User Representation
Representation Pros Cons
Explicit
• Easy to understand;• Can be directly
bidden by advertisers
• Hard to obtain training data;
• Difficult to satisfy complex and global needs;
Implicit
• Unified and heterogenous user representation;
• End-to-end learning
• Difficult to explain; • Need to fine-tune in
each task
![Page 10: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/10.jpg)
Personalized Service
User Representation
Item Representation
Personalized Ranking
![Page 11: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/11.jpg)
Our Research
user
Item
preference
Deep learning based user modeling
Knowledge enhanced recommendation
Explainable recommendation
Deep learning based recommendation
![Page 12: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/12.jpg)
• A collection of state-of-the-art deep learning based user representation and recommendation models. The systems are designed to be simple to use and easy to extend, while maintaining efficiency.
![Page 13: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/13.jpg)
Recent Publication
• Xiting Wang, Yiru Chen, Jie Yang, etc. A Reinforcement Learning Framework for Explainable Recommendation, ICDM 2018
• Chanyoung Park, Donghyun Kim, Xing Xie, Hwanjo Yu, Collaborative Translational Metric Learning, ICDM 2018
• Zhigang Yuan, Fangzhao Wu, Junxin Liu, etc. Neural Sentence-level Sentiment Classification with Heterogeneous Supervision, ICDM 2018
• Hongwei Wang, etc. Ripple Network: Propagating User Preferences on the Knowledge Graph for Recommender Systems, CIKM 2018
• Jianxun Lian, Xiaohuan Zhou, etc., xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems, KDD 2018
• Zheng Liu, Xing Xie, Lei Chen, Context-aware Academic Collaborator Recommendation, KDD 2018
• Defu Lian, Kai Zheng, Vincent W. Zheng, etc. High-order Proximity Preserving Information Network Hashing, KDD 2018
• Jianxun Lian, etc. Towards Better Representation Learning for Personalized News Recommendation: a Multi-Channel Deep Fusion Approach, IJCAI 2018
• Haochao Ying, Fuzhen Zhuang, Fuzheng Zhang, etc. Sequential Recommender System based on Hierarchical Attention Networks, IJCAI 2018
• Yingzi Wang, Anastasios Noulas, Xiao Zhou, etc. Predicting the Spatio-Temporal Evolution of Chronic Diseases in Population with Human Mobility Data, IJCAI 2018
• Guanjie Zheng, Fuzheng Zhang, Zihan Zheng, etc. DRN: A Deep Reinforcement Learning Framework for News Recommendation, WWW 2018
• Hongwei Wang, Fuzheng Zhang, Xing Xie, Minyi Guo, DKN: Deep Knowledge-Aware Network for News Recommendation, WWW 2018
• Youngnam Lee, etc. How to Impute Missing Ratings? Claims, Solution, and Its Application to Collaborative Filtering, WWW 2018
• Hongwei Wang, etc. SHINE: Signed Heterogeneous Information Network Embedding for Sentiment Link Prediction, WSDM 2018
![Page 14: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/14.jpg)
![Page 15: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/15.jpg)
Query Log based User Modeling
gifts for classmates
cool math games
mickey mouse cartoon
shower chair for elderly
presbyopic glasses
costco hearing aids
groom to bride gifts
tie clips
philips shaver
lipstick color chart
womans ana blouse
Dior Makeup
![Page 16: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/16.jpg)
Query Log based User Modeling
birthday gift for grandson
central garden street
my health plan
medicaid new York
medicaid for elderly in new York
alcohol treatment
amazon.com
documentary grandson
youtube
Different records have different informativeness
Neighboring records may have relatedness, while far ones usually not
Different words may have different importance
The same word may have different importance in different contexts
![Page 17: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/17.jpg)
Query Log based User Modeling
![Page 18: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/18.jpg)
Experiments
• Dataset:• 15,346,617 users in total with age category labels
• Randomly sampled 10,000 users for experiments
• Search queries posted from October 1, 2017 to March 31, 2018
Mapping between age category and age range
Distribution of age categoryDistribution of query number per user Distribution of query length
![Page 19: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/19.jpg)
Experiments
discrete feature, linear model
continuous feature, linear model
flat DNN models
hierarchical LSTM model
![Page 20: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/20.jpg)
Experiments
Word-level and query-level attention Word-level and query-level CNN networksConfusion matrix
![Page 21: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/21.jpg)
User Age Inference
Queries from a young user Queries from an elder user
![Page 22: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/22.jpg)
Car Segment
![Page 23: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/23.jpg)
Pet Segment
![Page 24: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/24.jpg)
Big Five
![Page 25: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/25.jpg)
pearson correlation
paragraph embedding
top k tokens
embedding vector
tweets avatars emoticons profiles
CNN embedding
embedding vector
clustering
group vector
pearson correlation
top k tokens
emotion mapping
emotion vector
individual feature engineering
social feature engineering
profile vector
LIWC mapping
semantic categories
ensemble model
personality
Personality Inference
![Page 26: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/26.jpg)
Data
• 3,162 users from a medical school• Major: nursing (524), clinical medicine (365) and pharmaceutics (342)
• Region: Anhui, Zhejiang, and Jiangsu
• Age: average 20.84
• Test Big Five Personality with a 44-item questionnaire
![Page 27: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/27.jpg)
Correlation between Tweet and Personality
Extraversion Agreeableness Neuroticism Conscientiousness Openness
Posi
tive
Neg
ativ
e
![Page 28: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/28.jpg)
Correlation between Avatar and Personality
Extraversion Agreeableness Neuroticism Conscientiousness Openness
Posi
tive
Neg
ativ
e
![Page 29: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/29.jpg)
Experimental Results
Honghao Wei, Fuzheng Zhang, Nicholas Jing Yuan, Chuan Cao, etc. Beyond the Words: Predicting User Personality from Heterogeneous Information, WSDM 2017
![Page 30: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/30.jpg)
Personality in XiaoIce
![Page 31: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/31.jpg)
Personality in Advertising
Tailoring messages to consumer personality increases effectiveness of digital advertising
![Page 32: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/32.jpg)
Deep Learning Based Recommender System
Learning latent representations Learning feature interactions
![Page 33: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/33.jpg)
Motivations
• We try to design a new neural structure that• Automatically learns explicit high-order interactions
• Vector-wise interaction, rather than bit-wise• 𝑓 𝑎𝑖 , 𝑎𝑗 =< 𝑣𝑖 , 𝑣𝑗 > 𝑎𝑖𝑎𝑗
• Different types of feature interactions can be combined easily
• Goals• Higher accuracy
• Reducing manual feature engineering work
![Page 34: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/34.jpg)
Compressed Interaction Network (CIN)
• Hidden units at the k-th layer:
![Page 35: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/35.jpg)
Compressed Interaction Network (CIN)
• Compression: interaction space from 𝑂(𝑚2) down to 𝑂(𝐻𝑘)• E.g., FM conduct the full pair-wise interaction, including necessary and
unnecessary
• Keep the form of vectors• Hidden layers are matrices, rather than vectors
• Degree of feature interactions increases with the depth of layers (explicit)
![Page 36: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/36.jpg)
Compressed Interaction Network (CIN)
![Page 37: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/37.jpg)
Relation with CNN
m
D
Direction of filter sliding
…
Feature map HK+1
An example of image CNN
Feature map 1…
![Page 38: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/38.jpg)
Relation with RNN
ours RNN
![Page 39: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/39.jpg)
Extreme Deep Factorization Machine (xDeepFM)
• Combining explicit and implicit feature interaction network
• Integrate both memorization and generalization
![Page 40: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/40.jpg)
Experiments
• Three real-world datasets• Criteo: ads click-through-rate prediction• Dianping: restaurant recommendation• Bing News: news recommendation
• Evaluation metrics • AUC• Logloss
![Page 41: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/41.jpg)
Experiments
• High-order interactions are necessary
• Effectiveness of CIN
![Page 42: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/42.jpg)
Experiments
![Page 43: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/43.jpg)
Hyper-Parameter Sensitivity
![Page 44: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/44.jpg)
Knowledge Graph
• A kind of semantic network, where node indicates entity or concept, edge indicates the semantic relation between entity/concept
![Page 45: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/45.jpg)
How Does Knowledge Graph Help?
• Precision• More semantic content about items
• Deep user interest
LikeFight Club
David FincherSe7en
Direct
Direct
May like
![Page 46: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/46.jpg)
How Does Knowledge Graph Help?
• Diversity• Different types of relations in knowledge graph
• Extend user’s interest in different paths
LikeFight Club
Edward Norton Primal FearAct
Act
Drama Trainspotting
David Fincher Se7en
Genre Genre
DirectDirect
![Page 47: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/47.jpg)
How Does Knowledge Graph Help?
• Explanation ability• Connect user interest and recommendation results
• Improve user satisfaction, boost user trust
LikeFight Club
Maybe like:
Primal Fear, because they share the same actorTrainspotting, because they share the same genreSe7en, because they share the same director
![Page 48: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/48.jpg)
Knowledge Graph Embedding
• Learns a low-dimensional vector for each entity and relation in KG,which can keep the structural and semantic knowledge
❑ Apply distance-based score function to estimate the triple probability
❑ TransE, TransH, TransR, etc.
Distance-based Models
![Page 49: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/49.jpg)
Knowledge Graph Embedding
❑ Apply similarity-based score function to estimate the triple probability
❑ SME, NTN, MLP, NAM, etc.
Matching-based Models
![Page 50: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/50.jpg)
Knowledge Graph Embedding (KGE)
• Learns a low-dimensional vector for each entity and relation, which can keep the structural and semantic knowledge
KGEKG
Entity VectorRelation Vector
RS TaskFeed into User Vector
Item Vector
Learning
KGEKG Entity Vector, Relation Vector
Learning
(Successive Training)
(Alternate Training)
RS User Vector, Item Vector
KGEKG Entity Vector, Relation VectorUser Vector, Item Vector
RS Learning(Joint Training)
![Page 51: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/51.jpg)
Collaborative Knowledge Embedding (Joint Training)
• Structural knowledge• Direct, act, etc.
• Visual knowledge• Movie poster, book cover image, etc.
• Textual knowledge• Movie description, reviews, etc.
![Page 52: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/52.jpg)
Collaborative Knowledge Embedding
![Page 53: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/53.jpg)
Data
• MovieLens-1M• 1-step subgraph includes category, director,
writer, actors, language, country, production date, rating, nominated awards, and received awards
• IntentBooks• 9-month Bing query logs, apply entity linking
to find out book entity
• 1-step subgraph includes category, author, publish date, belonged series, language, and rating
![Page 54: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/54.jpg)
Results
• Baselines• CKE(ST), CKE(SV), CKE(TV):
only two types of knowledge
• LIBFM(STV): all knowledge as raw features
• BPRMF+STV: not joint-learning
IntentBooks
MovieLens-1M
Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, Wei-Ying Ma, Collaborative Knowledge Base Embedding for Recommender Systems, KDD 2016
![Page 55: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/55.jpg)
Deep Knowledge-aware Network (Successive Training)
![Page 56: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/56.jpg)
Deep Knowledge-aware Network
![Page 57: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/57.jpg)
Extract Knowledge Representations
• Additionally use contextual entity embeddings to include structural information
• Context implies one-step neighbor
![Page 58: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/58.jpg)
Deep Knowledge-aware Network
![Page 59: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/59.jpg)
Experiments
![Page 60: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/60.jpg)
Examples
Hongwei Wang, Fuzheng Zhang, Xing Xie, Minyi Guo, DKN: Deep Knowledge-Aware Network for News Recommendation, WWW 2018
![Page 61: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/61.jpg)
Ripple Network (Joint Training)
• Users interests as seed entity, propagates in the graph step by step
• Decay in the propagating process
![Page 62: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/62.jpg)
Ripple Network
![Page 63: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/63.jpg)
Experiments
![Page 64: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/64.jpg)
Example
![Page 65: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/65.jpg)
可解释推荐
65
![Page 66: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/66.jpg)
Explainable AI
Attention from
• Government
• Industry
• Academia
66
=?
![Page 67: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/67.jpg)
Explainable AI
From Prof. Jitao Sang’s CCDM Talk
Attention from
• Government
• Industry
• Academia
GDPR (General Data Protection Regulation)
67
XAI
![Page 68: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/68.jpg)
Explainable AI
Attention from
• Government
• Industry
• Academia
Invests 1,600 engineers to support GDPR compliance
Moves more than 1.5 billion users out of reach of European privacy law
68
![Page 69: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/69.jpg)
Explainable AI
Attention from
• Government
• Industry
• Academia
11 accepted papers mentioned interpretation/explanation in the title
69
![Page 70: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/70.jpg)
Traditional vs. Explainable Recommendation
• Traditional recommendation• What, Who, When, Where
• Explainable recommendation• Why
It may help you better understand some major decisions of Satya
Connect the item with the user: persuasiveness, trust, satisfaction
It impacts how Satya thinksabout leadership
70
![Page 71: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/71.jpg)
Explainable Recommendation for Ads
71
![Page 72: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/72.jpg)
Explainable Recommendation for Ads
TwitterMerchant Rating
Site Link (ESL)
Top Ads
Review
Consumer Rating
Long Ad Title (LAT)
Base AdCopy Explanation (Decoration)
72
![Page 73: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/73.jpg)
Application Scenarios In AdsSearch Ads
Native Ads on outlook.comNative Ads on MSN
Bing Ads Platform
73
![Page 74: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/74.jpg)
Outline
• Definition and goals
• Forms of explanations
• Explainable recommendation pipelines
74
![Page 75: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/75.jpg)
Outline
• Definition and goals
• Forms of explanations
• Explainable recommendation pipelines
75
![Page 76: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/76.jpg)
Model explainability
Goals of Explainable AITransparency
DebuggingTrust
Open/gray black boxes
Debug failed modelsUnderstand why some models work
Important for high-stakes applications such as healthcare and finance
76
![Page 77: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/77.jpg)
Presentation quality
Goals of Explainable Recommendation
ResearchersAlgorithm developers
Ordinary Users
ReadabilityEffectivenessSatisfaction
Research beginners
Advertisers
Persuasiveness
Model explainability
TransparencyDebugging
Trust
77
![Page 78: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/78.jpg)
Goals of Explainable Recommendation
• Understanding their relationships• Correlated
• Trade-off
ReadabilityEffectivenessSatisfactionPersuasiveness
Model explainability
TransparencyDebugging
Trust
Presentation quality
78
![Page 79: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/79.jpg)
Relationships between the Goals: Correlated
[UMUAI2008]
Evaluation results on 82 users
Questionnaire: “I understand what the system bases its
recommendations on.”
Questionnaire: “I can depend on the system.”
Number of recommendations chosen
Questionnaire: “I think that the artworks that the system recommends
correspond to my art interests.”
Interview: acceptance scenario
Not correlated
Model explainability
Presentation quality
79
![Page 80: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/80.jpg)
Relationships between the Goals: Trade-Off
[UMUAI2008]
Trade-off Trade-off
Trade-off
80
Model explainability
Presentation quality
![Page 81: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/81.jpg)
Goals of Explainable Recommendation
• Understanding their relationships• Correlated
• Trade-off
ReadabilityEffectivenessSatisfactionPersuasiveness
Model explainability
TransparencyDebugging
Trust
Presentation quality
81
![Page 82: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/82.jpg)
Goals of Explainable Recommendation
• Understanding their relationships• Correlated
• Trade-off
• Most existing methods consider both criteria• Model explainability: 9 out of 10 papers
• Presentation quality: all papers
ReadabilityEffectivenessSatisfactionPersuasiveness
Model explainability
TransparencyDebugging
Trust
Presentation quality
82
![Page 83: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/83.jpg)
Definition of Explainable Recommendation
• In general, give statements that support the recommendations [WWW2013]
• Application specific
• [Model-explainability] help users understand the system behavior [CHI2012]
• [Presentation quality-Effectiveness] help users make more accurate decisions [IUI2015]
• [Presentation quality-Persuasiveness] convincing users to adopt recommendations [IUI2015, IUI2009]
83
![Page 84: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/84.jpg)
Outline
• Definition and goals
• Forms of explanations
• Explainable recommendation pipelines
84
![Page 85: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/85.jpg)
Forms of Explanations
• Three basic forms
[IUI2009]85
![Page 86: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/86.jpg)
Item-Based Explanations
• “You may like the item because it is similar to items you previously like”
Amazon [IUI2005]
86
![Page 87: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/87.jpg)
User-Based Explanations
• “You may like the item because a user similar to you like this item”
Facebook [WWW2013]87
![Page 88: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/88.jpg)
Feature-Based Explanations
• “You may like the item because this item contains features you like”
[IUI2005]
[SIGIR2014][Arxiv2018] 88
![Page 89: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/89.jpg)
Dialog-Based Explanations
[KDD2016]Microsoft XiaoIce (小冰)
89
![Page 90: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/90.jpg)
Structured Overview Explanations
NewsMap [CHI2003]
90
![Page 91: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/91.jpg)
Outline
• Definition and goals
• Forms of explanations
• Explainable recommendation pipelines
91
![Page 92: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/92.jpg)
Existing Pipelines
Post-hocRecommendation
model
Embedded
Recommendation model
Explanation method
Explanation method
Model explainability
Presentation quality
Model agnostic
92
![Page 93: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/93.jpg)
Post-Hoc Methods
• Rule-based
[WWW2013]
Friend with maximum tie strength:maximum number of interactions (likes, comments, wall posts)
Fraction of likelihood ratings above 5 (neutral rating) for each explanation strategy.
93
![Page 94: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/94.jpg)
Post-Hoc Methods
• Rule-based
• Retrieval-based
Scenario: book recommendation
[IUI2005]
: the category of likes
: the category of dislikes
Feature-based recommendationRanking score:
=
: number of times 𝑡 appears
94
![Page 95: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/95.jpg)
Post-Hoc Methods
• Rule-based
• Retrieval-based
Scenario: book recommendation
[IUI2005]
Item-based recommendation
Influence score of item 𝑗 on i: 𝑝 𝑖 𝑢, 𝑆+, 𝑆− − 𝑝 𝑖 𝑢, 𝑆+\𝑗, 𝑆−
Similarity score between item 𝑗 and i: 𝑃𝑒𝑎𝑟𝑠𝑜𝑛(𝑖, 𝑗)
95
![Page 96: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/96.jpg)
Post-Hoc Methods
• Rule-based
• Retrieval-based
• Generative
96
Scenario: explanation generation for music recommendation
![Page 97: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/97.jpg)
Data Preparation
• 163 music data• Song + Singer + Album + Lyric + Music tags + Comments
• User tags • XiaoIce tag
• Weibo tag
Explanation Generation for Music Recommendation
97
![Page 98: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/98.jpg)
Requirements
• User Profile Related Reasons• Age and Gender
• User tags
• Song Related Reasons• Lyric
Explanation Generation for Music Recommendation
98
![Page 99: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/99.jpg)
Our Framework
Rule Based Retrieval Method
Explanation Generation for Music Recommendation
99
![Page 100: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/100.jpg)
Examples-User Profiles Related
• 民谣大学时光校园时光光阴摇滚朴树我爱你再见
• 学生• 以前学校每天中午都会放这首歌• 校园十佳歌手,我就听了这首歌。[可爱]
• 电音• 这首歌真是越听越带感• 每次听到这首歌都会热血沸腾
• 民谣• 每次听这首歌都会有一种很安静的感觉• 很喜欢这首歌,很喜欢民谣
• 失恋• 今天分手了,听到这首歌,心都碎了下来• 我失恋了,听着这首歌,感觉自己也是醉了
• 晚睡• 每天晚上睡觉前听这首歌,越听越有感觉,越听越有感觉,• 这首歌是我最喜欢的一首歌,晚安
• Music Tags
• Singer
• Song Name
• User Profiles
Explanation Generation for Music Recommendation
100
![Page 101: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/101.jpg)
Examples-Song Related
• 正面指南无非自拍拍拍有趣欢笑悲哀姿态女孩李荣浩自拍• 李荣浩八个专辑里的歌最喜欢的就是这首了• 昨天今天真的好喜欢这首歌好想听现场版啊[亲亲][亲亲][亲亲]• 听李荣浩的歌不会分享给朋友们[可爱][可爱]• 看到李荣浩的歌啊[可爱][可爱][可爱][可爱][可爱]人我爱你一辈子~• 李荣浩还行!这首歌真的有味道??????
• 迷迭香甜味喜好发酵味道性感无可救药讯号飘扬优雅周杰伦迷迭香• 这首歌千万千万别火呀[发怒][发怒][发怒][发怒][发怒]• 我的阿珍什么时候来听这首歌• 这首歌好骚,喜欢[色]• 所以这首歌是我伦唱的最正常的[大哭]• 周杰伦慵懒的嗓音能驾驭这首歌
• 火星人地球猿人起火难过心脏小孩空袭话音舍利薛之谦火星人来过• 薛之谦唱的这首歌啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊• 这首歌是越听越好听• 因为薛之谦,我喜欢上了薛之谦的歌• 薛,我喜欢你,希望你的歌能给我带来好运[爱心]• 这首歌简直不要太酷,太喜欢这首了[色]
• Music Lyrics
• Singer
• Song Name
Explanation Generation for Music Recommendation
101
![Page 102: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/102.jpg)
Evaluation on User Profiles
Generated Reasons Fluency Personalization Relevance Overall
每次听这首歌都会想到初恋 3 2 2 2
这首歌是我初恋最喜欢的歌 3 1 2 2
今天分手了,听到这首歌,心都碎了下来 3 3 3 3
初恋女友最喜欢的歌 3 1 1 1
失恋了,听着这首歌,感觉自己也是醉了 3 3 3 2
单身狗听这首歌真的是真的好吗 3 3 2 2
分手后,听着这首歌,感觉自己也是醉了 3 2 2 2
我失恋了,听着这首歌,感觉自己也是醉了 3 2 2 2
单身狗听这首歌真的是真的好吗 3 3 2 2
听了这首歌,我就知道我失恋了 3 3 3 3
Music: 朴树 我爱你再见User profile: 失恋
Music tags: 民谣大学时光校园时光光阴摇滚
1: Bad
2: Medium
3: Good
Explanation Generation for Music Recommendation
102
![Page 103: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/103.jpg)
Evaluation on User Profiles
• 5 songs
• 20 user profiles
• 300 reasons
0
0.5
1
1.5
2
2.5
3
Fluency Personalization Relevance Overall
Human Evaluation
5 epoch 70 epoch 150 epoch
Explanation Generation for Music Recommendation
103
![Page 104: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/104.jpg)
Impact of Epoch
5 epochs(General)
70 epochs(Border)
150 epochs(Specific)
我们学校每天中午都放这首歌 学校每天都放这首歌 每次听这首歌,都想哭。那年的同学,你的未来,不知我
学校每天中午都放这首歌 刚刚学校广播站放的就是这首歌 刚刚听这首歌,在学校广播听到,爱上了这首歌
以前学校每天中午都会放这首歌 唉,学校每天都放这首歌,每次听到都好想哭,说好的 学校每天都是这首歌
记得以前学校每天中午都会放这首歌 今天学校广播站放了这首歌,好想回家路上中学时代喜欢陈奕迅的歌,我知道你明天会来,这也是音乐
老师的
今天学校放了这首歌,我就知道这首歌了 听着这首歌,想着你,想着你,想着你,想着你 坐在公交上,学校放的这首歌,当时没感觉,眼神中看着我
这首歌是我们学校每天中午放学的铃声 在学校的广播听到这首歌,感觉自己像赵小雷[吐舌][吐舌] 很多年前在学校听过的男生唱的最好的歌
当时学校广播放了这首歌,当时就觉得好听 每次听到这首歌都会想到以前校园生活的味道~ 听着这首歌,想回到校园时代
我同学说这首歌是我最喜欢的一首歌,每次听都会觉得很 这首歌是我的上课铃声[奸笑] 在听这首歌是因为是因为学校生活开始认识你,记得还记得那一天
曾经在学校的广播里听到这首歌,当时觉得好幸福 校园广播听到了这首歌,很好听刚听到这首歌,在学校广播里听到,才反应过来是这首歌…
忘
当年学校放这首歌,当时觉得好幸福 同桌的你,听这首歌让我想哭唉,听着这首歌写着曾经的我们曾经学校的周一,现在还有
祖国送给
Music: 李宇春下个路口见User profile: 学生
Music tags: 国语回忆校园时光记忆怀念
Explanation Generation for Music Recommendation
104
![Page 105: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/105.jpg)
Post-Hoc Methods
• Rule-based
• Retrieval-based
• Generative
Search Ads Bing Ads Platform
105
![Page 106: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/106.jpg)
Post-Hoc Methods
• Rule-based
• Retrieval-based
• Generative
Native Ads on outlook.comNative Ads on MSN
106
![Page 107: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/107.jpg)
Existing Pipelines
Post-hocRecommendation
model
Embedded
Recommendation model
Explanation method
Explanation method
Model explainability
Presentation quality
Model agnostic
107
![Page 108: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/108.jpg)
Embedded Methods
• Most embedded methods are feature-based• Features are usually parts from the auxiliary information (review, images)
• It fits well with existing recommendation models (can even improve accuracy)
• Types of features• Phrases
• Sentences
• Images
108
EFM: Phrase-level explanation
[SIGIR2014]
![Page 109: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/109.jpg)
Intuition
• To recommend a product that performs well on the features that a user concerns
109
EFM: Phrase-level explanation [SIGIR2014]
![Page 110: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/110.jpg)
Intuition
• To recommend a product that performs well on the features that a user concerns
110
EFM: Phrase-level explanation [SIGIR2014]
![Page 111: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/111.jpg)
Aspect-level Sentiment Analysis
• To extract and organize features and opinions in unstructured reviews
111
EFM: Phrase-level explanation [SIGIR2014]
![Page 112: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/112.jpg)
Structure the Textual Reviews
112
EFM: Phrase-level explanation [SIGIR2014]
![Page 113: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/113.jpg)
User-Feature Attention Matrix
113
EFM: Phrase-level explanation [SIGIR2014]
![Page 114: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/114.jpg)
Item-Feature Attention Matrix
114
EFM: Phrase-level explanation [SIGIR2014]
![Page 115: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/115.jpg)
Multi-Matrix Factorization
• Integrating the explicit and implicit features
115
EFM: Phrase-level explanation [SIGIR2014]
![Page 116: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/116.jpg)
Personalized Explanations
116
EFM: Phrase-level explanation [SIGIR2014]
![Page 117: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/117.jpg)
Offline Experiment
• Top-N recommendation is improved
• k: number of most cared features
117
EFM: Phrase-level explanation [SIGIR2014]
![Page 118: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/118.jpg)
Applied in Commercial Systems
• Provide personalized recommendations by a popular commercial web browser in an e-commerce website
118
EFM: Phrase-level explanation [SIGIR2014]
![Page 119: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/119.jpg)
Click Through Rate Improvement
3 user groups
• A (experimental group): Receive our personalized explanations
• B (comparison group): Receive the ‘people also viewed’ explanation
• C (control group): Receive no explanation
119
EFM: Phrase-level explanation [SIGIR2014]
![Page 120: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/120.jpg)
Embedded Methods
• Most embedded methods are feature-based• Features are usually parts from the auxiliary information (review, images)
• It fits well with existing recommendation models (can even improve accuracy)
• Types of features• Phrases
• Sentences
• Images
120
EFM: Phrase-level explanation
[SIGIR2014]
Recommendation Model Explanation
![Page 121: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/121.jpg)
Embedded Methods
• Most embedded methods are feature-based• Features are usually parts from the auxiliary information (review, images)
• It fits well with existing recommendation models (can even improve accuracy)
• Types of features• Phrases
• Sentences
• Images
121
NARRE: Review-level explanation
[WWW2018]
![Page 122: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/122.jpg)
Usefulness of Review
122
NARRE: Review-level explanation [WWW2018]
A
C
B
Rating(to the item)
Review(to the item)
Rated usefulness
(to the review)
The usefulness of a review is defined as whether it can provide detailed information about the item and help users make their purchasing decisions easily
![Page 123: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/123.jpg)
Limitations of Previous Work
123
NARRE: Review-level explanation [WWW2018]
Incorporating Textual Review
✓✓Most efforts are focused on how to combin with LDA model toimprove the recommendationperformance and generate word/feature-level explanation✓✓ Manual pre-processing is usually required✓✓ Damage the integrity of the sentence and lead to loss of information
Usefulness ofreview
✓✓Previous work only focuses on filtering spam in reviews as pre-processing
![Page 124: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/124.jpg)
CNN Text Processor
124
NARRE: Review-level explanation [WWW2018]
![Page 125: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/125.jpg)
Framework
125
NARRE: Review-level explanation [WWW2018]
Textprocessing
Attention-basedreview pooling
Predictionlayer
![Page 126: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/126.jpg)
1. Text Processing
126
NARRE: Review-level explanation [WWW2018]
Input: Review list of item 𝑖 [𝑉𝑖1 , 𝑉𝑖2 , … 𝑉𝑖𝑘]
Output: [𝑂𝑖1 , 𝑂𝑖2 , … 𝑂𝑖𝑘]
![Page 127: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/127.jpg)
127
NARRE: Review-level explanation [WWW2018]
2. Attention-based Review pooling
Attention score: Normalization:
Weighted sum Oi
Fully connected:
![Page 128: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/128.jpg)
3. Prediction Layer
128
NARRE: Review-level explanation [WWW2018]
![Page 129: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/129.jpg)
Experiments: Data & Metric
129
NARRE: Review-level explanation [WWW2018]
Datasets:
Evaluation Metric :
– RMSE
![Page 130: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/130.jpg)
Baselines
130
NARRE: Review-level explanation [WWW2018]
130
• CF-based Methods• PMF, NMF, SVD++
• Deep learning Method• DeepCoNN
• LDA-based Method• HFT
NARRE: Neural Attentional Regression model with Review-level Explanations
![Page 131: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/131.jpg)
Model Comparisons
131
• Performance comparison on four datasets for all methods (RMSE)
• 80% training, 10% validation, 10% test
NARRE: Review-level explanation [WWW2018]
![Page 132: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/132.jpg)
Effect of Attention
132
0.770
0.775
0.780
0.785
None Attention
RM
SE
Kindle_Store
0.870
0.875
0.880
0.885
None Attention
RM
SE
Toys_and_Games
0.990
0.995
1.000
1.005
None Attention
RM
SE
Movies_and_TV
• None: • Attention:
NARRE: Review-level explanation [WWW2018]
![Page 133: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/133.jpg)
Case Study
133
NARRE: Review-level explanation [WWW2018]
![Page 134: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/134.jpg)
Review Usefulness Evaluation 1
134
• Baselines:
• Latest
• Random Selected
• Length
• Ground truth:
• Top_rated_useful
**:p<0.01 in statistical significance test, compared to the best baseline
NARRE: Review-level explanation [WWW2018]
![Page 135: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/135.jpg)
Review Usefulness Evaluation 2
• Crowd-sourcing based usefulness labeling
135
Annotation Instructions 1:
Background: You are going to buy an item, so you want to refer to the
reviews written by previous consumers to know more about this item.
Task1: You need to browse each of the reviews below and then
determine whether it is useful for your purchasing.
The review can be classified as follows:
• 1 star: Not useful at all.
• 2 stars: Somewhat useful.
• 3 stars: Fairly useful.
• 4 stars: Very useful.
NARRE: Review-level explanation [WWW2018]
![Page 136: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/136.jpg)
Review Usefulness Evaluation 2
• Crowd-sourcing based usefulness labeling
136
0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
Top rated NARRE
1
2
3
4
Ua = 1: not useful at all; 2: somewhat useful; 3: fairly useful; 4: very useful.
NARRE: Review-level explanation [WWW2018]
![Page 137: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/137.jpg)
Review Usefulness Evaluation 3
• Crowd-sourcing based pairwise evaluation
137
Annotation Instructions 2:
Task2: You will see two groups of reviews, and each group contains 5
reviews. You need to browse each group and annotate pairwise
usefulness between Group A and Group B.
• A is more useful than B.
• B is more useful than A.
• A and B are almost the same, both useful.
• A and B are almost the same, both useless.
31%
26%
36%
7% A is more useful than B
B is more useful than A
A and B are almost the same, both
useful
A and B are almost the same, both
useless
In the evaluation: randomly shown as A or B
In the Figure→A: Ours;B: Top_rated_useful;
NARRE: Review-level explanation [WWW2018]
![Page 138: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/138.jpg)
Embedded Methods
• Most embedded methods are feature-based• Features are usually parts from the auxiliary information (review, images)
• It fits well with existing recommendation models (can even improve accuracy)
• Types of features• Phrases
• Sentences
• Images
138
NARRE: Review-level explanation
[WWW2018]
Explanation method
Recommendation model
![Page 139: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/139.jpg)
Embedded Methods
• Most embedded methods are feature-based• Features are usually parts from the auxiliary information (review, images)
• It fits well with existing recommendation models (can even improve accuracy)
• Types of features• Phrases
• Sentences
• Images
139
Re-VECF: Review enhanced visual explanation
[Arxiv2018]
![Page 140: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/140.jpg)
• Users may care about different visual features even on the same item
140
Re-VECF: Review enhanced visual explanation [Arxiv2018]
Visually Explainable Recommendation
![Page 141: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/141.jpg)
Visual Collaborative Filtering (VCF)
141
Re-VECF: Review enhanced visual explanation [Arxiv2018]
![Page 142: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/142.jpg)
Visually Explainable Collaborative Filtering (VECF)
142
Re-VECF: Review enhanced visual explanation [Arxiv2018]
![Page 143: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/143.jpg)
Incorporating the Text Signal
• People comment on image features that they care about in their textual reviews
143
Re-VECF: Review enhanced visual explanation [Arxiv2018]
![Page 144: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/144.jpg)
Review-Enhanced VECF
144
Re-VECF: Review enhanced visual explanation [Arxiv2018]
![Page 145: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/145.jpg)
Experiments
• Recommendation accuracy
145
Re-VECF: Review enhanced visual explanation [Arxiv2018]
![Page 146: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/146.jpg)
Experiments
• Evaluation of visual explanations
146
Re-VECF: Review enhanced visual explanation [Arxiv2018]
![Page 147: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/147.jpg)
Embedded Methods
• Most embedded methods are feature-based• Features are usually parts from the auxiliary information (review, images)
• It fits well with existing recommendation models (can even improve accuracy)
• Types of features• Phrases
• Sentences
• Images
147
![Page 148: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/148.jpg)
Comparison of Pipelines
148
Model explainability
Presentationquality
Model agnostic
Post-hoc x √ √
Embedded √ x x
![Page 149: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/149.jpg)
Comparison of Pipelines
149
Model explainability
Presentationquality
Model agnostic
Post-hoc x √ √
Embedded √ x x
Wrapper √ √ √
Our Pipeline
![Page 150: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/150.jpg)
Our Wrapper Method
150
![Page 151: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/151.jpg)
Problem Definition
• Input• User set 𝑈, 𝑢 ∈ 𝑈 is a user
• Item set 𝑉, 𝑣 ∈ 𝑉 is an item
• A recommendation model to be explained 𝑓(𝑢, 𝑣)
• Output• Explanation 𝑧 =
151
𝑢: user ID and/or some side information
𝑖: item ID 𝑙𝑗: interpretable component
EFM: phrases like “图像-清晰”NARRE: a user reviewRe-VECF: part of an imageCan also be: key features of an item, like five-star rating
The 𝑗th interpretable component is selected
The 𝑗th interpretable component is not selected
Reinforcement learning framework [ICDM2018]
![Page 152: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/152.jpg)
• Advantages: model-agnostic, model-explainability, presentation quality
152
Reinforcement Learning Framework
Reinforcement learning framework [ICDM2018]
![Page 153: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/153.jpg)
• Advantages: model-agnostic, model-explainability, presentation quality
153
Reinforcement Learning Framework
Reinforcement learning framework [ICDM2018]
Independent
![Page 154: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/154.jpg)
Agent 2 can predict 𝑓(𝑢, 𝑣)
• Advantages: model-agnostic, model-explainability, presentation quality
154
Reinforcement Learning Framework
Reinforcement learning framework [ICDM2018]
![Page 155: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/155.jpg)
• Advantages: model-agnostic, model-explainability, presentation quality
155
Reinforcement Learning Framework
Reinforcement learning framework [ICDM2018]
Agent 2 can predict 𝑓(𝑢, 𝑣)
![Page 156: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/156.jpg)
𝑟 will increase if 𝑧 is good given 𝐾
• Advantages: model-agnostic, model-explainability, presentation quality
156
Reinforcement Learning Framework
Reinforcement learning framework [ICDM2018]
![Page 157: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/157.jpg)
• Advantages: model-agnostic, model-explainability, presentation quality
157
Reinforcement Learning Framework
Reinforcement learning framework [ICDM2018]
Readability
Consistency
![Page 158: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/158.jpg)
Couple Agents
158Sentence-level Explanation
Reinforcement learning framework [ICDM2018]
![Page 159: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/159.jpg)
Optimization Goal
• Maximizing expected reward
159
Model-explainability Presentation quality
Reward 𝑟
Reinforcement learning framework [ICDM2018]
![Page 160: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/160.jpg)
Optimization Method
• Doubly Stochastic Policy Gradient
160
Agent 1
Agent 2
Reinforcement learning framework [ICDM2018]
![Page 161: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/161.jpg)
Offline Evaluation
𝑀𝑐: presentation quality 𝑀𝑒: explainability 161
![Page 162: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/162.jpg)
Offline Evaluation
𝑀𝑐: presentation quality 𝑀𝑒: explainability 𝑧∗:explanation length 162
![Page 163: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/163.jpg)
Evaluation with Human Subjects
163
• Ask the participants to choose the explanations that are most useful in helping them decide whether they will go to the restaurants
Reinforcement learning framework [ICDM2018]
![Page 164: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/164.jpg)
Evaluation with Human Subjects
164Words related to food Words related to services
Frequent words in reviews: P3
P4
Reinforcement learning framework [ICDM2018]
![Page 165: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/165.jpg)
Conclusion
165
Model explainability
Presentation quality
Model agnostic
Post-hoc x √ √
Embedded √ x x
Wrapper √ √ √
• Definition and goals
• Forms of explanations
• Explainable recommendation pipelines
![Page 166: User Profiling and Recommendation Systems - cips-cl.org · presbyopic glasses costco hearing aids groom to bride gifts tie clips philips shaver lipstick color chart womans ana blouse](https://reader033.vdocuments.site/reader033/viewer/2022050216/5f61d8e953192b44c05535f2/html5/thumbnails/166.jpg)
Thanks!