hybrid transitive trust mechanisms

30
Hybrid Transitive Trust Mechanisms Jie Tang, Sven Seuken, David C. Parkes UC Berkeley, Harvard University,

Upload: amanda

Post on 29-Jan-2016

42 views

Category:

Documents


0 download

DESCRIPTION

Hybrid Transitive Trust Mechanisms. Jie Tang, Sven Seuken , David C. Parkes UC Berkeley, Harvard University,. Motivation. L arge multi-agent systems must deal with fraudulent behavior eBay auctions P2P file sharing systems Web surfing Pool collective experience - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Hybrid Transitive Trust Mechanisms

Hybrid Transitive Trust Mechanisms

Jie Tang, Sven Seuken, David C. ParkesUC Berkeley, Harvard University,

Page 2: Hybrid Transitive Trust Mechanisms

Motivation

• Large multi-agent systems must deal with fraudulent behavior– eBay auctions– P2P file sharing systems– Web surfing

• Pool collective experience• Need mechanisms for aggregating trust

Page 3: Hybrid Transitive Trust Mechanisms

Agent Interaction ModelDefn. Agent Type: θi in [0,1] = prob. of a successful interaction

θ1

θ2

θ3

θ4

θ5

s1

s2

s3

s4

s5

Page 4: Hybrid Transitive Trust Mechanisms

Goals

• Informativeness: correlation between scores si produced by the trust mechanism and true agent types θi (corr(S, θ))

• Strategyproofness: Prevent individual agents from manipulating trust scores si

• Trust mechanisms should be both informative and strategyproof

• Optimize tradeoff between informativeness and strategyproofness

Page 5: Hybrid Transitive Trust Mechanisms

Outline

• Motivation• Example Mechanisms• Informativeness vs. Strategyproofness• Hybrid Transitive Trust Mechanisms– Theoretical Analysis

• Experimental Results– Informativeness– Efficiency

• Conclusions

Page 6: Hybrid Transitive Trust Mechanisms

Outline

• Motivation• Example Mechanisms• Informativeness vs. Strategyproofness• Hybrid Transitive Trust Mechanisms– Theoretical Analysis

• Experimental Results– Informativeness– Efficiency

• Conclusions

Page 7: Hybrid Transitive Trust Mechanisms

Example: PageRank

0.16

0.33

0.20

0.200.11

Page 8: Hybrid Transitive Trust Mechanisms

Example: Shortest Path

i

j

Page 9: Hybrid Transitive Trust Mechanisms

Example: Maxflow

i

j

Page 10: Hybrid Transitive Trust Mechanisms

Example: Hitting Time

i

j

Page 11: Hybrid Transitive Trust Mechanisms

Example: PageRank

i

j

Page 12: Hybrid Transitive Trust Mechanisms

ManipulationsMisreportSybil

0.16

0.32

0.20

0.200.11

0.36

0.11

0.08

0.070.03

Page 13: Hybrid Transitive Trust Mechanisms

Outline

• Motivation• Example Mechanisms• Informativeness vs. Strategyproofness• Hybrid Transitive Trust Mechanisms– Theoretical Analysis

• Experimental Results– Informativeness– Efficiency

• Conclusions

Page 14: Hybrid Transitive Trust Mechanisms

Value-strategyproof example

i

j

Value strategyproofness: an agent cannot increase its own trust score

Page 15: Hybrid Transitive Trust Mechanisms

Rank-strategyproof example

i

j

Rank strategyproofness: an agent cannot increase its rank

Page 16: Hybrid Transitive Trust Mechanisms

ε-strategyproof

• ε-value strategyproof: Agents cannot increase their trust score by more than ε through manipulation

• ε-rank strategyproof: Agents cannot improve their rank to be above agents who have ε higher trust score

Page 17: Hybrid Transitive Trust Mechanisms

Informativeness vs. Strategyproofness

Page 18: Hybrid Transitive Trust Mechanisms

Outline

• Motivation• Example Mechanisms• Informativeness vs. Strategyproofness• Hybrid Transitive Trust Mechanisms– Theoretical Analysis

• Experimental Results– Informativeness– Efficiency

• Conclusions

Page 19: Hybrid Transitive Trust Mechanisms

Hybrid Mechanisms

• Convex weighting of two mechanisms (one with good strategyproofness properties, one with good informativeness)

• Get intermediate strategyproofness and informativeness properties

α( ) + (1-α)( )

Page 20: Hybrid Transitive Trust Mechanisms

Main Results

• Can combine ε-value-strategyproof mechanisms naturally

• (1- α)Maxflow- α PageRank hybrid is 0.5α-value strategyproof

• Adjust strategyproofness as we vary α

Page 21: Hybrid Transitive Trust Mechanisms

Main Results:

• “Upwards value preservance” and value-strategyproofness yield α-rank strategyproofness

• (1- α) Shortest Path- α Hitting Time hybrid is α-rank strategyproof

• (1- α) Shortest Path- α Maxflow hybrid is α-rank strategyproof

Page 22: Hybrid Transitive Trust Mechanisms

Outline

• Motivation• Example Mechanisms• Informativeness vs. Strategyproofness• Hybrid Transitive Trust Mechanisms– Theoretical Analysis

• Experimental Results– Informativeness– Efficiency

• Conclusions

Page 23: Hybrid Transitive Trust Mechanisms

Informativeness

• Informativeness is the correlation between the true agent types θi and the trust scores given by each trust mechanism si

• Can only be measured experimentally• Setup– N agents, each with type θi (fraction of good)– No strategic agent behavior– Agents randomly interact, report results– Vary number of timesteps

Page 24: Hybrid Transitive Trust Mechanisms

Informativeness Properties• Sometimes hybrids have informativeness even

higher than either of their base mechanisms

Page 25: Hybrid Transitive Trust Mechanisms

Outline

• Motivation• Example Mechanisms• Informativeness vs. Strategyproofness• Hybrid Transitive Trust Mechanisms– Theoretical Analysis

• Experimental Results– Informativeness– Efficiency

• Conclusions

Page 26: Hybrid Transitive Trust Mechanisms

Efficiency Experiments

• In practice: care about trustworthy agents receiving good interactions

• Agents will be strategic• Measure efficiency as fraction of good interactions for

cooperative agents• Simulated two application domains, a P2P file sharing

domain and a web surfing domain• Setup– Agents use hybrid trust mechanism to choose interaction

partners– Report results of interactions to trust mechanism

Page 27: Hybrid Transitive Trust Mechanisms

Cooperative, Lazy free-rider, Strategic

• Cooperative agents have high type• Lazy free-rider agents have low type• Strategic agents also have low type, but

attempt to manipulate the system• Simple agent utility model:– Assume heterogenous ability to manipulate– Reward proportional to manipulability of algorithm– As α increases, more strategic agents manipulate

Page 28: Hybrid Transitive Trust Mechanisms

File Sharing Domain

Page 29: Hybrid Transitive Trust Mechanisms

Conclusions• Analyzed informativeness and

strategyproofness trade-off theoretically and experimentally

• Hybrid mechanisms have intermediate informativeness, strategyproofness properties

• For some domains, hybrid mechanisms produce better efficiency than either base mechanism

• Thank you for your attention

Page 30: Hybrid Transitive Trust Mechanisms

Conclusions• Analyzed informativeness and

strategyproofness trade-off theoretically and experimentally

• Hybrid mechanisms have intermediate informativeness, strategyproofness properties

• For some domains, hybrid mechanisms produce better efficiency than either base mechanism

• Thank you for your attention