multi-agent systems negotiation
DESCRIPTION
Multi-Agent Systems Negotiation. Shari Naik. Negotiation. Inter-agent cooperation Conflict resolution Agents communicate respective desires Compromise to mutually beneficial agreement. Negotiation in Cooperative domains. Jefferey Rosenschein Gilad Zlatkin. Domains. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/1.jpg)
Multi-Agent Systems
Negotiation
Shari Naik
![Page 2: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/2.jpg)
Negotiation
Inter-agent cooperationConflict resolutionAgents communicate respective desiresCompromise to mutually beneficial agreement
![Page 3: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/3.jpg)
Negotiation in Cooperative domains
Jefferey Rosenschein Gilad Zlatkin
![Page 4: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/4.jpg)
Domains
Distributed problem solving Distributed but centrally designed AI systems Global problem to solve
Multiagent systems Distributed, with different designers Agents working for different goals Task Oriented State Oriented Worth Oriented
![Page 5: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/5.jpg)
Task Oriented Domain
Non-conflicting jobsNegotiation : Redistribute tasks to everyone’s mutual benefitExample - Postmen domain
![Page 6: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/6.jpg)
State Oriented DomainGoals are acceptable final statesHave side effects - agent doing one action might hinder or help another agentNegotiation : develop joint plans and schedules for the agents, to help and not hinder other agentsExample – Slotted blocks world
![Page 7: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/7.jpg)
Worth Oriented DomainRates the acceptability of final statesNegotiation : a joint plan, schedules, and goal relaxation. May reach a state that might be a little worse that the ultimate objectiveExample – Multi-agent Tile world
![Page 8: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/8.jpg)
Task Oriented Domain
Tuple <T, A, c>T - set of tasks,A – List of agentsC - cost function from any set of tasks to a real numberEncounter(goal) - a list, T1, … Tn, of finite sets of tasks from the task set T, such that each agent needs to achieve all the tasks in its set.
![Page 9: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/9.jpg)
Building blocks
Precise specification of the domainNegotiation protocolNegotiation strategy
Assumptions Expected Utility Maximizer Complete Knowledge No History Commitments are Verifiable
![Page 10: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/10.jpg)
Domain Definitions Graph (City Map) G = G(V,E)
v V => nodes (address / Post office) e => edges (roads)
Weight function (Distance of road) W : EIN
Letters for agent A : LA Agent Li : I Letters (LA LB) =
Cost(L) IN => weight of minimum weight cycle that starts at PO and visits all vertices of L and ends at PO
![Page 11: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/11.jpg)
Definitions
Deal – Division of LAULB to two disjoint subsets, (DA,DB) such that
DAUDB= LAULB DADB=
Utility – Difference between the cost of achieving his goal alone and the cost of his part of the deal
Utilityi(DA,DB) = Cost(Li) – Cost(Di)
![Page 12: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/12.jpg)
Properties of a Deal ()
Individual rational {A,B}, Utilityi() >= 0
Pareto optimal – there does not exist another deal such that
Negotiation set – set of deals that are individual rational and pareto optimal
() – Product of the two agent utilities from
![Page 13: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/13.jpg)
Negotiation ProtocolA product maximizing ngotiation protocol
One step protocol Concession protocol
At t >= 0, A offers (A,t) and B offers (B,t), such that Both deals are from the negotiation set i andt >0, Utilityi((i,t)) <= Utilityi((i,t-1))
Negotiation ending Conflict - Utilityi((i,t)) = Utilityi((i,t-1)) Agreement, j !=i Utilityj((i,t)) >= Utilityj((j,t))
Only A => agree (B,t) Only B => agree (A,t) Both A,B => agree (k,t) such that ((k))=max{((A)),((B))} Both A,B and ((A))=((B)) => flip a coin
Pure deals
Mixeddeal
![Page 14: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/14.jpg)
Negotiation StrategiesHow an agent should act given a set of rules.
Definition – Function from the history of the negotiation to the current message
Risk - an indication of how much an agent is willing to risk a conflict by sticking to its last offer
Risk(A,t) = Utility, A loses accepting B’s offer Utility, A loses by causing a conflict
Risk Loss
Rational Negotiation Stratergy – At any step t+1, A sticks to his last offer if, Risk(A,t) > Risk(B,t)
![Page 15: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/15.jpg)
Negotiation Strategies Cont
Zeuthen Strategy – Start – A offers B the minimal offer
UtilityB((A,1)) = minNS{UtilityB() }
Next - A will make a minimal sufficient concession at step t+1 iff Risk(A,t)<=Risk(B,t)
If both agents follow the above stratergy, they will agree on a deal NS, such that (*)=maxNS {()}
![Page 16: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/16.jpg)
Equilibrium
A negotiation strategy s will be in equilibrium if under the assumption that A uses s, B prefers s to any other strategy
Zeuthen strategy is not in equilibrium
![Page 17: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/17.jpg)
Mixed deal
Element of probability – Agents will perform (DA,DB) with probability p or (DA,DB) with probability 1-pCosti([(DA,DB):p]) = pCost(Di) + (1-p)Cost(Dj)
Utilityi([:p]) = Cost(Li) – Costi([:p])
All or nothing deal – 0<=p<=1 such that mixed deal m = [({LA,LB}, ):p] NS (m) = maxNS(d)
![Page 18: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/18.jpg)
Incomplete InformationG and w – common knowledgei knows Li, not Lj : j!=I
Solution Exchange missing information Penalty for lie
Possible lies False information
Hiding letters Phantom letters
Not carry out a commitment
![Page 19: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/19.jpg)
Hidden lettersUtility of A
Expected(on telling the truth) = 4 Pure deal – [(,] = 6 Mixed deal - [(,] = 33/4
![Page 20: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/20.jpg)
Phantom lettersUtility of A
Expected(on telling the truth) = 3 Pure deal – [(,] = 4 Mixed deal – possibility of being caught (all or
nothing deal)
![Page 21: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/21.jpg)
Subadditive Task Oriented Domain
the cost of the union of tasks is less than or equal to the sum of the costs of the separate setsfor finite X,Y in T, c(X U Y) <= c(X) + c(Y)).Example of non additive TOD
![Page 22: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/22.jpg)
Incentive compatible Mechanism
L lying is beneficialT Honesty is betterT/P Lying can be beneficial, but chances of being caught
![Page 23: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/23.jpg)
Concave Task Oriented Domain
We have 2 tasks X and Y, where X is a subset of YAnother set of task Z is introduced
c(X U Z) - c(X) >= c(Y U Z) - c(Y).
![Page 24: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/24.jpg)
Modular TOD
c(X U Y) = c(X) + c(Y) 2 c(X Y).
![Page 25: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/25.jpg)
Multi Agent Compromise via Negotiation
Katia Sycara
![Page 26: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/26.jpg)
Negotiation process for conflicting goals
Identify potential interactionsModify intentions to avoid harmful interactions or create cooperative situations
Techniques required Representing and maintaining belief models Reasoning about other agents beliefs Influencing other agents intentions and beliefs
![Page 27: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/27.jpg)
PERSUADER
Program to resolve problems in labor relations domainAgents
Company Union Mediator
Tasks Generation of proposal Generation of counter proposal based on feedback
from dissenting party Persuasive argumentation
![Page 28: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/28.jpg)
Negotiation Methods
Case based ReasoningPreference analysis
![Page 29: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/29.jpg)
Case Based Reasoning
Uses past negotiation experiences as guides to present negotiationProcess
Retrieve appropriate precedent cases from memory Select the most appropriate case Construct and appropriate solution Evaluate solution for applicability to current case Modify the solution appropriately
![Page 30: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/30.jpg)
Case Based Reasoning
Cases organized and retrieved according to conceptual similarities.Advantages
Minimizes need for information exchange Avoids problems by reasoning from past failures.
Intentional reminding. Repair for past failure is used. Reduces computation.
![Page 31: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/31.jpg)
Preference Analysis
From scratch planning methodBased on multi attribute utility theoryGets a overall utility curve out of individual ones.Expresses the tradeoffs an agent is willing to make.Property of the proposed compromise
Maximizes joint payoff Minimizes payoff difference
![Page 32: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/32.jpg)
Persuasive argumentation
Argumentation goals Ways that an agents beliefs and behaviors can be
affected by an argument
Increasing payoff Change importance attached to an issue Changing utility value of an issue
![Page 33: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/33.jpg)
Narrowing differences
Gets feed back from rejecting party Objectionable issues Reason for rejection Importance attached to issues
Increases payoff of rejecting party by greater amount than reducing payoff for agreed parties.
![Page 34: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/34.jpg)
Experiments
Without Memory – 30% more proposalsWithout argumentation – lesser proposals and better solutionsNo failure avoidance – more proposals with objectionsNo preference analysis – Oscillatory conditionNo feedback – communication overhead by 23%
![Page 35: Multi-Agent Systems Negotiation](https://reader035.vdocuments.site/reader035/viewer/2022062304/56812b1e550346895d8f1699/html5/thumbnails/35.jpg)
Thank You