dai: agent interaction in mas

39
1 DAI: Agent interaction in MAS Material collected, assembled and extended by S. Costantini, Computer Sc. Dept. Univ. of L’Aquila Many thanks to all colleagues that share teaching material on the web.

Upload: madonna-douglas

Post on 30-Dec-2015

36 views

Category:

Documents


2 download

DESCRIPTION

DAI: Agent interaction in MAS. Material collected, assembled and extended by S. Costantini, Computer Sc. Dept. Univ. of L’Aquila Many thanks to all colleagues that share teaching material on the web. Distributed Artificial Intelligence – Definition. - PowerPoint PPT Presentation

TRANSCRIPT

1

DAI: Agent interaction in MAS

Material collected, assembled and extended by S. Costantini, Computer Sc. Dept. Univ. of L’Aquila

Many thanks to all colleagues that share teaching material on the web.

2

Distributed Artificial Intelligence – Definition A multiagent system (MAS) is a system in

which several interacting, intelligent agents pursue some set of goals or tasks that are beyond their individual capabilities.

Distributed problem solving considers how the task of solving a particular problem can be divided among a number of agents that cooperate in dividing and sharing knowledge about the problem and about its evolving solutions

DAI is the study, construction and application of MAS.

3

Agent communication and interaction Communication protocols enable agents

to exchange and understand messages Propose, accept, reject, retract, disagree or

counterpropse a course of action Interaction protocols enable agents to

have conversations Agent1 proposes an action to Agent2 Agent2 evaluates the proposal and sends to

Agent1: acceptance, counterproposal, disagreement or rejection

4

Agent communications - coordination Agents communicate in

order to achieve better the goals of themselves or of the society in which they exist.

MAS to maintain global coherence (behaving as a unit) without explicit global control.

Agents determine common goals and common tasks, avoid conflicts and pool knowledge and evidence.

Coordination

Cooperation Competition

Planning Negotiation

Centralized

Distributed

5

Communications - meaning Three aspects to the formal study

of communication:1. Syntax: how the symbols of

communication are structured2. Semantics: what the symbols denote3. Pragmatics: how the symbols are

interpreted Meaning is a combination of

semantics and pragmatics.

6

Message types Communication could be active, passive or

both (agent is master, slave or peer) Two message types: assertions and queries. All agents accept information by means of

assertions. Passive agent: accepts queries, sends replies Active agent: issue queries, make assertions Peer agent: all of the above.

7

Communication levels Communication protocols are typically

specified at several levels: Method of interconnection Syntax Meaning (semantics)

Binary, multicast, broadcast. Data structure of a protocol:

Sender, receiver(s), language, encoding and decoding functions, actions to be taken by the receiver

8

Speech acts Speech act theory used for analyzing

human communication Aspects of speech act theory:

Locution: physical utterance by the speaker Illocution: intended meaning Perlocution: action that result from the loction

Message contained within the protocol maybe ambiguous or require decomposition, however, the communication protocol itself should clearly identify the type of message.

9

Knowledge Query and Manipulation Language (KQML) KQML is a protocol for

exchanging information and knowledge.

The semantics of the communications protocol must be domain independent, while the semantics of the enclosed message may depend on the domain.

KQML performatives: evaluate, ask-one, ask-all, reply, sorry, cancel, ready, advertise, broadcast, etc.

Example:(tell:sender Agent1:receiver Agent2:language KIF :ontology Blocks-World:content (AND (BLOCK A)

(BLOCK B) (On A B))

Languages: KIF (Knowledge Interchange Format), Prolog, Lisp, etc.

An ontology is a specification of objects, concepts and relationships in an area of interest.

10

Interaction protocols - coordination DAI involves distributed control and distributed

data. Agents have a degree of autonomy in generating

new actions and deciding which goal to pursue next.

Knowledge of the system's overall state is dispersed throughout the system.

Coordination activities on a search problem may be represented as:

defining goal graph, assigning regions of the graph to appropriate agents decisions about which areas of the graph to explore traversing the graph ensuring that successful traversal is reported.

11

• Coordination is a mechanism for ensuring that agents’ activities retain some desired relationship/s (sequence, complementarity, etc.).

• Control is the extent to which coordination information must be elaborated by each agent.

• The range of control is from none to total. Control is inversely related to autonomy: no control corresponds to total autonomy, and being totally controlled corresponds to zero autonomy.

Coordination

12

Agents which have some degree of autonomy can cooperate with other such agents on tasks and activities, for their own or mutual benefit.

Cooperation

13

• Complete tasks quicker through shared effort

• By sharing resources, achieve tasks otherwise not possible

• Make use of complementary capabilities

• Avoid harmful interactions

Advantages of Cooperation

14

• accidental: not intended

• unilaterally intended: one agent intentionally helps another

• mutual cooperation: two or more agents intentionally collaborate

Modes of Cooperation

15

• Fully cooperative (benevolent): Agents always attempt to assist other agents that request or need their help

• Antagonistic: Agents do not cooperate with others and may even try to block their goals

• Partly cooperative: Agents sometimes or to some extent will assist other agents

Degrees of Cooperation

16

Cooperation protocols Basic strategy is to decompose and then

distribute tasks Decomposition done by system designer or by

agents Distribution mechanisms:

Market mechanism: generalized agreements or mutual selection

Contract net: announce, bid and award cycles Multiagent planning: planning agents perform task

assignment Organizational structure: agents have fixed

responsibilities

17

Blackboard systems

Offer a support for cooperation blackboard structure for exchanging

proposals/requests control component (optional) to

match proposals and requests based on Knowledge bases (KS’s) that

are application-dependent

18

Blackboard systems Independence of

expertise (knowledge sources)

Common interaction language

Event-based activation

Need for control

…..…..

Blackboard

…..…..

LibraryOf

KSs

ExecutingActivated

KS

Controlcomponents

PendingKS

Activations

Events

19

The process of improving agreement (reducing inconsistency and uncertainty) on common viewpoints or plans through the structured exchange of relevant knowledge

Negotiation (Def 1)

20

Negotiation (Def 2)

Negotiation is a process involving at least two parties aimed at reaching an agreement that is acceptable by the parties involved

21

Negotiation (Def 3)

Occurs when agents with different goals want to reach a joint decision

Negotiation mechanism ideally: Efficiency Stability Simplicity Distribution

22

• Prior to negotiation: an agent has identified a resource or service it requires but cannot supply: then, it needs to identify an agent/s which it believes potentially could.

23

Negotiation

Negotiation protocol is a set of rules which govern the interactions of participants

Negotiation Strategy is a decision making model, which participants employ in order to achieve their goal in line with a negotiation protocol

24

• bargaining (promising something in exchange for something else),

• bidding (offering a service or capability at a specific ‘price’),

• contracting (committing to provide a service or capability at a specific ‘price’) may be part of the negotiation process.

Elements of Negotiation

25

• Agent contacts other agent(s) to offer or request resource or service (often under specified conditions)

• other agent/s identify what can be supplied under what conditions

• initiating agent/s accepts conditions

• supplying agent/s commit to provide resource or service.

Negotiation Process

26

• In single-stage negotiation, initiating agent makes a request and the respondent accepts or rejects this.

• In multi-stage negotiation, agents iterate through more than one stage of offer/counter-offer.

• Negotiation protocols: a structured procedure for one or more stages of the negotiation process.

Forms of Negotiation

27

Basic Negotiation Techniques

Game theoretic Negotiation process seen as a game

where agents are players and make moves

Heuristic Agents make proposals and modify their

proposals if not accepted according to heuristic strategies

Argumentation based Agents try to convince others to accept

their proposals by logical arguments

28

Classification of negotiation protocols

Number of participants - 1-1, 1-N (Auction), N-M (Market)

Existence of third party - direct, mediated negotiation

Degree of automation - semi, fully automated

29

Agents coordinate their activities through contracts to accomplish specific goals.

1. An agent acting as a manager decomposes its contract (the task or problem it was assigned with) into subcontracts to be accomplished by other potential contractor agents.

2. For each subcontract, the manager announces a task to the network of agents.

Contract Net Protocol

30

3. Agents receive and evaluate the announcement.

4. Agents with appropriate resources, expertise, and information reply to the manager with bids that indicate their ability to achieve the announced task.

Contract Net Protocol (cont’d)

31

5. The manager evaluates the bids received and awards the task to the most suitable agent, called the contractor.

6. Finally, manager and contractor exchange information together during the accomplishment of the task

Contract Net Protocol (cont’d)

32

Contract Net Protocol Advantages:

dynamic task allocation via self-bidding

agents can be introduced and removed dynamically

it provides natural load-balancing (as busy agents need not bid)

33

Contract Net Protocol Disadvantages:

contract net protocol does not detect or resolve conflicts

the agents in the contract net are considered helpful and non-antagonistic (which in real-world scenarios is not realistic)

it is rather communication-intensive, the costs of which can be quite high

34

Basic contract net model does not consider interacting tasks

• e.g., two agents each need all of an available resource;

• e.g., several agents all need a resource or another agent’s help at or about the same time

Interacting tasks

35

1. Agents negotiate directly on resolving problem.

2. A mediator coordinates the interaction to reduce or eliminate the conflict, or negotiates with agents on resolving it.

3. The agents not only plan how to accomplish their tasks/goals but communicate these to others and negotiate potential conflicts, modifying plans accordingly.

Possible Approaches to Interacting tasks

36

Multi Agent Planning

Multi-agent planning emphasizes certain avoidance of inconsistent and conflicting situations, which is critical in applications such as air-traffic control

By forming a multi-agent plan, the nodes determine all of their actions and interactions beforehand, leaving nothing to chance

Two types of multi-agent planning centralizedcentralized distributeddistributed

37

Centralized Multi Agent Planning (1)

Separate agents form their individual plans and then they are sent to a central coordinator, that analyses them and finds potential plan conflicts

The central coordinator can identify critical regions of plans around which agents

should synchronize insert plan steps for sending and waiting for

synchronization messages to ensure proper synchronization

the individual partial plans can then be merged into a multi-agent plans with conflicting interactions eliminated

AOSE 38

Centralized Multi Agent Planning (2)

Disadvantages of centralized planning: It is static – e.g. the agents first form their

plans and then coordinate them, hence can miss opportunities for cooperation that would have been possible had the agents built their individual plans concurrently with reasoning about what other nodes are doing

It is difficult to create a central coordinator

39

Distributed Multi Agent Planning

It allows agents to model each other's plans Agents communicate in order to build and

update their individual plans and their models of others until all conflicts are resolved

Multi Agent Planning requires that nodes share and process substantial amounts of information and hence it generally involves more computation and communication than other approaches