intelligent agents – state of the art –
DESCRIPTION
Intelligent Agents – state of the art –. Aleksander Pivk. Materials collected at: America School on Agents and Multi-agent Systems (University of Southern California). SYSTEM. output. input. ENVIRONMENT. What is an agent?. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/1.jpg)
Intelligent Agents– state of the art –
Materials collected at:
America School on Agents and Multi-agent Systems(University of Southern California)
Aleksander Pivk
![Page 2: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/2.jpg)
69th Solomon Seminar
2/58
What is an agent?
• The main point about agents is that they are autonomous: capable of acting independently, exhibiting control over their internal state.
• Thus: an agent is a computer system capable of autonomous action in some environment.
SYSTEM
ENVIRONMENT
outputinput
![Page 3: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/3.jpg)
69th Solomon Seminar
3/58
What is an agent?
• Trivial (non-interesting) agents: – thermostat
• An intelligent agent is a computer system capable of flexible autonomous action in some environment.
By flexible, we mean:– reactive;– pro-active;– social.
![Page 4: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/4.jpg)
69th Solomon Seminar
4/58
Intelligent Agents and AI
• – A little intelligence goes a long way! – • Oren Etzioni, speaking of commercial experience of
NETBOT, Inc.:
• Microsoft Office Assistant
We made our agents dumber and dumber…until finally they made some money.
![Page 5: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/5.jpg)
69th Solomon Seminar
5/58
Purely Reactive Agents
• Some agents decide what to do without reference to their history – they base their making decision entirely on the present, with no reference at all to the past.
• We call such agents purely reactive:action: S A
• A thermostat is a purely reactive agent:
action(s)= off; if s=temperature OKon; otherwise
![Page 6: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/6.jpg)
69th Solomon Seminar
6/58
Perception
• Introduce the perception system:
• The see function is the agent’s ability to observe its env., whereas the action function represents the agent’s decision making process.
• New functions:see: S P {maps environment states to percepts}
action: P* A {maps sequences of percepts to actions}
ENVIRONMENT
outputinput AGENT
see action
![Page 7: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/7.jpg)
69th Solomon Seminar
7/58
Agents with State
• Lets consider agents that maintain state:
• Have some internal data structure, used to record inf. about the env. state and history.
• Let I be the set of all internal states of the agent.• Functions:
see: S P {maps environment states to percepts}action: I A {maps from internal states to actions}next: I P I {maps an internal states and percept to
IS}
ENVIRONMENT
outputinput
AGENTsee action
next state
![Page 8: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/8.jpg)
69th Solomon Seminar
8/58
Application & Research Domains
• Learning Agents
• Embodied Agents
• Logics for Agents
• Coordination, Cooperation, Collaboration
• Market-based Multi-agent Systems
![Page 9: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/9.jpg)
69th Solomon Seminar
9/58
Learning Agents• Why should agents learn?
– Learning user and world models, action-to-utility mappings, problem solving
• Learning modalities– from users (observation, interaction, being told) – from other agents (collaborative filtering, from experts)– from experience (supervised, reinforcement, probabilistic models)
• Learning techniques– neural/decision networks, decision trees,reinforcement learning,
instance based learning
• Assistant agents (work effort, productivity)
![Page 10: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/10.jpg)
69th Solomon Seminar
10/58
Learning for Information Agents
• Information agents – Access information from a variety of data sources
– Integrate the data from these sources
– Monitor and provide notifications
• Technical challenges– Turning semi-structured data into structured data
– Ensuring continued access to the data
– Resolving naming inconsistencies across sources
– Building agents that efficiently execute their tasks
![Page 11: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/11.jpg)
69th Solomon Seminar
11/58
Agent
WorldGovernments
NATO Members
19951996
CIA World Factbook
1997
Country Information Agent
![Page 12: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/12.jpg)
69th Solomon Seminar
12/58
Learned Flight Delay Predictor
Historical FlightData
Historical WeatherData
Yahoo Weather
Prediction
Agent
Flight Delay Prediction Agent
![Page 13: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/13.jpg)
69th Solomon Seminar
13/58
New Listing: 3br 2bath200K
Send EmailNotification
Real Estate Notification Agent
![Page 14: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/14.jpg)
69th Solomon Seminar
14/58
Travel Planning Agent
![Page 15: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/15.jpg)
69th Solomon Seminar
15/58
Wrapper Induction
Problem description:• Web sources present data in human-readable format
– take user query– apply it to data base– present results in “template” HTML page
• To integrate data from multiple sources, one must first extract relevant information from Web pages
• Task: learn extraction rules based on labeled examples– Hand-writing rules is tedious, error prone, and time consuming
![Page 16: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/16.jpg)
69th Solomon Seminar
16/58
Example of Extraction Task
NAME Casablanca Restaurant
STREET 220 Lincoln Boulevard
CITY Venice
PHONE (310) 392-5751
![Page 17: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/17.jpg)
69th Solomon Seminar
17/58
WIEN [Kushmerick et al ‘97, ‘00]
• Assumes items are always in fixed, known order– … Name: J. Doe; 1 Main; 111-1111. <p> Name: E. Poe; …
• Introduces several types of wrappers
– LR:
• Advantages:– Fast to learn & extract
• Drawbacks: – Cannot handle permutations and missing items
– Must label entire page
PhoneName AddrName: ; : . ; :
![Page 18: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/18.jpg)
69th Solomon Seminar
18/58
SoftMealy [Hsu & Dung, ‘98]
• Learns a transducer
• Advantages:– Also learns order of items
– Allows item permutations & missing items
– Uses wildcards (eg, Number, AllCaps, etc)
• Drawback: – Must “see” all possible permutations
Phone
Addr
NameName:
Phone: Phone:
Addr:
;
;
;
.
![Page 19: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/19.jpg)
69th Solomon Seminar
19/58
WHIRL Wrappers [Cohen ’99]
• Learns underlying HTML template– WHIRL “soft logic” to measure document similarity
• Name: html_table_tr_td
• Address: html_table_tr_td_td
• Advantages:– Learns from unlabeled data
– Explicitly exploits HTML structure
• Disadvantage:– Not as expressive as previous ones
– Works only at the level of “HTML nodes”
![Page 20: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/20.jpg)
69th Solomon Seminar
20/58
STALKER [Muslea et al, ’98 ’99 ’01]
• Hierarchical wrapper induction– Decomposes a hard problem in several easier ones
– Extracts items independently of each other
– Each rule is a finite automaton
• Advantages:– Powerful extraction language (eg, embedded list)
– One hard-to-extract item does not affect others
• Disadvantage:– Does not exploit item order (sometimes may help)
![Page 21: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/21.jpg)
69th Solomon Seminar
21/58
Extraction Rules
Extraction rule: sequence of landmarks
Name: Joel’s <p> Phone: <i> (310) 777-1111 </i><p> Review: …
SkipTo(Phone) SkipTo(<i>) SkipTo(</i>)
![Page 22: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/22.jpg)
69th Solomon Seminar
22/58
Start: EITHER SkipTo( Phone : <i> ) OR SkipTo( Phone ) SkipTo(: <b>)
More about Extraction Rules
Name: Kim’s <p> Phone (toll free) : <b> (800) 757-1111 </b> …
Name: Joel’s <p> Phone: <i> (310) 777-1111 </i><p> Review: …
Name: Kim’s <p> Phone:<b> (888) 111-1111 </b><p>Review: …
![Page 23: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/23.jpg)
69th Solomon Seminar
23/58
InductiveLearningSystem
ExtractionRules
EC Tree
Labeled Pages
Learning the Extraction Rules
GUI
![Page 24: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/24.jpg)
69th Solomon Seminar
24/58
Training Examples: Name: Del Taco <p> Phone (toll free) : <b> ( 800 ) 123-4567 </b><p>Cuisine ...
Name: Burger King <p> Phone : ( 310 ) 987-9876 <p> Cuisine: …
Initial candidate: SkipTo( ( )
Example of Rule Induction
![Page 25: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/25.jpg)
69th Solomon Seminar
25/58
Initial candidate: SkipTo( ( )
… SkipTo(Phone) SkipTo(:) SkipTo( ( ) ...
SkipTo( <b> ( ) ... SkipTo(Phone) SkipTo( ( ) ... SkipTo(:) SkipTo(()
Training Examples: Name: Del Taco <p> Phone (toll free) : <b> ( 800 ) 123-4567 </b><p>Cuisine ...
Name: Burger King <p> Phone : ( 310 ) 987-9876 <p> Cuisine: …
Example of Rule Induction
![Page 26: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/26.jpg)
69th Solomon Seminar
26/58
Multi-view Learning
Name: KFC <p> Phone: (310) 111-1111 <p> Review: Fried chicken …
SkipTo( Phone: ) BackTo( ( Number ) )
Two ways to find start of the phone number:
![Page 27: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/27.jpg)
69th Solomon Seminar
27/58
RULE 1 RULE 2
+-
Unlabeled data
++-
-
+-
Labeled data
Co-Testing
![Page 28: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/28.jpg)
69th Solomon Seminar
28/58
Name: Joel’s <p> Phone: (310) 777-1111 <p>Review: ...
SkipTo( Phone: )
Name: Kim’s <p> Phone: (213) 757-1111 <p>Review: ...
Name: Chez Jean <p> Phone: (310) 666-1111 <p> Review: ...
Name: Burger King <p> Phone: (818) 789-1211 <p> Review: ...
Name: Café del Rey <p> Phone: (310) 111-1111 <p> Review: ...
Name: KFC <p> Phone:<b> (800) 111-7171 </b> <p> Review:...
BackTo( (Number) )
Co-Testing for Wrapper Induction
![Page 29: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/29.jpg)
Embodied Agents
![Page 30: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/30.jpg)
69th Solomon Seminar
30/58
Embodied Agents
• Animated agent research integrates:– Artistic animation– Computer graphics– Intelligent agents
• Why build animated agents?– For more effective communication– For artistic effect– As models for robotic or human agents– When behavior cannot be scripted
• e.g., due to interactions with people and other agents
• In agents, we begin to see dynamic models of thought and action
![Page 31: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/31.jpg)
69th Solomon Seminar
31/58
Animated Pedagogical Agents
• Animated characters that:– Interact with students in learning envs.– Help keep learning on track– Act as guides, tutors, teammates– Engage in instructional dialog– Enhance motivation and interest
• APA’s require:– Realistic, lifelike behavior– A rich set of cognitive and social
abilities for effective learning
![Page 32: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/32.jpg)
69th Solomon Seminar
32/58
Steve: An Embodied Intelligent Agent for Virtual Environments
• J. Rickel, L. Johnson, M. Thiebaux, et al.
• 3D agent that interacts with students in virtual environments
• Can work together with multiple students and multiple users
![Page 33: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/33.jpg)
69th Solomon Seminar
33/58
Steve’s Architecture (detailed)
Cognition
MotorControl
Perception
General capabilities
Domain knowledge
Event notifications
Current state
Motor commands
Virtual Environment
Monitor events
Filter, assembleinto coherent view
Translate into movements, speech
Broadcast to environment
Commands to environment
Steve
![Page 34: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/34.jpg)
69th Solomon Seminar
34/58
Mission Rehearsal Exercise
![Page 35: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/35.jpg)
69th Solomon Seminar
35/58
Co. & Co. & Co.
As a process As an outcomeCoordinati
on
Decisionmaking takes others into account
Individuals are notthwarted by others
Cooperation Individual decisionsfurther the collective welfare
Individuals appear to be“working together”
Collaboration
Individuals worktoward shared goals
Common goalsachieved well and/orefficiently
![Page 36: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/36.jpg)
69th Solomon Seminar
36/58
Example: Hidden Pictures
• Simple (visual) search task
• How would YOU work as a part of a team to solve it ?
![Page 37: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/37.jpg)
69th Solomon Seminar
37/58
Market-based MAS
• Marketspace: class of agent interaction env.• What you need to know:
– Economic foundations and principles:• Game theory• Price system (general equlibrium)• Auction theory
– Design issues and experience• Market models and mechanisms• Trading Agents
![Page 38: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/38.jpg)
69th Solomon Seminar
38/58
Business games
• http://www.cmu.edu/comlabgames-----------------------------------------------------------At the comlabgames website, www.cmu.edu/comlabgames, there are three modules for designing, playing and analyzing the experimental outcomes of games: two person strategic form games, multi-person extensive form games, and auctions and markets. The original comlabgames website is visited on average 50,000 of time each week, and is linked to hundreds of other sites. UCLA mirrors the original site. Comlabgames is very easy to use, and the students just bring their laptops to class, design the games, run them and then analyze the data.
• Vesna Prasnikar, Marko Grobelnik
![Page 39: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/39.jpg)
69th Solomon Seminar
39/58
Logics for Agents
• Symbolic Reasoning– an agent contains an explicitly represented, symbolic
model of the world– makes decisions (action to take) via symbolic reasoning– problems:
• transduction: how to translate the real world in accurate, adequate symbolic description (speech understanding)
• representation/reasoning: how to symbolically represent inf., and how to get agents to reason with this inf. (planning)
– Theorem Proving Agents: agent decides what to do by using logic to encode the theory stating the best action in any situation (predicates + rules)
– Agent oriented programming: AGENT0 and PLACA
![Page 40: Intelligent Agents – state of the art –](https://reader034.vdocuments.site/reader034/viewer/2022051215/56814626550346895db3330f/html5/thumbnails/40.jpg)
69th Solomon Seminar
40/58
Logics for Agents
• Practical Reasoning (BDI Logic)– is a matter of weighting conflicting considerations for and
against competing options, where the relevant considerations are provided by the agent desires/values about and what the agent believes (Bratman).
– directed towards actions (theoretical towards belief)
– consists of two activities:• deliberation: deciding what state of affairs we want to achieve
• means-end reasoning: deciding how to achieve them
– implemented BDI agents: IRMA, PRS, Desiderata, LORA