lecture 3 models - the shanghai lectures€¦ · lecture 3 embodiment: concept and models fabio...

51

Upload: others

Post on 16-May-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s
Page 2: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Lecture 3 Embodiment: Concept and

Models

Fabio BonsignorioThe BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots

Page 3: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Today’s topics

• short recap• The classical approach: Cognition as

computation• Successes and failures of the classical

approach• Some problems of the classical approach• The need for an embodied approach

�3

Page 4: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Today’s topics

• short recap• The classical approach: Cognition as

computation• Successes and failures of the classical

approach• Some problems of the classical approach• The need for an embodied approach

�4

Page 5: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Today’s topics

• short recap• The classical approach: Cognition as

computation• Successes and failures of the classical

approach• Some problems of the classical approach• The need for an embodied approach

�5

Page 6: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

“Birth” of AI, 1956

�6

Herbert Simon and Allen NewellThe “Logic Theorist”

Noam Chomsky, Linguist

“Syntactic Structures”

George A. Miller, Psychologist“The Magical Number Seven Plus or Minus Two”

John McCarthy, Computer ScientistInitiator of Artificial Intelligence

Page 7: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Turing Machine (1)

�7

Page 8: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Turing Machine (2)

�8

input from tape 1 2 state of

read/write head

_ _R2 HALT

A AL1 BR2

B BL1 AR2

C CL1 CR2

write on tapenext state of r/w

headmove tape L/R

Page 9: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

�9

input from tape 1 2 state of

read/write head

_ _R2 HALT

A AL1 BR2

B BL1 AR2

C CL1 CR2

write on tapenext state of r/w

headmove tape L/R

initial situation: state r/w head = 1initial content of tape:

r/w head initial pos.. . . A A B A A C C C C A B A C C C C B B A B . . .

Page 10: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

�10

input from tape 1 2 state of

read/write head

_ _R2 HALT

A AL1 BR2

B BL1 AR2

C CL1 CR2

write on tapenext state of r/w

headmove tape L/R

initial situation: state r/w head = 1initial content of tape:

r/w head initial pos.. . A A B A A C C C C A B A C C C C B B A B . . .Turing

Machine (4)

The Universal Turing

Machine

Page 11: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Turing Machine (5)

�11

Cartoon by Roger Penrose

an “embodied” Turing Machine

Page 12: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Functionalism and the “Physical Symbol Systems

�12

biological

electronic

mechanicalSwiss cheeseHilary Putnam(AmericanPhilosopher)

Page 13: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Functionalism and the “Physical Symbol Systems

Model/Representation:

�13

Page 14: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

GOFAI

GOFAI

�14

Page 15: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Classical AI: Research areas

• problem solving• knowledge representation and reasoning• acting logically• uncertain knowledge and reasoning• learning and memory• communicating, perceiving and acting• (adapted from Russell/Norvig: Artificial intelligence, a modern

approach)

�15

Page 16: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Today’s topics

• short recap• The classical approach: Cognition as

computation• Successes and failures of the classical

approach• Some problems of the classical approach• The need for an embodied approach

�16

Page 17: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Classical AI: Successes

• search engines• formal games (chess!)• text processing systems/translation —> next

week• data mining systems• restricted natural language systems• appliances

�17

Indistinguishable from computer

applications in general

Page 18: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Chess: New York, 1997

�18

1 win 2 wins3 draws

Page 19: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Classical AI: Failures

• recognizing a face in the crowd• vision/perception in the real world• common sense• movement, manipulation of objects• walking, running, swimming, flying• speech (everyday natural language)

�19

in general:more natural forms of intelligence

Page 20: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Why is perception hard?

�20

Page 21: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Today’s topics

• short recap• The classical approach: Cognition as

computation• Successes and failures of the classical

approach• Some problems of the classical approach• The need for an embodied approach

�21

Page 22: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Fundamental problems of the classical approach

�22

real worldvirtual, formal world

Monika Seps, chess masterformer master student AI Lab, Zurich

in general: anything to do with real world interaction

fundamental differences: real — virtual

Page 23: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Fundamental problems of the classical approach

�23

real worldvirtual, formal world

in general: anything to do with real world interaction

fundamental differences: real — virtual

Page 24: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Differences real vs. virtual worlds

�24

Page 25: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Successes and failures of the classical approach

�25

successesapplications (e.g. Google)chessmanufacturing(applications:“controlled”artificial worlds)

failuresfoundations of behaviornatural forms of intelligenceinteraction with real world

Page 26: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Industrial environments vs.

industrial environmentsenvironment well-knownlittle uncertaintypredictability(“controlled”artificial worlds)

real world environmentlimited knowledge and predictabilityrapidly changinghigh-level of uncertainty

�26

Page 27: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Industrial robots vs. natural systems

�27

principles:- strong, precise, fast motors- centralized control- computing power- optimization

Industrial robots

Page 28: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Industrial robots vs. natural systems

�28

principles:- low precision- compliant- reactive- coping with uncertainty

humans

no direct transfer of methods

Page 29: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Fundamental problems of classical approach

• “symbol grounding problem”• “frame problem”• “homunculus problem”

�29

Page 30: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

The “symbol grounding” problem

real world:doesn’t come with labels ...

�30

Gary Larson

Page 31: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

The “frame problem” Maintaining model of real

• the more detailedthe harder

• information acquisition

• most changes:irrelevant to currentsituation

�31

Page 32: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Today’s topics

• short recap• The classical approach: Cognition as

computation• Successes and failures of the classical

approach• Some problems of the classical approach• The need for an embodied approach

�32

Page 33: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

�33

Two views of intelligence

classical: cognition as computation

embodiment: cognition emergent from sensory-motor and interaction processes

Page 34: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

The need for an embodied perspective

�34

• “failures” of classical AI• fundamental problems of classical

approach• Wolpert’s quote:

Page 35: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

The need for an embodied perspective

�35

“Why do plants not have brains?”

Page 36: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

The need for an embodied perspective

�36

“Why do plants not have brains? The answer is actually quite simple — they don’t have to move.” Lewis Wolpert, UCL

evolutionary perspective on development of intelligence/cognition

Page 37: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

The need for an embodied perspective

�37

• “failures” of classical AI• fundamental problems of classical

approach• Wolpert’s quote: Why do plants not …?• Interaction with environment: always

mediated by body

Page 38: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Today’s topics

• short recap• The classical approach: Cognition as

computation• Successes and failures of the classical

approach• Some problems of the classical approach• The need for an embodied approach

�38

Page 39: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

The “frame-of-reference” problem — introduction

�39

Video “Heider and Simmel”

Page 40: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

The “frame-of-reference” problem — introduction

�40

Video “Heider and Simmel”

Page 41: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

“Frame-of-reference” Simon’s ant on the beach

�41

Page 42: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

“Frame-of-reference” Simon’s ant on the beach

�42

food

nest

Page 43: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

“Frame-of-reference” Simon’s ant on the beach

• simple behavioral rules• complexity in interaction,

not — necessarily — in brain

• thought experiment:increase body by factor of 1000

�43

Page 44: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

“Frame-of-reference” Simon’s ant on the beach

�44

food

nest

new path?

Page 45: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

“Frame-of-reference” F-O-R

• perspectives issue• behavior vs. mechanism issue• complexity issue

�45

Page 46: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

“Frame-of-reference” F-O-R

• perspectives issue• behavior vs. mechanism issue• complexity issue

�46

Page 47: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Intelligence:

Hard to agree on definitions, arguments

• necessary and sufficient conditions?• are robots, ants, humans intelligent?

more productive question:“Given a behavior of interest, how to implement it?”

�47

Page 48: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Communication through interaction with

• exploitation of interaction with environment

simpler neural circuits

�48

angle sensors in joints

“parallel, loosely coupled

processes”

Page 49: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Emergence of behavior: the quadruped “Puppy”

�49

• simple control (oscillations of “hip” joints)

• spring-like material properties (“under-actuated” system)

• self-stabilization, no sensors• “outsourcing” of functionality

morphological computation

actuated:oscillation

springs

passive

Page 50: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Implications of embodiment

�50

Pfeifer et al.,Science,16 Nov. 2007

“Puppy”, But Also Cruse’s Ants!!!

Page 51: Lecture 3 Models - The ShanghAI Lectures€¦ · Lecture 3 Embodiment: Concept and Models Fabio Bonsignorio The BioRobotics Institute, SSSA, Pisa, Italy and Heron Robots. Today’s

Implications of embodiment

�51

Pfeifer et al.,Science,16 Nov. 2007

“Puppy”which part of diagram is relevant? —>