6th Framework Programme - Priority 2“Information Society Technologies”FP6/2003/IST/2

Joint Action Science and TechnologyJAST - FP6-003747

Joint-Action

Science and TechnologyScience and TechnologyJAST

Overview

1. Goals

2. Means

3. Co-ordinator

4. Organization

5. Activities

6. Website

7. Delegation

Joint-Action

Science and TechnologyScience and Technology

1. Goals

• Cognitive Systems– JAST will extend cognitive science beyond the domain of studying

individual cognitive systems

• Ultimate goal of JAST– To build jointly-acting autonomous systems that communicate and work

intelligently on non-trivial mutual tasks

• Primary goal– Understanding the cognitive architecture of collaborating cognitive

systems

2a. Means: ConsortiumPartners

1. Radboud Universiteit Nijmegen- Nijmegen Institute for Cognition and Information - FC Donders Centre for Cognitive NeuroimagingThe Netherlands – NICI + FCDC

2. Max Planck Institute for Biological Cybernetics, TübingenGermany – MPIT

3. Institute of Communication and Computer Systems, AthensGreece – ICCS

4. The University of EdinburghUnited Kingdom – UEDIN

5. Max Planck Institute for Psycholinguistics NijmegenThe Netherlands – MPIN

6. Technische Universität MünchenGermany – TUM

7. Universidade do MinhoPortugal – UMP

2b. Multidisciplinary team

Partners Disciplines1. NICI Neurocognitive scientists

2. FCDC id.

3. MPIT Cognitive scientists

4. ICCS Neuroscientists

5. UEDIN Psycholinguists

6. MPIN id.

7. TUM Robotocists

8. UMP id.

2c. Means: Common Scenario

Arbitrary initial object layout

Resulting objects after completion of multimodal dialogue sequence

Joint-Action

Science and TechnologyScience and Technology

2d. JAST Construction Task

Joint-Action

Science and TechnologyScience and Technology

(video)

2e: State-of-the-art starting conditions: Demonstrator-Hardware

– Two directly cooperating arms.A third arm may be used for holding aggregates

– Assembly without any fixtures orspecialised tools

– A rich set of action primitives(motor, sensor, sensorimotor) hasbeen implemented for positioning,grasping, assembling, disassembling,goal-directed motion under collisionavoidance, etc.

– Robust recognition and manipulationof parts in all positions

– 3 Robots, 10 colour cameras (partlyarticulated)

2f. Beyond state-of-the-art goalsSystem to be developed:

• real-time, adaptive planning

• dialogue-supported perception, reasoning, action

• cross-modal associations

• model of action-dynamics

• rule- and self-organization based learning

• monitoring and repairing errors by self/other

• multiple degrees-of-freedom in perception-action

3a. Co-ordinatorhttp://www.nici.kun.nl/People/BekkeringH/index.html

3b. Managerhttp://www.nici.kun.nl/People/MeulenbroekRGJ/index.html

4. Work-Packages

5. Activities

• Two-day Opening Conference– Athens, Greece– February, 2005– Dates: to be announced

• R&D activities in WP 2-3-4-5– See excerpt JAST

(http://bscw.socsci.kun.nl/pub/bscw.cgi/0/1706107)

6. JAST Website http://212.205.85.69/jast/index.htm

7. Delegation

Members of JAST attending the CogSys Kick-Off Meeting