Joint Action Science and Technology JAST - FP6-003747

1
Joint Action Science and TechnologyJAST -
FP6-003747

JAST
2
Overview

1. Goals
2. Means
3. Co-ordinator
4. Organization
5. Activities
6. Website
7. Delegation

3
1. Goals

• Cognitive Systems
• JAST will extend cognitive science beyond the
  domain of studying individual cognitive systems
• Ultimate goal of JAST
• To build jointly-acting autonomous systems that
  communicate and work intelligently on non-trivial
  mutual tasks
• Primary goal
• Understanding the cognitive architecture of
  collaborating cognitive systems

4
2a. Means Consortium

• Partners
• Radboud Universiteit Nijmegen- Nijmegen
  Institute for Cognition and Information - FC
  Donders Centre for Cognitive NeuroimagingThe
  Netherlands NICI FCDC
• Max Planck Institute for Biological Cybernetics,
  TübingenGermany MPIT
• Institute of Communication and Computer Systems,
  AthensGreece ICCS
• The University of EdinburghUnited Kingdom
  UEDIN
• Max Planck Institute for Psycholinguistics
  NijmegenThe Netherlands MPIN
• Technische Universität MünchenGermany TUM
• Universidade do MinhoPortugal UMP

5
2b. Multidisciplinary team

• Partners Disciplines
• NICI Neurocognitive scientists
• FCDC id.
• MPIT Cognitive scientists
• ICCS Neuroscientists
• UEDIN Psycholinguists
• MPIN id.
• TUM Robotocists
• UMP id.

6
2c. Means Common Scenario
Arbitrary initial object layout
Resulting objects after completion of multimodal
dialogue sequence
7
2d. JAST Construction Task
(video)
8
2e State-of-the-art starting conditions
Demonstrator-Hardware

• Two directly cooperating arms.A third arm may be
  used for holding aggregates
• Assembly without any fixtures orspecialised
  tools
• A rich set of action primitives(motor, sensor,
  sensorimotor) hasbeen implemented for
  positioning,grasping, assembling,
  disassembling,goal-directed motion under
  collisionavoidance, etc.
• Robust recognition and manipulationof parts in
  all positions
• 3 Robots, 10 colour cameras (partlyarticulated)

9
2f. Beyond state-of-the-art goalsSystem to be
developed

• multiple degrees-of-freedom
• in perception-action

• model of action-dynamics
• rule- and self-organization based learning
• monitoring and repairing errors by self/other

• real-time, adaptive planning
• dialogue-supported perception, reasoning,
  action
• cross-modal associations

10
3a. Co-ordinatorhttp//www.nici.kun.nl/People/Bek
keringH/index.html
11
3b. Managerhttp//www.nici.kun.nl/People/Meulenbr
oekRGJ/index.html
12
4. Work-Packages
13
5. Activities

• Two-day Opening Conference
• Athens, Greece
• February, 2005
• Dates to be announced
• RD activities in WP 2-3-4-5
• See excerpt JAST (http//bscw.socsci.kun.nl/pub/bs
  cw.cgi/0/1706107)

14
6. JAST Website http//212.205.85.69/jast/index.ht
m
15
7. Delegation
Members of JAST attending the CogSys Kick-Off
Meeting