an agent approach to data sharing in virtual worlds and cad filean agent approach to data sharing in...

23
An Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of Design Computing and Cognition, University of Sydney

Upload: others

Post on 30-Aug-2019

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

An Agent Approach to Data Sharing in Virtual Worlds and CAD

Mary Lou Maher, Pak-San Liew, John S GeroKey Centre of Design Computing and Cognition, University of Sydney

Page 2: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Collaborative Virtual Worlds

Page 3: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Object-Based Virtual Worlds

Page 4: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

?environmentpercepts

actions

sensors

effectors

agent

Autonomous Agents

Page 5: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

What the worldis like now

Condition-action rules What action Ishould do now

AgentSensors

Effectors

Environment

Rational Agents

Page 6: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Virtual World Agent Model

Perception

Conception

Hypothesizer

Action

Sensors

Effectors

The World

Page 7: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Agents as a Production System

Facts

Perception

Conception

Hypothesizer

Action

Controller

Sensors

Effectors

Page 8: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

ObjectDatabase

(EDM)

CAD #1

CAD #2

SPF

SPF

Application #1

Application #2

Interface

Virtual World(Active World)

SPF: STEP Physical File

Society of Agents

: Building Monitor

data

data

Agents to Support Data Sharing

Page 9: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

ObjectDatabase

(EDM)

CAD #1

CAD #2

SPF

SPF

Application X

Virtual World(Active World)

DBSensor

Facade

DBEffector

VR Sensor VR Effector

WorkingMemory

SemanticMemory

ProceduralMemory

Interface Agent

actiondatapull

datapush

actio

nda

tapu

llda

tapu

sh

AX Sensor AX Effector

DB Sensor DB Effector

Facade

Working MemoryProcedural Memory

Semantic Memory

Interface Agent X

SPF: STEP Physical File

Page 10: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

ObjectDatabase

(EDM)

Virtual World(Active World)

Facade

DBEffector

VR Perceptor

VR Effector

WorkingMemory

SemanticMemory

ProceduralMemory

Interface Agent

VR Sensor

MemorySystem

Conceptor

DBSensor

DBPerceptor

data pull

data push

action

data path

Page 11: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

ObjectDatabase

(EDM)

Virtual World(Active World)

Facade

DBEffector

VR Effector

AgentRepresentation

OfModel

InterfaceAgent VR Sensor

DBSensor

Controller

Perception

Conception

Hypothesizer

Action

CAD System #1

STEP Physical File

…CAD System #2

STEP Physical File

Reasoning Component

Page 12: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

ObjectDatabase

(EDM)

Virtual World(Active World)

Facade

DBEffector

VR Effector

AgentRepresentation

OfModel

InterfaceAgent VR Sensor

DBSensor

Controller

Perception

Conception

Hypothesizer

Action

CAD System #1

STEP Physical File

…CAD System #2

STEP Physical File

Reasoning Component

ObjectAgentDB

EffectorVR Effector

VR Sensor

Page 13: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Walls as defined in ArchiCAD

Walls for collaborative design in Active Worlds

Example: Agents for informationFlows between ArchiCAD and Active Worlds

Page 14: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Roles of Walls Agent: An Example of an Interface Agent

Maintains consistency of geometrical data between EDM database and AW.Controls two reversible processes of information flow.Creates wall agents.

Page 15: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Roles of Wall Agents: An Example of an Object Agent

Assist walls agent to complete the information flow from EDM database to AW.Build wall objects in AW.Provide intelligent reasoning to the wall objects in AW.

Page 16: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Walls Agent Controls Info Flows

From EDM database: senses a wall assembly of four separated walls.To AW: create four wall agents and passes the EDM wall sense data to the wall agents.

Walls Agent Virtual WorldWall Agent

Society of Agents

Object Database Wall AgentWall AgentWall Agent

Page 17: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Wall Agents Assist Info Flows

From walls agent: each wall agent receives the EDM sense data of a specific wall.To AW: each wall agent creates a wall object based on the EDM sense data.In AW: each wall agent provide a kind of intelligent agency to the wall it builds.

Walls Agent Virtual WorldWall Agent

Society of Agents

Object Database

Page 18: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Walls Agent Controls Info Flows

From AW: senses the changes of the wall objects built by the wall agents, during design collaborations.To EDM database: update the EDM database to reflect the above changes.

Walls Agent Virtual World

Society of Agents

Object Database

Page 19: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Walls Agent and Wall Agents

Hierarchical: walls agent creates wall agents.Walls agent communicates with both EDM database and AW.Wall agents focus on supporting intelligent agencies in AW. Any communication with EDM database is through walls agent.

Page 20: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Behaviours of Walls Agent

Maintain consistency of geometrical data between EDM database and AW.Allows querying on non-geometrical information (regarding the whole wall assembly) specified in EDM database from AW.

Page 21: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Behaviours of Wall Agents

Allow querying on non-geometrical information (regarding one specific wall each of the wall agent represents) specified in EDM database from AW.Reflexive and reflective behaviours during design collaborations: justify issues like fire rating, acoustics, disability control and etc.

Page 22: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Summary

Object-based Virtual Worlds support synchronous collaborative designRational agents provide autonomous and proactive data sharing capability between Virtual World platform and CADRational agents support modifications during a collaborative design session

Page 23: An Agent Approach to Data Sharing in Virtual Worlds and CAD fileAn Agent Approach to Data Sharing in Virtual Worlds and CAD Mary Lou Maher, Pak-San Liew, John S Gero Key Centre of

Acknowledgements

Coauthors: Pak-San Liew, John S GeroNing Gu for development of wall agent behavioursGreg Smith for development of agent package for Active WorldsFunded by the CRC for Construction Innovation in Australia