mycopter: enabling technologies for personal aerial ... · pdf filemycopter: enabling...

24
myCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir. Joost Venrooij Max Planck Institute for Biological Cybernetics Department: Human Perception, Cognition and Action Max-Planck-Institut für biologische Kybernetik

Upload: trinhngoc

Post on 11-Mar-2018

219 views

Category:

Documents


5 download

TRANSCRIPT

Page 1: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

myCopter: Enabling Technologies for

Personal Aerial Transportation Systems

Prof. Dr. Heinrich H. Bülthoff

Dr. ir. Joost Venrooij

Max Planck Institute for Biological Cybernetics

Department: Human Perception, Cognition and ActionMax-Planck-Institut

für biologische Kybernetik

Page 2: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Technology exists to build

aircraft for individual transport

• many concepts have already

been developed

Drawbacks of current designs

• Need for of a pilot license

• Need for infrastructure (e.g.,

landing strip)

• Focus on vehicle design

instead of transport system

The dream of Personal Aerial Vehicles

PAL-V Europe N.V.PAL-V

E-volo GmbHVolocopter

TerrafugiaTransition

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 2

Page 3: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Motivation for Personal Aviation

100 Billion Euro is lost yearly

in the EU due to congestion

“Green Paper ̶ Towards a new culture of urban mobility,” Sept. 2007,

Commission of the European Countries, Brussels.

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 3

Page 4: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Motivation for Personal Aviation

20x more fuel is wasted in the

USA in traffic jams than is used by the

“2009 Urban Mobility Report,” The Texas A&M University System, 2009

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 4

entire General Aviation fleet

Page 5: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Motivation for Personal Aviation

In large European cities, car drivers

spend more than 50 hours

per year in traffic jams

“Roadmap to a Single European Transport Area,” 2011

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 5

Page 6: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Challenges for Personal Aviation

“Designing the air vehicle is only a relative

small part of overcoming the challenges… The

other challenges remain…” [EC, 2007]

• How many?

• Who can fly?

• What about safety, noise, … ?

• How are PAVs integrated into

existing transport systems?

European Commission, Out of the box ̶ Ideas about

the future of air transport, 2007

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 6

Page 7: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

EU-project: myCopter

• Duration: Jan 2011 – Dec 2014

• Project cost: €4,287,529

• Project funding: € 3,424,534

Max-Planck-Institut

für biologische Kybernetik

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 7

Page 8: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Enabling Technologies for Personal Aviation

Piloting PAVs

• Shared control

between

human and

automation

• Situational

awareness

Human-machine

interfaces

• Control

interfaces and

displays

• Multi-sensory

feedback

Automation

(vision-based)

• Navigation

• Landing place

assessment

• Sensor-fusion

for collision

avoidance

Exploring the

socio-

technological

environment

• Acceptance:

noise, safety,

fuel, cars in the

sky

• Integration into

current

transport

systems10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 8

Page 9: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Novel Approaches to Automation

Goal: Develop robust novel algorithms

for vision-based control and navigation

Challenges

• Emulate VFR pilots

• Recognize obstacles and other traffic

• Recognize landing areas

• In all season and in adverse weather conditions

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 9

Page 10: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Framework for Vision-Based Navigation

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 10

Page 11: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Collision Avoidance Strategies

50 vehicles at the same altitude fly from a point on

a circle to a point on the opposite side

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 11

Page 12: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Demonstration of Swarm Technology

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 12

Page 13: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Piloting PAVs

Goal: Develop augmentation for PAVs

Challenges

• Flying a helicopter is difficult and requires

lots of training

• It is not clear which skills prospective pilots

should have

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 13

Page 14: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Augmented PAV Dynamics

Develop and assess new response types for VTOL vehicles

……

Basic helicopter rate control with cyclic

Attitude control (pitch and roll)

Translation control (forward/lateral velocity)

Turn coordination, heave augmentation

Car-like steering

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 14

Page 15: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Human-Machine Interfaces

Goal: Develop human-machine interfaces that

make flying as easy as driving a car

Challenges

• Current flight controls and displays are not

intuitive

• Multisensory perception is not taken into account

• No reliable objective measurements of pilot

workload

Max-Planck-Institut

für biologische Kybernetik

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 15

Page 16: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Intuitive Displays and Controls

• Highway-in-the-Sky display

• Active sidestick to feel the highway

(spring-like guidance forces)

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 16

Page 17: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Multi-sensory Human-Machine Interfaces

Novel HMI: haptic shared control

• Combining the advantages of

manual and automatic control

• The pilot remains in control and

can overrule the automatic control

system

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 17

Page 18: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Objective Measures for Workload using EEG

Novel mental workload measures

Traditionally with questionnaires,

such as NASA-TLX

Alternative: psychophysiological

measures, EEG, heart-rate

variability, skin conductance

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 18

Page 19: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Human-Machine Interfaces

Exchange helicopter flight controls with a steering

wheel and pedals

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 19

Page 20: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

HMI Demonstration in DLR Simulator

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 20

Page 21: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

The Socio-Technological Environment

Goal: Generate knowledge on the demands

and preferences of society towards PAVs

Challenges

• Identifying hurdles for introducing PAVs

• User expectations and objections

• Investigating where PAVs could have an impact

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 21

Page 22: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

How do people see Personal Air Transport?

Focus group interviews in 3 European countries

to determine user perceptions and expectations

1. Discussion on mobility patterns and behaviour as well as perceived

promises and actual expectations on PAV / PATS

2. Demonstration of a PAV ride in a simulator

3. Discussion on PAV‐specific aspects such as design, operational

environment, autonomy, usability, etc.

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 22

Page 23: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

Where do we go from here?

Developing PAV handling with MPI’s high fidelity motion simulator

CableRobot Simulator: https://youtu.be/cJCsomGwdk0

10/13/2015 Max Planck Institute for Biological Cybernetics | Department: Human Perception, Cognition and Action 23

Page 24: myCopter: Enabling Technologies for Personal Aerial ... · PDF filemyCopter: Enabling Technologies for Personal Aerial Transportation Systems Prof. Dr. Heinrich H. Bülthoff Dr. ir

myCopter: Enabling Technologies for

Personal Aerial Transportation Systems

Max Planck Institute for Biological Cybernetics

Department: Human Perception, Cognition and Action

Prof. Dr. Heinrich H. Bü[email protected]

Dr. ir. Joost [email protected]