retina: resilient synthetic vision for advanced control

Founding Members

SaraBagassi

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision

Madrid9March2017

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 2

RETINAconcept

RETINA (Resilient Synthetic Vision for Advanced Control Tower Air NavigationService Provision) is the concept of enhancing human sight capabilities andsituation awareness in the control tower by means of synthetic vision.

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 3

RETINAconcept

In the RETINA concept, controllers will be no longer limited by whatthe human eye can physically see out of the tower windows.

As trust in digital data will continue to grow, RETINA’s concept willallow the controller to have a head-up view of the airport traffic evenin low visibility conditions similar to the synthetic vision currentlyused in the cockpit.

RETINA will build upon the technologies developed in SESAR, such asremote tower, safety nets, SWIM, to provide augmented reality toolsfor the tower controller.

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 4

OutoftheTower ViewOverlay

RETINAconcept

RETINAconcept

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 5

OutoftheTower ViewOverlay

RETINAconcept

RETINAconcept

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 6

RETINAconcept

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 7

RETINAandautomation:ahumanfactorsperspective

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 8

SRKTaxonomy

Skill

• HighAutomatedprocessesinvolvinglongtermmemory(procedural)

• LowExecutivecontrol(i.e.lowattentionandworkingmemory)

• NoDecision-making(resolutionofconflictsanderrordetection)

• NoProblemsolving

Rule

• Lessautomatedprocessesandlongtermmemory(procedural)thanSkilllevel

• Moreexecutivecontrol(i.e.moreattentionandworkingmemory)thanSkilllevel

• NoDecision-making(resolutionofconflictsanderrordetection)

• NoProblemsolving

Knowledge

• Noautomatedprocessesandlongterm(procedural)memory

• Executivecontrol(highattentionandworkingmemory)

• Decision-making(resolutionofconflictsanderrordetection)

• Problemsolving

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 9

SRKTaxonomy

EID

•Expose/moverelevantinformationontotheoutsideofthewindowview•Makeconstraintsvisuallyperceivable•Increasecontrollers’situationawareness

OUTPUT

•Fewerlimitations,therefore:•Increasedcapacity•Increasedefficiency

Ø In adverse working conditions (e.g. low visibility) limiting procedures are used in

order to “preserve” or “improve” the type of cognitive behaviour.

Ø More complex cognitive behaviours are moved toward simpler cognitive

behaviours, at the expense of throughput and efficiency.

PerformS-R-KTaxonomy

Identifyshiftsincognitivebehaviour

“Improve”cognitivebehaviourbyexposingconstraints,moving

information

Designoverlays

Removelimitations

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 10

SRKTaxonomy

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 11

SRKTaxonomy:example

TASKCODE TASKDESCRIPTION S R K

GND4 ISSUETAXICLEARANCE

TaskGND4:Issue TaxiClearance1. Identifyaircraftonapron(SMR)2. Choosethecorrecttaxiwayaccordingtolocalregulation(rules)3. Identifytaxiwayclosedornotallowed,choosecorrectholdingpoint

accordingtorunwayinuse(rules)(airportlayout,stopbar)4. Assessaircraft/vehicleconflictalreadymoving(SMR)5. Choose thebestpath6. Transmittaxiclearance(standardphraseology)

Innormalvisibilityconditions:

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 12

SRKTaxonomy:example

TASKCODE TASKDESCRIPTION S R K

GND4 ISSUETAXICLEARANCE

TaskGND4:Issue TaxiClearance1. Identifyaircraftonapron(SMR)2. Choosethecorrecttaxiwayaccordingtolocalregulation(rules)3. Identifytaxiwayclosedornotallowed,choosecorrectholdingpoint

accordingtorunwayinuse(rules)(airportlayout,stopbar)4. Assessaircraft/vehicleconflictalreadymoving(SMR)5. Choose thebestpath6. Transmittaxiclearance(standardphraseology)

AsVisibilitydecreases:

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 13

SRKTaxonomy:example

TASKCODE TASKDESCRIPTION S R K

GND4 ISSUETAXICLEARANCE

TaskGND4:Issue TaxiClearance1. Identifyaircraftonapron(SMR)2. Choosethecorrecttaxiwayaccordingtolocalregulation(rules)3. Identifytaxiwayclosedornotallowed,choosecorrectholdingpoint

accordingtorunwayinuse(rules,airportlayout,stopbar)4. Assessaircraft/vehicleconflictalreadymoving(SMR)5. Choose thebestpath6. Transmittaxiclearance(standardphraseology)

Inlowvisibilityconditions:Thecontrollercannotseethemanoeuvering areaLimitations:severaltaxiwaysareclosed,stopbar CATII/IIIareactivated,follow-meforarrivingaircraft,oneaircraftmovingatonetime.

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision 14

SRKTaxonomy:example

TASKCODE TASKDESCRIPTION S R K

GND4 ISSUETAXICLEARANCE

TaskGND4:Issue TaxiClearance1. Identifyaircraftonapron(SMR)2. Choosethecorrecttaxiwayaccordingtolocalregulation(rules)3. Identifytaxiwayclosedornotallowed,choosecorrectholdingpoint

accordingtorunwayinuse(rules,airportlayout,stopbar)4. Assessaircraft/vehicleconflictalreadymoving(SMR)5. Choose thebestpath6. Transmittaxiclearance(standardphraseology)

Inlowvisibilityconditions+RETINAequipment:Thecontrollercanseeaircraft(“boundingbox”)positionThecontrollercanseeaerodromelayout,taxiwayclosed,stop-bar,vehicles(“follow-me”)Mostlimitationscanberemoved.

ThisprojecthasreceivedfundingfromtheSESARJointUndertakingundertheEuropeanUnion’sHorizon2020researchandinnovationprogramme undergrantagreementNo.699370

Thank you very muchforyour attention!

RETINA:Resilientsyntheticvisionforadvancedcontroltowerairnavigationserviceprovision