1 aura project © 2001 carnegie mellon university wearable computer architecture and applications...

1Aura Project© 2001 Carnegie Mellon University

Wearable Computer Wearable Computer Architecture and Architecture and

ApplicationsApplications

Daniel P. SiewiorekDaniel P. SiewiorekCarnegie Mellon UniversityCarnegie Mellon University

October 30, 2001October 30, 2001

Boeing


Five Generations of Wearable Computers

Navigator 2 used for aircraft maintenance

VuMan 1 VuMan 2 Navigator 1

VuMan 3 Navigator 2

Left, a look through the head mounted display.The user not only sees the aircraft maintenance interface, but also their work environment.


Wearable Applications and Architecture

Procedures - upload at completion Work Orders - incremental updates Collaboration - real time interaction

» Client-Server

– Thin Client Legacy Systems

– Interactive Electronic Technical Manuals (IETMs)


Time Rate of Change of Data Taxonomy

Procedures. Maintenance and plant operation applications are characterized by a large volume of information that varies slowly over time.

A typical request consists of approximately ten pages of text and schematic drawings. Changes to the centralized information base can occur on a weekly basis.


Savings Using Tactical Information Assistants in Marine Heavy Vehicle MaintenanceCurrent Practice

Current Practice

SAVINGS FACTOR

VuMan 3 Field Trials

VuMan 3 Field Trials

Personnel

2:1

Inspection time

40% less

SAVINGS FACTOR


Final SystemMock-up System Prototype SystemInitial visit Story Boards

Month

0 1 2 3 4

Four Month Design Cycle



(continued)

Work Orders. The trend is towards more customization in systems.

Manufacturing or maintenance personnel receive a job list that describes the tasks and includes text and schematic documentation. This information can change on a daily or even hourly basis.


User Interface Screen



(continued)

Collaboration. An individual often requires assistance. In a “Help Desk” an experienced person is contacted for audio and visual assistance. The Help Desk can service many people simultaneously.

Information can change on a minute-by-minute and sometimes even a second-by-second basis.


Integrated Technical Information

for the Air Logistics Centers (ITI-ALC)

Integrated Technical Information

for the Air Logistics Centers (ITI-ALC)

Technology DemonstrationTechnology DemonstrationTechnology DemonstrationTechnology Demonstration


F-15 Depot maintenance


Problem

Outdated, cumbersome maintenance information capability

» Paper-based products

» Independent, uncoordinated computer information systems


ITI-ALC TechnologyITI-ALC TechnologyDemonstration Demonstration

ArchitectureArchitecture

InspectorInspectorPentiumPentiumLaptopLaptop

InspectionInspection

CollaborationCollaborationOracleOracleDBDB

WindowsWindowsNT ServerNT Server

MechanicMechanic

Wireless LANWireless LAN

Engineer’sEngineer’sWorkstationWorkstation


Evaluation & Inventory

1. Select aircraft2. Select region3. Pick-up 173’s4. Check freq. defect list5. Get tools6. Conduct inspection7. Check-off defect list8. Stamp 173’s9. Write up new defects10. Access parts info.11. Access TO’s12. Access HowMal codes13. Write new defects in U-book14. Stamp U-book15. Enter data into database

CurrentCurrent ITI-ALCITI-ALC

1. Login

2. Hangar

3. 173 List

4. 173 Signoff

5. 173 History

4. Record Defects

5. Add New Defect

6. Submit Defects

7. Defect History


Engineering Assistance

1. Mechanic finds skin defect2. Mechanic obtains Form 202 3. Fills in fields of Form 202A 4. Views tech. data 5. Makes a rough sketch 6. Form to Scheduler 7. Form to Planner 8. Form to Engineering 9. Engineer reviews Form 202A10. Engineer researches problem11. Engineer goes to hangar for visual 12. Engineer fills in Form 202B 13. Reverse routing/logging above 14. Mechanic reads 202B15. Mechanic is ready to enact repair

1. Login Screen

2. Hangar Screen

3. Form 202A

4. Confirmation Screen

3a.Parts Screen

3d. Sound Tool

3c. Sketch Tool

3b. Take Picture

CurrentCurrent

ITI-ALCITI-ALC

1. ELogin 3. Form 202B

4. Confirmation Screen

2. 202B Selection Screen


Wearable PC Runs Inmedius Web-based IETM Software

Server

Web Server

IETM Engine

Client

database schema

database schema

Web Browser

database schema

IETMAuthoring

incremental updates

incremental updates

Authoring IncrementalDistribution

WebRuntime

incrementalupdates

F/A-18 Fleet Support Organization Fleet Operating Sites

IETM Authoring/Maint.

Organizations


IETM Display by Mobile Computer -

IBM Concept Model is an Example ThinkPad 560X Equivalent High Spec

» Full Function Portable PC in IBM High Density Package

Ultimate Portability » Headphone Stereo Size System Unit, 2/3lbs (299g)

IBM MicroDrive » 1" Disk, 5mm Thickness, 20g, 340 MB Capacity

Transparent Head Mount Display » Invented by IBM T.J. Watson Research


F-18 Inspection Application: Production vest fits under “Float Coat”


11 Mbs wireless LAN connects Wearable Computer to server


Selection of “hot links” with CMU’s Wheel/Pointer


Wireless and Handheld Andrew


Academic andAdministrative

Buildings

Residence Halls, Parking, etc

Wireless Campus as of June 2000

300+ basestations


Aura Thesis

The most precious resource in computing

is human attentionAura Goals

•reduce user distraction

•trade-off plentiful resources of Moore’s law for human attention

•achieve this scalably for mobile users in a

failure-prone, variable-resource environment


Context Aware Computing

Applications that use context to provide task-relevant information and/or services

Context is any information that can be used to characterize the situation of an entity (person, place, or physical or computational object)

Contextual sensing, adaptation, resource discovery, and augmentation

Examples of Context Aware applications» Matchmaking

» Proactive assistant


Example Agents

Notification Agent» Alert a user if they are passing within a certain distance of a

task on their to do list.

Meeting Reminder Agent» Alerts a user if they are in danger of missing a meeting.

Activity Recommendation Agent» Recommends possible activities/meetings that a user might

like to attend based on their interests.


Context Aware Computing Platform: The Spot Architecture


Spot Wearable Computer


Belt Worn Spot and

Head Mounted Display


Research Challenges

• User interface models—new application metaphors require experimentation

• Input/output modalities—accuracy and ease of use

• Quick Interface Evaluation Methodology—to use during design

• Match capability with application—resist “highest performance” temptation

1 aura project © 2001 carnegie mellon university wearable computer architecture and applications...

Documents

aura project

boeing slide

depot maintenance slide

month design cycle slide

maintenance personnel

aircraft maintenance

inspection time

aircraft maintenance