Electrical and Computer Engineering

SMART GOGGLES

To ChongRyan Offir

Matt FerranteJames Kestyn

Advisor: Dr. Tilman Wolf

Preliminary Design Review

2Electrical and Computer Engineering

Augmented Reality Goggle Application

An Example of Augmented Reality Goggle Application

3Electrical and Computer Engineering

Project Overview Augmented reality vision technology

• Sensing a user’s location and direction of view• Computing what to display in the user’s field of view• Displaying the visual content without obstructing the

user’s view of real objects

Simple, efficient, and functional smart goggle• Sensor unit• Intel Atom Processor• Goggle-based display

4Electrical and Computer Engineering

Design Layout

GPS

CPUIntel AtomMCUOpenGL

Sensor Board

MemorySensorData

U S B V G A

Sensor Filter

Gyro Compass/Accelerometer

+

Tunnel Creek Board

BatteryPack

T W IUART

DISPLAY

System Block Diagram

5Electrical and Computer Engineering

Conceptual System Design

Bird’s eye view of the system design as worn

6Electrical and Computer Engineering

Hardware & Software Components Sensor board

• GPS• Gyroscope• Compass/Accelerometer• AVR microcontroller

∙ Kalman filter Intel Atom Processor – Tunnel Creek board

• Windows Embedded 7 OS• OpenGL – API and graphical application

Goggle - Provided by Microvision, Inc.• VGA connection

Battery Pack – 12V

Sense location and direction of view through a Kalman filter

7Electrical and Computer Engineering

Sensor Board PCB

• Size: 1 x 2.5 in• Consumes < 0.8 W @ 3.3 V• GPS - USART• Gyroscope, Compass, Accelerometer – I2C• USB-powered, 3.3V and 1.8V regulators• On-board 32-bit microcontroller• Design completed• Sending out this week

8Electrical and Computer Engineering

GPS – MN1010 USART connection to the microcontroller Determines the location of the user Features:

• 12-channel GPS receiver, RF filtering, flash memory• Operates at 1.8V @ 35mA• < 75 mW total power consumption• 10mm x 10mm x 2mm, 36 pin LGA packet• Outputs NMEA-0183 string @ 1 PPS• Frequency: 1575.42 MH

9Electrical and Computer Engineering

Gyroscope - L3G4200DTR I2C bus connection to the microcontroller Determines head orientation of the user Features:

• Operates at 3.3V @ 6.1mA• Three-axis angular rate sensor

• X-axis: pitch axis• Y-axis: roll axis• Z-axis: yaw axis

• 16 bit-rate value data output

10Electrical and Computer Engineering

Accelerometer/Compass - LSM303DLHC Single I2C bus connection to the microcontroller Accelerometer determines head movements Compass determines the direction user is facing Features:

• 3.3V @ 0.11 mA• 3 magnetic field channels and 3 acceleration channels• From ±1.3 to ±8.1 gauss magnetic field full-scale• ±2g/±4g/±8g/±16g selectable full-scale• 3x5x1mm

11Electrical and Computer Engineering

AVR Microcontroller - AT32UC3B0256-Z2UT High Performance, Low Power AVR®32 UC3 32-Bit

Microcontroller Executes > 1 MIPS / MHz Universal Serial Bus (USB) Bootloader Internal High-Speed SRAM, Single-Cycle Access at

Full Speed: 96KB (256KB Flash) Single Cycle Access up to 60 MHz Single 3.3V Power Supply Implements the Kalman Filter

12Electrical and Computer Engineering

Kalman Filter

13Electrical and Computer Engineering

Kalman Filter A recursive predictive algorithm Increases accuracy of noisy measurements Measurements: Gyroscope, Accelerometer,

Compass, GPS Inputs: Measurements, Previous State of

System, Bias Terms Outputs (State Vector): Location, Orientation Predicts the users location/orientation based

on previous values, measurements, covariance, and noise

14Electrical and Computer Engineering

Kalman Filter

15Electrical and Computer Engineering

Intel Atom E680 – Tunnel Creek Operates at 1.6GHz Up to 2GB DDR2 1MB BIOS Flash, on-board

reprogrammable VGA port USB port 2 x SATA hard disk interface 2 x 1000 BaseT Ethernet ports Small size – 75 x 65mm (What is

the size from Cornell????) 6W power consumption

(Cornell???) Supply voltage: 5V (Cornell spec

please!!!)

16Electrical and Computer Engineering

Software Windows Embedded 7 OS Develop 3D environment application with

OpenGL OpenGL allows us to easily update graphical

position Translate users movement and orientation

into a virtual environment to be used for 3D graphic application

API Development

17Electrical and Computer Engineering

Picture example of openGL over image

18Electrical and Computer Engineering

Picture example of openGL over image 2

19Electrical and Computer Engineering

Goggle-Based Display VGA connection port Input image projected on corrective lens Semitransparent reflective lens To be provided by Microvision, Inc.

http://www.microvision.com

20Electrical and Computer Engineering

Cost Schedule

Components PriceSensor board components $71.00PCB Manufacturing $150.00Battery $50.00Intel Atom E680 $150.00Total $421.00

21Electrical and Computer Engineering

Battery 12VDC battery pack

22Electrical and Computer Engineering

Proposed MDR Deliverables Demonstrate the orientation of the Sensor Unit Design a simple 3D environment using OpenGL

• PC version

23Electrical and Computer Engineering

Questions