3/16/2008

1

The Exciting Future The Exciting Future

of Computingof Computing

Bill GriswoldBill Griswold

Computer Science and EngineeringComputer Science and Engineering

“The Engineer of the future

will have to think more like

a science fiction writer.”

– Vernor Vinge

2

3/16/2008

2

Nanotech convergence - Bio, Physics, Eng, and IT

2 mm

HP

MemorySpotMems - 1000x

Magnification

2 micron

DNA-Conjugated Microbeads

Nano - 400x

Magnification

IBM Quantum Corral

Iron Atoms on Copper

5 nanometers

400,000 x !

3

Second LifeSecond LifeSecond Life ericrice @ flickr4

3/16/2008

3

http://www.hdb.gov.sg/

Andrei Pungovschi / AP

AE Innovations

Bango

5

Example – location-based reminders

– Had not proven useful in small areas supported by 802.11b

– Investigated importance of ubiquity with Place-its phone app

10-person study revealed phenomena unique to ubiquity

– Slowness and coarseness of positioning not a major shortcoming

– Location used as a proxy for other kinds of context, e.g., not busy

– Ubiquity: “Since I was out of town, I would think of things on the

drive that I had to do when I got back and I'd put reminders on

the phone.”

– Distinctiveness: “There are certain activities that my calendaring

app is not particularly good at reminding me about. Especially …

when I’m not near a computer.... [examples are] grocery

shopping, and also when I’m leaving work I’m on my way out,

done for the day, not liable to be checking email.”

– Calm: “It was a relief knowing I would've been reminded....”6

Why Ubiquity? Context Awareness?

store

home

Arriving Arriving

Home:Home:

Call MomCall Mom

3/16/2008

4

Realizing proactive ubiquitous computingHow can we make ubiquitous context awareness work with commodity devices?

Detect proximity reliably

Convey proximity unobtrusively

Short personal sound clip and vibration

Novel vibration encoding algorithms:

- downsamping 44 kHz sounds to 50 Hz

running sum of energies

- 50Hz patterns � binary actuations

think µMorse code7

My Towers Your Towers

AB

C

D

E

PeopleTones -Play a person’s

unique sound

when they

become nearby

F

8

“One time at the library, I wanted to eat with someone and so I went

outside to call someone. The phone vibrated. I just called the person to

meet up.”

“When I was going to Bob’s birthday, I knew who was there when I

pulled up because of the ring tones.”

“Whenever I drive to school I found out where Alice works because I

always get her alert when I’m driving on Miramar. Oh, so she works

around here?”

“I thought it was so neat every time it would ring. It made me really

happy. Oh! They’re right here, or oh! They’re right there.”

“It was cool to see who was home by the time I got home. I could tell if

Melissa was home when I passed by Clairemont…. Oh she’s home, so let’s

call her and see if she wants to eat.”

3/16/2008

5

Escaping the palm top

9

Sousveillance Grid – Jenik, Collins, et al.

10

RealityFlythrough - ubiquitous videoConcept of remote live exploration

– Live video streamed by anyone from anywhere to

anywhere, but not just surveillance monitor view

– Multiple cameras viewing the same scene, stitched

together into a single immersive coherent view

RealityFlythrough makes this possible

3/16/2008

6

11

RealityFlythrough system architecture

802.11H323 Video

Conferencing

Stream

RFT MCU(Multipoint Control Unit)

RFT Engine(OpenGL + extensions)

Cameras

ImageCapture SensorCapture

StreamCombine

(352x288 video

resolution)

RFT Server

RealityFlythroughsystem abstractions for robust ubiquitous video

12

System projects image

from recorded location

and orientation onto

opposite wall

User “walks” between live cameras,

animated via transition

RFT applies number of techniques to

supercharge human’s “closure” process:

motion, fill-in, cross-fade, video freeze

3/16/2008

7

- personal enviro-sensing

• Typical city has just a few air

quality sensors

• Miniaturization, packaging,

and integration make

personal sensing possible

• Squirrel transmits photo

stream with sensor meta-data

• Visualization makes photos

grainier as air quality degrades

Spanhake, Greco, Kimball, et al. (Calit2)

13

Guided waveoptics

Aqueous bio/ chem sensors

Fluidic circuit

Free spaceoptics

Physicalsensors

Gas/chemicalsensors

Electronics (communication, power)

Ivan Schuller holding the first prototype in 2004

I. K. Schuller, A. Kummel, M. Sailor, W. Trogler, Y-H Lo (Physics & Calit2)Integrated nanosensors for ubicomp

Developing Multiple Nanosensors on a Single Chip

Integrated with Local Processing and Wireless Communications

20

06

14

3/16/2008

8

1

5

Future of Education is Inquiry

Capstone

Design

Classes

Faculty-directed

Research Projects

TIES ENG 100L (e.g., DigiNurse)

CSE 118

UbiComp

ActiveCampus

Calit2 internships

COSMOS

UP

Summer

Programs

Ubiquitous Computing(embodied virtuality)

Calm

Invisible

Commodity

Democratic

Networked

Multi-scale

Multimodal

Tangible

Web 2.0

Failure as a

normal mode of

operation

Beautiful

Mobile

Wireless

Mobile 2.0

Personal

Social

Context-awareMiniaturized

and convergent

16

Virtural Reality

3/16/2008

9

Acknowledgments and ThanksCompanies, agencies, and institutes…

Microsoft Research, Hewlett Packard, Motorola Research, Intel Research Seattle

National Library of Medicine, Calit2, CRA

Students and Faculty…

Tim Sohn, Kevin Li, Neil McCurdy, Roshni Malani, Gunny Lee, Steve Brown, Barry Demchak, Tammy Denning, Michelle Wilkerson, David Lindquist, Michael Kelly

Beth Simon, Les Lenert, Jim Hollan, Adriene Jenik, Larry Smarr

Yahoo! and you…

including my many former students who came today (and got me back to reading science fiction)

17

RealityFlythroughsystem abstractions for robust ubiquitous video

Limited bandwidth “in the wild”

1st person video yields little compression

Jumpy, blurry, lossy, very low fps video

Lower frame rate (to 1 fps)

Raise frame quality

Guarantee delivery

Apply RFT transition technique to

animate between frames 19