18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential

Dr.

Ulri

ch L

eine

r

Slide 1

Fraunhofer Institute for Telecommunications - Heinrich-Hertz-Institut

Einsteinufer 37 10587 Berlinwww.hhi.fraunhofer.de

3D, Interactive Devices and Innovative Applications

Dr. Ulrich LeinerFraunhofer Heinrich-Hertz-Institut

18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential

Dr.

Ulri

ch L

eine

r

Slide 2

Fraunhofer Association: Applied research in Germany60 Institutes, 17000 Scientists, 1.7 Bil Budget

Heinrich-Hertz-Institut (HHI)telecommunication, photonics, image processing270 Scientists, 26 Mio. Budget

What do we do?

DepartmentInteractive Media –Human Factors25 Scientists

18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential

Dr.

Ulri

ch L

eine

r

Slide 3

The virtual museum is getting real

• Many peaces of art are currently scanned• and reconstructed as high resolution 3D-objects• Monuments, books, figures, vases, statues, buildings

• Soon, there will be extremely realistic 3D-models of everything „important“ to mankind

• Virtual museums will make millions of artifacts available for watching, studying, comparing, creativity

• The download story for these models is just to come

Historic Artifacts in 3D

18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential

Dr.

Ulri

ch L

eine

r

Slide 4

Historic Artifacts in 3D

November 09 we installed a 3D-book presenter at the Bavarian State Library• Books are still stored locally, since there are rather few scanned 3D models yet• But there are about 100.000.000 to come

• Noteworthy, we addeda touchless interactionsystem

• This magic inputdevice allows completely new interaction paradigms

18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential

Dr.

Ulri

ch L

eine

r

Slide 5

3D Content should be seen in 3D!

If a proof for the success of movies was still needed, Avatar gave it to the full extend

• 3D-movies will spread out through the internet• Their resolution will be at least HD/eye

• Currently, real convincing 3D-displays are still lacking• Either, you have to wear glasses• Or compromise in the resolution

• HHI is successfully working on autostereoscopic3D-displays

• The virtual museum will also benefit from real 3D-displays

18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential

Dr.

Ulri

ch L

eine

r

Slide 6

3D Content should be seen in 3D!

Based on lenticular beam splitters and real time eye-tracking,

• we can provide each eye with a HD/2 resolution

• No glasses are needed

• Again, touchless interaction is shown as preferred input method

• It’s not yet possibleto show 3D on this beamer

Video

18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential

Dr.

Ulri

ch L

eine

r

Slide 7

Videoconferencing will realize in real time

• Multi-user auto stereoscopic display technology• Depth estimation with combination of narrow baseline, trifocal and wide baseline

camera setup

• Conversion to suitable layered video-plus-depth (LDV) format

• Each terminal receives eight LDV streams, one for eachview, two for each display

• Terminal decodes LDV and converts it to multiple views required by auto-stereoscopic display

Real Video-Conferences should be in 3D!

18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential

Dr.

Ulri

ch L

eine

r

Slide 8

3D City Navigation Systems

Not only pottery is modeled as virtual 3D objectsAll cities get their virtual counterpart

• Berlin city models presents nearly each building inzoomable levels of detail

• Realtime navigation and interaction is requested

• Points of information will be installed

• At home, applications will also become popular

• Combination with 2D images can be expected

25.02.2010 © Fraunhofer HHIFolie 8

18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential

Dr.

Ulri

ch L

eine

r

Slide 9

Remote Surveillance and Retrieval

Not necessarily a 3D-application, but one, which collects and transfers TeraPetabytes of data

• Demand for private and public security is rising

• Number of cameras, resolution and framerate will be increased

• Location of cameras, location of storage and location of surveillants are absolutely independent of each other

• We are currently working on optimal retrieval system, including object recognition and tracing

18. Februar 2010 © Fraunhofer HHI, Ulrich Leiner, confidential

Dr.

Ulri

ch L

eine

r

Slide 10

Fraunhofer Heinrich-Hertz-Institut

Thanks and

Way more info at www.hhi.fraunhofer.de/im