[Web version]Please visit this URL to give your feedback:

http://www.shirai.la/project/scritter

2x3D: Real time shader for

simultaneous 2D/3D hybrid theater

Wataru FUJIMURA, Yukua KOIDE,

Robert SONGER (Kanazawa Technical College),

Takahiro HAYAKAWA, Akihiko SHIRAI, Kazuhisa YANAKA

KAIT(Kanagawa Institute of Technology)

2x3d@shirai.la

Summary of this talk

• “2x3D” (tú: bái θrí: dí:) is a new 2D/3D hybrid display

• Everyone can see a same screen at same time!

Issues

Technical Issue

Current 3D stereoscopic imagery can not be seen without

the 3D glasses, and it is due to the doubled image shown.

Issues

Social/Market Issue:

We can not see a same screen in same time!

Solution

Technique

• ScritterH, the 2nd generation of multiplex imaging

• Image hiding algorithm

• GPU based real time shader

• Experiments

Related works:– multiplex / hidden imagery

• Direction based separation– “Bois-Clair” (Gaspar Antoine, 1692)

– “Vari-Vue” (Victor Anderson, 1962)

– “Lumisight Table”(2005), ”UlteriorScape” (2008) by Kakehi

• Time/Shutter based technologies– “Snared illumination” (fakespace lab, 2004)

– “ThirdEye” (Pranav Mistry, 2009)

– “SimulView” (SONY, 2010-)

• Polarization based technologies– “FaryFinder” (Hachiya, 2005)

– “Mysterious Pond”, “A visibility control system for collaborative digital table” (Kitamura, Sakurai. 2009)

• Hidden but not shown for naked eyes– Patent: JPA2005-092227 (Semiconductor Energy Lab, 2005)

(All images are taken from each references)

• ScritterH is 2nd generation of Scritter series, a hidden imagery method that invented by Utsugi, Shirai and Yanaka in 2010.

• It has compatibility with current S3D polarized projection.– Common hardware setup with similar stacking S3D.

– No electronic devices needed for the viewer’s side.

“Scritter H” Hidden imagery

NegativeB’+A’Contrast

compressionSource Images

ScritterH, image hiding algorithm

Image B

Image A

Image B’

Image A’ Image C

Projector 1

Projector 2

Polarization

ScritterH, image hiding algorithm

Image C

Naked eyes / filtered view

Gamma correction

Normalized positive + negative projection

With gamma correction:The center band looks for a same color.

ScritterH algorithm

• See more details on ACM Portal

– “ScritterHDR: multiplex-hidden imaging on high dynamic range projection”

– “A new "multiplex content" displaying system compatible with current 3D projection technology”

• Pixelshader on XNA GameStudio 4.0

GPU based real time shader

Inversed Gamma correction

Dynamic ScritterHalgorithm

2x3D configuration

• For better quality of imagery for various viewers

• Cognitive experiments

– Tested on a still image to cancel “the Pulfrich Illusion”

Experiments

Depth are …● :4■ :3◯:1▲:2

• 75% of viewers could answered the correct depth.

Applications

• Closed captioning or commentary overlay

• Education

• Medical

[Latest works]

• KARAOKE

• UbiCode– Interactivity for non interactive display

• 3rd generation of Scritter

Example: PARAOKE• “Parallel Augmented Reality for Audience-

Oriented Karaoke Entertainment”

• Lyrics + Dance game + Calorie consumption display

– Published in Laval Virtual ReVolution, NICOGRAPH 2012

ＡＢＣ

Conclusion• “2x3D” is a new 2D/3D hybrid display

• Everyone can see a same screen at same time!

International Patent is Pending, contact: 2x3d@shirai.la http://www.shirai.la/project/scritter

Thanks for your interestPlease visit this URL to give your feedback:

http://www.shirai.la/project/scritter