weetfabriek kb: virtual & augmented reality

Slide 1

De Virtuele BibliotheekRobin de LangeDe Weetfabriek20 September 2016

Welcome everybody

Kind of ironic that Im on the Digital Entertainment Stage, as Im actually interested in any use of Virtual Reality other than entertainment.1

Wat betekenen Virtual en Augmented Reality voor de bibliotheek?

WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE

In my graduation project I could bring a lot of interests together.

I created an Augmented Reality application and focused on the influence it could have on the way we solve problems.

The app was an early prototype and mainly tried to raise questions and discussion.

How does this change the way we solve problems?How should education respond to these developments?

2

Robin de Lange - CVBachelorPhysicsPhilosophyArtificial Intelligence

MSc. Media TechnologyFocus: Extended cognition & Augmented Reality

EDUCATIONWORKOwner tutoring company

Video production 1st MOOC in the Netherlands


3

Graduation projectAugmented Reality prototype

Raise discussion

PhD proposal

https://dl.dropboxusercontent.com/u/20732302/Demo%20ARMath.wmv






4

Graduation projectAugmented Reality prototype

Raise discussion

PhD proposal






5

Robin de Lange - CVBachelorPhysicsPhilosophyArtificial Intelligence

MSc. Media TechnologyFocus: Extended cognition & Augmented Reality

EDUCATIONWORKOwner tutoring company

Video production 1st MOOC in the Netherlands

PhD researcher @ Media TechnologyPromotor: Bas Haring

Founder Lyceo CodeLab


After my graduation project I wanted to continue doing research, so I started doing part-time PhD research as a buitenpromovendus and went searching for funding.

At the same time I started doing all sorts of freelance work. The biggest project at the moment is the Lyceo CodeLab, where we teach high school children how to code.

6

2013: Oculus Rift


Around 2014 I decided to change my focus of research from Augmented Reality to Virtual Reality. Devices like Google Glass were still a bit disappointing, while at the same time the Oculus Rift showed very promising results.

I bought an Oculus Rift in 2014 and was impressed with the experience. I played around with the different demos and started experimenting with creating VR content myself using Unity3D.

After this playing around it was time for a real project.7

Hack the Brain: Project BrainstormLive EEG data visualization for Oculus Rift

With Eva Delincakova & Bert Spaan @ Hack the Brain hackathon


A good occasion for this came by as I joined the Hack the Brain hackathon, organized by the Waag.

During this three day event the participants were challenged to hack the human brain. The Waag arranged EEG scanners and lots of help from neuroscientists, to see what people outside of the field could do with those devices.

Our project was a live visualization of the data from the EEG scanner through the Oculus Rift. You would put the Rift on, wear a cap full with electrodes and find yourself in a huge model of a brain. In this model you would see a live visualization of the alpha waves of your brain, measured by the different electrodes.

Its quite hard to get useful data from EEG sensors, but you could clearly see an increase in alpha waves when you became relaxed. This created an interesting form of feedback.8

Focus of research: phase I

In what ways can VR be used as a tool for learning?

What are the obstacles and opportunities for implementing VR in the field of education?


This project was a lot of fun and more importantly: it made me realize that it was possible to create an interesting VR prototype in just three days. This made me change the focus of my research to these two research questions:9

Method

Elective research course

Explorative qualitative research

Symposium


Parallel to this research course I did explorative, qualitative research myself.

The challenge of my research is to form some sort of theoretical framework to understand the potential of VR for education a little better. For this, I have read a lot of papers, experienced many VR applications, went to VR meetups, hosted workshops, gave talks, written a lot and spoke to many different people.10

Virtual Reality for Science & EducationElective research course for 25 bachelor and master students

Exploring the potential of VR for science & education;


called Virtual Reality for Science & Education. This was an elective course for bachelor and master students with participants from many different directions. Media Technology, Computer Science, Psychology, Chemistry and archeology.

Part of the challenge of the course was to obtain skills to create interactive VR content. As a final project all the students created a VR prototype with a small group.11

Virtual Reality for Science & EducationExperience VR and analyze it as a medium

Obtaining skills to create interactive VR content using e.g. Unity3D and 360 film technology;

Creating a VR prototype as final project


Analyse VR as a medium. During the course we took the time to analyze VR intensively. What sets it apart from screen-based media? What are the main characteristics.

During an earlier course we focussed on the relation between cinema and VR. In the first part of the course they learnt about the history of cinema. In the second part they explored to what extent the visual effects of cinema can be used in VR. Can we use editing? How does a green screen work? What does a split screen look like?Hier ook met studenten vanuit allerlei verschillende richtingenToen vooral nog veel first person ervaringen, zonder cuts of wat dan ook12

SymposiumWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE

https://www.youtube.com/watch?v=hfYI9IJB4vc

13

Student projectsWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE

14


https://www.youtube.com/watch?v=D7PfdWZTSB4

15

Student projects


16


https://www.youtube.com/watch?v=bVaE968FnUc

17


Virtual Reality Learning Lab

Research & prototyping

Honours Class Learning through Virtual Reality

Development & implementation in educational practice

Open for collaboration

To start answering these questions I started doing research.

An important part of this was an elective course.18

A Brief History of VRVirtual Reality is not new

WWW. ROBINDELANGE .COMWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE

Lets first zoom out a bit and talk about the history of VR

The first thing to notice is that Virtual reality is not new.19

A Brief History of VRSensorama1955 by Morton HeiligExperience TheaterMulti-sensoryNo financial support


20

A Brief History of VRHeadsight1961 by Philco Corp.First Head Mounted DisplayMagnetic tracking systemLive stream from camera system


21

A Brief History of VRLEEP Cyberface1989By Eric HowlettFirst commercial HMDVery wide angle stereoscopic optics


22

A Brief History of VRNintendo Virtual Boy1995Monochromatic displayNo head-tracking, fixed positionCommercial failureFrom VR hype to disappointment


23

A Brief History of VR

https://youtu.be/tdAaU0CRHng?t=1m51sWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE

24

A Brief History of VROculus Rift2012: Kickstarter campaignMuch wider FOVLow latency trackingAimed at consumer marketBenefits from developments in computer hardwareAcquired by Facebook in 2014Consumer version ships Q1 2016

https://www.youtube.com/watch?v=DhcOMOWRMnA


25

A Brief History of VRGoogle CardboardGift at 2014 Google I/OOpen source designStarting from $2Start of mobile VRMagnet as input button


Everything that is needed for a VR experience is present in a recent smartphone. Gyroscopes for tracking26

27

State of the artDesktop VRPowered by desktopBest image qualityInteractive possibilitiesWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE

28

State of the artDesktop VR


29

State of the artDesktop VRPowered by desktopBest image qualityInteractive possibilitiesWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE

~ 2000 per systemNeeds lot of space

30

State of the artMobile VRPowered by smartphone~ 500 per system + BYOD


Okay good image qualityLimited interaction

31

State of the artMobile VRPowered by smartphone~ 500 per system

WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEOkay good image qualityLimited interaction

Desktop VRPowered by desktopBest image qualityInteractive possibilities~ 2000 per systemNeeds lot of space

32

VR content creationGAME ENGINESe.g. Unity3D

Combination of 3D designing and coding environment


The first way is to use a game engine, such as Unity3D. This is a combination of 3D designing and coding environment.33

VR content creationPHOTO / VIDEORicoh Theta or GoPro-based setup

Workflow similar to regular video


The second way is to use 360 cameras. The consumer versions, like this one, create a spherical photo or video with the click of a button. More advanced cameras usually consist of a clever combination of GoPro action cameras.34

VR content creationUSER GENERATEDExisting VR applications where users create content


A third type of creating VR content is within existing applications. Programs like VRChat or Beloola are large multiplayer worlds where you can easily create your own spaces and fill them with content for your class for example.35

Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE

36

Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEBibliotheek als toegangspoort tot kennisVR als nieuwe informatiedrager

Bibliotheek als toegangspoort tot kennis

37


https://www.youtube.com/watch?v=MXGSvjryXSo

38

Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEBibliotheek als toegangspoort tot kennisVR content lenen in de bibliotheek


39

Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEBibliotheek voor mediawijsheidVR als nieuw medium


40

Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEBibliotheek als toegangspoort tot kennisVR als nieuwe poort


41


Een bibliotheek nabootsen in Virtual Reality is misschien niet zo spannend.

Maar wat als je een virtuele bibliotheek helemaal kunt inrichten voor de individuele gebruiker? Een bibliotheek die aansluit op wat de gebruiker al eerder heeft gelezen en wat anderen aanraden?

Niet beperkt tot de beschikbare boeken. Maar alle42


http://www.erikvlemmix.nl/images/LOOP.mp4









https://www.youtube.com/watch?v=EYMJKDTBTao

45

Augmented Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE

46

State of the artScreen-based ARReadily availableBYODImpressive resultsWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEToo much effortNo real 3D effect

47

State of the artGlasses-based ARIntegration with your experience of the worldAlways onWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE> 2000 per systemBulkyNot consumer-ready

48

State of the artWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE

49

Augmented Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEBibliotheek verrijken met digitale informatie


50

ARBieb


https://www.youtube.com/watch?v=LMc7_bgCuOU

51

Workshops

Op wat voor manieren kunnen we in VR de digitale collecties verkennen?

Met wat voor informatie kun je de bibliotheek verrijken?

Moet de bibliotheek VR content aanbieden?


However, many brainstorm sessions also showed that there are potential use cases for almost any field of study. Some fields are somewhat obvious, as 3D objects have an important role in that field of study. But there are also possibilities for fields which wouldnt come directly to mind.

52

Workshops

Mogelijkheden VR & AR voor bibliotheek verder verkennen

Meer demos ervaren

Ideen genereren en concepten maken

Aantal deelnemers: max 15



53

Demo & discussie



54