vr controlled 3d city
TRANSCRIPT
VR Controlled 3D City
Problem Statement & Solution
The Problem
Reality is a variable => different experience for each individual.
Several individuals have various constraints to have a basic experience with reality.
Constraints include => Old age, physical and mental disability, lack of funds to travel or not enough time.
The Solution
Virtual reality attempts to deliver a constant experience to all.
Every individual, regardless of any kind of constraint can have a virtual experience of a simulated reality.
Virtual 3D city gives a virtual experience for all users.
Other use cases => vision training, cognitive training etc
Architecture & Components
Overall Architecture
LAMBDA Server
Alexa Handler (Node JS + Socket.io)
Node JS Chat App
AWS EC2 Server
Alexa Skill Settings
Voice to Text
Voice to Text Converted Message Command
Voice Message
Data Flow Management
- Real-time 2 way communication b/w server & client
- Using TCP Socket
- Across browser & mobile device
- 100% JavaScript based
Data Flow Management
- HTTP is stateless and not reliable
- Mechanism for browser-based app that does not rely on multiple HTTP connections
- Before socket.io …..
- Event emission on the server
- Client listeners listen in a bi-directional manner
Data Flow Management
Server
Client
Client
Client
2
3
4
1
Data Flow Management
Server
Client
Client
Client
2
3
4
1
Data Flow ManagementServer
Client
Client
Client
2
3
4
1
Data Flow Management
2
3
1
4
Data Flow Management
2
3
1
4
Data Flow Management
2
3
1
4
json
jsonjson
json
Data Flow Management
Data Flow Management
1
2
3
Unity 3D Virtual Interface
Virtual representation of a model 3D city is created.
User has a 360 degree view of his/her surroundings.
Several viewpoints included for the user.
These include => Home, Bridge, Mall etc.
Accessed using mobile assistant and voice assistant.
Voice Assistant
Mobile Assistant and Voice Assistant
Used to shift between the different locations.
Mobile Assistant => 2 input modes => Text and Voice.
Text - identifies the name of the location.
Voice - Speech recognition used to decipher location.
Voice assistant => Alexa commands.
Web Interface