when iot meets virtual 3d world - events | internet2 · when iot meets virtual 3d world ... snmp...
TRANSCRIPT
![Page 1: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/1.jpg)
When IoT Meets Virtual
3D World
Liane Tarouco
Universidade Federal do Rio Grande do Sul
Brazil
![Page 2: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/2.jpg)
Team
� Liane Tarouco - PhD professor - chairman
� Lisandro Granville – PhD professor
� Leandro Bertholdo – Network engineer
� Cesar Loureiro – Software engineer
� Leandro Tibola – PhD student
� Fabiana Sgobbi – PhD student
� Fabricio Harpich – PhD student
� Lucas Arbiza – MsC student
![Page 3: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/3.jpg)
IoT and Virtual World
� Internet of Things are becoming ubiquitous and able to provide data to allow better contextualization in virtual 3D world
� This presentation report alternatives for integrating IoT and VW
� Using special designed midleware
� Using derailleur based on SDN
� Using direct access to web server
� Using the silo approach provided by default in
IoT devices available in the market
![Page 4: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/4.jpg)
Gardner – Hype Cycle 2015
![Page 5: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/5.jpg)
Realism and engagement
� Realistic environment promotes better engagement
� Projects
� AVATAR – Ambiente Virtual de Aprendizagem e
Trabalho Acadêmico Remoto
� HIGIA - Habitat Individual e Guia Interativa de Atitudes
![Page 6: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/6.jpg)
Virtual environment
� AVATAR - Effectiveness of digital laboratories as a learning resource.
� HIGIA - Virtual 3D world to improve motivation and self determination
![Page 7: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/7.jpg)
Communication in and outside
virtual worlds
� Communication with other objects in virtual and/or physical worlds.
![Page 8: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/8.jpg)
Virtual World being used
� Servidor Open Simulator
� Standalone
� Server / grid
� Clients
� Firestorm
� Singularity
![Page 9: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/9.jpg)
Authoring in VW
1. Visual blocks
� ScripTastic
� Scratch for Open Sim
� Flash Scratch to Linden Scripting Language
2. LSL & OSSL
• Notes
• Notepad++
• LSL Editor
![Page 10: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/10.jpg)
Multmedia resources in VW
� Presenting information� Slide presentation
� Videos
� Animations
� Web pages
![Page 11: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/11.jpg)
LSL comands for
interopreration
� llHTTPRequest� Send data from Open Sim to na URL address
� llOpenRemoteDataChannel();
� llOwnerSay("Channel : " + (string) channel + "");
� llRemoteDataReply(channel,NULL_KEY,"OK",1);
![Page 12: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/12.jpg)
OpenSim sending SMS
12
![Page 13: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/13.jpg)
LSL code for sending SMSkey myRequest;integer CHANNEL = 0;default{touch_start(integer number){
llSay(CHANNEL,“Type your phone number with area code 555191494040:");llListen(CHANNEL, "", NULL_KEY, "");
}listen(integer channel, string name, key id,string message){llSay(CHANNEL,“Sendin name: " +name + "=> test message sent to :" +message);
myRequest = llHTTPRequest("http://www.ieduca.com.br/enviasms.php",[HTTP_METHOD, "POST",HTTP_MIMETYPE, "application/x-www-form-urlencoded"],"name="+name+"&celular="+message);
}http_response(key request_id, integer status, list metadata, string body){
if (request_id == myRequest){
llSay(0,body);}
}}
![Page 14: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/14.jpg)
Exchanging data with external
world� Virtual worlds can exchange data with learning
management systems, enterprise resource planning, legacy systems, databases and Web systems, including chatterbot.
� These exchanges allow information to be sent and received regarding simulations and the its users
� User data can be collected to monitor user performance in learning activities
Moodle
PHP/My SQL
Chatterbot
![Page 15: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/15.jpg)
Virtual world Real World
� Applications to communicate with a virtual world� an HTTP request to a Web service, where a prim
sends a request to the Web service, which processes it and sends back an answer to OpenSim,
� an HTTP script call that runs a remote script program to manipulate data in a database
� XML-RPC: enable two-way communication between the virtual and physical world through remote procedure calls and XML data transfer
![Page 16: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/16.jpg)
Interoperation problems with IoT
� Interoperation problems derived from limited communication capabilities and low computational power of IoT devices. � Most of smart devices, used in the context of Internet
of Things is not using generic standards interfaces.
� One of the challenges in this context derives from the need to integrate the various devices and protocols making it possible to obtain information about the scenario being monitored
![Page 17: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/17.jpg)
REMOA project
17
� Environment Monitoring Network - project
targeting home solutions for homecare or/and
tele monitoring of patients with chronic
illnesses.
� Health in family public program
![Page 18: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/18.jpg)
Initial approach
18
ArchitectureData Collection
Agents
Middleware
![Page 19: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/19.jpg)
Middleware
� Wireless Access Point (AP) that supports OpenWRT or DD-WRT.
� Enables the development and deployment of additional software, and supports protocols
� IPv4, IPv6, NAT
� SNMP proxy
� Gateway to other devices19
![Page 20: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/20.jpg)
Middleware issues perceived
� Development of services features limited by APs constraints
� Complex deployment and maintenance
� Complex mechanism to manage smart devices
20
![Page 21: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/21.jpg)
Refactoring
� A solution to circumvent this problem may derives from using a SDN based approach, which turn an access point in a flow switch.
� This solution offers a possibility to divert traffic to a remote server in order to handle, transform and redirect data as required to use it as input in virtual 3D world.
![Page 22: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/22.jpg)
SDN-based middleware refactoring
22
![Page 23: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/23.jpg)
Architecture overview
23
![Page 24: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/24.jpg)
VW integration with external
objects
� Internet of Things� Sensors
� Monitors
� WIFI Camera with movement Sensor - WIFI
� Pedometer - Bluetooth
![Page 25: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/25.jpg)
IoT & Virtual Word
� Camera captured images may bepresented as web pages used as texture in 3D Objects
![Page 26: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/26.jpg)
Internet of Things
� Pedometer data recovered from FitBitserver and presented in VW
![Page 27: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/27.jpg)
Conection with external system
link_message(integer sender_num, integer num, string msg,
key id)
{requestid=llHTTPRequest(“http://www.anyexternalsystem.com
/talk-
xml?id=”+id+&input=”+llEscapeURL(msg)+”&custid=”+cust,
[HTTP_METHOD ,"POST"], ””); }
http_response(key request_id, integer status, list metadata,
string body)
{ if (request_id == requestid)
if (msg == “/create”){
listen_to (id); }
![Page 28: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/28.jpg)
HIGIA - academy
![Page 29: When IoT Meets Virtual 3D World - Events | Internet2 · When IoT Meets Virtual 3D World ... SNMP proxy Gateway to other devices 19. Middleware issues perceived ... liane@penta.ufrgs.br](https://reader031.vdocuments.site/reader031/viewer/2022022715/5c0d5f7809d3f213228d76ee/html5/thumbnails/29.jpg)
Prof. PhD. Liane Margarida Rockenbach Tarouco
Federal Federal Federal Federal UniversityUniversityUniversityUniversity ofofofof Rio Grande do Rio Grande do Rio Grande do Rio Grande do SulSulSulSul
Porto Alegre, Brazil