real time control and communication ( robots , machines , iot )
TRANSCRIPT
Real Time Control and Communication for IOT
ALTANAI BISHT & DEEPAK [email protected]://altanaitelecom.wordpress.com
Who am I ?4 Years in Telecom Industry
Frequently write , discuss and contribute to Open source software
Website : http://altanaitelecom.wordpress.com
Author of WebRTC Integrator’s Guide
2
1. Remote Machine Control2. M2M WebRTC3. Robot navigation 4. Robot Live Streaming via CDN
3Altanai Bisht ( http://altanaitelecom.wordpress.com )
IOT full solution stack
4Altanai Bisht ( http://altanaitelecom.wordpress.com )
Remote Machine Control
Controlling a remote machines like lights , fan over internet . Rpi acts as central control hub.
Components
Server side PHP Web-pages JavascriptWeb ServerMySQL
Communication Medium
Wireless ( 3G ) dongle
6Altanai Bisht ( http://altanaitelecom.wordpress.com )
Machine endpointRpi ECUPower MgmtMotor Noise FiltrationSPI
7
Raspberry Pi
7Altanai Bisht ( http://altanaitelecom.wordpress.com )
The Raspberry Pi is a series of credit card–sized single-board computers developed in the UK by the Raspberry Pi Foundation
Motor Driver Circuit
8Altanai Bisht ( http://altanaitelecom.wordpress.com )
9
youtube demo : https://www.youtube.com/watch?v=jrFpzN1jCR8&feature=youtu.be
Altanai Bisht ( http://altanaitelecom.wordpress.com )
Web page for control Electronic devices Hub and Electronic devices
M2M WebRTC
Transmitting media capture stream to Server
Media - WebRTCWebRTC offers real time communication natively from browsers. It is essentially just a media engine without control protocol
Bodies behind standardization
No plugins
Supported browsers
Supported Mobile platforms
11Altanai Bisht ( http://altanaitelecom.wordpress.com )
How does WebRTC work ?
12Altanai Bisht ( http://altanaitelecom.wordpress.com )
Signal
● Web Server/service based signaling
brokering
● Offer/Answer JSEP ( Java Session
Establishment Protocol ) model with
SDP ( Session Description Protocol )
● protocol NOT defined
Media
● Peer to peer media flow
● SRTP/RTCP
Firewall
● Uses ICE for STUN / TURN mechanism
WebRTC stack
13Altanai Bisht ( http://altanaitelecom.wordpress.com )
Components for WebRTC M2M communication
Server side JavascriptWeb ServerWebRTC browser
Communication Medium3G ( min > 2Mbps)
14Altanai Bisht ( http://altanaitelecom.wordpress.com )
Machine endpointRpi Iceweasel browserWebcam SpeakerMicDisplay
WebRTC Comm Network
TURN NodejsSocketio
Simple person-to-machine comm
15Altanai Bisht ( http://altanaitelecom.wordpress.com )
Milestone 2 : Machine-to-machine comm
16Altanai Bisht ( http://altanaitelecom.wordpress.com )
Robot navigation
Navigating robot movement using WebRTC stream feed and remote machine control over internet.
Components for WebRTC M2M communication Server side
JavascriptWeb ServerWebRTC browser PHP Web-pages MySQL
Communication Medium3G ( min > 2Mbps)
19Altanai Bisht ( http://altanaitelecom.wordpress.com )
Machine endpointRpi IceweaselWebcam SpeakerMicDisplay
WebRTC Comm Network
TURN NodejsSocketio
Robot4 wheelerECUAl baseSensorGear Motor
20
Robot basic blocks
Altanai Bisht ( http://altanaitelecom.wordpress.com )
Front 1 1
Left 1 0
Right 0 1
21Altanai Bisht ( http://altanaitelecom.wordpress.com )
Standing robot view View from robot moving towards right
Robot Live Streaming via CDN
Capturing the web stream as robot moves and live streaming via CDN
23
1. WebRTC multi peers
2. Torrent based WebRTC chain 3. WebRTC Relay
nodes for multiple peers
4. WebRTC Chunk recorder to Wowza Media Server
Scalable Broadcasting and Live streaming alternatives
Altanai Bisht ( http://altanaitelecom.wordpress.com )
24
1. WebRTC multi peers
Altanai Bisht ( http://altanaitelecom.wordpress.com )
25
3. WebRTC Relay nodes for multiple peers
Altanai Bisht ( http://altanaitelecom.wordpress.com )
26
1 : n Live streaming end-end solution
WebRTC on Robot -> WebRTC peer on Server -> Whammy Recorder -> Wowza Transcoder +Streaming Server -> Amazon Cloudfront -> Multi players
4. WebRTC Chunk recorder to Wowza Media Server
Altanai Bisht ( http://altanaitelecom.wordpress.com )
27
WebRTC -> vp8/webm -> live stream
Note : This method only provides the video . It doent not have audio .
Features
● Cheap and more customised solution to specific use cases
● Recycled components ● No patented or proprietary protocols● Easy person-to-machine and machine-to-
machine comm. ● Can be integrated with other modules like
Recording , Multiplexing , transcoding .
28Altanai Bisht ( http://altanaitelecom.wordpress.com )
Roadmap
Sensor’s triggering Real Time comm.
Solid Real Time Analytics
Machine Learning
Augmented Reality in flowing Media
Integration to IOT frameworks
Thank you29