submission doc.: ieee 802. 15-16-0025-01-007a project: ieee 802.15 working group for wireless...
DESCRIPTION
Submission Doc.: IEEE a Contents Introduction Proposal Descriptions Network Device Architecture MAC Layer PHY Layer Device Management Entity Simulation Analysis Conclusion January 2016 Jaesang Cha, Seoul National Univ. of Science &Tech Slide 3TRANSCRIPT
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Project: IEEE 802.15 Working Group for Wireless Personal Area Networks (WPANs)Project: IEEE 802.15 Working Group for Wireless Personal Area Networks (WPANs)
Submission Title: Invisible data embedded Display Tx schemes for OCC
Date Submitted: 10 January, 2016 Source: Jaesang Cha[SNUST], Junghoon Lee [ Dong Seoul Univ.] and Vinayagam Mariappan [SNUST]
Address : Seoul National University of Science & Technology [SNUST], Seoul, KoreaVoice: +82-2-970-6431, FAX: +82-2-970-6123, E-Mail: [email protected]: Response to Call For IEEE802.15.7r1 Proposal on November 2015
Abstract: Variable invisible data embedded Display Tx schemes for OCC are proposed. Variable modulation Scheme, Distance adaptive , Angle Free, Asynchronous, Rx Distance and Frame rate adaptive OCC communication schemes are proposed.
Purpose: To submit a Proposal IEEE 802.15.7r1
Notice: This document has been prepared to assist the IEEE 802.15. It is offered as a basis for discussion and is not binding on the contributing individual(s) or organization(s). The material in this document is subject to change in form and content after further study. The contributor(s) reserve(s) the right to add, amend or withdraw material contained herein.
Release:The contributor acknowledges and accepts that this contribution becomes the property of IEEE and may be made publicly available by IEEE 802.15
Jaesang Cha, Seoul National Univ. of Science &Tech
January 2016
Slide 1
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
January 2016
Jaesang Cha [SNUST] Vinayagam Mariappan [SNUST]
Junghoon Lee [ Dong Seoul University]
SNUST 802.15.7r1 Proposal for Invisible data embedded Display Tx schemes for OCC
Jaesang Cha, Seoul National Univ. of Science &TechSlide 2
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Contents
Introduction
Proposal Descriptions
Network Device Architecture
MAC Layer
PHY Layer
Device Management Entity
Simulation Analysis
Conclusion
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 3
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
January 2016
Introduction
Jaesang Cha, Seoul National Univ. of Science &TechSlide 4
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Introduction (1)• Information needed to transfer is encoded into a visual frame • Any camera equipped device can turn to the Display screen scene and
decode the information
January 2016
• Advantages- Operating on the Visible Light Spectrum Band- Electromagnetic Interference Free Communication- Promising out-of-band communication for Short Range information acquisition
Display Screens
Smart Device
Jaesang Cha, Seoul National Univ. of Science &TechSlide 5
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Introduction (2)• Display Screen – Smart Device Tx & Rx Data Flow
• Issues- Displays Visible Coded Images- Uses QR Code, 2D Barcode, Color
Code Patterns- Unpleasant View Experience - Camera receiver to be closer to the
screen- Low Data Rate- Need addition Synchronization Block
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 6
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Introduction (3)• Proposing Invisible Data Embedded on Display Screen – Smart Device
Communication Mode- Unobtrusive to the human eyes- Decodable by Camera Eyes
• Design Goal- Unobtrusive to Screen Viewer- Works on dynamic visual Scene- Angle and Distance Free Communication- Rx Distance Adaptive Communication by Screen with interactive Camera - Asynchronous Communication- Rx Frame Rate independent Transmission
January 2016
Tx
Rx
Data Received
Jaesang Cha, Seoul National Univ. of Science &TechSlide 7
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
January 2016
Proposal Descriptions
Jaesang Cha, Seoul National Univ. of Science &TechSlide 8
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Proposal Overview
• Key features- Invisible Data Embedding- Works on dynamic visual Scene- Angle Free and Distance Adaptive Communication- Rx Distance Adaptive Data Rate Control by Screen with interactive Camera - Asynchronous Communication- Rx Frame Rate independent Transmission- Uses Spread Spectrum based M-PSK, M-FSK, Hybrid-M-PSK-FSK, Sequential Scalable
2D Codes- Multi-Display Model for Transmission
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 9
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Display Tx Process Block
VIDEO FRAMING
OWC DATA FUSION
M-FSK / M-PSK/
2D CODE
Unipolar to
Bipolar A bpsB bpsC bps
Spread code
Generator
SS cps
Bipolar to
UnipolarSS cps
CODED PAYLOAD GRID
FRAMING
January 2016
• OWC Data Fusion- Uses Blending / Watermarking- Alpha Blending
OWCFusionDisplayFRAME = α . grid + (1- α ) Data2DWhere α 0 to 1 and α = 0 < 0. 1 100% Invisible
SS
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 10
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
SS Modulation Parameters
Data Rate(bps)Parameter 1000 2000 3000 Units Considerations
Tx data size 20 40 80 bits Payload sizeFrame duration 20 20 20 ms
SS chip rate 2 2 2 Mcps Spreading chip rateSpreading Factor 8 4 2Processing Gain 8 4 2
Number of chips per frame 32 128 512 chips
Grid Allocation 8*4 16*8 32*16The numbers of
rows and columns of screen
January 2016
• Study Case
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 11
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
M-PSK
January 2016
• 2-PSK
• 4-PSK
1) 0 2) 1
1) 00
3) 10
2) 01
4) 11
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 12
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
M-FSK
January 2016
• 2-FSK
• 4-FSK
1) 0 2) 1
f1 f2
1) 00 2) 01
f1 f2
3) 01 4) 10
f3f4
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 13
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Hybrid (M-PSK-FSK)
January 2016
• M-PSK and M-FSK - Data bits can be sent via frequency & phase combination
2) 01
1) 00
3) 10
4) 11
Phase Frequency
f1
f2
f1
f2
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 14
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Sequential Scalable 2D Codes
January 2016
• Use 2D Codes– QR Code– Color Code
• Use Invisible Watermarking Scheme for Embedding• Propose the Sequential Scalable 2D Code to support distance adaptive data
rate• Sequential Scalable QR Code
• Sequential Scalable Color Code
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 15
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Code set 1 : 0000000010010100100111101010110 (zero offset)
Code set 2 : 1001010010011110101011000000000 (8chip offset)
Code set 3 : 1001111010101100000000010010100 (16chip offset)
Code set 4 : 1010110000000001001010010011110 (24chip offset)
<Gold-sequence generator>
5 4 3 2 1
5 4 3 2 1
Gold-sequence
January 2016
SS Code Sequence – Study Case
• Spreading Code (Gold Sequence)- Gold sequence was chosen as a spreading code- Shifter register length is 5- Code length is 31 (=25-1)- 4 family code set was generated via offset 8*n chips of code set 1.
• Any Special Orthogonal Spreading Code Sequence with good process gain is adoptive for implementation
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 16
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Video Frame#1, SC#1(Spread code #1)
Video Frame#2, SC#2
Video Frame#3, SC#3
Video Frame#4, SC#4
Video Frame#5, SC#1
January 2016
SS Code Sequence Assignment
• Each code sets repeated for spreading data according to spreading factor
• Each spreading code set 1, 2, 3, 4 are assigned for successive 4 frames as below
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 17
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Rx Process Block
FFT M-FSK / M-PSKDetector
Unipolar to
Bipolar
Spread code Generator
SS cps
Bipolar to
UnipolarSS cps A bpsB bpsC bps
January 2016
QR CodeDetector
• Smart Device Camera Capture Visual Frame from Screen• Extract the ROI of Screen Visual Area• Apply the Sequential Scalable 2D Code or M-FSK or M-
QPSK detector based on Mapping Scheme Applied• Recover the Decoded data after applying SS
SS
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 18
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Asynchronous Communication MethodVideo Frame#1, SC#1(Spread code #1)
Video Frame#2, SC#2
Video Frame#3, SC#3
Video Frame#4, SC#4
Video Frame#5, SC#1
January 2016
• When transmitting data, different spreading code is used per video frame.• On Rx side spreading code already known.• If camera CMOS received same frame, for example #1 video frame receive
twice, then receiver will despread video frames using SC#1, SC#2. When processing using SC#2, dominant value will not appear so the video frame will be discarded.
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 19
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Variable Spreading Factor based on Client Distance from Display
Assigned with SS Short Code
Assigned with SS Long Code
January 2016
• Tx Camera Estimate the Rx’s Distance from Tx• If Rx is near SF Value is small so Short Sequence Code Assigned otherwise
SF values high so Long Sequence Code Assigned
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 20
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
January 2016
Scalable Bitrate Controller for Frame Rate Adaptive Transmission
• To achieve robust communication, the scalable data transmission mode is proposed
• Screen is divided into Multiple regions and each region has different frame rate controlled data transmission is enabled
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 21
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Positioning Service
• Invisible ID-Tag (2D code Tag) and Display Pattern transmit ID and Payload information to support the position based service or indoor positioning system
• Transferred data is assigned pointer of Big-data (URL link etc.)
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 22
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Authentication Service
• Authentication using Display with Camera for Authentication Service• Display Tx Camera will capture the user information from Smart
Device by Display Pattern or Flash and Provide user Authentication
January 2016
LED �ָ
ց ઝݛ�������ઝ Я ֆ( ΰݨ����� ઝ্� )
LED Light
Smart Device(LBS)
Smart Device
Gateway(Display - Camera)
Jaesang Cha, Seoul National Univ. of Science &TechSlide 23
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Network Device Architecture
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 24
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Network Device Architecture
• Layers
January 2016
- SNUST IEEE802.15.7r1 Layer Architecture proposes simplified model from IEEE802 Reference Model IEEE802.15.7-2011
- The Specifications are updated on respective section Layer Specification
- Device Management Entity (DME) uses Interactive Camera to provide Receiver distance dependent data rate control
• Used Topologies- Broadcast , Peer-to-Peer,
Point-to-Multipoint
Jaesang Cha, Seoul National Univ. of Science &TechSlide 25
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Network Device TopologiesJanuary 2016
• SNUST IEEE802.15.7r1 proposes to follow three topologies- Broadcast , Peer-to-Peer (P2P), Point-to-Multipoint(P2MP)
• Broadcast Topology- Tx a signal to other devices without forming a network- Uni-directional so the destination address is not required
• P2P Topology- Tx a signal to other devices with or without forming a network- Uni/Bi-directional and the destination address is need for Bi-directional case
• P2MP Topology- Tx a signal to other devices with forming a network so both need to built with Camera and
Display- Bi-directional and the destination address is required
Jaesang Cha, Seoul National Univ. of Science &TechSlide 26
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
MAC Layer
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 27
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
MAC Frame Format• The Proposed MAC Frame Format
• Broadcast and P2P (Uni-Directional) is does not use Source and Destination Address (Its Optional)• P2MP and P2P (Bi-Directional) uses Source and Destination Address• The Field Check Sequence (FCS) can be optional for future Extension. Not used now
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 28
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
MAC Protocol Setup Method
• The Beacon Message periodically transmitted to establish the communication between Display Screen Transmitter and Smart Media Device Receiver about Network Information. The Minimum periodicity is one sec. The periodicity configuration interval is [1 60] sec.
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 29
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Peer Indicator Negotiation MessageJanuary 2016
• The Peer Indicator Negotiation Message is Transmitter periodically after Beacon Message according to the Beacon Message Periodicity Configuration on Display Screen OCC transmitter
Jaesang Cha, Seoul National Univ. of Science &TechSlide 30
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Device Status Indicator Negotiation MessageJanuary 2016
• Transferred file size or remained file size with our eyes by using Device Information packet
Jaesang Cha, Seoul National Univ. of Science &TechSlide 31
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
MAC State Description for P2P / Broadcast Topology
January 2016
• To communicate device to device, device can transfer coarse link adaptation information to peer device by using Beacon Message and Indication Negotiation Message
• MAC States consist of IDLE State, Connection State, Data Exchange State
Jaesang Cha, Seoul National Univ. of Science &TechSlide 32
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
January 2016
MAC State Description for P2MP Topology• To communicate device to device, device can transfer coarse link
adaptation information to peer device by using Beacon Message, Device Information and Indication Negotiation Message.
• MAC States consist of IDLE state, Connection state, Data Exchange state.
Jaesang Cha, Seoul National Univ. of Science &TechSlide 33
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
PHY Layer
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 34
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
PHY Frame Structure
• IEEE 802.15.7r1 PHY is supports following activities:
- The preamble is replaced with a Start Frame Delimiter- Optional Fields define PHY Specific Information is Optional and defined in future - PSDU holds the data packet
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 35
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
PHY FRAME
• PHY frame includes Frame Generation SS, Modulation Scheme, Embedded Message on Image, Display driver and Display Screen
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 36
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Data Rate Performance
S.No SS Modulation Embedding Method Data Rate
(Kbps)
1 5 Step Gold Sequence
M-FSK Alpha Blend 9
2 5 Step Gold Sequence
M-PSK Alpha Blend 9
3 5 Step Gold Sequence
HYBRID Alpha Blend 18
4 5 Step Gold Sequence
QR CODE Watermark 21
January 2016
• For Display 1920x1080 (2-PSK/2-FSK/2-FSK-PSK)
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 37
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Device Management Entity
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 38
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
DME• Tx Camera Enable [1 Byte]
- [Bit 0] Represent Tx Camera Enable Bit - Check and Set the Status of Tx Enable Bit 1- 1/0 -> Tx Camera Connected / Tx Camera not connected
• Rx Distance [ 1 Byte]- Shows the Rx Distance from Tx
• Application Mode [ 3 Bit]- ID Mode [Bit 0]: 1/0 – Enable / Not Used- Authentication Mode [Bit 1]: 1/0 – Enable / Not Used- Data Mode [Bit 2]: 1/0 – Enable / Not Used
• Application Packet Length [2 Byte]- Used to specify the length of a data packet
• ID Length [1 Byte]- Used to specify the length of a ID
• Authentication Data Length [2 Byte]- Used to specify the length of a Authentication Data
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 39
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
DME (2)
• The DME information Shared to- Application Layer- MAC- PAHY
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 40
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Simulation Analysis
January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 41
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
System Simulation Block DiagramJanuary 2016January 2016
Jaesang Cha, Seoul National Univ. of Science &TechSlide 42
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Simulation Results - M-FSK
January 2016
• M-FSK– 2 /4 – FSK– 5 Step Gold Sequence
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 43
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Simulation Results - M-PSK
January 2016
• M-PSK– 2 /4 – PSK– 5 Step Gold Sequence
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 44
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Simulation Results - Hybrid (M-PSK-FSK)
January 2016
• M-PSK-FSK– 2 /4 – PSK– 5 Step Gold Sequence
Doc.: IEEE 802. 15-16-0025-00-007a
Jaesang Cha, Seoul National Univ. of Science &TechSlide 45
Submission
Doc.: IEEE 802. 15-16-0025-01-007a
Conclusion
• Variable Invisible data embedded Display Tx schemes for OCC are proposed and had many advantages- Data is Unobtrusive to User- Works on dynamic visual Scene- Angle Free and Distance Adaptive Communication- Rx Distance Adaptive Data Rate Control by Display with interactive Camera - Asynchronous Communication- Rx Frame Rate Support independent Transmission- Uses variable modulation and multiplexing methods. - Multi-Display Model for Transmission- Supports Indoor/outdoor Positioning, Authentication, Data Transmission
Jaesang Cha, Seoul National Univ. of Science &Tech46
January 2016