glive: the gradient overlay as a market maker for mesh ...€¦ · july 6, 2011 glive – amir h....
TRANSCRIPT
![Page 1: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/1.jpg)
GLive – Amir H. PayberahJuly 6, 2011 1
GLive: The Gradient overlay as a market maker for meshbased P2P live streaming
Amir H. Payberah Jim Dowling Seif Haridi{amir, jdowling, seif}@sics.se
![Page 2: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/2.jpg)
GLive – Amir H. PayberahJuly 6, 2011 2
Introduction
![Page 3: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/3.jpg)
GLive – Amir H. Payberah 3July 6, 2011
Media Streaming
● Media streaming is a multimedia that is sent over a network and played as it is being received by end users.
● Users do not need to wait to download all the media.
● It could be
Live Media Streaming
Video on Demand (VoD)
![Page 4: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/4.jpg)
GLive – Amir H. Payberah 4July 6, 2011
Solutions for Media Streaming
ClientServer
Server Farm
PeertoPeer
![Page 5: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/5.jpg)
GLive – Amir H. Payberah 5July 6, 2011
Problem Description (1/4)
● Building a streaming overlay network, such that: Nodes with higher upload bandwidth are positioned closer to the media source.
Nodes with similar upload bandwidth become neighbours.
● Reduces: Average number of hops
Streaming disruptions
Playback latency
Similar upload bandwidth
![Page 6: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/6.jpg)
GLive – Amir H. Payberah 6July 6, 2011
Problem Description (1/4)
● Building a streaming overlay network, such that: Nodes with higher upload bandwidth are positioned closer to the media source.
Nodes with similar upload bandwidth become neighbours.
● Reduces: Average number of hops
Streaming disruptions
Playback latency
Similar upload bandwidth
![Page 7: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/7.jpg)
GLive – Amir H. Payberah 7July 6, 2011
Problem Description (2/4)
● Bounded download/upload connections.
● A parentchild relation.
Parent
Child
Download slot
Upload slot
![Page 8: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/8.jpg)
GLive – Amir H. Payberah 8July 6, 2011
Problem Description (3/4)
● Problem: How to assign upload slots to download slots?
Parent
Child
Download slot
Upload slot
![Page 9: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/9.jpg)
GLive – Amir H. Payberah 9July 6, 2011
Problem Description (4/4)
● This can be modelled as an assignment problem.
● Centralized solution:
Needs global knowledge.
Possible for small system sizes.
● Distributed marketbased approach:
Inspired by auction algorithms.
Each node knows only a small number of nodes in the system (partial view).
![Page 10: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/10.jpg)
GLive – Amir H. PayberahJuly 6, 2011 10
GLive
![Page 11: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/11.jpg)
GLive – Amir H. Payberah 11July 6, 2011
Design Space
● What overlay topology is built for data dissemination?
● What algorithm is used for data dissemination?
● How to discover supplying nodes?
![Page 12: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/12.jpg)
GLive – Amir H. Payberah 12July 6, 2011
Design Space
● What overlay topology is built for data dissemination?
Tree
Multipletree
Mesh
● What algorithm is used for data dissemination?
Push
Pull
PushPull
● How to discover supplying nodes?
Centralized
DHT
Gossipbased
...
![Page 13: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/13.jpg)
GLive – Amir H. Payberah 13July 6, 2011
Design Space
● What overlay topology is built for data dissemination?
Tree
Multipletree
Mesh
● What algorithm is used for data dissemination?
Push
Pull
PushPull
● How to discover supplying nodes?
Centralized
DHT
Gossipbased
...
GLive
![Page 14: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/14.jpg)
GLive – Amir H. PayberahJuly 6, 2011 14
Glive – Design Space
What overlay topology is built for data dissemination?What algorithm is used for data dissemination?
How to discover supplying nodes?
![Page 15: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/15.jpg)
GLive – Amir H. Payberah 15July 6, 2011
Mesh Overlay
● Divide he main stream into a small blocks.
● Nodes are connected in a meshnetwork.
1 2 3 4 5 6
1
3
5
2
46
Media Server
![Page 16: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/16.jpg)
GLive – Amir H. Payberah 16July 6, 2011
The Market Model Node Properties
● Currency: The total number of blocks uploaded to children during the last 10 seconds.
● Price: The price of a node that has an unused upload slot is zero, otherwise the node’s price equals the lowest currency of its already connected children.
● Cost: The length of its path to the root via its shortest path.
Currency = 3Price = 1Cost = 3
currency = 2 currency = 1 currency = 2
Source
![Page 17: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/17.jpg)
GLive – Amir H. Payberah 17July 6, 2011
The Market Model – Child Side
Currency: 3Cost: 5
Q: Price: 1 Cost: 4
N: Price: 2 Cost: 6
M: Price: 5 Cost: 4
X: Price: 3 Cost: 5
P
P
Q
N
MX
![Page 18: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/18.jpg)
GLive – Amir H. Payberah 18July 6, 2011
The Market Model – Child Side
Currency: 3Cost: 5
Q: Price: 1 Cost: 4
N: Price: 2 Cost: 6
M: Price: 5 Cost: 4
X: Price: 3 Cost: 5
P
P
Q
N
MX
![Page 19: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/19.jpg)
GLive – Amir H. Payberah 19July 6, 2011
The Market Model – Parent Side
Q
Request
P
Price: 1
Currency: 2 Currency: 3 Currency: 3 Currency: 1
![Page 20: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/20.jpg)
GLive – Amir H. Payberah 20July 6, 2011
The Market Model – Parent Side
Q
P
![Page 21: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/21.jpg)
GLive – Amir H. PayberahJuly 6, 2011 21
Glive – Design Space
What overlay topology is built for data dissemination?What algorithm is used for data dissemination?
How to discover supplying nodes?
![Page 22: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/22.jpg)
GLive – Amir H. Payberah 22July 6, 2011
Data Dissemination (1/2)
● Each parent node periodically sends its buffer map and its load to all its assigned children.
● A child node, pull the required blocks using the received information.
![Page 23: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/23.jpg)
GLive – Amir H. Payberah 23July 6, 2011
Data Dissemination (2/2)
● Sliding window
Inorder set Rare set
![Page 24: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/24.jpg)
GLive – Amir H. PayberahJuly 6, 2011 24
Glive – Design Space
What overlay topology is built for data dissemination?What algorithm is used for data dissemination?
How to discover supplying nodes?
![Page 25: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/25.jpg)
GLive – Amir H. Payberah 25July 6, 2011
Node Discovery (1/2)
● Naïve solution: nodes in partial views are selected randomly from all the nodes.
● Optimization: nodes use the Gradient overlay to construct and maintain their partial view of the system.
Random view
![Page 26: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/26.jpg)
GLive – Amir H. Payberah 26July 6, 2011
The Gradient Overlay
● The Gradient overlay is a class of P2P overlays that arranges nodes using a local utility function at each node, such that nodes are ordered in descending utility values away from a core of the highest utility nodes.
![Page 27: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/27.jpg)
GLive – Amir H. Payberah 27July 6, 2011
Node Discovery (2/2)
Similarview
Finger
● Rather than have nodes explore the whole system for better parents, the Gradient enables nodes to limit exploration to the set of nodes with asimilar number of upload slots.
Random view
![Page 28: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/28.jpg)
GLive – Amir H. PayberahJuly 6, 2011 28
Conclusion
![Page 29: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/29.jpg)
GLive – Amir H. Payberah 29July 6, 2011
Conclusion
● GLive P2P solution for live media streaming.→
● Distributed market model
● Design space:
Overlay topology: Mesh
Data dissemination: Pull
Discover supplying nodes: Gossip – Gradient
![Page 30: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/30.jpg)
GLive – Amir H. PayberahJuly 6, 2011 30
Question?
![Page 31: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/31.jpg)
GLive – Amir H. Payberah 31July 6, 2011
Experiment Setup
● Using the Kompics as a simulator platform.
● King dataset is used to model the latencies between nodes.
● The streaming rate to 512 Kbps, and it is split into 8 stripes (in sepidar). The stream/stripe is divided into a sequence of 16 Kb blocks.
● Nodes start playing the media after buffering it for 15 seconds.
● The number of upload slots for the nonroot nodes is picked randomly from 1 to 10.
bandwidths from 128 Kbps to 1.25 Mbps.
● Compare with NewCoolstreaming.
![Page 32: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/32.jpg)
GLive – Amir H. Payberah 32July 6, 2011
Playback Continuity
![Page 33: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/33.jpg)
GLive – Amir H. Payberah 33July 6, 2011
Playback Latency
![Page 34: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/34.jpg)
GLive – Amir H. Payberah 34July 6, 2011
Gradient overlay vs. Random overlay
![Page 35: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/35.jpg)
GLive – Amir H. Payberah 35July 6, 2011
Buffering Time
![Page 36: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/36.jpg)
GLive – Amir H. Payberah 36July 6, 2011
Playback Latency
![Page 37: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/37.jpg)
GLive – Amir H. Payberah 37July 6, 2011
Gradient overlay vs. Random overlay
![Page 38: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/38.jpg)
GLive – Amir H. Payberah 38July 6, 2011
Buffering Time
![Page 39: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network](https://reader036.vdocuments.site/reader036/viewer/2022071412/61087776c86f663bd4620f0f/html5/thumbnails/39.jpg)
GLive – Amir H. Payberah 39July 6, 2011
Fairness and Connectivity in Failure