comb, needle, and haystacks: balancing push and pull for information discovery
DESCRIPTION
Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery. Xin Liu Computer Science Dept. University of California, Davis Collaborators: Qingfeng Huang & Ying Zhang , PARC. Objective. Simple, reliable, and efficient on-demand information discovery mechanisms. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/1.jpg)
Comb, Needle, and Haystacks:Balancing Push and Pull for Information Discovery
Xin LiuComputer Science Dept.
University of California, Davis
Collaborators: Qingfeng Huang & Ying Zhang, PARC
![Page 2: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/2.jpg)
11/4/2004 ACM Sensys 2
Objective
Simple, reliable, and efficient on-demand information discovery mechanisms
![Page 3: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/3.jpg)
11/4/2004 ACM Sensys 3
Where are the tanks?
![Page 4: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/4.jpg)
11/4/2004 ACM Sensys 4
Pull-based Strategy
![Page 5: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/5.jpg)
11/4/2004 ACM Sensys 5
Pull-based Cont’d
![Page 6: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/6.jpg)
11/4/2004 ACM Sensys 6
Push-based Strategy
![Page 7: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/7.jpg)
11/4/2004 ACM Sensys 7
Comb-Needle Structure
![Page 8: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/8.jpg)
11/4/2004 ACM Sensys 8
Related Work
D. Braginsky and D. Estrin, “Rumor routing algorithm for sensor networks”, WSNA, 2002.
J. Heidemann, F. Silva, and D. Estrin, “Matching data dissemination algorithms to application requirements”, SENSYS 2003.
ACQUIRE, IDSQ, SRT, GHT, DIMENSIONS, DIM, GRAB, gossip, flooding-based, agent-based, geo-routing, …
![Page 9: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/9.jpg)
11/4/2004 ACM Sensys 9
Application Scenarios
On-demand information query Any node can be the query entry node Queries may be generated at anytime Events can happen anywhere and anytime Examples:
Firefighters query information in the field Surveillance
Sensor nodes know their locations
![Page 10: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/10.jpg)
11/4/2004 ACM Sensys 10
When an Event Happens
Event
![Page 11: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/11.jpg)
11/4/2004 ACM Sensys 11
When a Query is Generated
Event
Query
Event
![Page 12: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/12.jpg)
11/4/2004 ACM Sensys 12
Tuning Comb-Needle
![Page 13: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/13.jpg)
11/4/2004 ACM Sensys 13
The Spectrum of Push and Pull
Pull Push
Global pull +Local push
Global push +Local pull
Push & Pull
Inter-spike spacing increases
Reverse comb
Relative query frequency increases
![Page 14: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/14.jpg)
11/4/2004 ACM Sensys 14
Reverse Comb
Query
Event
When query frequency > event frequency
![Page 15: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/15.jpg)
11/4/2004 ACM Sensys 15
Mid-term Review
Basic idea: balancing push and pull
Preview: Reliability Random network An adaptive scheme
![Page 16: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/16.jpg)
11/4/2004 ACM Sensys 16
Strategies for Improving Reliability
Local enhancement Interleaved mesh Routing update
Spatial diversity Correlated failures Enhance and balance query success rate at
different geo-locations
![Page 17: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/17.jpg)
11/4/2004 ACM Sensys 17
Spatial Diversity
Query
xEvent
![Page 18: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/18.jpg)
11/4/2004 ACM Sensys 18
Random Network
Constrained geographical flooding Needles and combs have certain widths
![Page 19: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/19.jpg)
11/4/2004 ACM Sensys 19
Simulation
Simulator: Prowler
![Page 20: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/20.jpg)
11/4/2004 ACM Sensys 20
![Page 21: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/21.jpg)
11/4/2004 ACM Sensys 21
![Page 22: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/22.jpg)
11/4/2004 ACM Sensys 22
Adaptive Scheme
Comb granularity depends on the query and event frequencies
Nodes estimate the query and event frequencies Important to match needle length and inter-spike
spacing Comb rotates
Load balancing Broadcast information of current inter-spike spacing
![Page 23: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/23.jpg)
11/4/2004 ACM Sensys 23
Simulation
Regular grid Communication cost: hop counts No node failure Adaptive scheme
![Page 24: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/24.jpg)
11/4/2004 ACM Sensys 24
Event & Query Frequencies
![Page 25: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/25.jpg)
11/4/2004 ACM Sensys 25
Tracking the Ideal Inter-Spike Spacing
![Page 26: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/26.jpg)
11/4/2004 ACM Sensys 26
Simulation Results
Gain depends on the query and event frequencies Even if needle length < inter-spike spacing, there is a
chance of success. Tradeoff between success ratio and cost
99.33% success ratio and 99.64% power consumption compared to the ideal case
![Page 27: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/27.jpg)
11/4/2004 ACM Sensys 27
Summary
Adapt to system changes Can be applied in hierarchical structures
Pull Push
Global pull +Local push
Global push +Local pull
Push & Pull
Relative query frequency increases
![Page 28: Comb, Needle, and Haystacks: Balancing Push and Pull for Information Discovery](https://reader035.vdocuments.site/reader035/viewer/2022070404/56813ad0550346895da2f9e2/html5/thumbnails/28.jpg)
11/4/2004 ACM Sensys 28
Future work
Further study on random networks Building a “comb-needle-like” structure
without location information Integrated with data aggregation and
compression Comprehensive models for communication
costs