p2p web search: make it light, make it fly · 2011-09-16 · matthias bender p2p web search: make...
TRANSCRIPT
Motivation MINERVA System Model Demo
P2P Web Search: Make It Light, Make It Fly
Matthias Bender, Tom Crecelius,Sebastian Michel, Josiane Xavier Parreira
Max-Planck-Institut fur InformatikSaarbrucken, Germany
Jan 8, 2007
Matthias Bender P2P Web Search: Make It Light, Make It Fly 1 / 16
Motivation MINERVA System Model Demo
Outline
1 Motivation
2 MINERVA System Model
3 Demo
Matthias Bender P2P Web Search: Make It Light, Make It Fly 2 / 16
Motivation MINERVA System Model Demo
Motivation
Potential of peer-to-peer (P2P) systems
scalable
efficient
resilient to failures and dynamics
P2P Web Search
benefit from intellectual input of user community
prevent information-resource monopolies
Key Challenge: Make it usable
Bingo! (Focused Web crawler), MINERVA (P2P Web Search),Cloudscape (Database Backend)⇒ Easy user deployment, common GUI
Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16
Motivation MINERVA System Model Demo
Architectural Model
Peers autonomously and independently crawl the webbuild local indexescan execute queries on local indexes
Matthias Bender P2P Web Search: Make It Light, Make It Fly 4 / 16
Motivation MINERVA System Model Demo
Architectural Model
share per-key statistics about local indexesform conceptually global directoryEach directory peer responsible for randomized subset of keys
Matthias Bender P2P Web Search: Make It Light, Make It Fly 5 / 16
Motivation MINERVA System Model Demo
Architectural Model
use directory to identify promising peers (Query Routing)send query to selected peersmerge results appropriately
Matthias Bender P2P Web Search: Make It Light, Make It Fly 6 / 16
Motivation MINERVA System Model Demo
1. Step: Import Bookmark File
Click Startbutton toimportbookmark file
Matthias Bender P2P Web Search: Make It Light, Make It Fly 7 / 16
Motivation MINERVA System Model Demo
2. Step: Crawl the Web
BINGO! fetchesbookmarkdocuments,builds classifier
Web crawlstartsautomatically,can be stoppedanytime
Start Minerva
Matthias Bender P2P Web Search: Make It Light, Make It Fly 8 / 16
Motivation MINERVA System Model Demo
3. Step: Instantiate Minerva
Enter nickname,network settings
Click CreateRing (or JoinRing, if exists)
Matthias Bender P2P Web Search: Make It Light, Make It Fly 9 / 16
Motivation MINERVA System Model Demo
4. Step: Update Minerva Index
Update Indeximports currentdata fromBingo!,computesmetadata
Matthias Bender P2P Web Search: Make It Light, Make It Fly 10 / 16
Motivation MINERVA System Model Demo
5. Step: Publish Metadata to directory
Use ShowWidgets menuto openReceived-Postspanel
Click Post Allbutton
Click Refreshbutton toinspectdirectory
Matthias Bender P2P Web Search: Make It Light, Make It Fly 11 / 16
Motivation MINERVA System Model Demo
6. Step: Execute Query
Enter Query,click Executequery
Inspect Results
Matthias Bender P2P Web Search: Make It Light, Make It Fly 12 / 16
Motivation MINERVA System Model Demo
7. Step: Tag Documents
Right-click ondocument, AddNew Tag forURL
Add desiredtag(s)
Matthias Bender P2P Web Search: Make It Light, Make It Fly 13 / 16
Motivation MINERVA System Model Demo
8. Step: Retrieve Annotations for Document
Right-click ondocument,Retrieve allTags for URL
Inspectedsubmitted tags
Matthias Bender P2P Web Search: Make It Light, Make It Fly 14 / 16
Motivation MINERVA System Model Demo
9. Step: Query for Annotated Documents
Enter query astag=value,possiblycombine withkeywords
Inspect results
Matthias Bender P2P Web Search: Make It Light, Make It Fly 15 / 16
Motivation MINERVA System Model Demo
Thank you for your attention
Download and more details available at:
http://www.minerva-project.org
Matthias Bender P2P Web Search: Make It Light, Make It Fly 16 / 16