p2p web search: make it light, make it fly · 2011-09-16 · matthias bender p2p web search: make...

Motivation MINERVA System Model Demo

P2P Web Search: Make It Light, Make It Fly

Matthias Bender, Tom Crecelius,Sebastian Michel, Josiane Xavier Parreira

Max-Planck-Institut fur InformatikSaarbrucken, Germany

Jan 8, 2007

Matthias Bender P2P Web Search: Make It Light, Make It Fly 1 / 16

Motivation MINERVA System Model Demo

Outline

1 Motivation

2 MINERVA System Model

3 Demo

Matthias Bender P2P Web Search: Make It Light, Make It Fly 2 / 16

Motivation MINERVA System Model Demo

Motivation

Potential of peer-to-peer (P2P) systems

scalable

efficient

resilient to failures and dynamics

P2P Web Search

benefit from intellectual input of user community

prevent information-resource monopolies

Key Challenge: Make it usable

Bingo! (Focused Web crawler), MINERVA (P2P Web Search),Cloudscape (Database Backend)⇒ Easy user deployment, common GUI

Matthias Bender P2P Web Search: Make It Light, Make It Fly 3 / 16

Motivation MINERVA System Model Demo

Architectural Model

Peers autonomously and independently crawl the webbuild local indexescan execute queries on local indexes

Matthias Bender P2P Web Search: Make It Light, Make It Fly 4 / 16

Motivation MINERVA System Model Demo

Architectural Model

share per-key statistics about local indexesform conceptually global directoryEach directory peer responsible for randomized subset of keys

Matthias Bender P2P Web Search: Make It Light, Make It Fly 5 / 16

Motivation MINERVA System Model Demo

Architectural Model

use directory to identify promising peers (Query Routing)send query to selected peersmerge results appropriately

Matthias Bender P2P Web Search: Make It Light, Make It Fly 6 / 16

Motivation MINERVA System Model Demo

1. Step: Import Bookmark File

Click Startbutton toimportbookmark file

Matthias Bender P2P Web Search: Make It Light, Make It Fly 7 / 16

Motivation MINERVA System Model Demo

2. Step: Crawl the Web

BINGO! fetchesbookmarkdocuments,builds classifier

Web crawlstartsautomatically,can be stoppedanytime

Start Minerva

Matthias Bender P2P Web Search: Make It Light, Make It Fly 8 / 16

Motivation MINERVA System Model Demo

3. Step: Instantiate Minerva

Enter nickname,network settings

Click CreateRing (or JoinRing, if exists)

Matthias Bender P2P Web Search: Make It Light, Make It Fly 9 / 16

Motivation MINERVA System Model Demo

4. Step: Update Minerva Index

Update Indeximports currentdata fromBingo!,computesmetadata

Matthias Bender P2P Web Search: Make It Light, Make It Fly 10 / 16

Motivation MINERVA System Model Demo

5. Step: Publish Metadata to directory

Use ShowWidgets menuto openReceived-Postspanel

Click Post Allbutton

Click Refreshbutton toinspectdirectory

Matthias Bender P2P Web Search: Make It Light, Make It Fly 11 / 16

Motivation MINERVA System Model Demo

6. Step: Execute Query

Enter Query,click Executequery

Inspect Results

Matthias Bender P2P Web Search: Make It Light, Make It Fly 12 / 16

Motivation MINERVA System Model Demo

7. Step: Tag Documents

Right-click ondocument, AddNew Tag forURL

Add desiredtag(s)

Matthias Bender P2P Web Search: Make It Light, Make It Fly 13 / 16

Motivation MINERVA System Model Demo

8. Step: Retrieve Annotations for Document

Right-click ondocument,Retrieve allTags for URL

Inspectedsubmitted tags

Matthias Bender P2P Web Search: Make It Light, Make It Fly 14 / 16

Motivation MINERVA System Model Demo

9. Step: Query for Annotated Documents

Enter query astag=value,possiblycombine withkeywords

Inspect results

Matthias Bender P2P Web Search: Make It Light, Make It Fly 15 / 16

Motivation MINERVA System Model Demo

Thank you for your attention

Download and more details available at:

http://www.minerva-project.org

Matthias Bender P2P Web Search: Make It Light, Make It Fly 16 / 16