dbease: making databases user-friendly and easily accessible

DBease: Making Databases User-Friendly and Easily

Accessible

Guoliang Li, Ju Fan, Hao Wu, Jiannan Wang, Jianhua Feng

Database Group, Department of Computer Science and Technology,

Tsinghua University, Beijing 100084, China

How to Access Databases?• Traditional database-access methods:

–SQLSelect title, author, booktitle, year From dblpWhere title Contains “search” And booktitle

Contains “cidr”–Query-by-exmaple (Form)

–Keyword Search“search cidr”

CIDR'11 - DBease (2)

cidr

Comparison of Different Methods


Usa

bil

ity

Too many

results!

Keyword Search• Is traditional keyword search good enough?

CIDR'11 - DBease

No result!

(4)

Form-based Search• Form-based Search has the same problem.

CIDR'11 - DBease

Complicated and

stillno result!

(5)

Our Solution


Type-Ahead Search

Type-Ahead Search in Forms

SQL SuggestionU

sabi

lit

y

What is Type-Ahead Search?


Type-Ahead Search• Advantages

– On-the-fly giving users instant feedback– Helping users navigate the underlying

data– Tolerating inconsistencies between query

and data– Supporting Synonyms – Supporting XML data– Supporting Multiple tables


Problem Formulation• Data: A set of records• Query

– Q = {p1, p2, …, pl}: a set of prefixes– δ: Edit-distance threshold

• Result– A set of records having all query prefixes or their similar

forms (conjunctive)

CIDR'11 - DBease

Edit Distance:The number of edit operations

(insertion, deletion, substitution)transformed a string to another

ed(string, stang) =2

(9)

Indexing• Trie Index• Words: root to leaves• Inverted lists on leaves


(11)CIDR'11 - DBease

Algorithm• Step 1: Find similar prefixes incrementally• Step 2: Retrieve the leaf nodes of similar prefixes • Step 3: Compute union lists of inverted lists of leaf nodes• Step 4: Intersect the union lists of query keywords

=cid r



Type-Ahead Search


Usa

bil

ity

What is Type-Ahead Search in Forms?



• Problem Formulation– Data: A relation with multiple attributes– Query: A set of prefixes on attributes in a

form interface – Answers:

• Local results of the focused attribute• Global results of the relation

• Advantages– On-the-fly Faceted Search– Supporting Aggregation


Data Partition• Global Table Local Tables


ID Title Conf. Author1 xml

databaseVLDB albert

2 xml database

SIGMOD

bob

3 xml search VLDB albert4 xml

securityVLDB alice

5 rdbms SIGMOD

charlie

ID Conf.C1 VLDBC2 SIGMO

D

ID Author

A1 albertA2 bobA3 aliceA4 charli

e

Indexing• Each attribute

– Trie– Mapping Tables

• Local Global• Global Local


……

Φ

x

m

l

s

e

T1: xml datrabaseT2: xml searchT3: xml security

a c

T1

Trie:1, 2

T2 3T3 4T4 5

L-G Mapping Table:

1 T12 T13 T24 T3

G-L Mapping Table:

5 T4

Our Solution


Author:

Title:

xml databasexml searchxml security

xml database (albert)xml database (bob)xml search (albert)xml security (alice)

……

Φ

x

m

l

s

e

T1: xml datrabaseT2: xml searchT3: xml security

a c

T1

Trie:1, 2

T2 3T3 4T4 5

L-G Mapping Table:

1 T12 T13 T24 T3

G-L Mapping Table:

5 T4

Author:

xmlTitle:

albertalice

xml database, albertxml search, albertxml security, aliceal

Our Solution


l

b

e

r

i

c

5: alice

4: albert

e

T1

Trie

1, 2T2 3T3 4T4 5

L-G Mapping Table

1 T12 T13 T24 T3

G- L Mapping Table

5 T4

a

a

SQL Suggestion


Type-Ahead Search


SQL SuggestionU

sabi

lit

y

What is SQL Suggestion?


SQL Suggestion• Problem Formulation

– Data: A database with multiple tables– Query: A set of keywords– Answers: Relevant SQL queries

• Advantages– Suggest SQL queries based on keywords– Help users formulate SQL queries to find accurate

results– Designed for both SQL programmers and Internet users– Group answers based on SQL structures– Support Aggregation– Support Range queries


Our Solution• Suggest Templates from

Keywords– A template is a structure in

the databases– Modeled as a graph

• Nodes: entities (table names or attribute names)

• Edges: foreign keys or membership

• Suggest SQL queries from Templates– Mapping between keywords

and templates


keyword paper ir(a) Query

(b) Template

(c) SQL

Template Suggestion• Template Generation

– Extension from basic entities (tables)

• Template Ranking– Template weight

• Pagerank – Relevancy between a keyword

and an entity• Tf*idf

• Algorithms– Fagin algorithms– Threshold-based pruning

techniques


SQL Suggestion• SQL suggestion model

– Mapping from keywords to templates – Matching is a set of mappings with all

keywords– Weighted set-covering problem (NP-hard)

• SQL ranking– Relevancy between keywords and attributes – Attribute weight

• Algorithms– Greedy algorithms


Search: dbeasehttp://dbease.cs.tsinghua.edu.cn

Differences to Google Instant Search• Fuzzy prefix matching• Google firstly predicts queries, and

then use the top queries to search the documents. Google may involve false negatives, while we can find the accurate top-k answers.


Differences to Complete Search• Fuzzy prefix matching• Different index structures• More efficient


Differences to Keyword Search• Effectiveness

– SQL Suggestion supports range queries, and aggregation functions.

– SQL Suggestion can group answers.– SQL Suggestion can help users to express

their query intent more accurately.• Efficiency

– Faster


dbease: making databases user-friendly and easily accessible

Documents

solutioncidr11 dbease

formscidr11 dbease

leavescidr11 dbease

formsusabilitycidr11

chinacidr11 dbease

cidr11 dbease complicated

cidr11 dbease algorithmstep

set of prefixes