semantics for universal search and discovery

15
Next Generation Search and Discovery Tools for the Web Semantics for Semantics for Universal Universal Search and Search and Discovery Discovery Endre Jofoldi and dr. Tamas Endre Jofoldi and dr. Tamas Doszkocs Doszkocs

Upload: endre-jofoldi

Post on 12-May-2015

1.285 views

Category:

Health & Medicine


4 download

DESCRIPTION

WebLib has recently won a prestigious U.S. challenge.gov award with its NLMplus entry, a large scale semantic search and knowledge discovery application that makes innovative use of the National Library of Medicine’s vast collection of biomedical data and services.The NLMplus app (http://nlmplus.com) combines a number of leading-edge semantic knowledge resources and technologies, such as a biomedical knowledge base, a semantic search engine, a distributed search engine, and a variety of smart content analysis and discovery services. Users can concurrently access 60 NLM databases to find trusted information ranging from consumer health topics to drugs and from news to clinical trials and translational medicine. One of the important innovations of NLMplus is WebLib’s Semantic Search Engine, which typically produces relevant search results with improved precision and recall from 1.6 million PubMed Review articles, which are semantically indexed and searched on a WebLib server. The NLMplus application also sends conceptually enhanced user queries to NLM’s PubMed system of more than 21 million citations from the biomedical literature, life science journals, and online books.Providing flexible access to heterogeneous databases is a common challenge in medical libraries, biomedical research institutions and the health care industry. The same is true for non-biomedical content and applications. WebLib’s domain independent semantic indexing and searching of local databases, in combination with universal search and discovery solutions for free and fee-based content allows all types of organizations to better serve their diverse user communities, including the public, researchers, professionals, and policy and decision makers.

TRANSCRIPT

Page 1: Semantics for universal search and discovery

Next Generation Search and Discovery Tools for the Web

Semantics for Semantics for Universal Universal

Search and Search and DiscoveryDiscovery

Endre Jofoldi and dr. Tamas DoszkocsEndre Jofoldi and dr. Tamas Doszkocs

Page 2: Semantics for universal search and discovery

What is semantic What is semantic search?search?

Keywords vs. Concepts

“semantic search is a search or a question or an action that produces meaningful results, even when the retrieved items contain none of the query terms, or the search involves no query text at all ”

Page 3: Semantics for universal search and discovery

What is NLMplus?What is NLMplus?

NLMplus is a semantic search and knowledge discovery application designed to tap into the rich content offerings of the National Library of Medicine in all areas of biomedicine and health

See NLMPlus

Page 4: Semantics for universal search and discovery

What is NLMplus?What is NLMplus?

Page 5: Semantics for universal search and discovery

Semantic Annotation ofSemantic Annotation of PubMed ReviewsPubMed Reviews

via the WebLib Part-of-Speech Tagger and Noun Phrase Chunker

Page 6: Semantics for universal search and discovery

phrases> key phrases> key concepts > synonyms > normalized semantic indexes

19418823;TI:anthracycline cardiotoxicity after breast cancer treatment

TI_NORMALP: anthracycline breast canc cardiotoxicit treat

TP:anthracycline; CUI:C0003234; Anthracycline Antibiotics; SY: anthracyclines;

TP:cardiotoxicity; CUI:C0876994; cardiac toxicity;

TP:breast cancer; CUI:C0678222; Breast Carcinoma;SY: breast tumor;

TP:breast cancer treatment; CUI:C1511300; Breast Cancer Therapeutic Procedure;

Semantic Annotation of aSemantic Annotation of a PubMed PubMed Review TitleReview Title

Page 7: Semantics for universal search and discovery

Semantic Searching of PubMed ReviewsSemantic Searching of PubMed Reviews

The WebLib Semantic Search Engine

Apache Solr enterprise search engine with WebLib’s Semantic Layer http://lucene.apache.org/solr/

Weblib Biomedical Knowledge Base and Query translator WBQT

Page 8: Semantics for universal search and discovery

Scaling the Semantic Searching ofScaling the Semantic Searching of PubMed ReviewsPubMed Reviews

More than 1.6 million PubMed Reviews are semantically searchable on our test server:

Query: prostate cancer antigen 3

Query: transient cortical blindness after coronary angiography

Page 9: Semantics for universal search and discovery
Page 10: Semantics for universal search and discovery

Results from NLM’s Results from NLM’s PubMedPubMed

http://www.ncbi.nlm.nih.gov/pubmed?term=prostate%20cancer%20antigen%203

Page 11: Semantics for universal search and discovery
Page 12: Semantics for universal search and discovery

PubMed Query: PubMed Query: transient cortical blindness transient cortical blindness following coronary angiographyfollowing coronary angiography

Page 13: Semantics for universal search and discovery

More about the NLMplus More about the NLMplus

NLMplus Innovations

Universal SearchFlexible access to 59 NLM

databases

Semantic Search EngineSemantic searching of PubMed

Reviews

Biomedical Knowledge Basepowers “Explore and Discover”

powers the Semantic Search Engine

Intuitive User Interface

Wide Spectrum of NLM usersConsumers

Physicians

Biomedical researchers

Decision makers

NLM APIs, web services and software tools utilized by the NLMplus app

Entrez Programming Utilities

UMLS Terminology Services

Medlineplus Web Service

MetaMap API

SKR Web API

Read more about NLMplus

Page 14: Semantics for universal search and discovery

Potential WebLib Semantic Search Potential WebLib Semantic Search and and Knowledge Base ApplicationsKnowledge Base ApplicationsCommon Problem: accessing heterogeneous databases

Meaningful Solution: semantic technologies

Biomedical Knowledge Base and Semantic Search

National Library of Medicine

National Institutes of Health

Department of Health and Human Services

U.S. Government Departments and Agencies

Health Care

Web Knowledge Base and Semantic Search

Libraries and Research Organizations

Media and Content Companies

Educational Institutions

Businesses

The Web

Page 15: Semantics for universal search and discovery

Endre Jofoldi [email protected] twitter: EndreJofoldi

Dr. Tamas [email protected]

ContactContact