Extending the SharePoint Search Infrastructure

Outline

SharePoint 2010 Search ArchitectureThe Connector FrameworkEnhancing the Search User InterfaceCreating Custom Ranking Models

SharePoint 2010 Search Architecture

SharePoint 2010 Search Product Line FAST and SharePoint Search form a unified productivity search line

Product

High End

Infrastructure

Entry Level

Key Themes

Capabilities of SharePoint Search 2010 PLUS:

Conversational user experienceEnhanced content processing capabilitiesDeep platform flexibility and scaleComplete search experienceUnique social search featuresIndustrial strength capabilitiesSharePoint platform integration

Basic search experienceSimple to set up and deployGreat price!

FAST Search for SharePoint 2010

SharePoint Search 2010

Search Server Express 2010

SharePoint Search Architecture

WFEsQuery server

s

Remote File Shares

SharePoint Sites

Custom Repositories

Web Sites

Metadata Database

Crawl Database

SSA Databas

e

Index Servers

Send Query

..

.

..

.

Propagate index + metadata to query

server & DB

Query Processo

r

Send Query to full text

index

Get Results Get Results from full text

index

Get

met

adat

a

info

from

SQL

Index Repositories

FAST Search for SharePointIntegration Architecture

Content Interface

WFEs Query servers

Remote File Shares

SharePoint Sites

Custom Repositories

Web Sites`

Metadata Database

Crawl Database

Query & Results Server

Query Processor

Search Engine

Index

Processing servers

SSA Database

Index Servers

Index Repositories

using SharePoint gatherer

Index Repositories using FAST

system

Propagate index to search engine

Query request to FAST location

Send Query to FAST backend

Modified

QuerySearch ResultsResults

Processing

Query Processin

g

Final search results

Show results in SharePoint

Send content to FAST for indexing

.

.

.

.

.

.

Enterprise Search PlatformConnecting to Repositories

Capabilities SharePoint Search

FAST Search for SharePoint

Indexing

Protocol Handlers (Shared SharePoint

Connector )

Index Database/Web Service using BDC Connectors

(Shared SharePoint

Connector )

Index custom repositories using custom BDC connectors

(Shared SharePoint

Connector )

Content API can be used for Push based content indexing

JDBC Based Indexing Pipeline Plug-ins

Querying

Federation

Enterprise Search PlatformManaging Content

Capabilities SharePoint Search

FAST Search for SharePoint

Define document metadata & scopes

Customize OOB Relevance Model

Custom Relevance Model (Enhanced)

Entity Extraction Best Bets Visual Best Bets Thesaurus PowerShell support

Enterprise Search PlatformEnhancing End User Experience

Capabilities SharePoint Search

FAST Search for SharePoint

Extend OOB Web Parts Interact with existing Web Parts Page Level Query hooks Page Level Result hooks Shallow Refinement Deep Refinement Result Previews Sort by custom managed properties

User Contextual Search

Enterprise Search PlatformQuery Capabilities

Capabilities SharePoint Search

FAST Search for SharePoint

Query Object Model (Advanced FAST

properties)

Federation Object Model (Advanced FAST

properties)

Query Web Service (Advanced FAST

properties)

Enhanced Keyword Query Language

Advanced FAST Query Language Enhanced RSS Mobile Search Search from Windows User contextual search

.NET Assembly Connector Framework

The Connector Framework

MOSS 2007 IndexingProtocol HandlersBusiness Data Catalog IDEnumerators

SharePoint 2010 ConnectorsExchangeNotesDocumentumFile NetOpen Text Custom .NET Connector

The Connector Framework

App Server

LOB App

App Server

MD Service

MetaData

SSO Service

SQL

SSO

External Data Source

BDC Protocol Handler

DB Server

BDC Runtime

MD Cache

Search Engine

BDC Profile Page

BDC Based .NET Assembly Connector New Features for Search in Model Files

Support for attachments

Item-level security

Crawl across entity associations

Control the resulting display URL

Creating a .NET Connector

demo

Enhancing the Search User Interface

Customizing User Interface

Extend OOTB Web PartsExtend any Web Part to change the default behavior

Add new Web Part that interacts with existing Web Parts on the search page

All Web Parts communicate through public interface (SharedQueryManager object)

Customizing User Interface (ctd)

Ability to modify query before it leaves the end user page

Override the GetXPathNavigator() method of Core Results Web Part

Ability to modify the search results before the results are displayed to the users

Override AggregateResults() method of LocationList class

Search Parts

demo

Creating Custom Ranking Models

Ranking Models

Admins use XML files to describe new Ranking Models

Custom ranking models rank using a weighted-average of the features in the XML descriptor

BM25F (Query Dependent Feature)

Static features

Click Features (static)

Manage Ranking Models using PowerShell

Use Custom Ranking Model in End user using Web Part Property

Multiple OOB Ranking ModelsDifferent for Core Results and People

Cannot be modified

Custom Ranking Model

demo

Summary

SharePoint 2010 Search ArchitectureThe Connector FrameworkEnhancing the Search User InterfaceCreating Custom Ranking Models