FAST ESP for SharePointIntegration of FAST ESP and SharePoint 2007

Insert Your Name HereInsert title and company here

Overview

Microsoft Enterprise SearchFAST ArchitectureFAST ESP + SharePoint OverviewFAST SharePoint ConnectorFAST-based Search Applications on SharePointIntegrating FAST ESP and Sharepoint with Windows 7 Desktop Search

Enterprise Search Roadmap

TomorrowToday

High End

Infrastructure

Entry Level

FAST ESPCross platformTuned for internet sites

No change to packaging & pricingIntegration via web parts & connectorFAST ESP on Windows, Linux, Unix

FAST Search for Internet Business

FAST Searchfor

SharePoint

ESP for SharePoint

OOB valueTuned for intranets

Bring the power of high-end

search to everyone

Microsoft’s Enterprise Search StrategyBuild on the FAST ESP platform to create innovative products

Make search the anchor for

monetizing assets online

Solutions for Internet Business

Solutions for Business Productivity

FAST ESP becomes the foundationfor all enterprise search products

Enterprise Search RoadmapNew FAST ESP-based products arriving with SharePoint 2010

Solutions for Internet Business

Solutions for Business Productivity

A common, underlying search platform with a rapid pace of innovation

Bridging Between Today and TomorrowIntroducing the ‘ESP for SharePoint’ offer

Buy ‘ESP for SharePoint’ now with a path to FAST Search for SharePoint

TodayFuture

Releases

For business productivity scenarios on Windows ServerFor customers who own the SharePoint Server eCALAvailable from FAST starting today until the general release of FAST Search for SharePoint

Buy Today With an Eye Towards the FutureHowever you purchase FAST ESP today, you’re covered tomorrow

SharePoint eCAL &

‘ESP for SharePoint’

(with current FAST M&S)

(with current FAST M&S)

Future versions of

(with an option to transition to future Microsoft Enterprise Search

offerings)

with a path to …Buy today …

FAST ESP Architecture

FAST ESP Logical ArchitectureArchitecture

DocumentProcessing

Indexing SearchQuery &Result

ContentConnectors

(Feeding Client)

Search Client

(Application)

Administration

FAST ESP™ - Content Acquisition

<XML>

400+ File

Types

FAST FileTravers

er

FAST Smart Connectors

FAST RDBMS

Connector

PartnerConnectors

Other Mechanism

s

<XML>

Push with FAST Content API

Enterprise Web

Crawler

Conversion LanguageDetection

Security

Pull Data from Database

Extract YourProduct Names

Extract People Names

Write to Database

Classify / Categorize

Normalize

Lemmatize Vectorize Tokenize

FAST ESP™

CO

LLEC

TIO

NS

Conte

nt

API

Connect

ors

Content Enrichment

CONTENT PROCESSINGPIPELINE

<XML>

400+ File

Types

Content Sources

…

…. . . . .

D

Q Query ResponseServers

SearchIndex

Search Client

Query Processing

QU

ERY A

PIQUERY PIPELINE

RESULT PIPELINE

SpellcheckQuery

TransformationSynonym Expansion

Matching EngineCompletion

Levenstein.NET

SubstringSentence

Regular Expression

.NETJavaC++

HTTP GET Web Service

Featured

ContentProgramtic interface for pushing content to ESP: • .NET• Java• C++• XML-RPC

FAST ESP + SharePoint

MOSS and ESP Integration

MOSS 2007 Connector

Web

Serv

ices

ESP Web Parts

.Net Search API

Meta Data,Security Info,& References

Documents

SearchResults

Queries

Win Auth Proxy

Security Access Module

SecurityEnterprise Quality of ServiceEnterprise Integration

Content Capture & Refinement

Contextual Insight

Search Management

Linguistics Relevance

Content DB

FAST ESP + SharePoint

FASTSharePoint2007ServiceDeployed on one or more WFE servers

FAST SharePoint Connector

SharePoint Connector Components

The SharePoint Connector provides the following featuresExtracts metadata and content from SharePoint Services, and feeds it to FAST ESP for indexing.Supports incremental indexing by reading the SharePoint Change Log.Reads Access Control List (ACL) information from SharePoint that can be indexed with the documents and used to preserve the access control that exists in the source system. User and group extraction is supported by the FAST ESP Security Access Module (SAM).Possibility to support multiple SharePoint top-level sites on different virtual servers.Provides a rich range of include/exclude filters.Maps dates and other data types correctly to FAST ESP. SharePoint data types of fields are kept all the way to the search engine to improve search possibilities (for example Navigators, range search). Easy indexing of all possible fields of all items with use of scope fields. Provides high freshness in index and low load on SharePoint server by reading changes from the SharePoint Change LogIncludes a Web Part template that can be installed as is, or customized to meet local requirement.

16

17

SharePoint to ESP document – List Items

List Item List Item

indexItemView = trueURL: Url to List itemItemView: Url to List ItemUrls: Url to List ItemDocumentType: ListItem

List Item without attachments

List Item with 2 attachments

List Item Attachment 1

Attachment 2

List Item

Attachment 1

Attachment 2

indexItemView = true

URL: Url to List itemItemView: Url to List ItemUrls: Url to List Item;url to both attachmentsDocumentType: ListItem

URL: Url to Attachment 1ItemView: Url to List ItemUrls: Url to List Item;url to both attachmentsDocumentType: AttachmentInherits Metadata from List Item

URL: Url to Attachment 2ItemView: Url to List ItemUrls: Url to List Item;url to both attachmentsDocumentType: AttachmentInherits Metadata from List Item

SharePoint Services Documents

Fast ESP Documents

18

Filters

WebInclude filter on pathExclude filter on path

ListInclude filter on path and typeExclude filter on path, title (RegExp) and type

ItemsInclude filter on extensionExclude filter on extension and file size

19

Other features

Support for multiple Virtual Servers. Easier maintenance.Central configurationEasy configuration – only few mandatory parametersHigh freshnessSupport for scope serachSupport for xml-export

Security Access Module

Source Systems

(w/user directories and content

w/access rights)

Connector

SearchIndex

Document ProcessingPipeline

Results Pipeline

Query Pipeline

User Monitor

ACL Monitor

Admin

Search Filter Generator

Last minute access rights

Security Access Module

SearchClient

21

FAST WinAuthProxy – About

A service used to authenticate against services that require Windows authentication.Authenticates on behalf of a clientOnly available for Windows platforms.Installed as a Windows serviceThe FAST WinAuthProxy service supports authenticating against sites protected by HTTPS/SSL. (certificate required)

22

SharePoint 2007 connector and the WinAuthProxy

The connector loads metadata from SharePoint using SOAP by calling the SharePoint Web Services.

The actual content (files/attachments/pages etc) is loaded directly from the SharePoint Web Server by an http(s) call.

The content can be retrieved from eitherFrom the connector itself

From a stage in the Document Processing Pipeline

(Illustrations on next slides)

Retrieving content from the Document Processing Pipeline is usually recommended avoid unnecessary network usage and better scaling.

Crawling Large SP Farms

Load Balancer

FAST Wrappe

r

FAST Wrappe

r

FAST SP Connector

WFE2

WFE1 WFE3

Admin Server,Content Distributor

Doc Processer, Indexer

Doc Processer, Indexer

Doc Processor, Indexer

QR Server

FAST-based Search Applications on SharePoint

Document Thumbnai

ls

Federated Results

Exact Navigator

Counts

Engage Your User with Visual Search

Numerous visual navigation options for more intuitive search

Results can be scanned rapidly with document previews and thumbnails

Identify content without downloading and opening applicationsDisparate result setsare unified with robust federation offeringmore control

ESP Web Parts on CodePlex

ESP Web Parts Demo

Navigation driven by Entity Extraction

VisualNavigators

Exact Navigator Counts

DisplaySelectedMeta Information

DocumentThumbnails

Content from Multiple Sources(Federation)

Get Better Answers, Fasterwith conversational search experiences that understand your information

Deep navigators with exact

counts

Document preview pane

Related searches

Documentthumbnails

Explore using navigatorsthat understand and visualize your information, making it easier to find

Make information usable—whether it’s unstructured content or structured application data,everything has more meaning

Access all content securelyusing a full-featured crawler, support for 400+ document types, and high-end scalability

Featured content

(Prototype only)

Amplify the Impact of Knowledge & Expertiseby building on a platform for social computing, collaboration, ECM and BI

Organization browsing

Recently authored content

Expertise identificatio

nFilter by focus,

expertise, and other attributes

Connect with expertiseusing improved matching frommined Outlook inbox data and

SharePoint MySite profiles

Improve relevance with usebased on how people tag and rate content in SharePoint and on click-throughs of search results

Use search as an entry pointto productivity applications like collaboration, social computing, ECM, workflow, and BI

Phonetic name lookup

(Prototype only)

Tackle Challenging Requirementswith a cost-effective enterprise search infrastructure

Scale to meet any demandusing linear scaling across content, queries, and index freshness—with a best-in-class hardware footprint and TCO

Build search-driven applicationsas an easy entry point to complex sets of business data and applications using a single, company-wide search platform

Tune for great findabilitythat supports 85 languages, flexible content processing, with relevance and UX control for specific audiences

Deploy and run easilywith simple, out-of-the-box deployment for common use cases, powerful search management, and flexible administration

TechReady

https://mytechready.com/banner.html

EMEA R&D

(Pro

toty

pe o

nly

)

(Prototype only)

Integrating FAST ESP and Sharepoint with Windows 7 Desktop Search

All-Up Search

Everyone’s

Ours

My Stuff

400+ File Types

Windows 7 Desktop + FAST ESP

Choose a search provider right from the Start Menu

Windows 7 Desktop + FAST ESP

Display custom search providers in the “Search Again” links

Windows 7 Desktop + FAST ESP

Windows 7 Desktop + FAST ESP

“Search on Website” link allows user to see the results within SharePoint itself, with Dynamic Navigation

Document Thumbnai

ls

FAST ESP Generate

d Metadata

Exact Navigator

Counts

Gateway to full ESP Functionality

Numerous visual navigation options for more intuitive search

Results can be scanned rapidly with document previews and thumbnails

Identify content without downloading and opening applications

FAST ESP extracts and displays custom metadata from unstructured content

“Search on Website” Link

demo

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.

The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the

date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

microsoft.com / Enterprise Search

Thank You.

40

SharePoint 2007 Connector OverviewCCTK

Publisher

Fast

ESP

Fast

ML

Share

Poin

t200

7

ListQueue

ItemLoaders

WebAndListLoader

Start Connector

SPA

dapte

rAPI

Common ResourcesPersistence HandlerCallback Handler

State Handler

SPAdapter(one web)

SPTaskSplitter(Split on webs)

SPNormalizer

ItemLoaderController