the world of information at your fingertips the right information at the right moment to make...
TRANSCRIPT
Creating a Unified View of Business Critical Information with SharePoint and SearchJeff FriedCTOBA Insight
Guy Mounier
CEOBA Insight
The world of informationat your Fingertips
The right information at the right moment to make
decisions
Deliver relevant information
Unified View
SharePoint is a platform meant to be extended…
PresentationData
Search Makes
the Connection!
Who We Are - The SpeakersJeff Fried, CTO, BA Insight• Previously VP Advanced
Solutions for FAST, then Search Product Manager for Microsoft
Based in Boston, MA, USA• Technet Column: “A View from the Crawlspace”• Twitter: @jefffried
Guy Mounier, Founder & CEO, BA InsightConsulting background in ERP and BI. CTO at Fortune 100 Company prior to co-founding BA Insight.
Based in New York City, USA
Blog: BAinsight.com/BlogTwitter: @BAinsight
Demo
Unified View Example
The Value of a Unified View• The problem: information and application silos• Unified View - Examples in action
Unified View – Data Layer• Creating a single unified index via crawling & connectors• Using Federation across 2010 and 2013; O365 and on-
prem
Unified View – Presentation Layer• Rapid Assembly of Search-Based Applications• Patterns and Practices
Outline
Top business challenges we hear about
Information Explosion Data in Silos Diverse User Requirements
Unstructured Data Un-Organized Un-Categorized Exponential Growth
Discrete Roles Diverse Systems Varied functions Lack 360° view of info
100+ Systems No Interconnect Difficult to find info Frustration
BigData
Unified View feeds many Search-Based Applications
CRMECM
Web
ERP
Data Bases
CloudUnified Index
Expertise Finder
Customer 360
Asset Tracker
Research Portal Analyst Workbench
• Any Data Source• Any Data Type• Any Device• Intuitive• Interactive• Targeted• Dynamic
Search Driven Unified View
Demo
Unified View at BA Insight:Across O365, TFS, Web Site, SharePoint, ….
Information and application silos
Marketing Sales ProcurementConsulting Research HR / LegalSupportProduction
ContentSilos
Siloed UI Applications
Receive customer call
Search in CRM
system(s)
Search in contract system
Verify customer
data
Search in issues DB
Search KM and experts
Search in discussions and blogs
Analyze Answer customer
Introducing "Paul" from SupportCustomer support – the hard way
CRM DB
Time
7 minutes
CMS
10 minutes
Agreements
5 minutes
Issue DB
15 minutes
Intranet
20 minutes
Wikis and blogs
15 minutes
10 minutes
82 minutes
Receive customer call
Search in CRM
system(s)
Search in contract system
Verify customer
data
Search in issues DB
Search KM and experts
Search in discussions and blogs
Analyze Answer customer
Introducing "Paul" from SupportCustomer support – the hard way
Time
Challenges;• Time to resolution = Cost• Quality on solution and cost of reworking information• Customer satisfaction• Frustration
7 minutes10
minutes5 minutes
15 minutes
20 minutes
15 minutes
10 minutes
82 minutes
Receive customer call
Find all relevant informati
on
Analyze Answer customer
With Unified ViewCustomer support – the new way
Time
CRM DB CMSAgreement
sIssue DB Intranet
Wikis and blogs
1 minute 2 minutes 3 minutes
Search platform
Demos
Example Search Based Applications Based on a Unified View
Unified View App for Legal
It is a General App Pattern across Industries
Customer Service 360 Client Matter 360 Sales Manager View
Analyst Workbench Research Portal Intelligence Dashboard
Click this link to see Screenshot Details
New Class of Enterprise Apps, Powered by SearchTotalView for Customer Service
New Class of Enterprise Apps, Powered by SearchTotalView for Sales
New Class of Enterprise Apps, Powered by SearchTotalView for Professional Services
New Class of Enterprise Apps, Powered by Search
21
TotalView for Research
New Class of Enterprise Apps, Powered by Search
22
TotalView for Intelligence
The Value of a Unified View• The problem: information and application silos• Unified View - Examples in action
Unified View – Data Layer• Creating a single unified index via crawling & connectors• Using Federation across 2010 and 2013; O365 and on-
prem
Unified View – Presentation Layer• Rapid Assembly of Search-Based Applications• Patterns and Practices
Outline
Data
Silo
s
Email & Messaging Search enginesCRM/ERP
ECM, Social Streams
DatabasesUnstructured , Big Data
External Web Sites
SaaS/Office 365
Data Layer
Presentation Layer
Indexing Connectors
Auto-Classification
Unified View Architecture
Entity and Relationship Extraction
Federating Connectors
Visual Refiners and Dynamic Dashboards
Alerting & Trending Query & Result Orchestration
Search Makes the Connection!
Preview / Action on Documents + Data
• Indexing• Crawl content from an on-premise search farm+ Provides uniform content processing, relevance, and latency‒ Requires higher bandwidth and footprint
• Federation• Send queries to multiple search instances and combine the results+ Lower bandwidth, small footprint, sometimes the only way possible‒ Only as good as the weakest link, tricky to combine results well
2 ways of creating a unified data layer
What is an indexing connector?
Web Content
File shares
Databases
SharePoint
Enterprise Repositories
Search Engine
Connector
Connect Securely1
Map Content2
Feed Engine3
Find any changes4
• Heterogeneous Data Models and System characteristics• Every system is different• Mapping to common metadata is essential for findability
• Heterogeneous Security• Every system has different security and authentication models• User must see ONLY information they are entitled to, across all
systems• Bandwidth and Performance
• Lots of content!!!• Cross-site Bandwidth can still be expensive or limited• Source systems can be the limiting factor and need a ‘light touch’
• Usually MANY systems, not just a couple
Why is this hard?
Demo
Unified View at BA Insight:Across O365, TFS, Web Site, SharePoint, ….
Indexing Connectors
SharePoint / FASTMetadata
Enrichment
Change LogSecurity Mapping
Search Optimized
API
Targets
SharePoint Libraries & Lists
Unified Search Index
Most organizations have MANY enterprise systems; you can surface all these in SharePoint
• Aderant Practice Management
• Autonomy EAS / (Zantaz) • Autonomy Worksite
(iManage)• Elite Prolaw • EMC Documentum• EMC eRoom• HP Trim Context
(TowerSoft)• IBM Lotus Notes • IBM Filenet P8• IBM Content Manager• IBM DB2• IBM Filenet Content
Services
IBM WebSphere KnowledgeMill OnePlace LexisNexis Interaction CRM Microsoft Dynamics CRM Microsoft Exchange Microsoft Exchange Online Microsoft SharePoint Online Microsoft SQL Server NetDocuments Objective DMS OpenText Hummingbird / eDocs DM OpenText LegalKEY / eDocs RM
Oracle Databases Oracle CMS/Stellent Oracle WebCenter Interactive
(PlumTree) Practical Law Real Practice Salesforce.com/Force.com SAP Business Suite SAP DMS Symantex EVault Thomson Reuters West KM Xerox DocuShare
What is Federation? “Scatter-Gather” across multiple search engines
Combined Result SetOOB in SharePoint 2013: Result Blocks
With Partner Products: interleaved by
relevance order Unified refiners for
streamlined navigation and filtering
Auto-generated refiners based on identity of source systems
Cross-version Federation to SharePoint 2013Scenario 1: Enabling operations across mixed farms
Unified view (and refinement) of all enterprise content
Get the SP 2013 Search Experience enterprise-wide as soon as first farm deploys
Demo
Federating across FAST Search for SharePoint and SharePoint 2013
Hybrid Cross-Version Federation
Scenario 2: Bridging SharePoint 2010 & SharePoint Online 2013 Adopt SharePoint 2013
Online rapidly, without having to immediately upgrade on-premise
Get the SP 2013 Online search experience enterprise-wide as soon as Office 365 subscription commences
Demo
Federating across O365 (running SharePoint 2013) and SharePoint 2010
How does the Federator combine results?
• Intelligent unification of the Search Results
• Interleaved results• Merged refiners• Augmented metadata
Interleaves result sets across sources by relevance order
Creates new source refiner on
the fly
Combines refiners (adding ones with the same value)
The Value of a Unified View• The problem: information and application silos• Unified View - Examples in action
Unified View – Data Layer• Creating a single unified index via crawling & connectors• Using Federation across 2010 and 2013; O365 and on-
prem
Unified View – Presentation Layer• Rapid Assembly of Search-Based Applications• Patterns and Practices
Outline
Data
Silo
s
Email & Messaging Search enginesCRM/ERP
ECM, Social Streams
DatabasesUnstructured , Big Data
External Web Sites
SaaS/Office 365
Data Layer
Presentation Layer
Indexing Connectors
Auto-Classification
Unified View Architecture
Entity and Relationship Extraction
Federating Connectors
Visual Refiners and Dynamic Dashboards
Alerting & Trending Query & Result Orchestration
Search Makes the Connection!
Preview / Action on Documents + Data
1 Topicmight be multiple sources
360° Viewresults, apps, widgets
Relevanttuned to the user community
Userleverage your knowledge
Graphical Navigation
Results
Map
Advertising
Search
Ratings
Widget
ZAGAT
The Key is Search-Driven Presentation
Demo
Search-Driven Presentation
42
Medical Research Portal
Site Navigation
Tag Cloud
Technical Documents External Sources
Welcome User | TitleLogo
Product Marketing Documents
Document Histogram
Keywords, Taxonomy, Synonyms, Definitions
Search
Welcome Matteo Di Tomasso | Vice President, Research Informatics
heart disease lipitor
Products Symptoms Compounds Research 360° My Lab Notebook
Source: Research Documentum
1997 2001 2006 2011
Atorvastatin: FDA Submission DocumentsHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost::8571/Webtop/FDA/Submissions/Lipitor
Atorvastatin: MSDS – Data SheetHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost:/Shared Documents/FDA/Submissions/Lipitor
Lipitor: Dosing, Side Effects and IndicationsHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost:/Shared Documents/FDA/Submissions/Lipitor
Technical Documents Product Marketing
Lipitor – Physician Fact SheetHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost:/Shared Documents/FDA/Submissions/Lipitor
Atorvastatin: End of Patent StatementHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost:/Shared Documents/FDA/Submissions/Lipitor
Lipitor: Common QuestionsHMG-CoA reductase inhibitor which lowers plasma cholesterol levels by inhibiting endogenous cholesterol synthesis. It also reduces triglyceride levels through an as yet unproven mechanism. Dose-dependent reductions in total cholesterol, ...Authors: Lea AP, McTavish Date: 3/11/2010 Size: 6mbhttp://localhost:/Shared Documents/FDA/Submissions/Lipitor
MeSH Cloud
Carcinoid Heart Disease Cardiac Tamponade Cardiomegaly Cardiomyopathies
Endocarditis Heart Aneurysm
Heart Arrest Heart Defects,
Congenital Heart Failure Heart Neoplasms Heart Rupture
Heart Valve Diseases Myocardial Ischemia
Pericardial Effusion Pericarditis Pneumopericardium
Pulmonary Heart Disease Rheumatic
Heart Disease
Ventricular Dysfunction Ventricular Outflow Obstruction
All Scientific Journals NIH Medline Scirus FDA
Series1
Document Histogram
Source: Marketing SharePoint 2010
Triad of Metabolic Syndrome, Chronic Kidney Disease, and Coronary Heart Disease with a Focus on MicroalbuminuriaMicroalbuminuria develops in many patients with metabolic syndrome and may be an important correlate of chronic kidney disease and coronary heart disease. Journal Article, J Am Coll Cardiol, June 2011
Mortality in Adult Congenital Heart DiseaseLearn more about the causes of death for adults with congenital heart disease. ... in adults with congenital heart disease is known to be ... Journal Article, European Heart Journal, June 2010
Heart Disease in Patients with Pulmonary EmbolismSome specific heart diseases in older patients could themselves be a possible source of pulmonary emboli. ... of review Several heart diseases are ... Journal Article, Curr Opin Pulm Med, September 2010
Medline Journals
Source: Medline via BA Insight Federator
Heart DiseaseScope Note: Pathological conditions involving the HEART including its structural and functional abnormalities.
See Also: Neurocirculatory Asthenia, Myocardial Infarction
Keywords: angina, high blood pressure, hypertension, ischemic heart disease, acute myocardial infarction, atherosclerosis, hypercholesterolemia, lipoprotein, low-density lipoprotein, LDLTaxonomy: Diseases (1,442,487)
Cardiovascular Diseases (8,322)
Heart Diseases (1,387)
Demo
SearchParts
Longitude Search Parts – Information Orchestrated
Refiner Tiles• Locate refiners on multiple areas on page
Search Templates• Refinement, Query, Result components • Panels, Apps, & Sites
Widgets • ‘Search Within’ List• Multi-select (OR) • Dynamic List• Date Slider • Scalar Range Slider• Pie Chart • Path Tree • Search Bread Crumbs• Multi-field Search Box • Property-specific search in Search Box• Saved Query / History• ….and more …..
Rapid, Model-Driven Application DeliveryConfigurable and Reusable Components for a Compressed Time-to-Value
4 to 12 Weeks Total Time-to-Value
SBA Platform Unified View Apps
Data
Silo
s
Email & Messaging Search enginesCRM/ERP
ECM, Social Streams
DatabasesUnstructured , Big Data
External Web Sites
SaaS/Office 365
Data Layer
Presentation Layer
Longitude Connectors
Longitude AutoClassifier
BA Insight & Unified View Architecture
Entity and Relationship Extraction
Longitude Federator
Longitude SearchParts
Alerting & Trending Longitude Federator
Search Makes the Connection!
Longitude Search
The Demand for Unified View is Accelerating;Driven by two big underlying trends
Structured AND Unstructured BIG DATA
Technology Expectations
End-User Expectations
Consumerization of IT
& Intuitive User Experience
201520102006
Sta
te o
f th
e E
nte
rpri
se
Source: IDC
(1 Exabyte = 1 Million Terabytes)
60% Unstructured
Data
30% Unstructured
Data
Technology Trend: Big Data
161 Exabytes10+ Data Silos 988 Exabytes
80+ Data Silos
8,000 Exabytes500+ Data Silos
90% Unstructured Data
Every two days now we create as much information as we did from the dawn of civilization up until 2003Eric Schmidt (Former CEO of Google)
End-User Trend: Consumerization of ITConsumer AppsSearch for Product, Restaurant, Travel
Enterprise AppsSearch for Experts, Projects, Customers, Vendors, Parts,
Intuitive Unified View Intuitive Targeted Context-aware Device-independent Actionable
The world of informationat your Fingertips
The right information at the right moment to make
decisions
Deliver relevant information
Unified View = POWER
Want to Know More About SharePoint 2013 Search?
The Essential Guide to Enterprise Search in SharePoint 2013
Everything You Need to Know to Get the Most Out of Search and Search-based Applications
Available at BA Insight Booth #234 & downloadable free from
www.SharePointSearch2013.com A one stop shop for e-books, videos and
more about SharePoint 2013 Search100+ page, in-depth guide to SharePoint 2013 search. 22 easy to digest chapters that can be read on their own or
together