Understanding Your FAST Search 2010 for SharePoint Application Topology

Transcription

1 Understanding Your FAST Search 2010 for SharePoint Application Topology Daniel Webster MCT, MCSE: Security + Internet, MCSA, MCTS: MOSS07 Co-author, Microsoft Office SharePoint Server 2007 Administrator s Companion Technical Editor, Microsoft Office SharePoint Server 2007 Best Practices Co-author, Microsoft SharePoint Server 2010 Administrator s Pocket Consultant Contributing author, Microsoft SharePoint Server 2010 Administrator s Companion

2 2 SharePoint Saturday Atlanta

3 3 SharePoint Saturday Atlanta

4 4 SharePoint Saturday Atlanta

5 5 SharePoint Saturday Atlanta

6 Summit 7 Systems We are Experts in Enabling Enterprise SharePoint Success We view SharePoint as a Platform for Innovation in your organization Microsoft Certified Partner with multiple Gold competencies specializing in the Business Productivity infrastructure including SharePoint and FAST Enterprise Search Our proven Solutions include: SharePoint Platform Solutions Enterprise Content Management Enterprise Search Business Process Mapping Internet Solutions/Web Content Management Extranet Solutions Intranet Solutions

7 Can We Help You? Yes We Can! To discuss your biggest obstacle and find out how we can work together to Conquer Your Mountain Visit our website at: Or give us a call at:

8 Agenda FAST Search 2010 for SharePoint: Two Worlds SharePoint Components Inside FS4SP FAST Components Scaling: Why Would You? Additional Resources

9 How To For PowerShell scripts see Search Topology Operations in SharePoint Server 2010 at For UI instructions see Farm Topology Management at

10 FAST Search Extends SharePoint Server Search Content Search based on FAST ESP Common query and federation APIs FAST Search for SharePoint Common connectors and content APIs SharePoint Server 2010 End Users Content + Unique Social Search Profiles from SharePoint Server 2010 Common IT Pro and developer experience

11 SharePoint Search Components Administration Component Search Query and Site Settings service Crawl Components Crawl Databases Property Databases Index Partition Query Component(s) Host Distribution Rules

12 Search Databases & SQL Search requires three databases. Your environment may include multiple Property and Crawl databases. The Search administration database is typically small: allocate 10 GB. To estimate the required storage for your Property and Crawl databases, use the following multipliers: Crawl: (sum of content databases) Property: (sum of content databases)

13 Search Databases & SQL The IOPS requirements for Search are significant. For the Crawl database, search requires from 3,500 to 7,000 IOPS. For the Property database, search requires 2,000 IOPS.

14 SharePoint Search Topology For a recorded presentation on scaling the SharePoint components topology, see

15 FS4SP Overview (SharePoint) SharePoint Farm Site Collection Administration UI Deployment User Context Management Site / Document Promotion & Demotion Keywords / Synonyms / Best Bets PowerShell Schema Configuration Admin Configuration Deployment Configuration Central Administration UI Property Mapping Property Mapping Spell Checking Reports Custom Search Application FAST Query SSA Query Web Service Federated Object Model Query Object Model FAST Search Server 2010 for SharePoint FAST Connector SSA SharePoint BDC Exchange Web External Federated Sources People Search Active Directory Microsoft System Center Operations Manager

16 FAST Components Administration Search Cluster Indexing Indexing Dispatcher Query Processing Query Matching Item Processing Web Analyzer Content Dispatcher

17 FAST Connectors Web Crawler Database (JDBC) Lotus Notes Connector

18 FS4SP Content Processing

19 Network Traffic

20 Configurable content processing pipeline Transform and process content automatically Strong linguistic coverage 80+ languages detected 45 languages with advanced linguistics features Property Extraction to create new metadata Prebuilt extractors: Person, Location, Company Generic extractors to extend Extensibility The Content Pipeline Processing & refinement REDMOND, Wash., and OSLO, Norway Jan. 8, 2008 Microsoft Corp. (Nasdaq MSFT ) today announced that it will make an offer to acquire Fast Search & Transfer ASA (OSE: FAST ), a leading provider of enterprise search solutions, through a cash tender offer for Norwegian kroner (NOK) per share. This offer represents a 42 percent premium to the closing share price on Jan. 4, 2008 (the last trading day prior to this announcement)

21 conceptsearching FAST Integration

22 SmartLogic FAST Integration

23 Silver Light Conversion Longitude FAST Integration Longitude Search Content Search Center User Profiles

24 Deployment.xml: Admin <host name= fastadmin.s7gear.com"> <admin /> <document-processor processes="12" /> <webanalyzer server="true" max-targets="4" linkprocessing="true" lookup-db="true" redundantlookup="false" /> <query /> </host>

25 Deployment.xml: Application Server <host name= fastapp1.s7gear.com"> <document-processor processes="12"></document-processor> <indexing-dispatcher /> <webanalyzer server="false" max-targets="4" link-processing="true" lookup-db="true" redundant-lookup="true" /> </host>

26 Deployment.xml: Cluster Member <host name= fastserver01.s7gear.com"> <document-processor processes="16" /> <content-distributor id= 0" /> <indexing-dispatcher /> <searchengine row="0" column= 0" /> </host>

27 FS4SP Components Admin Role Index / Query Role

28 FS4SP Search Cluster Components <searchcluster> <row id="0" index="primary" search="false" /> <row id="1" index="secondary" search="false" /> <row id="2" index="none" search="true" /> <row id="3" index="none" search="true" /> </searchcluster>

29 Scaling for Availability (SharePoint) Load Balanced Crawl Targets Create Multiple Crawl Components per Database Across Multiple Servers Create Multiple Query Components Across Multiple Servers Mirror or Cluster SQL Servers

30 Scaling for Crawling Add Crawl Databases Add SQL Servers Use Host Distribution Rules Add Crawling Components & Servers Add Dedicated Crawl Targets

31 Scaling for Query Performance Partition the Index Add Query Components & Servers

32 Scaling Document Processing Add DocProcessors (automatic load balancing) To Cluster Members To Dedicated Application Servers Add Web Analyzers To Cluster Members To Dedicated Application Servers Add Content Dispatchers

33 Scaling Indexing Add Columns to increase Indexing capacity Add Indexer Rows to increase Recoverability Add Indexing Dispatchers (Can be outside cluster.)

34 Scaling Query Matching Add Query Matching Rows To Increase Availability and Performance Add Query Processing Components (Can be outside cluster.)

35 Scaled Out Farm MOSS Farm Dedicated Targets TK5-FSTCRL-01 TK5-FSTCRL-02 FS14 Crawl 1 FS14 Crawl 2 Central Admin Using SQL Cluster 1 Using SQL cluster1 TK5-FSTCRL-03 People Query 1 People Crawl Component 1 Using SQL Cluster 2 TK5-FSTCRL-04 People Query 2 People Crawl Component 2 Using SQL Cluster 2 Heading FAST Search Farm Heading Heading TK5-FSTCRL-05 Admin ConfigServer Spelltuner SamAdmin Using SQL Cluster 2 TK5-FSTCRL-06 QRServer WA Admin WA Worker WA Lookup DB TK5-FSTCRL-07 QRServer WA Worker WA Lookup DB TK5-FSTCRL-08 QRServer WA Worker WA Lookup DB TK5-FSTCRL-09 TK5-FSTCRL-10 Content Distributor 1 Content Distributor 2 Indexing dispatcher 1 Indexing Dispatcher 2 6 Docproc 6 Docproc (Enterprise crawler) (Enterprise crawler) TK5-FSTIDX-01 4 Docproc TK5-FSTIDX-03 4 Docproc TK5-FSTIDX-05 4 Docproc TK5-FSTIDX-07 4 Docproc TK5-FSTIDX-09 FAST TK5-FSTIDX-11 WFE #2 4 Docproc 4 Docproc TK5-FSTIDX-13 4 Docproc TK5-FSTIDX-15 4 Docproc TK5-FSTIDX-17 4 Docproc TK5-FSTIDX-19 4 Docproc TK5-FSTIDX-21 4 Docproc TK5-FSTIDX-23 4 Docproc TK5-FSTIDX-02 TK5-FSTIDX-04 TK5-FSTIDX-06 TK5-FSTIDX-08 TK5-FSTIDX-10 TK5-FSTIDX-12 TK5-FSTIDX-14 TK5-FSTIDX-16 TK5-FSTIDX-18 TK5-FSTIDX-20 TK5-FSTIDX-22 TK5-FSTIDX-24

36 Additional Resources: Online Manage search topology ( Technical diagrams ( Search cmdlets (

37 Additional Resources: Books Microsoft SharePoint Server 2010 Administrator s Pocket Consultant Microsoft SharePoint Server 2010 Administrator s Companion Professional Microsoft Search Working with FAST Search Server 2010 for SharePoint

38 Free Online Training

39 #SPSATL speaker sponsor Session Prizes 1 Starbucks - 4 $25 gift cards 2 MSFT Store 2 $50 gift cards Lunch Kindle Fire! 3 Best Buy 2 $50 gift cards 4 Amazon.com 4 $50 gift cards 5 itunes 4 $50 gift cards GRAND PRIZE: XBOX + KINECT

40 Daniel Webster Fill out surveys for big prizes SCAN QR MCT, MCSE: Security + Internet, MCSA,, MCITP & MCTS: SharePoint 2010 Co-author, Microsoft Office SharePoint Server 2007 Administrator s Companion Technical Editor, Microsoft Office SharePoint Server 2007 Best Practices Co-author, Microsoft SharePoint Server 2010 Administrator s Pocket Consultant Contributing author, Microsoft SharePoint Server 2010 Administrator s Companion