SearchCrawler Class

Search HTML crawler for indexing content from the output of the web site

Inheritance Hierarchy

System.Object
  CMS.Search.SearchCrawler

Namespace: CMS.Search
Assembly: CMS.Search (in CMS.Search.dll) Version: 9.0.0

Syntax

public class SearchCrawler

The SearchCrawler type exposes the following members.

Constructors

	Name	Description
Public method	SearchCrawler

Properties

	Name	Description
Public property Static member	CrawlerDomainName	Gets the domain specified in app keys which should be used for crawler indexer.
Public property	CrawlerFormsUserName	Gets the username which should be used for crawler search.
Public property Static member	CrawlerID	Gets or sets the crawler id which is sent within the request.
Public property	CrawlerPassword	Gets the scheduler user password.
Public property Static member	CrawlerUserAgent	Gets or sets the user agent which should be used within crawler search.
Public property	CrawlerUserName	Gets the crawler user name which should be used for current search.

Methods

	Name	Description
Public method	DownloadHtmlContent	Downloads the html code for the specified url.
Public method Static member	HtmlToPlainText	Converts html to the plain text (body part).
Public method Static member	IsCrawlerRequest	Returns true if current request was initialized by smart search crawler.

Events

	Name	Description
Public event Static member	OnHtmlToPlainText	Fires when html to plain text process is required.