SearchCrawler Class

Search HTML crawler for indexing content from the output of the web site

Inheritance Hierarchy

System.Object
  CMS.Search.SearchCrawler

Namespace: CMS.Search
Assembly: CMS.Search (in CMS.Search.dll) Version: 13.0.131

Syntax

public class SearchCrawler : ISearchCrawler

The SearchCrawler type exposes the following members.

Constructors

	Name	Description
Public method	SearchCrawler	Initializes an instance of the SearchCrawler class.

Properties

	Name	Description
Public property Static member	CrawlerID	Gets or sets the crawler id which is sent within the request.
Public property	CrawlerUser	Gets or sets the user name which should be used for crawler search.
Public property Static member	CrawlerUserAgent	Gets or sets the user agent which should be used within crawler search.

Methods

	Name	Description
Public method	DownloadHtmlContent	Downloads the HTML code for the specified URL.
Public method Static member	HtmlToPlainText	Converts html to the plain text (body part).
Public method Static member	IsCrawlerRequest	Returns true if current request was initialized by smart search crawler.

Events

	Name	Description
Public event Static member	OnHtmlToPlainText	Fires when html to plain text process is required.