SearchCrawler Class

Search HTML crawler for indexing content from the output of the web site

Inheritance Hierarchy

System.Object
  CMS.Search.SearchCrawler

Namespace: CMS.Search
Assembly: CMS.Search (in CMS.Search.dll) Version: 8.2.23

Syntax

public class SearchCrawler

The SearchCrawler type exposes the following members.

Constructors

	Name	Description
Public method	SearchCrawler

Methods

	Name	Description
Public method	DownloadHtmlContent	Downloads the html code for the specified url.
Public method Static member	HtmlToPlainText	Converts html to the plain text (body part).
Public method Static member	IsCrawlerRequest	Returns true if current request was initialized by smart search crawler.

Extension Methods

	Name	Description
Public Extension Method	AsValue	Converts object to a query value which can be used as a query parameter (Defined by QueryExtensions.)
Public Extension Method	GetAPIString	Gets the string by the specified resource key (Defined by CoreExtensions.)
Public Extension Method	GetString	Gets the string by the specified resource key (Defined by CoreExtensions.)
Public Extension Method	ToBoolean	Returns the boolean representation of an object or default value if not. (Defined by CoreExtensions.)
Public Extension Method	ToDateTime	Returns the DateTime representation of an object or default value if not. (Defined by CoreExtensions.)
Public Extension Method	ToDouble	Returns the double representation of an object or default value if not. (Defined by CoreExtensions.)
Public Extension Method	ToGuid	Returns the Guid representation of an object or default value if not. (Defined by CoreExtensions.)
Public Extension Method	ToInteger	Returns the integer representation of an object or default value if not. (Defined by CoreExtensions.)
Public Extension Method	ToString	Returns the string representation of an object or default value if not. (Defined by CoreExtensions.)

Properties

	Name	Description
Public property Static member	CrawlerDomainName	Gets the domain specified in app keys which should be used for crawler indexer.
Public property	CrawlerFormsUserName	Gets the username which should be used for crawler search.
Public property Static member	CrawlerID	Gets or sets the crawler id which is sent within the request.
Public property	CrawlerPassword	Gets the scheduler user password.
Public property Static member	CrawlerUserAgent	Gets or sets the user agent which should be used within crawler search.
Public property	CrawlerUserName	Gets the crawler user name which should be used for current search.

Events

	Name	Description
Public event Static member	OnHtmlToPlainText	Fires when html to plain text process is required.