Crawl Method (startURL, isLoginPage, indexableSourceRecord)

Keyoti SearchUnit v6

Starts the spidering process, which will recrawl all the existing documents for new links.

Declaration Syntax

C#	Visual Basic

[ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)]
public virtual ArrayList Crawl(
	string startURL,
	bool isLoginPage,
	WebsiteBasedIndexableSourceRecord indexableSourceRecord
)

<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)> 
Public Overridable Function Crawl ( 
	startURL As String,
	isLoginPage As Boolean,
	indexableSourceRecord As WebsiteBasedIndexableSourceRecord
) As ArrayList

Parameters

startURL (String): The URL to start crawling a web-site from.

isLoginPage (Boolean): Whether this start URL is the login form for the site

indexableSourceRecord (WebsiteBasedIndexableSourceRecord): The indexable source record representing a web-site to crawl

Return Value

ArrayList
ArrayList of Uri objects with URLs that weren't already in the index

Exceptions

Exception	Condition
InvalidOperationException	If Configuration.IsLock is true (a lock has been applied).

Assembly: Keyoti4.SearchEngine.Core (Module: Keyoti4.SearchEngine.Core.dll) Version: 2022.8.22.610