Crawl Method (startURL, isLoginPage, indexableSourceRecord)

Keyoti SearchUnit v6

Starts the spidering process, which will recrawl all the existing documents for new links.

Declaration Syntax

Visual Basic

Visual C++

[ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)]
public virtual ArrayList Crawl(
	string startURL,
	bool isLoginPage,
	WebsiteBasedIndexableSourceRecord indexableSourceRecord
)

[ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)]
public virtual ArrayList Crawl(
	string startURL,
	bool isLoginPage,
	WebsiteBasedIndexableSourceRecord indexableSourceRecord
)

<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)> 
Public Overridable Function Crawl ( 
	startURL As String,
	isLoginPage As Boolean,
	indexableSourceRecord As WebsiteBasedIndexableSourceRecord
) As ArrayList

<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)> 
Public Overridable Function Crawl ( 
	startURL As String,
	isLoginPage As Boolean,
	indexableSourceRecord As WebsiteBasedIndexableSourceRecord
) As ArrayList

public:
[ObsoleteAttribute(L"Use DocumentIndex.ImportWebsite instead.", true)]
virtual ArrayList^ Crawl(
	String^ startURL, 
	bool isLoginPage, 
	WebsiteBasedIndexableSourceRecord^ indexableSourceRecord
)

public:
[ObsoleteAttribute(L"Use DocumentIndex.ImportWebsite instead.", true)]
virtual ArrayList^ Crawl(
	String^ startURL, 
	bool isLoginPage, 
	WebsiteBasedIndexableSourceRecord^ indexableSourceRecord
)

[<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)>]
abstract Crawl : 
        startURL : string * 
        isLoginPage : bool * 
        indexableSourceRecord : WebsiteBasedIndexableSourceRecord -> ArrayList 
[<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)>]
override Crawl : 
        startURL : string * 
        isLoginPage : bool * 
        indexableSourceRecord : WebsiteBasedIndexableSourceRecord -> ArrayList

[<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)>]
abstract Crawl : 
        startURL : string * 
        isLoginPage : bool * 
        indexableSourceRecord : WebsiteBasedIndexableSourceRecord -> ArrayList 
[<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)>]
override Crawl : 
        startURL : string * 
        isLoginPage : bool * 
        indexableSourceRecord : WebsiteBasedIndexableSourceRecord -> ArrayList

Parameters

startURL (String): The URL to start crawling a web-site from.

isLoginPage (Boolean): Whether this start URL is the login form for the site

indexableSourceRecord (WebsiteBasedIndexableSourceRecord): The indexable source record representing a web-site to crawl

Return Value

ArrayList
ArrayList of Uri objects with URLs that weren't already in the index

Exceptions

Exception	Condition
InvalidOperationException	If Configuration.IsLock is true (a lock has been applied).

Assembly: Keyoti4.SearchEngine.Core (Module: Keyoti4.SearchEngine.Core.dll) Version: 2015.6.15.120