Crawl Method (urlList)

Keyoti SearchUnit v6

Crawls all URL strings in urlList, adds new document URLs (including those from urlList) to the 'database' and returns list of newly found URLs.

Declaration Syntax

Visual Basic

Visual C++

[ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)]
public virtual ArrayList Crawl(
	ArrayList urlList
)

[ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)]
public virtual ArrayList Crawl(
	ArrayList urlList
)

<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)> 
Public Overridable Function Crawl ( 
	urlList As ArrayList
) As ArrayList

<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)> 
Public Overridable Function Crawl ( 
	urlList As ArrayList
) As ArrayList

public:
[ObsoleteAttribute(L"Use DocumentIndex.ImportWebsite instead.", true)]
virtual ArrayList^ Crawl(
	ArrayList^ urlList
)

public:
[ObsoleteAttribute(L"Use DocumentIndex.ImportWebsite instead.", true)]
virtual ArrayList^ Crawl(
	ArrayList^ urlList
)

[<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)>]
abstract Crawl : 
        urlList : ArrayList -> ArrayList 
[<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)>]
override Crawl : 
        urlList : ArrayList -> ArrayList

[<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)>]
abstract Crawl : 
        urlList : ArrayList -> ArrayList 
[<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)>]
override Crawl : 
        urlList : ArrayList -> ArrayList

Parameters

urlList (ArrayList): List of string objects specifying URLs to be crawled

Return Value

ArrayList
ArrayList of Uri objects with new URLs added to 'database'.

Remarks

Crawling will read each page and then each page (within the same host) linked from that page, until it finds no new pages.

Exceptions

Exception	Condition
InvalidOperationException	If Configuration.IsLock is true (a lock has been applied).

Assembly: Keyoti4.SearchEngine.Core (Module: Keyoti4.SearchEngine.Core.dll) Version: 2015.6.15.120