Keyoti SearchUnit API Docs
Crawl Method (urlList)
API DocumentationKeyoti.SearchEngine.Index.IndexableSourcesWebSiteSpiderCrawl(ArrayList)
Keyoti SearchUnit v6
Crawls all URL strings in urlList, adds new document URLs (including those from urlList) to the 'database' and returns list of newly found URLs.
Declaration Syntax
C#Visual Basic
[ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)]
public virtual ArrayList Crawl(
	ArrayList urlList
)
<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)> 
Public Overridable Function Crawl ( 
	urlList As ArrayList
) As ArrayList
Parameters
urlList (ArrayList)
List of string objects specifying URLs to be crawled
Return Value
ArrayList
ArrayList of Uri objects with new URLs added to 'database'.
Remarks
Crawling will read each page and then each page (within the same host) linked from that page, until it finds no new pages.
Exceptions
ExceptionCondition
InvalidOperationExceptionIf Configuration.IsLock is true (a lock has been applied).

Assembly: Keyoti4.SearchEngine.Core (Module: Keyoti4.SearchEngine.Core.dll) Version: 2022.8.22.610