Crawls all URL strings in urlList, adds new document URLs (including those from urlList)
to the 'database' and returns list of newly found URLs.
Declaration Syntax| C# | Visual Basic | Visual C++ |
[ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)] public virtual ArrayList Crawl( ArrayList urlList, ArrayList isLoginPage, WebsiteBasedIndexableSourceRecord indexableSourceRecord )
<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", True)> _ Public Overridable Function Crawl ( _ urlList As ArrayList, _ isLoginPage As ArrayList, _ indexableSourceRecord As WebsiteBasedIndexableSourceRecord _ ) As ArrayList
[ObsoleteAttribute(L"Use DocumentIndex.ImportWebsite instead.", true)] public: virtual ArrayList^ Crawl( ArrayList^ urlList, ArrayList^ isLoginPage, WebsiteBasedIndexableSourceRecord^ indexableSourceRecord )
Parameters- urlList (ArrayList)
- List of string objects specifying URLs to be crawled
- isLoginPage (ArrayList)
- List of booleans indicating whether URL at corresponding index in urlList is a 'login page' for Forms Authentication - see user guide section on Forms Authentication for more.
- indexableSourceRecord (WebsiteBasedIndexableSourceRecord)
- The IndexableSourceRecord that this document is assigned to, may be null.
Return ValueArrayList of Uri objects with URLs added to 'database'.
RemarksCrawling will read each page and then each page (within the same host) linked from that page, until it finds no new pages.
Note that the return list includes newly found URLs and pre-existing URLs (from prior crawls, etc).
Exceptions| Exception | Condition |
|---|---|
| InvalidOperationException | If Configuration.IsLock is true (a lock has been applied). |