Whether to store links found on a page before that page is crawled. Set false to conserve memory.
Declaration Syntax
C# | Visual Basic |
public bool CacheCrawlLinks { get; set; }
Public Property CacheCrawlLinks As Boolean Get Set
Property Value
Remarks
Having this set true will reduce number of connections made to the server by half, and under normal conditions have minimal impact on memory. In cases where thousands of links occur on a page, this may cause higher memory consumption (order of hundred megabytes).
Assembly: Keyoti4.SearchEngine.Core (Module: Keyoti4.SearchEngine.Core.dll) Version: 2022.8.22.610