Whether to consider the robots.txt specifications

C# | Visual Basic | Visual C++ |
public bool RespectsRobotsTXT { get; set; }
Public Property RespectsRobotsTXT As Boolean
public: property bool RespectsRobotsTXT { bool get (); void set (bool value); }