The "robot-restrict" setting:
The VALUE of this setting is a list of GLOB patterns that match
pages for which complex HTTP requests from unauthenticated clients
should be disallowed. "Unauthenticated" means the user is "nobody".
The recommended value for this setting is:
timelineX,diff,annotate,fileage,file,finfo,reports,tree,download,hexdump
Usually the tag should exactly match the page name. The "diff" tag covers all diffing pages such as /vdiff, /fdiff, and /vpatch. The "annotate" tag also covers /blame and /praise. "zip" also covers /tarball and /sqlar. If a tag has an "X" character appended then it only applies if query parameters are such that the page is particularly difficult to compute. Useful "X" tags include "timelineX" and "zipX". The "ext" tag matches all extension, but a tag of the form "ext/PATH" only matches the extension at PATH.
See the robot-zip-leaf and robot-zip-tag settings for additional controls associated with the "zipX" restriction.
Change this setting "off" to disable all robot restrictions.